-- Logs begin at Tue 2022-07-19 10:18:36 UTC, end at Tue 2022-07-19 12:53:00 UTC. -- Jul 19 10:51:21.020884 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Jul 19 10:51:21.033310 n-d-master-1 devstack@keystone.service[80565]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 10:51:21 2022] *** Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: nodename: n-d-master-1 Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: machine: x86_64 Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: clock source: unix Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: pcre jit disabled Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: detected number of CPU cores: 4 Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: current working directory: / Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: detected binary path: /usr/bin/uwsgi-core Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: your processes number limit is 47680 Jul 19 10:51:21.035348 n-d-master-1 devstack@keystone.service[80565]: your memory page size is 4096 bytes Jul 19 10:51:21.035980 n-d-master-1 devstack@keystone.service[80565]: detected max file descriptor number: 2048 Jul 19 10:51:21.035980 n-d-master-1 devstack@keystone.service[80565]: lock engine: pthread robust mutexes Jul 19 10:51:21.035980 n-d-master-1 devstack@keystone.service[80565]: thunder lock: enabled Jul 19 10:51:21.035980 n-d-master-1 devstack@keystone.service[80565]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 19 10:51:21.035980 n-d-master-1 devstack@keystone.service[80565]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 10:51:21.079524 n-d-master-1 devstack@keystone.service[80565]: Python main interpreter initialized at 0x559f0afcc9c0 Jul 19 10:51:21.079524 n-d-master-1 devstack@keystone.service[80565]: python threads support enabled Jul 19 10:51:21.079524 n-d-master-1 devstack@keystone.service[80565]: your server socket listen backlog is limited to 100 connections Jul 19 10:51:21.079524 n-d-master-1 devstack@keystone.service[80565]: your mercy for graceful operations on workers is 90 seconds Jul 19 10:51:21.080016 n-d-master-1 devstack@keystone.service[80565]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 10:51:21.080016 n-d-master-1 devstack@keystone.service[80565]: *** Operational MODE: preforking *** Jul 19 10:51:21.080281 n-d-master-1 devstack@keystone.service[80565]: *** uWSGI is running in multiple interpreter mode *** Jul 19 10:51:21.080281 n-d-master-1 devstack@keystone.service[80565]: spawned uWSGI master process (pid: 80565) Jul 19 10:51:21.080573 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Jul 19 10:51:21.081147 n-d-master-1 devstack@keystone.service[80565]: spawned uWSGI worker 1 (pid: 80580, cores: 1) Jul 19 10:51:21.081446 n-d-master-1 devstack@keystone.service[80565]: spawned uWSGI worker 2 (pid: 80581, cores: 1) Jul 19 10:51:21.081647 n-d-master-1 devstack@keystone.service[80565]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 10:51:26.612141 n-d-master-1 devstack@keystone.service[80580]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:51:26.612141 n-d-master-1 devstack@keystone.service[80580]: from cryptography.utils import int_from_bytes Jul 19 10:51:26.613456 n-d-master-1 devstack@keystone.service[80580]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:51:26.613456 n-d-master-1 devstack@keystone.service[80580]: from cryptography.utils import int_from_bytes Jul 19 10:51:26.662156 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 10:51:26.662428 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 10:51:26.662573 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] command line args: [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 10:51:26.662840 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 10:51:26.663036 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ================================================================================ {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 10:51:26.663304 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] admin_token = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.663652 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] config_dir = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.665263 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.666121 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] config_source = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.666338 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] debug = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.666574 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.667393 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.667615 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.667916 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.668185 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.668598 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.669800 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_config_append = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.670023 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.670223 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_dir = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.670426 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_file = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.670710 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.670992 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.671275 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.671532 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.671717 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.671899 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.672151 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.672425 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.672670 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.673066 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.673309 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.673551 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.673804 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.674054 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.674337 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.674844 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.675028 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] publish_errors = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.675263 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.675495 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.675674 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.675922 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.676160 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.676418 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] standard_threads = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.676653 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.676897 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.677072 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.677250 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] use_journal = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.677425 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] use_json = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.677599 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] use_stderr = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.677779 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] use_syslog = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.678011 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.678273 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.678511 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.678772 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.679011 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.679325 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.679566 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.679817 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.680049 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.680298 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.680581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.680837 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.681072 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.681320 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.681559 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.681804 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.682050 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.682286 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.682539 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.682794 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.683040 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.683276 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.683528 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.683790 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.684043 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.684290 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.684546 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.684778 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.685008 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.685242 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.685491 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.686222 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.686222 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.686222 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.686577 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.686727 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.686938 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.687185 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.687416 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.687651 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.687872 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.688110 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.688339 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.688592 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.688824 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.689061 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.689307 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.689537 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.689776 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.690012 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.690247 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.690483 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.690730 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.690961 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.691199 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.691435 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.691670 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.691905 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.692141 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.692385 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.692642 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.692877 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.693113 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.693343 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.693603 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.693837 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.694069 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.694306 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.694542 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.694876 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.695118 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.695368 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.695615 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.695850 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.696084 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.696320 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.696628 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.696854 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.697088 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.697331 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.697573 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.697820 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.698072 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.698281 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.698517 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.698780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.699022 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.699268 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.699499 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.699742 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.699979 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.700214 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.700473 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.700710 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.700951 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.701167 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.701407 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.701630 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.701876 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.702112 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.702359 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.702596 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.702850 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.703108 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.703354 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.703589 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.external = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.703813 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.704111 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.704390 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.704601 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.password = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.704827 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] auth.token = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.705064 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.705301 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.705549 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.705778 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.706026 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.706277 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.706508 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.706744 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.706989 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.707237 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.707480 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.707718 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.707961 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.708196 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.708484 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.708740 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.708983 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.709235 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.709535 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.709790 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.710038 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.710320 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.710643 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.710861 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.711086 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.711338 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.711585 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.711821 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.712074 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.712320 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.712608 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.712837 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.713096 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.713337 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.713589 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.713825 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.714069 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.714306 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.714539 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.714779 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.715168 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.715410 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.715644 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.715898 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.716153 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.716407 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.716648 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.716892 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.717119 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.717359 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.717625 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.717868 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.718115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.718387 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.718634 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.718862 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.719098 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.719336 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.719568 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.719808 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.720051 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.720293 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.720567 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.720791 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.721044 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.721292 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.721530 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.721772 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.722008 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.722243 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.722483 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.722718 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.722955 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.723195 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.723442 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.723675 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.723914 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.724164 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.724457 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.724669 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.724904 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.725136 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.725385 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.725620 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.725854 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.726132 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.726363 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.726603 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.726860 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.727090 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.727336 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.727584 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.727835 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.728062 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.728285 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.728549 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.728771 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.729008 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.729226 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.729448 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.729693 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.729915 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.732256 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.735701 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.738324 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] role.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] role.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.740332 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.742780 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.744729 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.746581 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.748523 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.750402 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.connection = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.752224 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.754115 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.755971 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.755971 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.755971 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.755971 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.755971 n-d-master-1 devstack@keystone.service[80580]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80580) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 10:51:26.785800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.786052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.786227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.795070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.824045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.824297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.825432 n-d-master-1 devstack@keystone.service[80581]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:51:26.825432 n-d-master-1 devstack@keystone.service[80581]: from cryptography.utils import int_from_bytes Jul 19 10:51:26.826332 n-d-master-1 devstack@keystone.service[80581]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 10:51:26.826332 n-d-master-1 devstack@keystone.service[80581]: from cryptography.utils import int_from_bytes Jul 19 10:51:26.872806 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 10:51:26.873043 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 10:51:26.873252 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] command line args: [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 10:51:26.873528 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 10:51:26.873770 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ================================================================================ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 10:51:26.874090 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] admin_token = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.874398 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] config_dir = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.874686 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.874935 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] config_source = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.875178 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] debug = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.875460 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.875772 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.876016 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.876373 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.876698 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.876989 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.877243 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_config_append = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.877504 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.877771 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_dir = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.878028 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.878344 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.878667 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.878978 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.879294 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.879540 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.879786 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.880098 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.880459 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.880772 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.881072 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.881371 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.881679 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.881994 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.882352 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.882703 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.883609 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.883856 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] publish_errors = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.884159 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.884498 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.884744 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.885056 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.885350 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.885651 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] standard_threads = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.885945 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.886257 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.886494 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.886737 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_journal = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.886976 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_json = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.887216 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_stderr = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.887454 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] use_syslog = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.887757 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 10:51:26.888082 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.888434 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.888780 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.889088 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.889409 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.889719 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.890036 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.890360 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.890719 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.891079 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.891450 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.891795 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.892151 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.892539 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.892899 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.893256 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.893610 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.893975 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.894337 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.894697 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.895048 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.895417 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.895799 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.896170 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.896566 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.896915 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.897265 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.897621 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.898092 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.898463 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.898835 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.899181 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.899530 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.899900 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.900273 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.900666 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.901028 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.901405 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.901759 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.902121 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.902463 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.902809 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.903156 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.903499 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.903853 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.904231 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.904623 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.905007 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.905355 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.905709 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.906062 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.906439 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.906784 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.907142 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.907491 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.907842 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.908192 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.908587 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.908936 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.909307 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.909659 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.909989 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.910307 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.910670 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.911000 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.911316 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.911641 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.911968 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.912325 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.912707 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.913047 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.913384 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.913742 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.914121 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.914469 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.914810 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.915135 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.915461 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.915797 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.916121 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.916556 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.916871 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.917198 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.917525 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.917886 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.918220 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.918547 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.918877 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.919205 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.919526 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.919849 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.920170 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.920518 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.920846 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.921218 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.921662 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.921961 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.922293 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.922617 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.922965 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.923290 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.923632 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.923983 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.924310 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.924677 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.external = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.925002 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.925390 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.925711 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.926094 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.password = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.926401 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] auth.token = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.926726 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.927066 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.927402 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.927719 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.928051 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.928423 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.928741 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.929073 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.929493 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.929831 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.930167 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.930492 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.930823 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.931152 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.931521 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.931861 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.932186 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.932557 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.932943 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.933281 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.933667 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.933998 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.934345 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.934666 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.934993 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.935329 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.935676 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.935992 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.936330 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.936688 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.937085 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.937410 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.937751 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.938072 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.938403 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.938727 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.939071 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.939404 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.939728 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.940051 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.940550 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.940871 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.941208 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.941555 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.941890 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.942210 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.942527 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.942844 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.943185 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.943542 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.943878 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.944221 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.944642 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.945030 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.945367 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.945693 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.946014 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.946386 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.946891 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.947222 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.948713 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.950723 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.951013 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.951275 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.953357 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.953833 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.954255 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.954721 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.955186 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.955592 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.955941 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.956405 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.956846 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.957287 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.957744 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.958188 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.958635 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.959111 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.959567 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.959998 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.960536 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.960999 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.961407 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.961672 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.962030 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.962478 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.962900 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.963346 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.963802 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.964232 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.964723 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.965177 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.965635 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.966076 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.966490 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.967021 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.967522 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.967948 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.968372 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.968799 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.969225 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.969657 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.970084 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.970509 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.970905 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.971315 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.971719 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.972126 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.972577 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.973003 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.973416 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.973840 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.974250 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.974689 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.975085 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.975495 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.975681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:26.975894 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.976298 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.976737 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.977181 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.977602 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.977996 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.978418 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.978833 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.979268 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.979663 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.980043 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.980494 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.980929 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.981331 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.981766 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.982180 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.982586 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.983002 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.983426 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.983814 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.984233 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.984696 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.985111 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.985545 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.985970 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.986394 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.986799 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.987228 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.987613 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.988037 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.988500 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.988922 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.989331 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.990020 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.990396 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.990793 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.991202 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.991662 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.992109 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.992540 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.992977 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.993398 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.993804 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.994199 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.994592 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.994976 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.995400 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.995869 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.996288 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.996717 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.997089 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.997479 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.997876 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.998283 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.998715 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.999129 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.999566 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:26.999991 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.000394 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.000854 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.001264 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.001670 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.002044 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.002420 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.002813 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.003221 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.003650 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.004044 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.004507 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.005003 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.005433 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.005829 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.006222 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.006596 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.007003 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.007424 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.007828 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.008580 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.008987 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.009399 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.009793 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.010187 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.010591 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.011018 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.011388 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.011779 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.012162 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.012614 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.013023 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 10:51:27.013314 n-d-master-1 devstack@keystone.service[80581]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80581) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 10:51:27.059847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.060188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.060570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.065810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.066159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.076325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.110136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.110477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.177348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.185478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.185802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.186167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.186505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.186854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.187201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.230543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.230828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.231180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.231500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.231819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.232130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.232476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.251587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.270350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.273530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.273930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.274220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.274501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.274779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.275059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80580) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.293956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.294198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:51:27.294626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.294887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:51:27.295218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.295538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.295861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.296178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.308046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.308457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.308792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.309137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.317753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.321152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.321429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.321707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.322117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.322395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.322654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.322920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.323188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.323457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.323727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.323991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.333776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.334031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.350907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.352752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.353098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.358660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.359022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.359365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.366955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.367321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.372199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.372584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.372926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.373269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.373604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.373941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.374271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.374594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.377204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.377440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.377658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.377873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.378085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.378299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.391944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.392190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.392410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.392632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.392847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.393064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.393277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.394816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.395188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.400002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.401615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.403975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.404375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.404941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.405167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.405389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.405607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.405819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.406031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.406241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80581) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 19 10:51:27.409996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.413863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.418181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.418558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.418917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.419057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.419200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:51:27.419376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.419522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.419656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 19 10:51:27.419798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.419939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.420155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.420299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.420434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.420707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.432078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.432400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.432649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.432951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.440025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.440458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.440739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.441002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.441279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.444774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.445105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.445398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.445691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.445973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.446246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.446518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.446911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.447260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.447466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.447749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.449115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.450844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.451114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.454292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.454571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.454845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.455120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.455478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.469100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.469401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.469683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.469968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.470247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.470528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.470798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.474684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.476521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.476963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.482573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.482859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.483140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.490350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.490737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.491038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.493846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.495836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.496142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.496453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.496873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.497151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.497427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.497560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.497815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.497999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.499350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.501087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.501427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.501780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.512270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.514137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.516990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.517283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.517705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.518082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.518444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.518805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.522035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.525830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.526131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.529773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.530155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.530513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.531919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.535779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.540205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80580) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.540368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.540607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.540761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.540865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.541972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.542396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.542500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.542775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.543047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.543304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.543789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.544040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80580) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.563486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.563910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.564048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.564326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.574979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.576865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.577146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.580787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.581203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.581456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.581728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.581970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.592158 n-d-master-1 devstack@keystone.service[80580]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f0afcc9c0 pid: 80580 (default app) Jul 19 10:51:27.599073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f965dc-cfed-4248-9646-54198c358997 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:27.599611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.599765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f965dc-cfed-4248-9646-54198c358997 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:27.599920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.600321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f965dc-cfed-4248-9646-54198c358997 None None] PATH_INFO: `/v3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:27.600517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.600517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.600973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.601131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.601630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.608969 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Tue Jul 19 10:51:27 2022] GET /identity/v3/ => generated 255 bytes in 13 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:27.625452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.629723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.634242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.635990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.637753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.638044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.638335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.646252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.649040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.653516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.653912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.654280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.654652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.667332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.667718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.668099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.680702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80581) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 19 10:51:27.681160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.681535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.681876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.682299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.682623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.683003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.683366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.683813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.684247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.684745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.685105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.685447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.685792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80581) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 19 10:51:27.754665 n-d-master-1 devstack@keystone.service[80581]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x559f0afcc9c0 pid: 80581 (default app) Jul 19 10:51:35.479508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:35.480091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:35.480091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:35.481454 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:35.491498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:35.492039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:35.492039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:35.561806 n-d-master-1 devstack@keystone.service[80581]: INFO dbcounter [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] Registered counter for database keystone Jul 19 10:51:35.583708 n-d-master-1 devstack@keystone.service[80581]: DEBUG oslo_db.sqlalchemy.engines [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80581) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 10:51:35.591317 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writer thread running {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 10:51:35.772869 n-d-master-1 devstack@keystone.service[80581]: DEBUG passlib.handlers.bcrypt [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80581) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 10:51:35.773331 n-d-master-1 devstack@keystone.service[80581]: DEBUG passlib.handlers.bcrypt [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80581) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 10:51:35.830445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:35.832188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:36.002628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1/3] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 514 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 10:51:36.137317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:36.206782 n-d-master-1 devstack@keystone.service[80580]: INFO dbcounter [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] Registered counter for database keystone Jul 19 10:51:36.227147 n-d-master-1 devstack@keystone.service[80580]: DEBUG oslo_db.sqlalchemy.engines [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80580) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 10:51:36.237921 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writer thread running {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 10:51:36.466238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19394d9-1ab7-40aa-93b0-c9e34948536c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:36.474217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:36.475339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.475798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.476282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.492829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:36.599392 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 10:51:36.599977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357532b-3c3c-47ba-a33e-45169f01d46c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:36.618963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Jul 19 10:51:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 10:51:36.625566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:36.641608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743291-c46d-4ada-836f-c9b6ca2da415 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:36.647626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:36.648902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:36.649196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:36.649475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] PATH_INFO: `/v3/projects/4d370718d88b47738f450251a884cc98` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:36.651290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d370718d88b47738f450251a884cc98)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:36.704076 n-d-master-1 devstack@keystone.service[80581]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 19 10:51:36.704529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b29cda-16d0-418b-b4d5-c465ac3139f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:36.709493 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2/5] 10.222.0.15 () {56 vars in 1207 bytes} [Tue Jul 19 10:51:36 2022] GET /identity/v3/projects/4d370718d88b47738f450251a884cc98 => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:38.887691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d65039-7ade-41d8-a8fb-c990c92aace2 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.888276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d65039-7ade-41d8-a8fb-c990c92aace2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.888276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d65039-7ade-41d8-a8fb-c990c92aace2 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.892454 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4/6] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:38.898813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.899376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.899376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.922295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:38.923963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:38.933034 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:38 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 19 10:51:38.955699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d65039-7ade-41d8-a8fb-c990c92aace2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:38.969873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d65039-7ade-41d8-a8fb-c990c92aace2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:38.974565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dc7fd-c2b7-4180-ae5e-e103a098d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:38.975228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc7fd-c2b7-4180-ae5e-e103a098d2a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:38.975505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc7fd-c2b7-4180-ae5e-e103a098d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:38.975774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dc7fd-c2b7-4180-ae5e-e103a098d2a6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:38.984698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dc7fd-c2b7-4180-ae5e-e103a098d2a6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:38.986587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dc7fd-c2b7-4180-ae5e-e103a098d2a6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:38.996410 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1324 bytes} [Tue Jul 19 10:51:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 10:51:39.002853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:39.019778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98eaa5-3925-455c-b37b-472d7a636702 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:39.026569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fad7485-2f23-41ae-8fef-107a844b68f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:39.028023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7485-2f23-41ae-8fef-107a844b68f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:39.028542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7485-2f23-41ae-8fef-107a844b68f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:39.029014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fad7485-2f23-41ae-8fef-107a844b68f2 admin admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:39.031264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad7485-2f23-41ae-8fef-107a844b68f2 admin admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:39.034401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fad7485-2f23-41ae-8fef-107a844b68f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:39.037391 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4/9] 10.222.0.15 () {56 vars in 1198 bytes} [Tue Jul 19 10:51:39 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:41.229027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beeb2df-2638-499b-b06d-9f7cd22ee5fa None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.229582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beeb2df-2638-499b-b06d-9f7cd22ee5fa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.229935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beeb2df-2638-499b-b06d-9f7cd22ee5fa None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.232313 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:41.240274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.241062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.241370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.248924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0973-6602-40f4-b366-006ebd17966a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.249335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0973-6602-40f4-b366-006ebd17966a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.249695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febc0973-6602-40f4-b366-006ebd17966a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.251177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 7/11] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:41.257691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.258101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.258466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.260589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:41.261834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:41.304222 n-d-master-1 devstack@keystone.service[80580]: DEBUG passlib.handlers.bcrypt [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80580) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 19 10:51:41.304777 n-d-master-1 devstack@keystone.service[80580]: DEBUG passlib.handlers.bcrypt [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80580) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 19 10:51:41.350520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:41.352124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:41.363163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 5/12] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:41.403754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.433297 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.463813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 8/13] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:41.502711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.554635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c0b05d-5c75-43ea-bd64-95650336a14e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.594738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.595549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.595829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.596103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.610278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:41.623397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:41.625147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:51:41.626213 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 6/14] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:41.632723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.634301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e76507c-a6c0-4e88-815e-dbf2c8528457 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.637300 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.681803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.683427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.683789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.684132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.733474 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.757052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a185bf99-7635-47b0-9754-48c78effa13b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:41.771286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.773022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.799108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:41.799927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:41.800303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:41.800712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:41.801625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:41.802068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:41.803631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:41.819358 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 7/15] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:41.827740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.893529 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:51:41.899655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:41.903991 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:41.962300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340120f-292e-4659-88ee-8165a57d8184 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.010819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.011701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.011978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.012244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.013516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.015064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.016917 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 8/17] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:42.022768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.039865 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:42.049052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447f74-5eb9-41ba-8423-46c8580f5353 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.095119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.095922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.096195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.096498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.119045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.120608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:42.144402 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:42.145836 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:42.147583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:42.147583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:42.147583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:42.147583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:51:42.147583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 10/18] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:51:42.154907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.161605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85982d-4190-4e2e-ade2-4282036e2cef None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.218118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.218965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.219235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.219505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.220878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.222396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.223499 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:42.224164 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 9/19] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:42.231346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:42.285699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e37a2-d656-4298-993e-364783fa00c1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.334282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.334954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.335237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.335509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.336256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:42.336597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.338050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aeec-27d2-4de9-b119-e963b2328fd1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.350791 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:42.358373 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 11/20] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:42.388846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b9896-7f57-4fba-8ee4-52b887857c47 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:42.455111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:42.456169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:42.456707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:42.457207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:42.458834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.domain.id=default, user.id=44cb4b6cf7e6461fb9360e3f317f41d2) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:42.459395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:42.462323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6724089a-7794-4bb6-abb2-44df0c953fde None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:42.475742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 10/21] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Jul 19 10:51:42 2022] GET /identity/v3/role_assignments?user.id=44cb4b6cf7e6461fb9360e3f317f41d2&scope.domain.id=default&role.id=c71870b3a21e455080504ab36dac896f => generated 233 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:45.482383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b025-8005-476f-ba62-6ecf58e09b1b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.482910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b025-8005-476f-ba62-6ecf58e09b1b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.482910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee1b025-8005-476f-ba62-6ecf58e09b1b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.484313 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 12/22] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:45.490482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be420356-a19c-454a-9086-5a456e47a24b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.491410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be420356-a19c-454a-9086-5a456e47a24b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.491879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be420356-a19c-454a-9086-5a456e47a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.514948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be420356-a19c-454a-9086-5a456e47a24b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:45.516556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be420356-a19c-454a-9086-5a456e47a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:45.605882 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 11/23] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:45.645284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b025-8005-476f-ba62-6ecf58e09b1b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:45.877599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee1b025-8005-476f-ba62-6ecf58e09b1b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:45.914255 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:45.950617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d50d52-25d7-4208-9733-e82e0f84f5e8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.951466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d50d52-25d7-4208-9733-e82e0f84f5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.952065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d50d52-25d7-4208-9733-e82e0f84f5e8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.953963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 12/24] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:45.960537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.961260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.961727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.962227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af6f86-bd20-41f2-a6b7-b2ccec7669f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:45.963363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6f86-bd20-41f2-a6b7-b2ccec7669f6 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:45.963861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6f86-bd20-41f2-a6b7-b2ccec7669f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:45.964211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af6f86-bd20-41f2-a6b7-b2ccec7669f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:45.968384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6f86-bd20-41f2-a6b7-b2ccec7669f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:45.968555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af6f86-bd20-41f2-a6b7-b2ccec7669f6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.005603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:46.007171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:46.153847 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 13/25] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:46.185489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.200756 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.240072 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 13/26] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jul 19 10:51:45 2022] POST /identity/v3/roles => generated 219 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:46.243037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1039b1-ad87-4585-a336-f3aa0f3f9111 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.243545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1039b1-ad87-4585-a336-f3aa0f3f9111 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.244066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1039b1-ad87-4585-a336-f3aa0f3f9111 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.246941 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 14/27] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:46.255256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5dd92-b5fd-413f-a3d0-a56f1b81a595 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.255764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5dd92-b5fd-413f-a3d0-a56f1b81a595 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.256254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5dd92-b5fd-413f-a3d0-a56f1b81a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.319604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee073d-79d1-478f-827c-8bbd77707b35 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.330258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-42c5dd92-b5fd-413f-a3d0-a56f1b81a595 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:46.332984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-42c5dd92-b5fd-413f-a3d0-a56f1b81a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:46.400080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.401014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.401299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.401578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.441244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:46.449203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:46.450091 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:51:46.451291 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:46.456761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.553408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 15/29] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:46.554804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb531ed-64de-4c5d-a688-c4154767065a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.555139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb531ed-64de-4c5d-a688-c4154767065a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.555418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb531ed-64de-4c5d-a688-c4154767065a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.556920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:46.563423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.563729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.563987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.593505 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.594055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:46.595460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:46.648722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511ed9d-0eb2-445e-bf02-eb056fa84a8d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.687724 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 17/31] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:46.689122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.694413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.695345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.695895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.696307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.697373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:46.697880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:46.699665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.710150 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 15/32] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:46.716264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.740178 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.858481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2292fef-4d10-4b8f-b84a-47fa82e9d600 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.877947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063906-43cc-4291-8a58-42fb8711da4a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:46.906861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.908020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.908308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.908628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.923313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:46.925320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.927230 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:46.942949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:46.944762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:46.945335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:46.945944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:46.948236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:51:46.949487 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:46.950290 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:46.951086 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:51:46.951086 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:51:46.951086 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:51:46.951086 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:51:46.951086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 18/33] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:46.951330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:46.951760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:46.955062 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 16/34] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:46.957460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.115437 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.137495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d692b12-5048-4710-bd32-306f0fda360f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.141572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff637fa5-674a-4d6b-944c-a0b9ca7dbe45 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.195109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.195670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.195782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.196035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.196314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.196862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.197108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.197368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.197869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.198530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.199249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:47.199803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.202662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd4af0-34ce-45ef-ac1d-09a1bcb0b217 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.214085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 19/35] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jul 19 10:51:46 2022] POST /identity/v3/roles => generated 225 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:47.228566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.237699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 17/36] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:47.240391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea128-bdda-423d-bd91-363ba386a763 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.240899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea128-bdda-423d-bd91-363ba386a763 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.241396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eea128-bdda-423d-bd91-363ba386a763 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.245043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 18/37] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:47.246517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eea128-bdda-423d-bd91-363ba386a763 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.366709 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.374797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4461f2f-8bcc-4b3b-8ca6-28dd9d1eb276 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.442219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eea128-bdda-423d-bd91-363ba386a763 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.454250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b30975-551d-4a1a-941f-cb378623196d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.455413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b30975-551d-4a1a-941f-cb378623196d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.455789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b30975-551d-4a1a-941f-cb378623196d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.456174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b30975-551d-4a1a-941f-cb378623196d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.459352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b30975-551d-4a1a-941f-cb378623196d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.461726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b30975-551d-4a1a-941f-cb378623196d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.463775 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:47.464998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5222cd-90a2-45b4-a741-2a26a853b985 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.465340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5222cd-90a2-45b4-a741-2a26a853b985 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.465622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5222cd-90a2-45b4-a741-2a26a853b985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.487809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4f5222cd-90a2-45b4-a741-2a26a853b985 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:47.489092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f5222cd-90a2-45b4-a741-2a26a853b985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:47.490077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e82ca-854b-4398-bc33-5a6c8a89cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.490753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e82ca-854b-4398-bc33-5a6c8a89cc31 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.491033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e82ca-854b-4398-bc33-5a6c8a89cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.491329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e82ca-854b-4398-bc33-5a6c8a89cc31 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.492023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e82ca-854b-4398-bc33-5a6c8a89cc31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.493640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e82ca-854b-4398-bc33-5a6c8a89cc31 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.501805 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.569141 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:47.570546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2937-3850-4b6d-9723-35eaf09d1320 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.570903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2937-3850-4b6d-9723-35eaf09d1320 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.571185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa2937-3850-4b6d-9723-35eaf09d1320 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.572563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 22/40] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:47.573267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2937-3850-4b6d-9723-35eaf09d1320 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.702515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa2937-3850-4b6d-9723-35eaf09d1320 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:47.748463 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 19/41] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:51:47 2022] POST /identity/v3/projects => generated 301 bytes in 503 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:47.750066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.750363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.752006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.756416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:47.757946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:47.758455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:47.758897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] PATH_INFO: `/v3/domains/default/users/44cb4b6cf7e6461fb9360e3f317f41d2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:47.764698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=44cb4b6cf7e6461fb9360e3f317f41d2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:47.767514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:47.781742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:47.783640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:47.794023 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 23/42] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Jul 19 10:51:47 2022] PUT /identity/v3/domains/default/users/44cb4b6cf7e6461fb9360e3f317f41d2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:51:47.795269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.819042 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.907041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 20/43] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:47.936133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:47.989751 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:47.996141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b691868-fe0c-4320-aae0-fe8c707790ff None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.066710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.068500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.069047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.069457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.071336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.073447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.075663 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 24/44] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:48.082149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:48.109909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df78484-a04a-4370-9439-0fd7670a784a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.171369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d4075c-482d-447a-9bcd-2378e632e1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.172617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4075c-482d-447a-9bcd-2378e632e1de None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.173195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4075c-482d-447a-9bcd-2378e632e1de None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.173530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d4075c-482d-447a-9bcd-2378e632e1de None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.174779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4075c-482d-447a-9bcd-2378e632e1de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.177684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d4075c-482d-447a-9bcd-2378e632e1de None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.206948 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 21/45] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jul 19 10:51:47 2022] POST /identity/v3/roles => generated 223 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:51:48.207202 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:48.240502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be62153-3230-4ec9-8561-c84bfc69fb42 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:48.280012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5e2cd3-c1b1-4101-89b2-202b242a7a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:48.280744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2cd3-c1b1-4101-89b2-202b242a7a61 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:48.281031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2cd3-c1b1-4101-89b2-202b242a7a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:48.281312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5e2cd3-c1b1-4101-89b2-202b242a7a61 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:48.282065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e2cd3-c1b1-4101-89b2-202b242a7a61 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:48.283591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5e2cd3-c1b1-4101-89b2-202b242a7a61 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:48.317838 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 25/46] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:51:48 2022] POST /identity/v3/projects => generated 312 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:51:49.958880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1414f-32c4-464e-9378-919376a2062f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.959449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1414f-32c4-464e-9378-919376a2062f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.959796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc1414f-32c4-464e-9378-919376a2062f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:49.962359 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 22/47] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:49.971784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be305e5-af85-4d6a-a527-267555905aab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:49.972314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be305e5-af85-4d6a-a527-267555905aab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:49.972864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be305e5-af85-4d6a-a527-267555905aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.003298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4be305e5-af85-4d6a-a527-267555905aab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:50.005499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4be305e5-af85-4d6a-a527-267555905aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:50.104069 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 26/48] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:50.129867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1414f-32c4-464e-9378-919376a2062f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.247196 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.256058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc1414f-32c4-464e-9378-919376a2062f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.295262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b028cf3e-eb05-497a-abdc-f2ddb320cf8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.296061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028cf3e-eb05-497a-abdc-f2ddb320cf8a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.296366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028cf3e-eb05-497a-abdc-f2ddb320cf8a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.297871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b028cf3e-eb05-497a-abdc-f2ddb320cf8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.312285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b028cf3e-eb05-497a-abdc-f2ddb320cf8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b028cf3e-eb05-497a-abdc-f2ddb320cf8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:50.320846 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:50.321896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:51:50.323264 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 23/49] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:50.328883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be305e5-af85-4d6a-a527-267555905aab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.397102 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.412045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74dd6d-2b26-4861-8a60-20e6505374ef None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.412549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74dd6d-2b26-4861-8a60-20e6505374ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.412840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b74dd6d-2b26-4861-8a60-20e6505374ef None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.415466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 24/50] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:50.421320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.421674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.422009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.448756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:50.450363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:50.451296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be305e5-af85-4d6a-a527-267555905aab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.489929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.490620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.490903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.491175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.491957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:50.492267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.493786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.506585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 27/51] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:50.512706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.533079 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 25/52] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:51:50.556248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.621823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f67012-063a-4ee7-8dfe-0fcf91e894f8 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.641223 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.659958 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:50.663811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.665123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.665737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.666261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.668584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.671380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.674352 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 28/53] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:50.677923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617175cc-aa1a-4f3f-bcb3-ea4283e09446 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.680217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.720281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.721147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.721434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.721722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.723044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.724624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.726413 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 26/54] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:50.732785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.855076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43dce5a4-5d9a-4407-a7f7-4eb1fa6db85a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.890170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.890848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.891132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.891409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.892141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.893674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.897372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41480abf-330d-4c15-b581-397a62da0d16 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:50.922778 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 27/55] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Jul 19 10:51:50 2022] POST /identity/v3/projects => generated 298 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:51:50.945984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b56bb3-8c96-4aae-a222-bf10d4a6c7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:50.947415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56bb3-8c96-4aae-a222-bf10d4a6c7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:50.947883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56bb3-8c96-4aae-a222-bf10d4a6c7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:50.948417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56bb3-8c96-4aae-a222-bf10d4a6c7c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:50.950373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b56bb3-8c96-4aae-a222-bf10d4a6c7c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:50.952184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b56bb3-8c96-4aae-a222-bf10d4a6c7c4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:50.954191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 29/56] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:51:50.960505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:50.971187 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:51.087574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa53f5-821c-4a9b-97dd-d7ce1daa38b1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:51.124809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:51.125408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:51.125683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:51.125959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:51.126828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.domain.id=default, user.id=44cb4b6cf7e6461fb9360e3f317f41d2) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:51.127110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:51.128613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4ea0-b3aa-4be3-80a4-2570ccd8b9b5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:51.135665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1322 bytes} [Tue Jul 19 10:51:50 2022] GET /identity/v3/role_assignments?user.id=44cb4b6cf7e6461fb9360e3f317f41d2&scope.domain.id=default&role.id=c71870b3a21e455080504ab36dac896f => generated 530 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:53.010253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f484e-3be7-44ee-b84f-33909cd05e71 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:53.010811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f484e-3be7-44ee-b84f-33909cd05e71 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:53.010811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f484e-3be7-44ee-b84f-33909cd05e71 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:53.012204 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:53.018154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:53.018651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:53.018762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:53.036762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:53.037982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:53.107868 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:53.118489 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:53.143574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f484e-3be7-44ee-b84f-33909cd05e71 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:53.206776 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:53.259524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f484e-3be7-44ee-b84f-33909cd05e71 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:53.295929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9977ce2-3d7a-483e-9ce3-0ec9f0b259ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:53.296663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977ce2-3d7a-483e-9ce3-0ec9f0b259ca None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:53.296946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977ce2-3d7a-483e-9ce3-0ec9f0b259ca None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:53.297219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9977ce2-3d7a-483e-9ce3-0ec9f0b259ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:53.298435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977ce2-3d7a-483e-9ce3-0ec9f0b259ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:53.299878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9977ce2-3d7a-483e-9ce3-0ec9f0b259ca None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:53.301524 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:53.307566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:53.413598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6158bc-77bc-47e1-97a7-c82c5338a72b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:53.453291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f23fa86-31f5-4626-b2ca-0a5c58c4e78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:53.453971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23fa86-31f5-4626-b2ca-0a5c58c4e78e None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:53.454257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23fa86-31f5-4626-b2ca-0a5c58c4e78e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:53.454539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f23fa86-31f5-4626-b2ca-0a5c58c4e78e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:53.455268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23fa86-31f5-4626-b2ca-0a5c58c4e78e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:53.456785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f23fa86-31f5-4626-b2ca-0a5c58c4e78e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:53.484199 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:53 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:51:58.080418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f336-0fc4-4c3a-922c-bdd63b227fd9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.082045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f336-0fc4-4c3a-922c-bdd63b227fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.082815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406f336-0fc4-4c3a-922c-bdd63b227fd9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.086070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.092459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7989-5045-4ad0-900d-be28756f4739 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.093939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7989-5045-4ad0-900d-be28756f4739 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.094720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c7989-5045-4ad0-900d-be28756f4739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.128711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c06e1-8f01-4a91-b245-34f7c5ca73a5 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.129669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c06e1-8f01-4a91-b245-34f7c5ca73a5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.130396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c06e1-8f01-4a91-b245-34f7c5ca73a5 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.133318 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 33/63] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:51:58.141496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-390c7989-5045-4ad0-900d-be28756f4739 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.142255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d08eb-fb14-4e39-ba61-55b02587f75a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.143027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d08eb-fb14-4e39-ba61-55b02587f75a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.143752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d08eb-fb14-4e39-ba61-55b02587f75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.143985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-390c7989-5045-4ad0-900d-be28756f4739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:58.187253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-564d08eb-fb14-4e39-ba61-55b02587f75a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.189316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-564d08eb-fb14-4e39-ba61-55b02587f75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:58.300300 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.328008 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 31/64] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:58.329774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e9ba-3853-4c5f-996b-94b71c3abe94 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.330058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e9ba-3853-4c5f-996b-94b71c3abe94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.330338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e9ba-3853-4c5f-996b-94b71c3abe94 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.331682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 32/65] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.335778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad5c45-52af-4f34-bf7a-b06e651987eb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.335778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad5c45-52af-4f34-bf7a-b06e651987eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.335778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad5c45-52af-4f34-bf7a-b06e651987eb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.339900 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 33/66] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.341690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.342160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.342625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.371963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.374097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:58.375003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 34/67] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:58.377739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.378248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.378740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.406242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:58.407911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:58.472920 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.494709 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 34/68] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:58.495786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.508558 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 35/69] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:58.508558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.609440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f030760-6ceb-499d-b23b-63c37642af35 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.630581 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.651010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b2bb8-a10e-4755-9782-a3cffa260d4b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.657069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2aff4-6b90-48c2-8438-3e321d28892e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.658349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2aff4-6b90-48c2-8438-3e321d28892e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.658807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2aff4-6b90-48c2-8438-3e321d28892e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.659257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2aff4-6b90-48c2-8438-3e321d28892e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.673429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2aff4-6b90-48c2-8438-3e321d28892e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-31a2aff4-6b90-48c2-8438-3e321d28892e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:58.681383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:58.689423 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 35/70] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:58.690944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92652a-39a9-428b-aafb-7da86740a04a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.692733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92652a-39a9-428b-aafb-7da86740a04a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.692733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92652a-39a9-428b-aafb-7da86740a04a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.692733 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 36/71] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:51:58.692733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92652a-39a9-428b-aafb-7da86740a04a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.706739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.708093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.708650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.709149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.728081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:58.738478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:58.740089 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:51:58.741576 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 36/72] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:58.742876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.797637 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.816504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f92652a-39a9-428b-aafb-7da86740a04a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.863792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.864948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.865325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.865686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.867247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:58.869287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:58.871078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 37/73] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:58.871875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:58.886263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80296541-c1a2-48d3-9f79-d338aa78362c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:58.934553 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:58.935385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa06cae-89d9-4960-9a91-fca6f0073317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:58.936524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa06cae-89d9-4960-9a91-fca6f0073317 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.936961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa06cae-89d9-4960-9a91-fca6f0073317 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.937372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa06cae-89d9-4960-9a91-fca6f0073317 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:58.957020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa06cae-89d9-4960-9a91-fca6f0073317 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-6aa06cae-89d9-4960-9a91-fca6f0073317 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:58.969887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:58.971594 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:51:58.972793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 37/74] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:58.973419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:58.973674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:58.974287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.003069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9f3e1-23aa-412d-98f7-f679455697c9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.003311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:51:59.005350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:51:59.045853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.047112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.047546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.048194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.049602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:59.050092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.051539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.061609 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 38/75] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.062496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.099481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 38/76] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:51:59.100232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.136778 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.215844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f4fe71-6820-4436-a38c-ef037a356b9a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.224772 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.225150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdaf7a-8e7f-4621-b5c7-52611aa1cd27 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.255669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.256376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.256645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.256920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.257692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:59.257987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.260934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.270146 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 39/77] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.271026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.275265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.276838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.276838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.276838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.277275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.278765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.306544 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 39/78] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:51:59 2022] POST /identity/v3/users => generated 289 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:51:59.307410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.442309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d2308-e888-48a8-b900-71336bd13a0d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.451383 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.471763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6650c3f2-b16e-40d7-bd64-11958ae7e2e2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.505745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.506445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.506744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.507016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.507804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:51:59.508119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.509663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.524411 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 40/79] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.524693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.524885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.525029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.525029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.525029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.540668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.542180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.544244 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 40/80] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.545727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.565884 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.686266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b373b-ebd3-43af-81cb-71c26fb2569f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.690548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba05676-9155-4ae7-9c63-365d2dc1621b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.731293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.732235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.732636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.732939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.750486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:51:59.754712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.756566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.757243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.757929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:51:59.758734 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:51:59.760865 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 41/81] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:51:59.762794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.766745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.769806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:51:59.771771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 41/82] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:51:59.776964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:51:59.794953 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.918825 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:51:59.933719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4c765c-a03f-4a61-8fce-46100547c806 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.933906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9899189-1f6e-453b-b18c-465752cadbee None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:51:59.978140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.979549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.980051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.980567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.994660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:51:59.995481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:51:59.995841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:51:59.996118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:51:59.997964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:51:59.999828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.001916 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 42/83] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.007120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.077514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.080644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.108682 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.161457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c5452-f15e-45bd-bc00-05ceac30754b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.203677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.204795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.204919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.205187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.206049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:00.206455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.208145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.219235 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 43/84] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.220455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.240498 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 42/85] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:51:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:00.241699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.258199 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.363397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02e1853-d3ec-4016-839d-04a92a3dedc4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.388636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3db629e-6893-40c0-9265-63da0417d574 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.408825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.410698 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.410912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.411407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.412771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.434323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.435114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.435460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.436112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.517248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.518803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.540967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.542890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.578094 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.683086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 43/86] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:00.684379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.704631 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 44/87] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:00.706222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.729997 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.826111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125e8e2f-d6de-41fd-bd72-55a181c3f8ea None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.864609 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:00.880153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2e13c-e93b-405d-b243-7fa9e7b4162f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:00.902631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.903967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.904545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.905024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.909189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.917031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.918159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:00.919047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:00.919328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:00.919606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:00.920851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:00.922313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:00.924334 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 44/88] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.924822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 45/89] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:00.925855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:00.929049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.072378 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.086002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee3a57-bd4b-4ca8-94be-51be72bd1bec None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.132372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82984d7b-6433-4820-ba80-18b41417a2d5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.162145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.162145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.162145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.162145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] PATH_INFO: `/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.162870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] RBAC: Authorizing `identity:get_project(project_id=2d8f7ed22d5b4176b1d0e1be6e7e0657)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.166387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.166387 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 45/90] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657 => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.167015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.179942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.181783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.182082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.182365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.184175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.186759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.190211 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 46/91] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:00 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.193194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.271728 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.292392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb1d08-9e91-472c-8cf1-c3c8c30efa7a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.350450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdd3ea-d7f2-45fb-86cc-93d565308dbd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.350633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.351556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.352122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.352610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.405256 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.408437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.409494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.409955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.410425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.411925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=50527b1e60e34ba8b7cd042824c4e1bc) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:01.412474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.415366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.425378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 47/92] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/role_assignments?user.id=50527b1e60e34ba8b7cd042824c4e1bc&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=1b8336fe2a2642b387272398a640a960 => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.426747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.540127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.542810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.710192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7e6a48-e55e-440e-b9c9-7842a1c4d1e2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.739886 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.761734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.762533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.762894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.763267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.764128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=2d8f7ed22d5b4176b1d0e1be6e7e0657, user.id=50527b1e60e34ba8b7cd042824c4e1bc) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:01.764480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:01.769978 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 46/93] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:01.770145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3316bd-3e65-4a26-9c72-406cc5209e90 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:01.770239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.772690 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 48/94] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/role_assignments?user.id=50527b1e60e34ba8b7cd042824c4e1bc&scope.project.id=2d8f7ed22d5b4176b1d0e1be6e7e0657&role.id=1b8336fe2a2642b387272398a640a960 => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:01.776471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e41e-63fa-44e4-91f6-6f699e6db129 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.776471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e41e-63fa-44e4-91f6-6f699e6db129 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.776471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8968e41e-63fa-44e4-91f6-6f699e6db129 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.780323 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 49/95] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:01.781789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407d9f-e6d8-4528-bd77-c6bea2cc6d45 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.782168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407d9f-e6d8-4528-bd77-c6bea2cc6d45 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.782451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c407d9f-e6d8-4528-bd77-c6bea2cc6d45 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.783924 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 50/96] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:01.784766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407d9f-e6d8-4528-bd77-c6bea2cc6d45 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:01.856977 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:01.938962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c407d9f-e6d8-4528-bd77-c6bea2cc6d45 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.940367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00d8e9b-3f74-499e-9f08-06b1e2a7a7b9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:01.995999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:01.997062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:01.997349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:01.997626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:01.998497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=44cb4b6cf7e6461fb9360e3f317f41d2) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:01.998816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.000307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985d46d-ab51-4265-84bf-629b70ba0b5f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.001971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068bb028-96cf-4ae3-9ecd-1090e598ab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.003421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bb028-96cf-4ae3-9ecd-1090e598ab23 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.003784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bb028-96cf-4ae3-9ecd-1090e598ab23 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.004195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068bb028-96cf-4ae3-9ecd-1090e598ab23 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.005763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bb028-96cf-4ae3-9ecd-1090e598ab23 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.008099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068bb028-96cf-4ae3-9ecd-1090e598ab23 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.012623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 47/98] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/role_assignments?user.id=44cb4b6cf7e6461fb9360e3f317f41d2&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:02.014415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.014939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.015686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 51/98] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:01 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:02.015806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.017230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.017652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.017943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.060564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:02.065577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:02.066938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:02.070460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:02.180769 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.209674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 48/99] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:02.211419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.222362 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 52/100] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:02.244296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.295390 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.355450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780eadb-0d92-41c9-96e8-2ba0492a928c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.405139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.409604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.409909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.410190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.411068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] RBAC: Adding query filter params (role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=50527b1e60e34ba8b7cd042824c4e1bc) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:02.411385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.412928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.423668 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 49/101] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/role_assignments?user.id=50527b1e60e34ba8b7cd042824c4e1bc&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:02.426237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.478611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e86c9-01e7-4f5c-a5a7-bbea33e81dc8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.553593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.554344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.554630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.554911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.556312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.559496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:02.562503 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 53/102] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:02.569012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.708728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee136-611a-4309-8030-aa5dd6e7d08e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.723277 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.737951 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:02.816494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.817749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.818065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.818315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.864070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:02.878705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2738c1d4-bbce-4448-b451-ce57cbaa42fd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:02.882022 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:02.883503 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:02.884844 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:02.890518 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 50/103] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:02.896919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:02.973162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:02.973854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:02.974144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:02.974426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:02.975232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:02.977554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.037146 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 54/104] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:52:02 2022] POST /identity/v3/projects => generated 302 bytes in 469 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:03.156694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24899332-35cd-41b1-b03a-cb48df479aef None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.239695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.240946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.241518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.242018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.243575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:03.244144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.246911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.266751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 51/105] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.275414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.429343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dafe5b-9dc8-4f81-9702-7e44bfa0ac2a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.431522 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.469590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f8fa4-a59e-42e2-9208-b52c55c09979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.470504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8fa4-a59e-42e2-9208-b52c55c09979 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.470791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8fa4-a59e-42e2-9208-b52c55c09979 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.471078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f8fa4-a59e-42e2-9208-b52c55c09979 None admin] PATH_INFO: `/v3/users/73b23937cdb34626983387ce2c255af9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.487651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f8fa4-a59e-42e2-9208-b52c55c09979 None admin] RBAC: Authorizing `identity:get_user(user_id=73b23937cdb34626983387ce2c255af9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.489259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f8fa4-a59e-42e2-9208-b52c55c09979 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.491411 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 55/106] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/users/73b23937cdb34626983387ce2c255af9 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:03.497157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:03.533646 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:03.655394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acad6b7-2bd4-4e76-a897-24779f49547e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:03.723948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:03.725143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.725664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.726483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.867224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:03.869267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:03.896406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf69e9-bd7e-42af-b72f-90ae7df13810 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.896993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf69e9-bd7e-42af-b72f-90ae7df13810 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.897507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bf69e9-bd7e-42af-b72f-90ae7df13810 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.900136 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 56/107] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:03.906578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:03.907042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:03.907503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:03.944370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:03.944370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:03.945306 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.083954 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 52/108] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:04.091028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.107271 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 57/109] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:04.142581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.377824 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.387108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb3db9-a10c-4fe5-b27e-edae70317bb9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.408265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f42725f-0ef0-4a97-84d4-16ac3029aa02 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.483683 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:04.511586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.513175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.513676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.514184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.522759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:04.534625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:04.538174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 53/110] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:04.545598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.548700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:04.550099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:04.550619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:04.551128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:04.593814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:04.619416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:04.620335 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:04.621148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:04.631928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 58/111] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:04.642220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:04.899647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cada2c3-a524-4014-a199-18c9a19155ed None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.980990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb01652-f3a0-4ef1-b52f-0f8d44ebca1f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:04.999320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.003269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.005628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.006177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.016720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] RBAC: Adding query filter params (role.id=a0486ae89dca46fa88a6c73f065ba459, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=73b23937cdb34626983387ce2c255af9) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:05.017451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.020895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb53ca94-7650-42fc-b9b0-64b507c4ab2a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.031535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 54/112] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/role_assignments?user.id=73b23937cdb34626983387ce2c255af9&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=a0486ae89dca46fa88a6c73f065ba459 => generated 259 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:05.033263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517b131-088c-4fc0-9216-0de3617d1fb2 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.034559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517b131-088c-4fc0-9216-0de3617d1fb2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.035213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6517b131-088c-4fc0-9216-0de3617d1fb2 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.038290 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 55/113] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:05.046324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.046937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.047411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.073310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.074405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.074901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.075394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.076394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:05.081815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.083555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.101111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:05.104872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:05.105433 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 59/114] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:05.113255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.152992 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:05.276180 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:05.311337 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 56/115] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:05.348123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.438415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a46c01-bb95-4462-80c1-840d08cbf17a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.476005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc90e35-1cea-4c4a-8524-983c6abceaf2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.505961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.507113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.507566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.507993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.513306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.514626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.515024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.515877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.516366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.516802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 60/116] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:05 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:05.517156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.522985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.529728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:05.537996 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:05.538913 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:05.539666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:05.541805 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 57/117] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:05.551144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.620097 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:05.682550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2cb18-c0d4-486a-877f-a798a810ebfe None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.728936 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:05.735185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.736933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.737609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.738109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.739095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:05.739585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.741424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.751887 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 58/118] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:05.761544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.784961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af78b4-7fbc-43d5-8251-59a4651cf64a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.881335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964391ba-ac02-462a-ae18-cd0068598c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.888374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964391ba-ac02-462a-ae18-cd0068598c0a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.888374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964391ba-ac02-462a-ae18-cd0068598c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.888374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964391ba-ac02-462a-ae18-cd0068598c0a None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.888374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964391ba-ac02-462a-ae18-cd0068598c0a None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.888374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964391ba-ac02-462a-ae18-cd0068598c0a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.888374 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 61/119] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:05 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:05.893291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930d49-720e-4f8a-b97d-dd5cffb726df None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.893587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930d49-720e-4f8a-b97d-dd5cffb726df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.893874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a930d49-720e-4f8a-b97d-dd5cffb726df None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.895520 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 62/120] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:05.898438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7328f1-a068-41c4-8f95-43ec99ca5528 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:05.898583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930d49-720e-4f8a-b97d-dd5cffb726df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:05.923749 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:05.950818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d3a4a-01f7-442e-a9df-81ccc54091b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:05.952063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3a4a-01f7-442e-a9df-81ccc54091b5 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.952594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3a4a-01f7-442e-a9df-81ccc54091b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.953072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d3a4a-01f7-442e-a9df-81ccc54091b5 None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.954588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d3a4a-01f7-442e-a9df-81ccc54091b5 None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:05.956501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d3a4a-01f7-442e-a9df-81ccc54091b5 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:05.960477 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 59/121] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:05 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:05.962049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:05.963071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:05.963558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:05.983725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:05.985817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:06.074288 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 60/122] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:06.075490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:06.121787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a930d49-720e-4f8a-b97d-dd5cffb726df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:06.245825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:06.247039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.247039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.247293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6/users/50527b1e60e34ba8b7cd042824c4e1bc/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.257293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cf690794a2b455785424e72c672b5a6, user_id=50527b1e60e34ba8b7cd042824c4e1bc, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:06.257963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea223d34-0c70-4a31-8acb-c92276bc6201 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:06.258813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:06.279503 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:06.291976 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 63/123] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:05 2022] PUT /identity/v3/projects/3cf690794a2b455785424e72c672b5a6/users/50527b1e60e34ba8b7cd042824c4e1bc/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:52:06.293012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:06.316903 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:06.341296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:06.342246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.342531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.342811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] PATH_INFO: `/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.345030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] RBAC: Authorizing `identity:get_project(project_id=2d8f7ed22d5b4176b1d0e1be6e7e0657)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:06.346837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:06.349262 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 61/124] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:06 2022] GET /identity/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657 => generated 312 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:06.355932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:06.523863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e466fa0e-55c5-4e08-a72b-4d653056afe3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:06.554423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262f1e5-f335-4de4-9d7a-a29c2b4371fe None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:06.619836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6ea18-e435-407e-a4ab-c25b4a5dbc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:06.620708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ea18-e435-407e-a4ab-c25b4a5dbc81 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.620994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ea18-e435-407e-a4ab-c25b4a5dbc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.621286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6ea18-e435-407e-a4ab-c25b4a5dbc81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.625406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:06.627401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.628465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.629209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] PATH_INFO: `/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657/users/50527b1e60e34ba8b7cd042824c4e1bc/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.633510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d8f7ed22d5b4176b1d0e1be6e7e0657, user_id=50527b1e60e34ba8b7cd042824c4e1bc, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:06.633738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b6ea18-e435-407e-a4ab-c25b4a5dbc81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:06.637220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-27b6ea18-e435-407e-a4ab-c25b4a5dbc81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:06.644236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:06.645948 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 64/125] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:06.647473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a839-337f-4353-a9b5-d61ca5f319c6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.648879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a839-337f-4353-a9b5-d61ca5f319c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.648879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856a839-337f-4353-a9b5-d61ca5f319c6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.653237 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 65/126] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:06.660964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:06.661549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:06.662430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:06.689787 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 62/127] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:06 2022] PUT /identity/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657/users/50527b1e60e34ba8b7cd042824c4e1bc/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:52:06.691463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:06.716311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:06.718631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:06.889722 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:06.973122 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:06.987051 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 66/128] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:07.022497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.131053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a55cf6a-38b4-4b3a-a960-d6c90f412a86 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.259846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.260714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13305bf7-fdf0-4f35-830e-53a8d8428e0b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.261074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.261901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.262407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.263790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:07.264267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.266910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d8d87-2c90-4dbd-bc29-e54d825bcf77 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.284435 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 63/129] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 594 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:07.293440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24905a-957e-403d-ad4e-bbfb029b93a4 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.293946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24905a-957e-403d-ad4e-bbfb029b93a4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.294407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af24905a-957e-403d-ad4e-bbfb029b93a4 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.297317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 64/130] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:07 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:07.300627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24905a-957e-403d-ad4e-bbfb029b93a4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.338577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ab217-5b55-456f-bae5-6c61d9de2434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.339767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ab217-5b55-456f-bae5-6c61d9de2434 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.340246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ab217-5b55-456f-bae5-6c61d9de2434 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.340739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ab217-5b55-456f-bae5-6c61d9de2434 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.369067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ab217-5b55-456f-bae5-6c61d9de2434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8a8ab217-5b55-456f-bae5-6c61d9de2434 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:07.387054 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:07.387971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:07.388779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:07.396763 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 67/131] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 375 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:07.398493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.400746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.402705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.439548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:07.442228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:07.497912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af24905a-957e-403d-ad4e-bbfb029b93a4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.500200 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.551123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.552378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.552912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.553380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.554877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.557137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.559138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 65/132] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:07.560177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.606716 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.643156 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 68/133] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:07.644919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.684590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43bd5a-ddaf-4c65-bdfd-3493f14e757b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.727551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.728728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.729231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.729701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.730660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:07.731175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.732813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.742641 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 66/134] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:07.743813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:07.792892 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:07.853761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63801ab5-a58e-48e7-862b-4121f4dc1c72 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:07.893509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:07.894795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:07.895281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:07.895751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:07.897329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:07.899046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:07.901380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 67/135] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:07.902506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.005344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9f713-59be-4b37-9158-73c707acb995 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.015428 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.019006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b75d5-dcbf-4fba-b2ce-147d90e78d3d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.071230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.072610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.073107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.073609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.075378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.077272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.079754 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 68/136] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.080849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.123140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.125522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.128566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.129106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.131998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.135094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.137825 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 69/137] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:07 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.138789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.215643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ba798-d9f7-49de-922a-54460ec3e381 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.271382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.272471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.273051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.273522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.274462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.276232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.282492 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.303513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 69/138] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:08 2022] POST /identity/v3/users => generated 283 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:08.304887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.337062 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.388696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0077dc-0848-4058-b532-c4399f875e91 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.431810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3db9bd-1168-40d6-9158-e6491f6a3693 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.473259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.474773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.475345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.475821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6/users/44cb4b6cf7e6461fb9360e3f317f41d2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.478274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] RBAC: Authorizing `identity:create_grant(project_id=3cf690794a2b455785424e72c672b5a6, user_id=44cb4b6cf7e6461fb9360e3f317f41d2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.480372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.483184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71862b97-5879-406f-9571-5a04d3aff4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.484184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862b97-5879-406f-9571-5a04d3aff4cf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.484497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862b97-5879-406f-9571-5a04d3aff4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.484774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71862b97-5879-406f-9571-5a04d3aff4cf None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.489413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71862b97-5879-406f-9571-5a04d3aff4cf None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.491358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71862b97-5879-406f-9571-5a04d3aff4cf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.493652 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 70/139] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:08.499341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4042-a3a9-4bab-b5ee-f0aed9c26dd7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.500148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4042-a3a9-4bab-b5ee-f0aed9c26dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.503001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 70/140] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:08 2022] PUT /identity/v3/projects/3cf690794a2b455785424e72c672b5a6/users/44cb4b6cf7e6461fb9360e3f317f41d2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:08.504605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4042-a3a9-4bab-b5ee-f0aed9c26dd7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.505626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.508468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 71/141] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:08 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:08.517207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.517861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.518334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.551159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:08.556315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:08.679393 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.703140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f5daa2-e8eb-4db8-8c2c-07b51911dd0d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:08.705633 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 72/142] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:08.756960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:08.758443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:08.758944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:08.759437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6/users/50527b1e60e34ba8b7cd042824c4e1bc/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:08.763899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] RBAC: Authorizing `identity:create_grant(project_id=3cf690794a2b455785424e72c672b5a6, user_id=50527b1e60e34ba8b7cd042824c4e1bc, role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:08.766852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:08.779407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:08.790036 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 71/143] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:08 2022] PUT /identity/v3/projects/3cf690794a2b455785424e72c672b5a6/users/50527b1e60e34ba8b7cd042824c4e1bc/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:08.858463 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:08.912439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c5b46-f1ea-405a-8110-4259ea24ccff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.010465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.012075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.012489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.012963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.037012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:09.049679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:09.050736 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:09.051701 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 73/144] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:09.060883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.216636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafa5ac3-4a1c-4866-89f4-24056032492a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.259495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.260307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.260678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.260907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.261998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:09.262303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.263724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d2e147-784b-4c83-9d12-dd04478b910b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.273473 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 72/145] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.279882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.431704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d248f2c-4c42-41d3-8962-18dcb2f9c826 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.447351 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.458197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd551b5-b15d-48f8-994f-97cc7beffe38 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.458528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd551b5-b15d-48f8-994f-97cc7beffe38 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.458761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd551b5-b15d-48f8-994f-97cc7beffe38 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.464701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 73/146] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:09.469900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.470178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.470395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.470530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.471300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.471588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.471972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] PATH_INFO: `/v3/users/73b23937cdb34626983387ce2c255af9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.473284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] RBAC: Authorizing `identity:get_user(user_id=73b23937cdb34626983387ce2c255af9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.474800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.476983 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 74/147] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/users/73b23937cdb34626983387ce2c255af9 => generated 289 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.482310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.505567 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.515507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:09.517299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:09.599592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb5ded-9249-4148-8be5-74c337a0b05e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.637352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.638200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.638480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.638753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.640091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.641727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.643963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 75/148] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:09.644838 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 74/149] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:09.649470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.676297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:09.719067 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.785059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892d5ac-2776-4c71-99f3-ad22249aad6c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.822348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.823274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.823561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.823836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6/users/73b23937cdb34626983387ce2c255af9/roles/a0486ae89dca46fa88a6c73f065ba459` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.826085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cf690794a2b455785424e72c672b5a6, user_id=73b23937cdb34626983387ce2c255af9, role_id=a0486ae89dca46fa88a6c73f065ba459)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:09.827611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:09.847233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 76/150] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:09 2022] PUT /identity/v3/projects/3cf690794a2b455785424e72c672b5a6/users/73b23937cdb34626983387ce2c255af9/roles/a0486ae89dca46fa88a6c73f065ba459 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:09.873323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc586f7a-8f92-4c17-80e5-4c150f36e333 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:09.926136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:09.926963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:09.927248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:09.927524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:09.933696 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:09.949188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:09.957264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:09.958257 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:09.959452 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 75/151] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:09.964842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.147360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f37c2c-df7b-4c92-ba7b-aedcc0aa1333 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.165271 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.201613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.202341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.202617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.202974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.204011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:10.204455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.206074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.218710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 77/152] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.224089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.368575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca09c1b-8ba3-429f-82d4-7fcccbb26848 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.411429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.412331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.412642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.412920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.417224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.418737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.420861 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:10.426082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.566790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd6b809-1f74-4a71-8172-44f66dd4f41a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:10.632859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:10.633865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:10.634370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:10.634989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:10.693632 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:10.732259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:10.737561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:10.883749 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 78/154] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:52:10.889889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:10.957540 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.001435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8cee9b-09ef-4f09-bf03-376c61e8ab0c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.038693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9885686-6854-4998-915d-9eabd90c0590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.039577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9885686-6854-4998-915d-9eabd90c0590 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.039856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9885686-6854-4998-915d-9eabd90c0590 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.040128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9885686-6854-4998-915d-9eabd90c0590 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.042376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9885686-6854-4998-915d-9eabd90c0590 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.043853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9885686-6854-4998-915d-9eabd90c0590 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.045715 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 77/155] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:10 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.051857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.132459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939748-0481-403c-8f2f-b09bf5bd7c66 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.132975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939748-0481-403c-8f2f-b09bf5bd7c66 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.133387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa939748-0481-403c-8f2f-b09bf5bd7c66 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.135332 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 78/156] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:11.141693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.142211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.142793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.169616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:11.171079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:11.184979 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.225795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aae980-94ec-4b07-b436-d129dc9288fc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.294914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.295827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.296422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.296836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.297818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=50527b1e60e34ba8b7cd042824c4e1bc) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:11.298289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.299907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.308715 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 79/157] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/role_assignments?user.id=50527b1e60e34ba8b7cd042824c4e1bc&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=1b8336fe2a2642b387272398a640a960 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.338661 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 79/158] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:11.398124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.523006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38fd732-f175-483a-ac87-a6fc7364ec18 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.564812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.566009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.566465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.566952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.573799 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.584268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:11.593082 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:11.594016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:11.595098 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 80/159] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:11.602285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:11.706078 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:11.776990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9351a8d-72fb-40be-bf9c-240ad4fa7b85 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:11.840088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:11.841297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:11.841797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:11.842287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:11.843312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:11.843940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:11.846498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:11.862553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 80/160] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:11.869323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.036218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7d4d4-dd4a-47b3-ac6e-e59b03792268 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.082148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.083053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.083334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.083620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.084897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.086438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.088514 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 81/161] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:11 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:12.094153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.223580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3114db43-4500-4cc5-ae8d-b11442deddbd None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.253570 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.268180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.268894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.269180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.269455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.357868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.359285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.495062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 81/162] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:12.500649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.591974 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.643569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd63754-ae4b-41a9-b75e-8e2351d9d098 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.724774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e3c61c-75cd-4dfb-9b80-ddd93f768edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.726413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c61c-75cd-4dfb-9b80-ddd93f768edc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.726917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c61c-75cd-4dfb-9b80-ddd93f768edc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.727396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e3c61c-75cd-4dfb-9b80-ddd93f768edc None admin] PATH_INFO: `/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.733904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c61c-75cd-4dfb-9b80-ddd93f768edc None admin] RBAC: Authorizing `identity:get_project(project_id=2d8f7ed22d5b4176b1d0e1be6e7e0657)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.736804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e3c61c-75cd-4dfb-9b80-ddd93f768edc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.740254 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 82/163] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/projects/2d8f7ed22d5b4176b1d0e1be6e7e0657 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:12.746623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:12.826798 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:12.888087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27392e0-c250-4893-9d3a-b6c4e76c7537 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:12.928450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:12.929085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.929509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.929834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.930708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=2d8f7ed22d5b4176b1d0e1be6e7e0657, user.id=50527b1e60e34ba8b7cd042824c4e1bc) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:12.931025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:12.932623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb446f0-6e0d-43ac-815e-fa5abcfed728 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:12.939957 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 82/164] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:12 2022] GET /identity/v3/role_assignments?user.id=50527b1e60e34ba8b7cd042824c4e1bc&scope.project.id=2d8f7ed22d5b4176b1d0e1be6e7e0657&role.id=1b8336fe2a2642b387272398a640a960 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:12.978353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c660-292c-481a-bea3-a9e88b3ae136 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.979324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c660-292c-481a-bea3-a9e88b3ae136 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.980074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc99c660-292c-481a-bea3-a9e88b3ae136 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:12.982938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 83/165] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:12.989160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d635a-31e2-44d4-9aa0-6118330ecdce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:12.989547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d635a-31e2-44d4-9aa0-6118330ecdce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:12.989781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d635a-31e2-44d4-9aa0-6118330ecdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.014354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-537d635a-31e2-44d4-9aa0-6118330ecdce None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:13.015611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-537d635a-31e2-44d4-9aa0-6118330ecdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:13.103578 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 83/166] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:13.145887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99c660-292c-481a-bea3-a9e88b3ae136 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.235394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b3a7a-6b1d-4b33-85e2-e9d7b5caca6a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.235875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b3a7a-6b1d-4b33-85e2-e9d7b5caca6a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.236558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b3a7a-6b1d-4b33-85e2-e9d7b5caca6a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.238188 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 84/167] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:13.244137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72464ff5-ecdf-490f-a919-7f02dc8550ea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.244561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72464ff5-ecdf-490f-a919-7f02dc8550ea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.244936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72464ff5-ecdf-490f-a919-7f02dc8550ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.263588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-72464ff5-ecdf-490f-a919-7f02dc8550ea None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:13.264819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-72464ff5-ecdf-490f-a919-7f02dc8550ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:13.281204 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:13.351207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 85/168] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:13.352668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca52d0-a6e6-4057-8d38-a2fb06e99686 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.352963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca52d0-a6e6-4057-8d38-a2fb06e99686 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.353217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca52d0-a6e6-4057-8d38-a2fb06e99686 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.354921 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 86/169] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:13.365387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.365774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.365953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.371417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc99c660-292c-481a-bea3-a9e88b3ae136 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.385777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:13.387314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:13.418510 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:13.434400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.435231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.435545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.435792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.459007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:13.471182 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:13.472107 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:13.472904 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:13.474043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 84/170] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:13.474868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.508528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 87/171] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:13.509365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.641100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a477d-8577-4cf0-ba19-3355c7bb4250 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.676773 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:13.710317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.712542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.714488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.714783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.729112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad819e3-e3f6-4058-8e3e-8ae6b352f3b3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.735760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:13.749559 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:13.750496 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:13.751308 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 85/172] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:13.754603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.802390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.803000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.803275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.803545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.805040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:13.805346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:13.806785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:13.823372 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 88/173] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:13.829804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:13.862534 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:13.935709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f97159-10cb-4282-9238-6bc3bad60d6a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:13.978701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:13.979862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:13.980285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:13.980722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:13.994545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:14.003983 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:14.004972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:14.005743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:14.008498 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 86/174] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:14.009747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.069902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf7f4b-bc60-4df0-9082-63be1589f8d0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.131257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6b9423-2b92-4769-94ab-ddc5e2d8033e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.133103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.133932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.134107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.134356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.135192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:14.135489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.137294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.146589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 89/175] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:14.147462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.149665 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.151867 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.174758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27495c7a-bb82-4a23-b42a-71aa9a362b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.176063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27495c7a-bb82-4a23-b42a-71aa9a362b26 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.176611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27495c7a-bb82-4a23-b42a-71aa9a362b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.177105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27495c7a-bb82-4a23-b42a-71aa9a362b26 None admin] PATH_INFO: `/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.178590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27495c7a-bb82-4a23-b42a-71aa9a362b26 None admin] RBAC: Authorizing `identity:get_user(user_id=44cb4b6cf7e6461fb9360e3f317f41d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.181907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27495c7a-bb82-4a23-b42a-71aa9a362b26 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.184422 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 87/176] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/users/44cb4b6cf7e6461fb9360e3f317f41d2 => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:14.185949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019ef1-db00-44be-85ac-fb884bb84a6b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.186543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019ef1-db00-44be-85ac-fb884bb84a6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.187068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c019ef1-db00-44be-85ac-fb884bb84a6b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.188677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 88/177] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:14.189625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019ef1-db00-44be-85ac-fb884bb84a6b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.284969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1e3c6-359f-471b-84b7-7014a318ef4e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.301571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c019ef1-db00-44be-85ac-fb884bb84a6b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.337711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6ae23-7489-4db8-b83b-a15bf7f0026e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.338552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ae23-7489-4db8-b83b-a15bf7f0026e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.338873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ae23-7489-4db8-b83b-a15bf7f0026e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.339150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6ae23-7489-4db8-b83b-a15bf7f0026e None admin] PATH_INFO: `/v3/users/50527b1e60e34ba8b7cd042824c4e1bc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.340659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6ae23-7489-4db8-b83b-a15bf7f0026e None admin] RBAC: Authorizing `identity:get_user(user_id=50527b1e60e34ba8b7cd042824c4e1bc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.342167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6ae23-7489-4db8-b83b-a15bf7f0026e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.343909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 89/178] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/users/50527b1e60e34ba8b7cd042824c4e1bc => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:14.348825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025e92-dd9d-4c41-b938-f713a9f83adc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.348825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025e92-dd9d-4c41-b938-f713a9f83adc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.348825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23025e92-dd9d-4c41-b938-f713a9f83adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.351043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.351999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.352448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.352836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.354017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:14.354459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.356577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.364898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23025e92-dd9d-4c41-b938-f713a9f83adc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:14.366116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23025e92-dd9d-4c41-b938-f713a9f83adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:14.374596 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 90/179] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:14.374596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.422796 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.453893 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 90/180] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:14.454834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee40c16-2d2c-4d58-ac5c-de58b46cf7d1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.455122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee40c16-2d2c-4d58-ac5c-de58b46cf7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.455386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee40c16-2d2c-4d58-ac5c-de58b46cf7d1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.457970 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 91/181] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:14.457970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee40c16-2d2c-4d58-ac5c-de58b46cf7d1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.515940 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.574060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ca935-bee1-4979-9b09-1848090aa2fa None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.613472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee40c16-2d2c-4d58-ac5c-de58b46cf7d1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:14.623872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.624927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.625375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.625825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.667905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596e84e-3149-4623-a498-399961838b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:14.668803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596e84e-3149-4623-a498-399961838b48 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.669198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596e84e-3149-4623-a498-399961838b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.669554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596e84e-3149-4623-a498-399961838b48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.716154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.717876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.726079 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.752146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596e84e-3149-4623-a498-399961838b48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:14.753751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596e84e-3149-4623-a498-399961838b48 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:14.819338 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:14.873995 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 91/182] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:14.875357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.876110 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 92/183] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:14.877522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:14.877812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:14.878093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:14.907131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:14.908984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:14.983464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 93/184] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:14.984379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:14.999539 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.003328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17802bea-22f3-407d-90fa-07fde15e6681 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.065998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a67fd-31c4-4563-ba94-e046000de3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.067334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a67fd-31c4-4563-ba94-e046000de3fe None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.067779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a67fd-31c4-4563-ba94-e046000de3fe None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.068132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a67fd-31c4-4563-ba94-e046000de3fe None admin] PATH_INFO: `/v3/users/9ce391d3b3b245bfb3abd6ab38337777` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.091711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a67fd-31c4-4563-ba94-e046000de3fe None admin] RBAC: Authorizing `identity:get_user(user_id=9ce391d3b3b245bfb3abd6ab38337777)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.094173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a67fd-31c4-4563-ba94-e046000de3fe None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.096095 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 92/185] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/users/9ce391d3b3b245bfb3abd6ab38337777 => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.097597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b765989-ad7d-443e-bbf2-51d54a7dacae None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.097990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b765989-ad7d-443e-bbf2-51d54a7dacae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.098356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b765989-ad7d-443e-bbf2-51d54a7dacae None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.099832 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 93/186] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:15.100697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b765989-ad7d-443e-bbf2-51d54a7dacae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.128164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a2124-4614-4db8-bf39-7184adcf745a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.138987 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.180920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.181730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.182057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.182332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.194491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:15.202650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:15.204508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 94/187] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:15.206078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.237760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b765989-ad7d-443e-bbf2-51d54a7dacae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.281515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.282422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.282702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.282978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.284397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.285944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.287842 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 94/188] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.288703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.302764 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.350366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db2b1-dcd8-434a-8556-22fe09a63c79 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.389235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e90166-88d4-4299-8345-7742e05caae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.389993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e90166-88d4-4299-8345-7742e05caae2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.390271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e90166-88d4-4299-8345-7742e05caae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.390540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e90166-88d4-4299-8345-7742e05caae2 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.392251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e90166-88d4-4299-8345-7742e05caae2 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.393931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e90166-88d4-4299-8345-7742e05caae2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.395705 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 95/189] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.399028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.399028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.399028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.405413 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.416628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:15.417550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e0d032-7685-4989-8dde-ebddc732fc04 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.417879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:15.469018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.469840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.470115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.470385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.471659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.473184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.474887 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 95/190] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.475668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.500921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 96/191] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:15.502293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.592727 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.612777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982a737-9054-45f6-b1cb-ec8bd5023300 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.634401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb9774-187c-4ce0-9f28-fb1a1f000b1b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.654570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.655268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.655662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.656040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.674866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.675772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.676220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.676686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.677945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:15.678441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.680810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.694910 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 97/192] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.695734 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.696047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.760220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.763361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.853840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8695285-d185-42bf-bc27-25f52cfa4535 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:15.899047 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:15.909773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:15.910355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:15.910639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:15.910921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:15.911783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=44cb4b6cf7e6461fb9360e3f317f41d2) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:15.912100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:15.913661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:15.920978 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 98/193] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/role_assignments?user.id=44cb4b6cf7e6461fb9360e3f317f41d2&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:15.921842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:15.937890 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 96/194] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:15.939197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.033617 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.103504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71895176-a865-4c06-a309-c6d92d2d5501 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.114570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aee485-f5bc-4553-93d8-cfdbff6f6dd7 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.174040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.174864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.175153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.175388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.175512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.176285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] RBAC: Adding query filter params (role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=50527b1e60e34ba8b7cd042824c4e1bc) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:16.176559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.176694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.177029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.177488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.178057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.178613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.180866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.185495 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 99/195] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:15 2022] GET /identity/v3/role_assignments?user.id=50527b1e60e34ba8b7cd042824c4e1bc&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 608 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.186353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.222578 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 97/196] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:15 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:16.226128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.318301 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.419011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570d96af-4c68-433e-bc88-338b292f0a1b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.442226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4445332f-b524-44da-aaae-884e1bed91aa None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.468454 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.489883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.492095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.492516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.493579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.504001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.504954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.505241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.505686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] PATH_INFO: `/v3/users/73b23937cdb34626983387ce2c255af9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.507394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] RBAC: Authorizing `identity:get_user(user_id=73b23937cdb34626983387ce2c255af9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.510288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.514476 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 98/197] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/users/73b23937cdb34626983387ce2c255af9 => generated 289 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.515841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:16.516001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:16.525148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:16.526853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:16.528233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 100/198] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:16.532466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.710942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea11285b-ad5a-4607-bcba-8db4a3d018b8 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.722111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e83d09-9b7d-4fd4-a97f-7be6c90d8c66 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.750636 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.780885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.781198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.781980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.782399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.782552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.782873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.783036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.783344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.785496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.788159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.791839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 99/199] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:16.799270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:16.881332 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:16.898083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.899419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:16.943993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281365fe-e383-4784-84bc-8d069b18e371 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:16.985413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:16.986461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:16.986918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:16.987395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:16.988390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:16.988946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:16.990562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.000550 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 100/200] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.001809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.030234 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 101/201] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:17.032786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.059469 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.151419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39677df-90d4-41c3-8105-79b88790e5d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.191710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449a71d-fa72-4ff7-aa30-790608696075 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.212074 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.232678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.235964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.237092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.238396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] PATH_INFO: `/v3/users/9ce391d3b3b245bfb3abd6ab38337777` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.241266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] RBAC: Authorizing `identity:get_user(user_id=9ce391d3b3b245bfb3abd6ab38337777)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.242971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.243719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.244084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.244446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.245462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=9ce391d3b3b245bfb3abd6ab38337777) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:17.245816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.246098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.247601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.249528 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 102/202] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/users/9ce391d3b3b245bfb3abd6ab38337777 => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.252592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.264251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 101/203] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/role_assignments?user.id=9ce391d3b3b245bfb3abd6ab38337777&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.266386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.419490 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.446295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32740ffc-f603-415e-8ef6-f5e46ddf4504 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.490710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.491520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.491804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.492083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.493490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.495250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.498674 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 103/204] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.506275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:17.549580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825cac13-dc38-4998-aa5b-757a46aa154a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.623695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.624849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.625319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.625778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.750351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b05ac59-ed90-4657-9b94-61efcf6d2a65 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:17.774621 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:17.806517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:17.807322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:17.807606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:17.807876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:17.808800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] RBAC: Adding query filter params (role.id=a0486ae89dca46fa88a6c73f065ba459, scope.project.id=3cf690794a2b455785424e72c672b5a6, user.id=73b23937cdb34626983387ce2c255af9) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:17.809218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.810854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:17.819415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 104/205] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/role_assignments?user.id=73b23937cdb34626983387ce2c255af9&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=a0486ae89dca46fa88a6c73f065ba459 => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:17.850878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:17.853927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:18.013004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 102/206] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:18.014844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.050965 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.205834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f610d-8bea-4ae1-994c-a6cd3b1e148c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.271322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1fd77-4d67-49a8-80da-9a6fefc3ba9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.275432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1fd77-4d67-49a8-80da-9a6fefc3ba9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.275987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1fd77-4d67-49a8-80da-9a6fefc3ba9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.276695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1fd77-4d67-49a8-80da-9a6fefc3ba9e None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.279093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1fd77-4d67-49a8-80da-9a6fefc3ba9e None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:18.281900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1fd77-4d67-49a8-80da-9a6fefc3ba9e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:18.284127 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 105/207] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:18.290606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:18.381350 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:18.406868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aa5019-7200-4892-9cf1-14fd1736e1b9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:18.444174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:18.444872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:18.445149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:18.445420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:18.446262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] RBAC: Adding query filter params (role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=9ce391d3b3b245bfb3abd6ab38337777) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:18.446567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:18.449162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3c540-2247-44d4-92a3-810b32e3d8e8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:18.455907 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 103/208] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:18 2022] GET /identity/v3/role_assignments?user.id=9ce391d3b3b245bfb3abd6ab38337777&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:19.047649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4b70c-4110-489f-aa5c-c33092e36266 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.048165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4b70c-4110-489f-aa5c-c33092e36266 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.048238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc4b70c-4110-489f-aa5c-c33092e36266 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.049641 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 106/209] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:19.055948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2896e-3865-496d-8cd6-7fb3d694530c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.056238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2896e-3865-496d-8cd6-7fb3d694530c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.056523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe2896e-3865-496d-8cd6-7fb3d694530c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.076868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fbe2896e-3865-496d-8cd6-7fb3d694530c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:19.078396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fbe2896e-3865-496d-8cd6-7fb3d694530c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:19.150926 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 104/210] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:19.175157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4b70c-4110-489f-aa5c-c33092e36266 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.325003 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.366702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc4b70c-4110-489f-aa5c-c33092e36266 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.386037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11a8d4-e97e-46c6-bbda-4d7f63e48e8f None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.387026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11a8d4-e97e-46c6-bbda-4d7f63e48e8f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.387788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11a8d4-e97e-46c6-bbda-4d7f63e48e8f None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.392494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 105/211] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:19.396696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.397246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.397732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.416605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:19.418180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:19.428981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.430330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.430793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.431115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.450391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:19.467778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:19.469014 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:19.469806 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:19.477310 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 107/212] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:19.479305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.526603 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.538673 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 106/213] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:19.570481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.648310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc3015-4924-4a9e-a6ba-3f8ae31458b3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.696008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.696949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.697362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.697774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.699148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:19.699704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.701666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.716006 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 108/214] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:19.723209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.738070 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.778938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54207bb-67a4-4b93-81c7-c20e14cb63dc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.843344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.844861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.845357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.845652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.847467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.850455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.856399 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 107/215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:19.860900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:19.874804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4687af-6931-4e60-92a1-635900488b1a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:19.924548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1227f4a9-973e-4228-966c-7f19b129aae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:19.925340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f4a9-973e-4228-966c-7f19b129aae6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.925620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f4a9-973e-4228-966c-7f19b129aae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.925893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1227f4a9-973e-4228-966c-7f19b129aae6 None admin] PATH_INFO: `/v3/users/d5c58bc2e68d4f55a609720e6ac89b8f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.941192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227f4a9-973e-4228-966c-7f19b129aae6 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c58bc2e68d4f55a609720e6ac89b8f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:19.941967 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:19.942979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1227f4a9-973e-4228-966c-7f19b129aae6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:19.948777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 109/216] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:19 2022] GET /identity/v3/users/d5c58bc2e68d4f55a609720e6ac89b8f => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:19.948777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772b61-59c7-4e6c-8756-a8481c69a45b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.948777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772b61-59c7-4e6c-8756-a8481c69a45b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.948777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66772b61-59c7-4e6c-8756-a8481c69a45b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.948777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 110/217] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:19.953518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:19.953518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:19.953727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:19.970729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:19.971912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:20.005868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca1331c-2c09-4e4c-8e32-d4b2d156be66 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.048880 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.051159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.051862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.052227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.052610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.055576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.055576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.076379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 111/218] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:20.076379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.093062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 108/219] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:19 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:20.094486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.227027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85aa8b56-bd73-4e0d-8d49-ac6ea72e33d2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.272598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.273432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.273880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.274257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.291546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48ad6e-6ac2-4782-93c6-6eb633907fb2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.327218 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.344332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.345815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.346252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.346872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.351988 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.367145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.368780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:20.368987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:20.378464 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:20.379520 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:20.381263 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 109/220] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:20.386664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.542993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65658c9-9b11-4978-982a-e8a7d012e240 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.558284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 112/221] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:20.565162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.599562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.600251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.600566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.600845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.602104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.602104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.603345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.613161 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 110/222] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.619267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.685915 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.696103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee420f8-03b6-4446-9f70-16bf965f35cb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.712863 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:20.752996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.754204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.754634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.755041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.756640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.757677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedb28ca-9a31-47c2-be53-8802cd0852f1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.758476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.760841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 113/223] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.770347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.805611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.806553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.806832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.807107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] PATH_INFO: `/v3/users/9ce391d3b3b245bfb3abd6ab38337777` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.809067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] RBAC: Authorizing `identity:get_user(user_id=9ce391d3b3b245bfb3abd6ab38337777)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.810554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.816870 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 111/224] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/users/9ce391d3b3b245bfb3abd6ab38337777 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:20.825300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:20.926692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22942523-30e2-43b6-a9ab-2529fff5fd44 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.964169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:20.964999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.965341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.965753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.966599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=d5c58bc2e68d4f55a609720e6ac89b8f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:20.966908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:20.968514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f14c70c-6a82-40f8-b522-36c1c6e849eb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:20.974742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 114/225] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/role_assignments?user.id=d5c58bc2e68d4f55a609720e6ac89b8f&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=1b8336fe2a2642b387272398a640a960 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:20.975644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d30114-f566-4550-ba31-910c274cb333 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:20.976042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0ec1d-9407-4b45-928d-32a4535536d3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.976323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0ec1d-9407-4b45-928d-32a4535536d3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.976618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0ec1d-9407-4b45-928d-32a4535536d3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:20.982243 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 115/226] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:20.987932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:20.988244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:20.990891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.023588 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.036874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:21.039005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:21.088665 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.094494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.095406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.095685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.095959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.098400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.099921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.105650 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 112/227] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:20 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.110675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.191683 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 116/228] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:21.216501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.233503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a74fde6-346e-4788-80c7-c8abcb5bf0b6 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.269836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.270743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.271024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.271296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/9ce391d3b3b245bfb3abd6ab38337777/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.273375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] RBAC: Authorizing `identity:create_grant(project_id=33e83e5227cd49ab890ad6a29a885f62, user_id=9ce391d3b3b245bfb3abd6ab38337777, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.274860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.294375 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 113/229] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:21 2022] PUT /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/9ce391d3b3b245bfb3abd6ab38337777/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:21.331975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4026d0e-4f0a-4d16-bb90-785824a75a31 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.371310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.372154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.372524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.372805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.384822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:21.393996 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:21.396305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:21.398376 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 117/230] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:21.409587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.495237 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.601920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328a579-d569-45dc-b596-dfd6f387535c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.662663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.663421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.663708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.663985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.664875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:21.665186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.666637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.687217 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 114/231] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.693523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:21.726170 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:21.844820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ace124-cb55-4d1d-a972-72fa0294f2ac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:21.900225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:21.901091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:21.901430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:21.901717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] PATH_INFO: `/v3/users/9ce391d3b3b245bfb3abd6ab38337777` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:21.903123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] RBAC: Authorizing `identity:get_user(user_id=9ce391d3b3b245bfb3abd6ab38337777)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:21.904680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:21.906867 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 118/232] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/users/9ce391d3b3b245bfb3abd6ab38337777 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:21.912608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.154686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491dcbf-a6b6-47f5-89d5-f0430fc66ded None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:22.166458 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:22.217196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca01d64-57d7-427b-9cbc-7643ac35ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.218667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01d64-57d7-427b-9cbc-7643ac35ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.219166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01d64-57d7-427b-9cbc-7643ac35ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.219640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca01d64-57d7-427b-9cbc-7643ac35ce05 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.221762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01d64-57d7-427b-9cbc-7643ac35ce05 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.224609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca01d64-57d7-427b-9cbc-7643ac35ce05 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.227987 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 115/233] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:21 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:22.237251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:22.384246 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:22.400984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbb68c-d3e9-4e8c-b1f9-d30625a9bb54 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:22.456126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9448caf-65ed-4d9e-ba6d-1897121704e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:22.456969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448caf-65ed-4d9e-ba6d-1897121704e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.457256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448caf-65ed-4d9e-ba6d-1897121704e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.457531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9448caf-65ed-4d9e-ba6d-1897121704e8 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/9ce391d3b3b245bfb3abd6ab38337777/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.459875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9448caf-65ed-4d9e-ba6d-1897121704e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=33e83e5227cd49ab890ad6a29a885f62, user_id=9ce391d3b3b245bfb3abd6ab38337777, role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:22.461390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9448caf-65ed-4d9e-ba6d-1897121704e8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:22.481594 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 119/234] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:22 2022] PUT /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/9ce391d3b3b245bfb3abd6ab38337777/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:22.881538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f94df-7812-42f2-a04c-045faddc27c8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.882453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f94df-7812-42f2-a04c-045faddc27c8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.882938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f94df-7812-42f2-a04c-045faddc27c8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.884639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 116/235] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:22.892457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:22.893065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:22.893533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:22.911916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:22.913576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:23.012230 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 120/236] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:23.052031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f94df-7812-42f2-a04c-045faddc27c8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.299026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f94df-7812-42f2-a04c-045faddc27c8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.377851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342692eb-ca3f-4663-be07-b2bd372bcc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.379238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342692eb-ca3f-4663-be07-b2bd372bcc35 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.379722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342692eb-ca3f-4663-be07-b2bd372bcc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.380207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342692eb-ca3f-4663-be07-b2bd372bcc35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.409810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342692eb-ca3f-4663-be07-b2bd372bcc35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-342692eb-ca3f-4663-be07-b2bd372bcc35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:23.433536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:23.434680 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:23.435659 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:23.436460 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 117/237] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:23.442562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.543987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffdd15-af9c-4866-9bb3-4a95f7877f3d None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.544488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffdd15-af9c-4866-9bb3-4a95f7877f3d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.544976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ffdd15-af9c-4866-9bb3-4a95f7877f3d None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.547653 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 118/238] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:23.554470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672edaa0-01ae-4be2-88c2-9d0bebeb1637 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.554883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672edaa0-01ae-4be2-88c2-9d0bebeb1637 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.555382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672edaa0-01ae-4be2-88c2-9d0bebeb1637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.576776 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.602193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b121a5f-be40-43a9-835d-2bf4a4664671 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.602773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-672edaa0-01ae-4be2-88c2-9d0bebeb1637 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:23.614847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-672edaa0-01ae-4be2-88c2-9d0bebeb1637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:23.652067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.652789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.653074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.653351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.654128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:23.654440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.655885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.676447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 121/239] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:23.678479 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.681727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.794126 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 119/240] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:23.797455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527a2865-a189-4b08-bbfd-dd7361b90de5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:23.814110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e575-ca42-4077-9fcb-5e3cff06ef9f None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.814328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e575-ca42-4077-9fcb-5e3cff06ef9f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.814624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f92e575-ca42-4077-9fcb-5e3cff06ef9f None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.816283 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 120/241] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:23.822070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.822339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.822662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.835834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:23.836761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:23.837046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:23.837324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] PATH_INFO: `/v3/users/15b4f446aa214e7f87b63fc848e2fea1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:23.840465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:23.841891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:23.847478 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:23.854309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] RBAC: Authorizing `identity:get_user(user_id=15b4f446aa214e7f87b63fc848e2fea1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:23.856521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:23.858628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 122/242] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/users/15b4f446aa214e7f87b63fc848e2fea1 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:23.860020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.924480 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 121/243] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:23.926035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:23.989427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba4a44b-a901-435f-8a73-d4e7b9d25d8b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.049787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.051674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.052591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.053291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.076438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:24.077267 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.087067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2531f6-c1c8-4d2d-bf69-9d435de9485d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:24.094428 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:24.096422 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:24.097941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:24.108553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 123/244] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:24.110638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.127672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cfd31-b372-4940-836b-13f9815225c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.128369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cfd31-b372-4940-836b-13f9815225c3 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.128656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cfd31-b372-4940-836b-13f9815225c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.128936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cfd31-b372-4940-836b-13f9815225c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.214494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cfd31-b372-4940-836b-13f9815225c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.216080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cfd31-b372-4940-836b-13f9815225c3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.230567 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.309821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed7012-d2c5-4775-a3c3-98e1e34baa43 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.351548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.352257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.352578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.352849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.354101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.355669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.357813 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 124/245] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.358307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.361595 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.385474 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 122/246] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:24.385474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229ee25-81ec-48bf-b154-f0f2248219a3 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.385474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229ee25-81ec-48bf-b154-f0f2248219a3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.385474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229ee25-81ec-48bf-b154-f0f2248219a3 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.385474 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 123/247] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:24.385474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229ee25-81ec-48bf-b154-f0f2248219a3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.530252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b09e4-b754-4d31-9582-b360dac986ce None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.561602 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.579653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.580513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.580810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.581084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.581449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229ee25-81ec-48bf-b154-f0f2248219a3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.581896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:24.582207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.583949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508298ad-9ba6-4c30-8fde-77dc23506a4c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.601058 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 125/248] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.603840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.604269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.605465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.628520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:24.630139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:24.642794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.643879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.644395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.644889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.646120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.648743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.682380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 124/249] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:24 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:24.684118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.747261 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 126/250] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:24.749020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:24.802791 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:24.904830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ab7b28-7315-4128-bc8f-ecdbbfe98137 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.968555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:24.969627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab77a4e3-22da-4185-9d7a-71049d485ee4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:24.971228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:24.971961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:24.973010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:24.975464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:24.978406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:24.988043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 125/251] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:24.989981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.001203 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.040014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.042120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.042736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.043230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] PATH_INFO: `/v3/users/d5c58bc2e68d4f55a609720e6ac89b8f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.045574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] RBAC: Authorizing `identity:get_user(user_id=d5c58bc2e68d4f55a609720e6ac89b8f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.049100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.053324 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 127/252] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/users/d5c58bc2e68d4f55a609720e6ac89b8f => generated 297 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:25.055195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.168486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f881b74-2762-4e05-8753-4f94471eb8e0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.200537 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.226523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad087a4b-7ed0-44e2-bee2-18bc89185071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.227853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087a4b-7ed0-44e2-bee2-18bc89185071 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.228128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087a4b-7ed0-44e2-bee2-18bc89185071 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.228605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad087a4b-7ed0-44e2-bee2-18bc89185071 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.242592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad087a4b-7ed0-44e2-bee2-18bc89185071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ad087a4b-7ed0-44e2-bee2-18bc89185071 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:25.252632 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:25.253665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:25.254588 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:25.257274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 126/253] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:25.259100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf67d6-c11c-4710-a19b-25ad9b6f6803 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.259568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf67d6-c11c-4710-a19b-25ad9b6f6803 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.259975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf67d6-c11c-4710-a19b-25ad9b6f6803 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.261878 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 127/254] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:25.262696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c87f7f-c929-45c1-8ee6-509c72a2f82f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.262871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf67d6-c11c-4710-a19b-25ad9b6f6803 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.329270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.330949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.331851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.332634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.334848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] RBAC: Adding query filter params (role.id=a0486ae89dca46fa88a6c73f065ba459, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=15b4f446aa214e7f87b63fc848e2fea1) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:25.335740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.339262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.350426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 128/255] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/role_assignments?user.id=15b4f446aa214e7f87b63fc848e2fea1&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=a0486ae89dca46fa88a6c73f065ba459 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:25.352511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.394140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf67d6-c11c-4710-a19b-25ad9b6f6803 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.443023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa8629-4603-44f4-8283-cb8c823a1712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.443836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8629-4603-44f4-8283-cb8c823a1712 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.444117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8629-4603-44f4-8283-cb8c823a1712 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.444411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa8629-4603-44f4-8283-cb8c823a1712 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.446451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8629-4603-44f4-8283-cb8c823a1712 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.448180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa8629-4603-44f4-8283-cb8c823a1712 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.451350 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 128/256] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:25.452941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.453051 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.453447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.453870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.474047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:25.475493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:25.532705 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:25.566132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12798808-9bb3-454f-b2e6-af7c02256183 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.586526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 129/257] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:25.587684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.703648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.705300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.705755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.706471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.712931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:25.714842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.716518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.727966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4f1259-8387-4d84-99d7-85f47669072c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:25.742876 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 129/258] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:25.744873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.806786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:25.808472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:25.809225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:25.809928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/d5c58bc2e68d4f55a609720e6ac89b8f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:25.814188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] RBAC: Authorizing `identity:create_grant(project_id=33e83e5227cd49ab890ad6a29a885f62, user_id=d5c58bc2e68d4f55a609720e6ac89b8f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:25.818670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:25.853953 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 130/259] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:25 2022] PUT /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/d5c58bc2e68d4f55a609720e6ac89b8f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:25.856062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:25.987217 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.065286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59a723-2850-4d5d-9a1e-59884e359c9d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.081507 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.112160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.113043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.113476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.113752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.126523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:26.135217 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:26.136883 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:26.138565 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 130/260] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:26.146165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.276187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cfc70-34e7-4767-a110-1fa7f8030a5f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.290145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddf1bd7-d0b6-484c-9cd6-e8c091d53d02 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.361473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.363065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.363561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.364032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.365753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:26.366310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.368969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.396837 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 131/261] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:26.399218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.425606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.427005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.427439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.427870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] PATH_INFO: `/v3/users/9ce391d3b3b245bfb3abd6ab38337777` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.429999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] RBAC: Authorizing `identity:get_user(user_id=9ce391d3b3b245bfb3abd6ab38337777)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.432472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.435387 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 131/262] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:25 2022] GET /identity/v3/users/9ce391d3b3b245bfb3abd6ab38337777 => generated 283 bytes in 580 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:26.442457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.501418 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.689284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48814f15-0136-47cf-9305-9ce94ffca2d7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.750388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:26.751305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:26.751589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:26.751863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] PATH_INFO: `/v3/users/9ce391d3b3b245bfb3abd6ab38337777` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:26.753194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] RBAC: Authorizing `identity:get_user(user_id=9ce391d3b3b245bfb3abd6ab38337777)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:26.754678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:26.760779 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 132/263] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/users/9ce391d3b3b245bfb3abd6ab38337777 => generated 283 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:26.765775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:26.868261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488a211-3327-4899-9c57-da26086e9401 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:26.871861 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.983414 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:26.993443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279de77a-4997-4f7f-93a6-65d95acf0c08 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.002649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.003790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.004286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.004822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.071936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.073531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.075113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.075859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.250444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.253858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.260381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.261986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.454309 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 132/264] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 1013 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:52:27.466614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.470842 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:27.518978 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:27.537057 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 133/265] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 772 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:27.559234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.734556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc4e66c-9752-4188-85c1-bbe9e0d8392c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:27.856393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:27.858468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:27.859334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:27.860207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:27.862959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:27.866190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:27.874934 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 133/266] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:27.877127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:27.956180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61341385-64e9-4748-88ed-a90c65578494 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.064931 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.071924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.073201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.073681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.074207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.075996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.077763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.083722 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 134/267] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 526 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:28.089263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.130203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5643d-bed7-442c-94aa-b9c33dd43791 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.207943 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.232748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.234525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.235148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.235787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.237803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=9ce391d3b3b245bfb3abd6ab38337777) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:28.238549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.241628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2405e2be-256e-404a-9c22-8bce87d86454 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.254262 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 134/268] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:27 2022] GET /identity/v3/role_assignments?user.id=9ce391d3b3b245bfb3abd6ab38337777&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:28.257533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370464-22a8-4ad9-b422-ad989c52a00f None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.259213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370464-22a8-4ad9-b422-ad989c52a00f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.260558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a370464-22a8-4ad9-b422-ad989c52a00f None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.269669 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 135/269] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:28 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:28.271472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.272229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.273509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.286424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda449d-0d84-44bc-9430-856d1ae9c8e6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.297421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:28.299096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:28.346169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.346847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.347125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.347395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.348233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] RBAC: Adding query filter params (role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=9ce391d3b3b245bfb3abd6ab38337777) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:28.348573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.350080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.363023 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 135/270] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:28 2022] GET /identity/v3/role_assignments?user.id=9ce391d3b3b245bfb3abd6ab38337777&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:28.382765 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 136/271] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:28.409374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.570668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6203a-5e5b-432c-ac38-90760bb3edfc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.611855 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.619214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2bcf4-b47e-4e71-abcb-4f3d2c08111d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.620490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2bcf4-b47e-4e71-abcb-4f3d2c08111d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.622331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2bcf4-b47e-4e71-abcb-4f3d2c08111d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.623210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2bcf4-b47e-4e71-abcb-4f3d2c08111d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.625009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2bcf4-b47e-4e71-abcb-4f3d2c08111d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.626929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2bcf4-b47e-4e71-abcb-4f3d2c08111d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.629578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 136/272] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:28.636866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:28.782660 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:28.858410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cd319-f071-426f-b0f7-b48104f244ea None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:28.934843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803474bd-20fb-4e53-a68b-50024b8b911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:28.935924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803474bd-20fb-4e53-a68b-50024b8b911d None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:28.936484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803474bd-20fb-4e53-a68b-50024b8b911d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:28.936969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803474bd-20fb-4e53-a68b-50024b8b911d None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:28.938295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803474bd-20fb-4e53-a68b-50024b8b911d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:28.941075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803474bd-20fb-4e53-a68b-50024b8b911d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:28.996839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 137/273] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:28 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:52:29.204013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301086de-788e-4424-9a7b-73a3f8eb4783 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.204832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301086de-788e-4424-9a7b-73a3f8eb4783 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.204832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301086de-788e-4424-9a7b-73a3f8eb4783 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.206227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 137/274] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:29.212514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.213300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.213300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.235580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:29.236869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:29.319499 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 138/275] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:29.334144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7905d-5ad4-4d52-8e75-4176f95b7e9b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.334559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7905d-5ad4-4d52-8e75-4176f95b7e9b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.334722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7905d-5ad4-4d52-8e75-4176f95b7e9b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.336564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 138/276] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:29.343996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:29.345209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.345502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.345742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.370505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:29.371880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:29.412057 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:29.470357 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 139/277] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:29.507341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d46a-216e-473b-abf0-8e3fbc2c8dd8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.514219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:29.572056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.572921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.573198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.573467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.591999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:29.601193 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:29.603026 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:29.604720 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 139/278] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:29.611495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:29.638197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6da3f1-6cf9-49f2-957d-2b7b2e5176c3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.673461 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:29.685116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.685965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.686253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.686602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.700391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:29.712637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:29.715371 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:29.716920 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 140/279] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:29.723319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:29.836992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc4109-9d61-4426-8ef1-d88b94438fe4 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.858210 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:29.903738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:29.904900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:29.905352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:29.905835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:29.907160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:29.907671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:29.910280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:29.910482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2f233-e174-4de3-8a55-5f4e79e57486 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:29.927077 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 140/280] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:29.938014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.005662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.006780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.007176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.007516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.008971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:30.009517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:30.019023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:30.067353 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 141/281] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:30.068791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4bdc0-5cf5-437e-b455-8c6f736ea458 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.074876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.111337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da16f4ca-125e-4d5e-9685-21563859f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.113044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f4ca-125e-4d5e-9685-21563859f443 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.113562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f4ca-125e-4d5e-9685-21563859f443 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.114062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da16f4ca-125e-4d5e-9685-21563859f443 None admin] PATH_INFO: `/v3/users/37d385954a4f47fca8e611f0775f53fb` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.132191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16f4ca-125e-4d5e-9685-21563859f443 None admin] RBAC: Authorizing `identity:get_user(user_id=37d385954a4f47fca8e611f0775f53fb)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:30.134847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da16f4ca-125e-4d5e-9685-21563859f443 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:30.137611 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 141/282] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:29 2022] GET /identity/v3/users/37d385954a4f47fca8e611f0775f53fb => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:30.139607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1e83f-ba15-4ad6-a099-c2a22eabfd4a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.140120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1e83f-ba15-4ad6-a099-c2a22eabfd4a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.140770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a1e83f-ba15-4ad6-a099-c2a22eabfd4a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.143590 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 142/283] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:30.154080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1e83f-ba15-4ad6-a099-c2a22eabfd4a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.176282 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:30.216521 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:30.279218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae3e50c-6e9c-4c3e-b2fd-f593c83e3b88 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.343632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db1081-0b28-48b3-a2af-9fd9becb4de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.345360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1081-0b28-48b3-a2af-9fd9becb4de1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.345903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1081-0b28-48b3-a2af-9fd9becb4de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.346485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db1081-0b28-48b3-a2af-9fd9becb4de1 None admin] PATH_INFO: `/v3/users/d5c58bc2e68d4f55a609720e6ac89b8f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.348877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db1081-0b28-48b3-a2af-9fd9becb4de1 None admin] RBAC: Authorizing `identity:get_user(user_id=d5c58bc2e68d4f55a609720e6ac89b8f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:30.351646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db1081-0b28-48b3-a2af-9fd9becb4de1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:30.355335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 142/284] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/users/d5c58bc2e68d4f55a609720e6ac89b8f => generated 297 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:30.357656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.358121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.358577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.367226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a1e83f-ba15-4ad6-a099-c2a22eabfd4a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.387837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:30.390197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:30.447600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.448269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.448604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.448870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.449758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, user.id=37d385954a4f47fca8e611f0775f53fb, scope.system=all) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:30.450068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:30.451534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:30.459291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 143/285] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/role_assignments?user.id=37d385954a4f47fca8e611f0775f53fb&scope.system=all&role.id=1b8336fe2a2642b387272398a640a960 => generated 226 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:30.460176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.504851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 143/286] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:30.527910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.581421 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:30.671779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e673e-1fbe-4529-a1e6-cbfd5212dc54 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.676949 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:30.692773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3021b4d3-f63b-4aef-8a6b-43e233682448 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:30.720634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.721467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.721765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.722034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:30.742065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:30.750219 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:30.752056 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:30.754310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:30.758331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 144/287] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:30.761288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:30.810389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:30.811968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:30.813175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:30.815314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.010216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.013709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.049606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c204513-ac93-41b4-9a0c-c85f2065b50b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.067056 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:31.140117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.140716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.141000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.141279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.142046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:31.142353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.143773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.164326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 145/288] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:31.169672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.225146 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:31.239975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 144/289] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 780 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:31.251125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.408508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a43a6b8-833f-4d7b-8422-06407f1b91e3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.482145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.484147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.484941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.485695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] PATH_INFO: `/v3/users/15b4f446aa214e7f87b63fc848e2fea1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.489345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] RBAC: Authorizing `identity:get_user(user_id=15b4f446aa214e7f87b63fc848e2fea1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.492398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.496722 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 146/290] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/users/15b4f446aa214e7f87b63fc848e2fea1 => generated 297 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:31.502793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.538648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e6ce77-2a3b-4236-aaa1-0381440d7c53 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.581431 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:31.639393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.639393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.639393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.639743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.640868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.642375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.647740 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 145/291] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:31.650380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.693451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d946b2bf-fe78-48ba-a814-21fdb8c4e4ae None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.767322 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:31.781074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3b80-1881-4442-a6b4-e2e20880c9f0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:31.817112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cc031-0f39-4285-a788-b5f7f4129e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.818004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc031-0f39-4285-a788-b5f7f4129e16 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.818298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc031-0f39-4285-a788-b5f7f4129e16 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.818540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cc031-0f39-4285-a788-b5f7f4129e16 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.819979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:31.820890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.821362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.821841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.822881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=d5c58bc2e68d4f55a609720e6ac89b8f) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:31.823384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.825209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.825338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc031-0f39-4285-a788-b5f7f4129e16 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:31.826806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cc031-0f39-4285-a788-b5f7f4129e16 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:31.829100 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 147/292] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:31.834050 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 146/293] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:31 2022] GET /identity/v3/role_assignments?user.id=d5c58bc2e68d4f55a609720e6ac89b8f&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=1b8336fe2a2642b387272398a640a960 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:31.835029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc292-b16d-4caa-9f68-4e2f131297ff None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.835316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc292-b16d-4caa-9f68-4e2f131297ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.835594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedc292-b16d-4caa-9f68-4e2f131297ff None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.835837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:31.837320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 148/294] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:31.843076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:31.843391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:31.843628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:31.861945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:31.863612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:31.994068 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 149/295] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:32.020222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.034429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e1c14f-6e7a-4651-ba4a-79fef250d04b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.062885 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.089684 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.105241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f927b8-77a2-4cac-afbb-9472d3594f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.106199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f927b8-77a2-4cac-afbb-9472d3594f7b None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.106476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f927b8-77a2-4cac-afbb-9472d3594f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.106746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f927b8-77a2-4cac-afbb-9472d3594f7b None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/15b4f446aa214e7f87b63fc848e2fea1/roles/a0486ae89dca46fa88a6c73f065ba459` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.108877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f927b8-77a2-4cac-afbb-9472d3594f7b None admin] RBAC: Authorizing `identity:create_grant(project_id=33e83e5227cd49ab890ad6a29a885f62, user_id=15b4f446aa214e7f87b63fc848e2fea1, role_id=a0486ae89dca46fa88a6c73f065ba459)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.110477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f927b8-77a2-4cac-afbb-9472d3594f7b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.132006 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 147/296] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:52:31 2022] PUT /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62/users/15b4f446aa214e7f87b63fc848e2fea1/roles/a0486ae89dca46fa88a6c73f065ba459 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:32.166023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2d4078-fd9e-48c8-ae1b-8fd18b808088 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.184159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7cee-b640-4ef9-b9fd-a59d370a607d None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.184528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7cee-b640-4ef9-b9fd-a59d370a607d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.184733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908d7cee-b640-4ef9-b9fd-a59d370a607d None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.186493 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 148/297] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:32.193840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.194183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.194389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.218966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:32.220420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:32.221413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.222602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.223123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.223603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.237548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:32.246440 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:32.247388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:32.248234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:32.251250 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 150/298] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:32.257044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.334103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 149/299] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:32.358324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.421191 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.429782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2defaab3-477a-4152-9fd0-8508ff9c98f1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.492800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.494338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.495008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.495697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.497484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:32.498259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.501346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.517158 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 151/300] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:32.526995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.534367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78075e-5aaa-4703-823b-fe1eafaae86a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.575320 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.617701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.619089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.619571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.620054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.622592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.625452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.628832 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 150/301] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:32.635417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.650886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebdd230-ecfe-41fe-ad6f-eafc85394600 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.688221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.689155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.689438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.689713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] PATH_INFO: `/v3/users/af720d9068d246d0aa6983b114d7aeb2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.706334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] RBAC: Authorizing `identity:get_user(user_id=af720d9068d246d0aa6983b114d7aeb2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.707977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.710435 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 152/302] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:32 2022] GET /identity/v3/users/af720d9068d246d0aa6983b114d7aeb2 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:32.720223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:32.747064 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:32.833991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877772c3-e870-48da-8a21-31f6f95bfda7 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.847459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ed470c-87bc-4bf9-b67e-a899b764af87 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:32.881478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce4e74-6d68-422d-909f-aaf2f89dda85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.882173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4e74-6d68-422d-909f-aaf2f89dda85 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.882459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4e74-6d68-422d-909f-aaf2f89dda85 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.882745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce4e74-6d68-422d-909f-aaf2f89dda85 None admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.883457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4e74-6d68-422d-909f-aaf2f89dda85 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.884970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce4e74-6d68-422d-909f-aaf2f89dda85 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.905171 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 151/303] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Jul 19 10:52:32 2022] POST /identity/v3/groups => generated 229 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:52:32.919839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:32.920662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.920951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.921365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.922285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] RBAC: Adding query filter params (role.id=a0486ae89dca46fa88a6c73f065ba459, user.id=af720d9068d246d0aa6983b114d7aeb2, scope.system=all) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:32.922607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:32.924221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a436b78-9e84-4527-8ed5-ddc6d222b3bc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:32.931519 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 153/304] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jul 19 10:52:32 2022] GET /identity/v3/role_assignments?user.id=af720d9068d246d0aa6983b114d7aeb2&scope.system=all&role.id=a0486ae89dca46fa88a6c73f065ba459 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:32.964171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aacaa-6638-4926-8789-090802804e2b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.964513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aacaa-6638-4926-8789-090802804e2b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.964771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aacaa-6638-4926-8789-090802804e2b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.967114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 152/305] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:32.975237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:32.975560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:32.975793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:32.996683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:32.997996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:33.100380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 154/306] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:33.140971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aacaa-6638-4926-8789-090802804e2b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.233490 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.344169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aacaa-6638-4926-8789-090802804e2b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.395785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.396949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.397411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.397879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.410815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:33.419526 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:33.420482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:33.421357 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:33.424103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 153/307] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:33.432749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.446590 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.545131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf339a4-64b3-463b-88dc-6ba28893b923 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.583106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.584069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.584529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.584948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.585868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:33.586325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.587867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.597983 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 155/308] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:33.604548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.736736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99142c89-e2eb-4068-b592-b034ffc19eac None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.740314 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.786488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a8ca2-ec06-4dcf-93c8-572fc88f22e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.788037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a8ca2-ec06-4dcf-93c8-572fc88f22e5 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.788531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a8ca2-ec06-4dcf-93c8-572fc88f22e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.788949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a8ca2-ec06-4dcf-93c8-572fc88f22e5 None admin] PATH_INFO: `/v3/users/37d385954a4f47fca8e611f0775f53fb` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.790827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a8ca2-ec06-4dcf-93c8-572fc88f22e5 None admin] RBAC: Authorizing `identity:get_user(user_id=37d385954a4f47fca8e611f0775f53fb)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.793663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a8ca2-ec06-4dcf-93c8-572fc88f22e5 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.796739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 154/309] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:33 2022] GET /identity/v3/users/37d385954a4f47fca8e611f0775f53fb => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:33.805192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:33.894848 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:33.930131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e07e43-ec7f-4e76-9f6c-6e440026bdcf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:33.967457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caebe18-28a3-4120-b567-bd7e0349f7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:33.968732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebe18-28a3-4120-b567-bd7e0349f7e3 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:33.969244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebe18-28a3-4120-b567-bd7e0349f7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:33.969712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caebe18-28a3-4120-b567-bd7e0349f7e3 None admin] PATH_INFO: `/v3/system/users/37d385954a4f47fca8e611f0775f53fb/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:33.971463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caebe18-28a3-4120-b567-bd7e0349f7e3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=37d385954a4f47fca8e611f0775f53fb, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:33.973133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caebe18-28a3-4120-b567-bd7e0349f7e3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:33.984319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 156/310] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Jul 19 10:52:33 2022] PUT /identity/v3/system/users/37d385954a4f47fca8e611f0775f53fb/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:34.776815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8923f-f0bb-4e9a-80b3-c3806949bc91 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.777384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8923f-f0bb-4e9a-80b3-c3806949bc91 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.777384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8923f-f0bb-4e9a-80b3-c3806949bc91 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.779142 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 155/311] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:34.785129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e89c-1069-4ff7-aa34-c4ec8c5a15ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:34.786164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e89c-1069-4ff7-aa34-c4ec8c5a15ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:34.786650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562e89c-1069-4ff7-aa34-c4ec8c5a15ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:34.813730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0562e89c-1069-4ff7-aa34-c4ec8c5a15ba None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:34.816123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0562e89c-1069-4ff7-aa34-c4ec8c5a15ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:34.925959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 157/312] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:34.965511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8923f-f0bb-4e9a-80b3-c3806949bc91 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.016217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe603-6a01-4873-b13a-9b5a22fc557a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.017215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe603-6a01-4873-b13a-9b5a22fc557a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.017998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe603-6a01-4873-b13a-9b5a22fc557a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.021125 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 158/313] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:35.026790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.027505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.028042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.046898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:35.048510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:35.108493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8923f-f0bb-4e9a-80b3-c3806949bc91 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.118874 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.136673 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 159/314] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:35.153046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.174686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.176023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.176569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.177120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.197645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:35.214081 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:35.215062 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:35.215906 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:35.217057 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 156/315] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:35.225700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.273566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb553ab6-7046-4433-9f7e-8154fbc271c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.292861 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.322540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.323802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.324336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.325114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.341086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:35.351316 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:35.353266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:35.354057 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:35.359953 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 160/316] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:35.361369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.441541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef1023-1d13-4a03-a6c4-4e9bfce90c66 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.456291 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.503065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.504488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.505082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.505671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.506450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:35.507063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.510224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.512369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ac8a4-fb27-4c00-a009-71c3b33c518e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.531650 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 157/317] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:35.533319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.566219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.567168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.567666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.568146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.569446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:35.569983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.572609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.592647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 161/318] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:35.594321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.671744 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.681415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82beca1a-3ea7-4a72-8c3c-220e8d26eb44 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.727665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6158a53-fea0-4768-a734-c0af0c56a283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.728979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158a53-fea0-4768-a734-c0af0c56a283 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.729415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158a53-fea0-4768-a734-c0af0c56a283 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.729762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6158a53-fea0-4768-a734-c0af0c56a283 None admin] PATH_INFO: `/v3/users/15b4f446aa214e7f87b63fc848e2fea1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.731383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158a53-fea0-4768-a734-c0af0c56a283 None admin] RBAC: Authorizing `identity:get_user(user_id=15b4f446aa214e7f87b63fc848e2fea1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.733391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6158a53-fea0-4768-a734-c0af0c56a283 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.734535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42935a-2bf4-4591-aa7d-23de596e0340 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.742342 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 158/319] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/users/15b4f446aa214e7f87b63fc848e2fea1 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:35.742342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298117-8aef-48c7-b27d-d22f20ca7ccf None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.742342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298117-8aef-48c7-b27d-d22f20ca7ccf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.742342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31298117-8aef-48c7-b27d-d22f20ca7ccf None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.742342 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 159/320] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:35.743388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298117-8aef-48c7-b27d-d22f20ca7ccf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.766093 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:35.786162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5919ad5-9aad-4e79-82cb-a3fc0e6e29d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:35.787124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919ad5-9aad-4e79-82cb-a3fc0e6e29d0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.787371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919ad5-9aad-4e79-82cb-a3fc0e6e29d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.787655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5919ad5-9aad-4e79-82cb-a3fc0e6e29d0 None admin] PATH_INFO: `/v3/users/af720d9068d246d0aa6983b114d7aeb2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.788920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5919ad5-9aad-4e79-82cb-a3fc0e6e29d0 None admin] RBAC: Authorizing `identity:get_user(user_id=af720d9068d246d0aa6983b114d7aeb2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:35.790371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5919ad5-9aad-4e79-82cb-a3fc0e6e29d0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:35.792306 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 162/321] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/users/af720d9068d246d0aa6983b114d7aeb2 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:35.798164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:35.798811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:35.798811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:35.817761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:35.819939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:35.917580 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 163/322] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:35.917580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:35.945480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31298117-8aef-48c7-b27d-d22f20ca7ccf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:35.999333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.000019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.000306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.000563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.040234 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.061771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd85b0-7529-479e-9748-fe60c0386537 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.082763 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.092627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.094143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.104751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.105641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.105992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.106300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] PATH_INFO: `/v3/system/users/af720d9068d246d0aa6983b114d7aeb2/roles/a0486ae89dca46fa88a6c73f065ba459` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.107884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=af720d9068d246d0aa6983b114d7aeb2, role_id=a0486ae89dca46fa88a6c73f065ba459)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.109326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.124394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 164/323] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Jul 19 10:52:35 2022] PUT /identity/v3/system/users/af720d9068d246d0aa6983b114d7aeb2/roles/a0486ae89dca46fa88a6c73f065ba459 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:36.124394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.278842 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 160/324] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:36.285342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.338826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3d975-1f5c-4dd2-b5db-dce51cc37106 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.373891 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.387559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee961e7e-f5bc-4ee0-ad35-6456c239137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.388394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961e7e-f5bc-4ee0-ad35-6456c239137a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.388680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961e7e-f5bc-4ee0-ad35-6456c239137a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.388958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee961e7e-f5bc-4ee0-ad35-6456c239137a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.390534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee961e7e-f5bc-4ee0-ad35-6456c239137a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.392020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee961e7e-f5bc-4ee0-ad35-6456c239137a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.393830 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 165/325] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.399874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeac601-8803-4227-b037-d6a0cdbefb69 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.400143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeac601-8803-4227-b037-d6a0cdbefb69 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.400691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeac601-8803-4227-b037-d6a0cdbefb69 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.403085 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 166/326] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:36.403085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeac601-8803-4227-b037-d6a0cdbefb69 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.437698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0daf6-30b4-403b-bf63-dce82189ba47 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.459534 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.487692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299b5627-3a48-4101-bf86-a19eca393aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.488608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5627-3a48-4101-bf86-a19eca393aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.488894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5627-3a48-4101-bf86-a19eca393aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.489165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299b5627-3a48-4101-bf86-a19eca393aa3 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.490416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5627-3a48-4101-bf86-a19eca393aa3 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.491869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299b5627-3a48-4101-bf86-a19eca393aa3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.493856 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 161/327] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.494891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.495175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.495449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.521482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:36.522783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:36.552115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeac601-8803-4227-b037-d6a0cdbefb69 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.596975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 162/328] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:36.597737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.628209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.629846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.630647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.631392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.632734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.635250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.666472 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 167/329] 10.222.0.15 () {60 vars in 1134 bytes} [Tue Jul 19 10:52:36 2022] POST /identity/v3/groups => generated 226 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:52:36.669274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:36.688964 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.759248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85402e44-bc1a-496e-a56a-48196d3bb40a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.825807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.827603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.828303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.829060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.831194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] RBAC: Adding query filter params (role.id=a0486ae89dca46fa88a6c73f065ba459, scope.project.id=33e83e5227cd49ab890ad6a29a885f62, user.id=15b4f446aa214e7f87b63fc848e2fea1) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:36.832011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:36.835104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:36.852923 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 163/330] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/role_assignments?user.id=15b4f446aa214e7f87b63fc848e2fea1&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=a0486ae89dca46fa88a6c73f065ba459 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:36.861769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c288ecf-3421-4fc6-b099-fd6b63a2534e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:36.877177 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:36.905930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:36.906770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:36.907054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:36.907336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:36.921710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:36.929757 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:36.931624 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:36.934632 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 168/331] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:36.947258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.114165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b991022-6276-47fd-bfe4-6892875b5a5c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.144522 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:37.161146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.162805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.163308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.163805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.165293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:37.165845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.168674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.183654 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 164/332] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.189522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.367070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225cb235-0a54-4163-83cb-03978537fe81 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.430517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6958ec1b-d9a9-48c7-be3b-01bed0c9f992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.432054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ec1b-d9a9-48c7-be3b-01bed0c9f992 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.432604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ec1b-d9a9-48c7-be3b-01bed0c9f992 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.432941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6958ec1b-d9a9-48c7-be3b-01bed0c9f992 None admin] PATH_INFO: `/v3/users/37d385954a4f47fca8e611f0775f53fb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.435318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958ec1b-d9a9-48c7-be3b-01bed0c9f992 None admin] RBAC: Authorizing `identity:get_user(user_id=37d385954a4f47fca8e611f0775f53fb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.438163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6958ec1b-d9a9-48c7-be3b-01bed0c9f992 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.441616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 169/333] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/users/37d385954a4f47fca8e611f0775f53fb => generated 293 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:37.448432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:37.574391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc96b12-a53f-4885-84cf-7d05838aba3d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:37.610936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:37.611612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:37.611896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:37.612171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:37.613051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] RBAC: Adding query filter params (role.id=1b8336fe2a2642b387272398a640a960, user.id=37d385954a4f47fca8e611f0775f53fb, scope.system=all) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:37.613367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:37.614854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6de043-3d9c-4d6a-921c-e664e7a801b9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:37.628496 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 165/334] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jul 19 10:52:37 2022] GET /identity/v3/role_assignments?user.id=37d385954a4f47fca8e611f0775f53fb&scope.system=all&role.id=1b8336fe2a2642b387272398a640a960 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:38.367006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf89e-ff7b-403c-a148-02266c26d5c1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.367737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf89e-ff7b-403c-a148-02266c26d5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.367737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bf89e-ff7b-403c-a148-02266c26d5c1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.369383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 170/335] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:38.377536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.378154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.378154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.403673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:38.404942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:38.466694 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:38.502838 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 166/336] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:38.529273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf89e-ff7b-403c-a148-02266c26d5c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:38.584608 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:38.688593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bf89e-ff7b-403c-a148-02266c26d5c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.743974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.744884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.745173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.745454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.762764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:38.771140 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:38.772151 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 19 10:52:38.773411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:38.776853 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 171/337] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:38.784450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:38.932489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cc8fb-d436-4d5d-9e37-0386eb7b9914 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:38.984079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:38.985207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:38.985711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:38.986181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:38.987148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:38.987651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:38.989296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:38.999527 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 167/338] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:39.005596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:39.164020 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:39.173153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66421f3c-6661-428d-9b77-8f0d2606cd07 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:39.216410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9bbef-6223-4e1b-8538-3828813df30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:39.217322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9bbef-6223-4e1b-8538-3828813df30f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.217602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9bbef-6223-4e1b-8538-3828813df30f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.217877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9bbef-6223-4e1b-8538-3828813df30f None admin] PATH_INFO: `/v3/users/af720d9068d246d0aa6983b114d7aeb2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.219305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9bbef-6223-4e1b-8538-3828813df30f None admin] RBAC: Authorizing `identity:get_user(user_id=af720d9068d246d0aa6983b114d7aeb2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:39.220840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9bbef-6223-4e1b-8538-3828813df30f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:39.222911 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 172/339] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:52:39 2022] GET /identity/v3/users/af720d9068d246d0aa6983b114d7aeb2 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:39.228641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:39.325325 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:39.386655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4f93e-8712-492c-bdca-2c69769105b2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:39.434662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:39.435346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.435631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.435911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.436790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] RBAC: Adding query filter params (role.id=a0486ae89dca46fa88a6c73f065ba459, user.id=af720d9068d246d0aa6983b114d7aeb2, scope.system=all) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:39.437107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:39.438663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adddea9-97fd-4dce-9772-21bc1f7530b4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:39.456084 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 168/340] 10.222.0.15 () {56 vars in 1308 bytes} [Tue Jul 19 10:52:39 2022] GET /identity/v3/role_assignments?user.id=af720d9068d246d0aa6983b114d7aeb2&scope.system=all&role.id=a0486ae89dca46fa88a6c73f065ba459 => generated 510 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:39.648034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dfe4-3d3e-4033-9362-d8ac62792586 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.648562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dfe4-3d3e-4033-9362-d8ac62792586 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.648562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533dfe4-3d3e-4033-9362-d8ac62792586 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.650334 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 173/341] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:39.656968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.657272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.657525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:39.680571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:39.681793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:39.768066 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 169/342] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:39.807778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dfe4-3d3e-4033-9362-d8ac62792586 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:39.948724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533dfe4-3d3e-4033-9362-d8ac62792586 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:39.992788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:39.993604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:39.993887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:39.994167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.008084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:40.016718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:40.017637 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:40.018414 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 174/343] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:40.023948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.100972 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.159051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522fc0b-823f-41a4-becb-dcc3ec2543e9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.198116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.198870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.199094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.199369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.200187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:40.200530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.201949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b607-c7c4-4798-b626-259f30d63c44 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.212608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 170/344] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:40.218137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.255444 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.298109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497b149-e90b-4112-a79a-e7613ac36f31 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.298583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497b149-e90b-4112-a79a-e7613ac36f31 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.299039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497b149-e90b-4112-a79a-e7613ac36f31 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.301560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 171/345] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:40.309909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.310553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.311056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.337832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:40.339369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:40.366061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f2562-2e54-49c2-846a-7b412ea32c8e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.413827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.414525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.415269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.415939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.499090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.501568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.507043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 172/346] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:40.533031 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.578345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.614101 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 175/347] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:40.620805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.634162 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.734387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0b0c1-94e0-4235-a211-4fd654575917 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.738585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b7fbe-dcc3-4000-b896-c92162feebf5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:40.774639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e978d1-74e2-4afd-a6f7-a4d2f83fdf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.775825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e978d1-74e2-4afd-a6f7-a4d2f83fdf08 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.776290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e978d1-74e2-4afd-a6f7-a4d2f83fdf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.780679 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.783215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e978d1-74e2-4afd-a6f7-a4d2f83fdf08 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.784252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e978d1-74e2-4afd-a6f7-a4d2f83fdf08 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:40.785769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:40.785929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e978d1-74e2-4afd-a6f7-a4d2f83fdf08 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:40.786943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.787401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.787840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.788017 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 176/348] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:40.792375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8519ca-be5e-4f2d-b89b-5d5b5d9d6887 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.792375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8519ca-be5e-4f2d-b89b-5d5b5d9d6887 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.792375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8519ca-be5e-4f2d-b89b-5d5b5d9d6887 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.792375 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 177/349] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:40.797915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:40.798251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:40.798475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:40.810279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:40.819568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:40.820952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:40.821315 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:40.822167 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:40.822962 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:40.826706 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 173/350] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:40.828053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.944778 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:40.957703 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 178/351] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:40.958680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:40.997249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ed76d0-5764-4b92-8b55-efc72c1037fd None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.079735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.081454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.081947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.082414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.094880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.097960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.102700 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 174/352] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:41.103936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83915e68-4fc2-4ba5-9ff7-3e8b45b85031 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.104195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.129702 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.145116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.145798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.146086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.146366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.147124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:41.147435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.148862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.159282 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 179/353] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:41.160183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.281225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c880b-8881-4b2a-af53-d6a48f6e2dae None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.352763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.355970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.357088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.357844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.377233 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.379000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6756d79-3e8e-497c-a468-e9f060c79f06 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.388853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:41.407116 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:41.408928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:41.410463 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 175/354] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:41.412726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.471110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.472276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.472863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.473351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.474949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=3cf690794a2b455785424e72c672b5a6) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:41.475273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.477542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.490110 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 180/355] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=1b8336fe2a2642b387272398a640a960 => generated 260 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:41.491647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.611452 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.619268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecf9d2-133d-4713-9225-e959867c7f9d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.737505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cdca99-29fa-4d98-ae7d-9f34352e3a89 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:41.773574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65b0f9-e4a4-4a25-978f-9fc04565800b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.774735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b0f9-e4a4-4a25-978f-9fc04565800b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.775191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b0f9-e4a4-4a25-978f-9fc04565800b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.775708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65b0f9-e4a4-4a25-978f-9fc04565800b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.813298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:41.814457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:41.814960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:41.816145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:41.817714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] RBAC: Adding query filter params (name=member) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:41.818271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.821062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:41.841991 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 181/356] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:41.850468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:41.944980 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:41.948618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65b0f9-e4a4-4a25-978f-9fc04565800b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:41.950139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65b0f9-e4a4-4a25-978f-9fc04565800b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.033304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bfdf16-e40e-441b-8f60-21062d511866 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.081854 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.089971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d2dec-9dda-4952-b289-fe22b03137d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.091151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2dec-9dda-4952-b289-fe22b03137d2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.091442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2dec-9dda-4952-b289-fe22b03137d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.091720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d2dec-9dda-4952-b289-fe22b03137d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.109903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 176/357] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:42.111385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a7ed-a42b-4673-b67c-71697fc6f54e None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.111677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a7ed-a42b-4673-b67c-71697fc6f54e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.111955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8a7ed-a42b-4673-b67c-71697fc6f54e None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.113881 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 177/358] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:42.116536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a7ed-a42b-4673-b67c-71697fc6f54e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.200514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d2dec-9dda-4952-b289-fe22b03137d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.202558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d2dec-9dda-4952-b289-fe22b03137d2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.254004 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.258581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8a7ed-a42b-4673-b67c-71697fc6f54e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.304375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf069aa2-aac6-46e1-bd98-84bb7578ae11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.305288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069aa2-aac6-46e1-bd98-84bb7578ae11 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.305567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069aa2-aac6-46e1-bd98-84bb7578ae11 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.305848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf069aa2-aac6-46e1-bd98-84bb7578ae11 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.307147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf069aa2-aac6-46e1-bd98-84bb7578ae11 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.308687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf069aa2-aac6-46e1-bd98-84bb7578ae11 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.311178 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 178/359] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:42.312743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.313055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.313289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.333861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:42.335234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:42.365278 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 182/360] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:42.368963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a107-b14c-4b17-92d5-f48087c03a06 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.369242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a107-b14c-4b17-92d5-f48087c03a06 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.369548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a107-b14c-4b17-92d5-f48087c03a06 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.372772 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 183/361] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:42.374029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a107-b14c-4b17-92d5-f48087c03a06 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.391813 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.467252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 179/362] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:42.468818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.580693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a107-b14c-4b17-92d5-f48087c03a06 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.626127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeac85c-fa8d-42b7-943b-5dbbc226f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.627043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeac85c-fa8d-42b7-943b-5dbbc226f8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.627320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeac85c-fa8d-42b7-943b-5dbbc226f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.627598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeac85c-fa8d-42b7-943b-5dbbc226f8c4 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.630002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeac85c-fa8d-42b7-943b-5dbbc226f8c4 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.630401 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.631771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeac85c-fa8d-42b7-943b-5dbbc226f8c4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.633744 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 184/363] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:42.635094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.635384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.635730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.646668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3b56db-a8d4-476c-97f1-d01a4fd5980d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.660840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:42.662445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:42.715240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.716964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.717510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.717949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.720406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.724732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:42.728124 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 180/364] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:42.729718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.779982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 185/365] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:42.781680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:42.803830 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:42.930264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09916923-1e86-41b9-af2d-3e8b8a09bbdb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.936418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5003a97-296f-4d63-ab43-b07c7de924cd None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:42.981486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:42.982631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:42.983125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:42.983686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:42.985377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=3cf690794a2b455785424e72c672b5a6) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:42.985937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:42.992164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.006486 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 186/366] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.007542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.008735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.009226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.009695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.013947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.029719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:43.038855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:43.039807 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:43.040645 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:43.043584 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 181/367] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:43.049922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.087851 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.169642 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.194016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377577c7-58c6-42b1-ac22-a377870d576a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.229972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a45017a-7d7b-4250-9455-6f5b9e594139 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.233820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.234982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.235484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.235956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.250494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:43.260088 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:43.262169 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:43.263024 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:43.265896 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 182/368] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:43.267809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.310681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.311965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.312273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.312609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.317784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.324166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.328564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 187/369] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.331810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.406357 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.435630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef45a2d-3e3c-4a3a-a11c-4c7f375a6709 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.525490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.526842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.527778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.529152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.531169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:43.532123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.536637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.540315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5493b5-665d-48f0-9901-0829c2602693 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.552966 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 183/370] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.554019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.615800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.616694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.617079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.617454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.618396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:43.618846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.620383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.631623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 188/371] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.633628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.637071 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.774178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1b886b-2a1e-4c18-aef3-22f771b033d2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.804656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4add9a-fb2f-4dbb-b0a4-20fca0954dbf None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:43.820495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.821501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.821501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.821961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.898037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:43.899169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:43.899653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:43.900141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:43.903140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=33e83e5227cd49ab890ad6a29a885f62) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:43.904128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.908373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.920996 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 184/372] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=1b8336fe2a2642b387272398a640a960 => generated 260 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:43.921886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:43.933909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:43.937629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:43.941603 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:43.944783 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.226491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeaf05-0284-44a0-9e7c-02dfb0ee1d23 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.235654 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 189/373] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:44.250196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.302222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.303381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.303885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.304375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.402197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe901d90-9880-4ebd-8f64-2aae1f16bef6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.407372 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.438146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.440961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.464055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9bc4e-3565-4107-9d01-508b5481171b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.465718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bc4e-3565-4107-9d01-508b5481171b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.466002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bc4e-3565-4107-9d01-508b5481171b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.466327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9bc4e-3565-4107-9d01-508b5481171b None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.467683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9bc4e-3565-4107-9d01-508b5481171b None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.469258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9bc4e-3565-4107-9d01-508b5481171b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.471592 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 190/374] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:44.473203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526453f-d1d6-4c60-b994-c04900b61b6e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.473666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526453f-d1d6-4c60-b994-c04900b61b6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.474095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526453f-d1d6-4c60-b994-c04900b61b6e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.475643 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 191/375] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:44.481963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.482498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.482782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.484918 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.503157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:44.504795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:44.616606 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 192/376] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:44.618743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.681152 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 185/377] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 759 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:44.683032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.796017 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.803262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b9b03-8ce8-4734-81b5-3276bac57f86 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.860900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cd4f4b-2776-41f2-801e-3e3495f79c46 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:44.864140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.866458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.867205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.868043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.870370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:44.873647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:44.877214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 193/378] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:44.879023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:44.880776 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:44.918894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:44.919767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:44.920041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:44.920321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:44.933523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:44.941667 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:44.943432 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 186/379] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:44.945070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.055238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11334958-bb00-4d9d-aac2-312aa45ea9f5 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.078621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b18ee8-5e45-4a7e-b092-46a5539ec407 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.092972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.093647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.093931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.094198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.095359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=33e83e5227cd49ab890ad6a29a885f62) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:45.095359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.097491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.103995 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 187/380] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.104871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.145060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.146390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.146823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.147303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] PATH_INFO: `/v3/projects/4d370718d88b47738f450251a884cc98` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.149124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] RBAC: Authorizing `identity:get_project(project_id=4d370718d88b47738f450251a884cc98)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.152839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.158163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 194/381] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:44 2022] GET /identity/v3/projects/4d370718d88b47738f450251a884cc98 => generated 344 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.171235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.196612 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.251263 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.342786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95cb7a-d21f-4fed-abce-e7eef4bcccde None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.363370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817befa5-ee63-42a1-bfc9-a090b5514fa2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.410071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.411237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.411648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.411960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] PATH_INFO: `/v3/groups/fe093b7a2ed346918559f651ba4cd471` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.427174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] RBAC: Authorizing `identity:get_group(group_id=fe093b7a2ed346918559f651ba4cd471)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.428716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.430870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 195/382] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/groups/fe093b7a2ed346918559f651ba4cd471 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.437831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.444124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.445116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.445606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.445988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.447044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:45.447303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.449196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.474449 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 188/383] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.479868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.661939 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.665287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07d830-97b9-4511-871a-6818c6badf61 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.680759 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:45.688494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a080d-fcad-428e-81c1-59f47cc7f506 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:45.704266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.704881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.705157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.705426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.706274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] RBAC: Adding query filter params (group.id=fe093b7a2ed346918559f651ba4cd471, role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=4d370718d88b47738f450251a884cc98) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:45.706585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.708527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.716337 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 196/384] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/role_assignments?group.id=fe093b7a2ed346918559f651ba4cd471&scope.project.id=4d370718d88b47738f450251a884cc98&role.id=c71870b3a21e455080504ab36dac896f => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:45.737477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:45.738428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:45.738712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:45.738988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:45.740395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:45.741900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:45.743976 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 189/385] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:45.749792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:45.930433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adac58-5dbd-4812-8d32-d5bcb58c743d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.006615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8656ef-de39-4b01-973c-5ecec1c995dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.008070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8656ef-de39-4b01-973c-5ecec1c995dc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.008531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8656ef-de39-4b01-973c-5ecec1c995dc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.008964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8656ef-de39-4b01-973c-5ecec1c995dc None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.013843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8656ef-de39-4b01-973c-5ecec1c995dc None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.016536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8656ef-de39-4b01-973c-5ecec1c995dc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.019885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 197/386] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:45 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:46.026496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.066832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1f82c-2388-422e-bdb0-bdad5e61488a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.067251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1f82c-2388-422e-bdb0-bdad5e61488a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.067703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1f82c-2388-422e-bdb0-bdad5e61488a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.070048 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 198/387] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:46.077389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.078162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.078647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.101053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:46.103757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:46.184890 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.282047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 199/388] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:46.322891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8e308e-ae07-4ef7-b125-c926cb1824fd None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.325921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.429453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f29f96-2911-4b99-9788-c8fa7b4158a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.430790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f29f96-2911-4b99-9788-c8fa7b4158a0 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.431264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f29f96-2911-4b99-9788-c8fa7b4158a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.431765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f29f96-2911-4b99-9788-c8fa7b4158a0 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6/groups/df78f7afd1dc4d739607639811d94179/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.442221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f29f96-2911-4b99-9788-c8fa7b4158a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cf690794a2b455785424e72c672b5a6, group_id=df78f7afd1dc4d739607639811d94179, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.444860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f29f96-2911-4b99-9788-c8fa7b4158a0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.496054 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 190/389] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jul 19 10:52:46 2022] PUT /identity/v3/projects/3cf690794a2b455785424e72c672b5a6/groups/df78f7afd1dc4d739607639811d94179/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:46.511299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5ae77-a907-4e62-9efe-3cd9fb1aa110 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.511746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5ae77-a907-4e62-9efe-3cd9fb1aa110 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.512170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff5ae77-a907-4e62-9efe-3cd9fb1aa110 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.515137 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 191/390] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:46.539675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.540083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.540470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.582393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:46.584587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:46.611318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1745232e-8eab-483b-b750-f41ce3586785 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.633500 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.675648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.676511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.676793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.677061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.698558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:46.708148 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:46.709149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:46.709919 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 200/391] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:46.717052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.738226 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 192/392] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:52:46.764836 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:46.781566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:46.860101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c1137a-d005-4db3-bb2c-420dfe7c2191 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:46.936378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:46.936378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:46.936378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:46.936378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:46.937754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:46.937754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:46.937754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:46.956530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 201/393] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:46.966165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.000126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e92df7-5cb2-4304-aaaa-25d8c1f57e98 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.105128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.106772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.107316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.107801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.126430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:47.137312 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:47.140384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:47.141626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:47.142410 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:47.150472 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 193/394] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:47.152662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857076e1-2c93-4482-83e9-74814c5a2e3b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.160416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.200883 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.223442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.224610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.225108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.225732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.227960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.234791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.236575 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 202/395] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:46 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:47.243129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.360969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728b9a9-405c-46ad-8ee3-77703e1ae207 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.415044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.416111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.416626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.417103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.418101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:47.418611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.420335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.436395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169c3277-0d07-4fb8-8a9a-db92ede053ed None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.446181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 194/396] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:47.454067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.509963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.511595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.512086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.512616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.515015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.518444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.524631 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 203/397] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:47.531919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.573373 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.592840 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:47.617935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5390d-e35f-451c-8bcb-8aad974e0993 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.698354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.699480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.699909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.700327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.701915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.703586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.712947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 195/398] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:47.722313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:47.723579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774453e2-c69f-4762-9d1d-da04efd1d91b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.786799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.788831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.789583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.790321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6/groups/df78f7afd1dc4d739607639811d94179/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.795116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] RBAC: Authorizing `identity:create_grant(project_id=3cf690794a2b455785424e72c672b5a6, group_id=df78f7afd1dc4d739607639811d94179, role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.798237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:47.828567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 204/399] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jul 19 10:52:47 2022] PUT /identity/v3/projects/3cf690794a2b455785424e72c672b5a6/groups/df78f7afd1dc4d739607639811d94179/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:47.941004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964962d0-488f-47f9-aee0-f316864497ba None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:47.990746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25127e4b-f00c-46ac-aa8c-283258af120f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:47.991636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25127e4b-f00c-46ac-aa8c-283258af120f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:47.991919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25127e4b-f00c-46ac-aa8c-283258af120f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:47.992196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25127e4b-f00c-46ac-aa8c-283258af120f None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:47.997251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25127e4b-f00c-46ac-aa8c-283258af120f None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:47.998818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25127e4b-f00c-46ac-aa8c-283258af120f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:48.000698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 196/400] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:47 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:48.010851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.180876 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:48.220215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf3b7d-245c-4ed1-8e1a-7a052d70f52a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:48.283464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3013087-0bc7-4cb1-996a-5dad147f2b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:48.285558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3013087-0bc7-4cb1-996a-5dad147f2b2e None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.286392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3013087-0bc7-4cb1-996a-5dad147f2b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.287143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3013087-0bc7-4cb1-996a-5dad147f2b2e None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62/groups/df78f7afd1dc4d739607639811d94179/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.291114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3013087-0bc7-4cb1-996a-5dad147f2b2e None admin] RBAC: Authorizing `identity:create_grant(project_id=33e83e5227cd49ab890ad6a29a885f62, group_id=df78f7afd1dc4d739607639811d94179, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:48.293865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3013087-0bc7-4cb1-996a-5dad147f2b2e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:48.323342 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 205/401] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jul 19 10:52:48 2022] PUT /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62/groups/df78f7afd1dc4d739607639811d94179/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:48.351665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bbc1e-9afe-4ba8-89fe-41c6929cb9d9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.352480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bbc1e-9afe-4ba8-89fe-41c6929cb9d9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.352480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bbc1e-9afe-4ba8-89fe-41c6929cb9d9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.353957 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 197/402] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:48.359800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7b23-277a-4f51-b920-ac792dcb9579 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.360179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7b23-277a-4f51-b920-ac792dcb9579 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.360439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada7b23-277a-4f51-b920-ac792dcb9579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.379191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1ada7b23-277a-4f51-b920-ac792dcb9579 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:48.380452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ada7b23-277a-4f51-b920-ac792dcb9579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:48.510491 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 206/403] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:48.541372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bbc1e-9afe-4ba8-89fe-41c6929cb9d9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.566565 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:48.661810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a956b6-4582-4808-9bd1-1d228f5f40c3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.662954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a956b6-4582-4808-9bd1-1d228f5f40c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.663884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a956b6-4582-4808-9bd1-1d228f5f40c3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.671553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 207/404] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:48 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:48.680976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885536f-b492-4526-b25b-3854795d5918 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.681882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885536f-b492-4526-b25b-3854795d5918 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.682661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885536f-b492-4526-b25b-3854795d5918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.686549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bbc1e-9afe-4ba8-89fe-41c6929cb9d9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:48.717883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c885536f-b492-4526-b25b-3854795d5918 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:48.721631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c885536f-b492-4526-b25b-3854795d5918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:48.729313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:48.729313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:48.729721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:48.729856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:48.742162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:48.751843 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:48.754744 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:48.756781 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 198/405] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:48.760088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.889689 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:48.907169 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 208/406] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:48.936491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885536f-b492-4526-b25b-3854795d5918 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:48.983479 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.067350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6c2246-bef7-4dbd-9b17-e011f4f1252a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.153945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885536f-b492-4526-b25b-3854795d5918 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.193183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.193890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.194167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.194449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.195248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:49.195557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.197014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.217064 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 199/407] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 457 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:49.226704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.228200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.228732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.229278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.232327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.251222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:49.267222 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:49.270380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:49.272599 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 209/408] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:49.283217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.436576 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.541103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527e544-22da-4aa0-b2d0-3c84af682388 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.566411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093597f-6b39-4b19-bd75-5cd7459a1366 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.617493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.620012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.620792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.621809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.623776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:49.624560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.628023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.647663 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 210/409] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:49.654395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.654918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.656172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.656699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.657211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.658705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.660434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.662703 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 200/410] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:49.699521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.711885 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.863291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2199f5d-1d7b-4d61-a8a9-0666f8fffddc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:49.908219 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:49.926469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:49.928585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:49.929546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:49.930241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] PATH_INFO: `/v3/groups/fe093b7a2ed346918559f651ba4cd471` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:49.932906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] RBAC: Authorizing `identity:get_group(group_id=fe093b7a2ed346918559f651ba4cd471)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:49.935978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:49.939870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 211/411] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/groups/fe093b7a2ed346918559f651ba4cd471 => generated 229 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:49.945838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:49.983913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89568e71-4da5-48e6-85b0-3b6fb082a014 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.044888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9190328-41d2-4291-862c-44829ee94c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.046863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9190328-41d2-4291-862c-44829ee94c6b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.047639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9190328-41d2-4291-862c-44829ee94c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.048407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9190328-41d2-4291-862c-44829ee94c6b None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.050132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9190328-41d2-4291-862c-44829ee94c6b None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.051795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9190328-41d2-4291-862c-44829ee94c6b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.055435 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 201/412] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:50.058355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414d06-9156-458c-9148-edac98ae1bcf None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.059270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414d06-9156-458c-9148-edac98ae1bcf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.060175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd414d06-9156-458c-9148-edac98ae1bcf None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.063234 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 202/413] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:50.066088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd414d06-9156-458c-9148-edac98ae1bcf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.187619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b888b8c-d406-468a-bbac-4ecc7eb02e88 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.196414 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.256644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd414d06-9156-458c-9148-edac98ae1bcf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.258432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce440af-8fab-4706-a3b1-f2c3473ef923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.259856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce440af-8fab-4706-a3b1-f2c3473ef923 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.260673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce440af-8fab-4706-a3b1-f2c3473ef923 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.261150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce440af-8fab-4706-a3b1-f2c3473ef923 None admin] PATH_INFO: `/v3/projects/4d370718d88b47738f450251a884cc98` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.264211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce440af-8fab-4706-a3b1-f2c3473ef923 None admin] RBAC: Authorizing `identity:get_project(project_id=4d370718d88b47738f450251a884cc98)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.267094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce440af-8fab-4706-a3b1-f2c3473ef923 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.270526 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 212/414] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:49 2022] GET /identity/v3/projects/4d370718d88b47738f450251a884cc98 => generated 344 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:50.272623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.273829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.274312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.305783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:50.308096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:50.322456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.324534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.325262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.325966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62/groups/df78f7afd1dc4d739607639811d94179/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.330471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] RBAC: Authorizing `identity:create_grant(project_id=33e83e5227cd49ab890ad6a29a885f62, group_id=df78f7afd1dc4d739607639811d94179, role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.333597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.357065 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 203/415] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jul 19 10:52:50 2022] PUT /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62/groups/df78f7afd1dc4d739607639811d94179/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:50.359328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.446390 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.481536 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 213/416] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:50.517467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.561178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad9b30-12f4-4c74-9ea1-fdb36ae3046e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.621591 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:50.628915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.630869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.631590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.632254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] PATH_INFO: `/v3/projects/4d370718d88b47738f450251a884cc98/groups/fe093b7a2ed346918559f651ba4cd471/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.635992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=4d370718d88b47738f450251a884cc98, group_id=fe093b7a2ed346918559f651ba4cd471, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:50.640631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:50.666429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 204/417] 10.222.0.15 () {58 vars in 1442 bytes} [Tue Jul 19 10:52:50 2022] PUT /identity/v3/projects/4d370718d88b47738f450251a884cc98/groups/fe093b7a2ed346918559f651ba4cd471/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:52:50.747096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee126c0f-d693-4d9e-b053-a7261f3365ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:50.824682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be708f88-d8d0-4900-8657-d3859c222003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:50.826666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708f88-d8d0-4900-8657-d3859c222003 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.827522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708f88-d8d0-4900-8657-d3859c222003 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.828374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708f88-d8d0-4900-8657-d3859c222003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.850653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be708f88-d8d0-4900-8657-d3859c222003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-be708f88-d8d0-4900-8657-d3859c222003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:50.866824 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:50.868570 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:50.870188 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:50.875180 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 214/418] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:50.881157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:50.934704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c178-2bb3-40dc-b510-51d4090a319c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.935204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c178-2bb3-40dc-b510-51d4090a319c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.935745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c178-2bb3-40dc-b510-51d4090a319c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.940393 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 215/419] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:50.948280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:50.949198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:50.950206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:50.990124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:50.991608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:51.083684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91824437-0936-4325-90ea-d17c07fe0f38 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.087178 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.148634 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 216/420] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:51.167130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.167839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.168121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.168414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.169215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:51.169527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.171126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.181808 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 205/421] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:51.187503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.210730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.276494 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.348749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24779f-5158-4db3-aeae-c5b26dbde3ca None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.360467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549dc780-de21-4b0a-bc03-287a339910a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.420044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cc070-54f7-45a6-bc63-d2305b579906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.421956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cc070-54f7-45a6-bc63-d2305b579906 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.422634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cc070-54f7-45a6-bc63-d2305b579906 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.423030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.423510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cc070-54f7-45a6-bc63-d2305b579906 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.424455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.425106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.425679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.447970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23cc070-54f7-45a6-bc63-d2305b579906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a23cc070-54f7-45a6-bc63-d2305b579906 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:51.465857 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:51.467771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 19 10:52:51.469334 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:51.472249 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 206/422] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:52:51.474020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e491-1dc6-4f97-af4b-a54c82674700 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.474512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e491-1dc6-4f97-af4b-a54c82674700 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.475011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e491-1dc6-4f97-af4b-a54c82674700 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.477633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 207/423] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:51.479108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e491-1dc6-4f97-af4b-a54c82674700 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.534512 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.586465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.589435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.689532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e491-1dc6-4f97-af4b-a54c82674700 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:51.725948 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.771679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:51.773597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.774083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.774768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.776147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] RBAC: Adding query filter params (name=member) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:51.776699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:51.779190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c4c719-eb6a-4dc2-9b79-7a261ea4cb94 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:51.791806 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 208/424] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:51.793906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:51.794384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:51.794796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:51.804769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 217/425] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:51.806611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:51.819345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:51.821856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:51.964498 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:51.965216 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 209/426] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:51.966114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.014751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b5e0b-aa6e-4ee7-a36d-a476650e2254 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.053591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.054256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.054540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.054790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.140676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.142728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.175897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ccf1ad-9ffe-4682-bf49-5861dd7ed4d1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.191572 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.228867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.247566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.249894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.250656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.251408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.253258 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 218/427] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:52.254124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.254413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.257779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.261468 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 210/428] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:51 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.263658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.365458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff2b8f5-3474-43f6-afec-f36bd727ac89 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.409814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.411181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.411703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.412226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.437579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:52.458488 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:52.459729 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:52.460871 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:52.463013 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 219/429] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:52.463861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.476228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063c3c7d-53b5-404e-9f95-d8b9ae4c2257 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.555273 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.556899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.558237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.558721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.559140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.561179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.564314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.567416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 211/430] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.568884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.643637 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:52.691774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd1df1-4769-44b4-80a8-06b7464a5f9a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.756189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35ab2aa-b210-4493-a487-34c8a1ba95ec None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:52.773207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.775807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.776496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.777081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.780760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.783599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.788177 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 220/431] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.794154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.837430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:52.839010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:52.839373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:52.839947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:52.842380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:52.843036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:52.846548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:52.863685 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 212/432] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:52.865680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:52.999687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccbb7a8-f34b-4ecb-b5aa-5f65d34d62d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.015782 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.054320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c574d3-fc2e-42f9-a9f0-1ce9c3b30863 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.059318 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.064786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.066372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.066853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.067354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.069656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.072527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.075768 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 221/433] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:53.077331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.119162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.119740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.120021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.120303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.121213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=3cf690794a2b455785424e72c672b5a6) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:53.121523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.123006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee3f554-9b5b-4ee9-bb2b-f899d4a9aea6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.133275 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 213/434] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:52 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=1b8336fe2a2642b387272398a640a960 => generated 611 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:53.136025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bed759-ab53-46eb-a525-702401622455 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.136828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bed759-ab53-46eb-a525-702401622455 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.137528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bed759-ab53-46eb-a525-702401622455 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.141031 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 214/435] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:53.145725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bed759-ab53-46eb-a525-702401622455 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.280132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33c4cb9-1926-4939-8bd4-b33f8cd66e22 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.316860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bed759-ab53-46eb-a525-702401622455 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.360993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.362263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.362871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.363436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.364694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=1b8336fe2a2642b387272398a640a960, scope.project.id=33e83e5227cd49ab890ad6a29a885f62) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:53.365136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.365478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.366321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.366841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.367313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.368104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e08683-7b76-429e-93dd-4341d241ad11 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.380580 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 215/436] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=1b8336fe2a2642b387272398a640a960 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:53.382545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6afe-6a4d-4672-b5b6-fb05e7140b84 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.383041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6afe-6a4d-4672-b5b6-fb05e7140b84 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.383579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d6afe-6a4d-4672-b5b6-fb05e7140b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.410785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-978d6afe-6a4d-4672-b5b6-fb05e7140b84 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:53.412001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-978d6afe-6a4d-4672-b5b6-fb05e7140b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:53.448577 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.460622 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.508795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:53.511702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:53.540746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 216/437] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:53.543766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf9ce-6c15-433c-9dce-df75cf9355e3 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.544253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf9ce-6c15-433c-9dce-df75cf9355e3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.544805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eaf9ce-6c15-433c-9dce-df75cf9355e3 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.546701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 217/438] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:53.553162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.553673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.554111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.575499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:53.577195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:53.682485 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 218/439] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:53.684584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.713012 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 222/440] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:53.714348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.841567 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.852631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706b1d-8222-4e9b-aff3-3208ed3af655 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.853677 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:53.892143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.892979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.893277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.893541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.900066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34ae1-c2be-4d28-85c8-3afb418cbe9a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:53.905777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:53.913698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:53.915478 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 219/441] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:53.916456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:53.952872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:53.953591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:53.953870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:53.954143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:53.965417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:52:53.973784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:53.974888 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:52:53.975658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:53.977233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 223/442] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:53.978077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.047727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377909d-f21b-4bfd-a424-2181af562027 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.092525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.093526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.093982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.094344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] PATH_INFO: `/v3/projects/3cf690794a2b455785424e72c672b5a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.095992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] RBAC: Authorizing `identity:get_project(project_id=3cf690794a2b455785424e72c672b5a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.097754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.100072 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 220/443] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/projects/3cf690794a2b455785424e72c672b5a6 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:54.101398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.112920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0741454a-bc5d-4490-ac3f-11cf323e1999 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.132720 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.156309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.157191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.157596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.157972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.158792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:54.159223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.160713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.162531 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.172794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 224/444] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:52:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:54.173870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.233425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37aad3-e39f-4675-aad2-6fd997e3ebe7 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.277291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.278114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.278457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.278806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.279660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:54.280050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.281657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.291743 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 221/445] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:54.293174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.295654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa140b9-95ac-4bb4-bab3-f7240627b2ac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.336825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.337886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.338233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.338596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.339927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.341591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.343742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 225/446] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:54.344763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.398171 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.421364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f2837e-4044-4b9a-8ef1-9135905f88a4 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.425927 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.473594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc9090-5729-4dc7-849f-3fe80cbf1ad3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.475583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.476522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.476962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.478682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.518777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.519324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.519605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.519879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.558442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.560654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.601055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.602655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.660751 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.677950 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.683890 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 222/447] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:54.685627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.727285 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 226/448] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:52:54.728301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.822715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b758dd7-9d9a-4d5c-8f3a-9ad530580eb8 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.857530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.858406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.858567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.858820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.859655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=3cf690794a2b455785424e72c672b5a6) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:54.859957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.861479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.867835 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 223/449] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=3cf690794a2b455785424e72c672b5a6&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:54.868681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.868828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96802c0d-9e49-4317-b342-98c8f162bf80 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:54.934805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:54.935812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:54.936226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:54.936590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] PATH_INFO: `/v3/projects/4d370718d88b47738f450251a884cc98` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:54.938087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] RBAC: Authorizing `identity:get_project(project_id=4d370718d88b47738f450251a884cc98)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:54.939515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:54.941654 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 227/450] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/projects/4d370718d88b47738f450251a884cc98 => generated 344 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:54.947324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:54.953456 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:54.985449 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.066000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e916c1e-f8e7-403d-a19f-0b7baa666088 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.088713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e38f-fa9d-4576-94d2-20d0b105c6bb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.130216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.131086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.131364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.131635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] PATH_INFO: `/v3/projects/33e83e5227cd49ab890ad6a29a885f62` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.132914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] RBAC: Authorizing `identity:get_project(project_id=33e83e5227cd49ab890ad6a29a885f62)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.134390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.136168 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 224/451] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/projects/33e83e5227cd49ab890ad6a29a885f62 => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:55.143474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.144655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.145117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.145545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] PATH_INFO: `/v3/groups/fe093b7a2ed346918559f651ba4cd471` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.145688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.147176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] RBAC: Authorizing `identity:get_group(group_id=fe093b7a2ed346918559f651ba4cd471)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.149160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.153658 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 228/452] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:54 2022] GET /identity/v3/groups/fe093b7a2ed346918559f651ba4cd471 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:55.161927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.309034 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.315093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c9f355-3ad4-4ba2-b430-59c191a87d07 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.319838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f30118-a34c-44f6-bf6a-73055f5d3650 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.341963 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:55.377046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.378213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.378658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.379073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] PATH_INFO: `/v3/groups/df78f7afd1dc4d739607639811d94179` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.379225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.379894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.380172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.380482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.380900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] RBAC: Authorizing `identity:get_group(group_id=df78f7afd1dc4d739607639811d94179)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.381337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] RBAC: Adding query filter params (group.id=fe093b7a2ed346918559f651ba4cd471, role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=4d370718d88b47738f450251a884cc98) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:55.381644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.382759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.383095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b1acc-4e52-4de9-9e43-45821ceedda3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.385867 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 225/453] 10.222.0.15 () {56 vars in 1180 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/groups/df78f7afd1dc4d739607639811d94179 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:55.394323 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 229/454] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/role_assignments?group.id=fe093b7a2ed346918559f651ba4cd471&scope.project.id=4d370718d88b47738f450251a884cc98&role.id=c71870b3a21e455080504ab36dac896f => generated 611 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:55.394561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:55.579666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc1f5d-e9bd-4047-8f22-5e0e760f33ef None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:55.619944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:55.620711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:55.621176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:55.621590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:55.622746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] RBAC: Adding query filter params (group.id=df78f7afd1dc4d739607639811d94179, role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=33e83e5227cd49ab890ad6a29a885f62) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:55.623236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:55.624922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6882ccb-376a-4f77-aa85-fbb88a3c9f2c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:55.633936 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 226/455] 10.222.0.15 () {56 vars in 1376 bytes} [Tue Jul 19 10:52:55 2022] GET /identity/v3/role_assignments?group.id=df78f7afd1dc4d739607639811d94179&scope.project.id=33e83e5227cd49ab890ad6a29a885f62&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 611 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:52:58.714648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08b3f-78ee-49be-8682-79f990c02f17 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.715172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08b3f-78ee-49be-8682-79f990c02f17 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.715329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c08b3f-78ee-49be-8682-79f990c02f17 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.718010 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 230/456] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:52:58.725989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.726485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.726974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.762057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:58.764084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:58.867462 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:58.907367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b590c-e553-4964-82b8-875465e38e6b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.907692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b590c-e553-4964-82b8-875465e38e6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.907924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b590c-e553-4964-82b8-875465e38e6b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.909354 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 231/457] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:58.914548 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 227/458] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:58.915801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:58.916277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:58.916792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:58.938658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:58.956497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:58.961183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:59.163940 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 232/459] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:59.188931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.224278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf81cf5-aa71-49bc-9ee3-7f72d10464d6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.290196 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:59.298507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210fced-53c2-44be-bb92-47c720e3b373 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.305148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.305956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.306230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.306494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.321034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.323016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.337309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.338475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.338960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.339428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7b667789-5205-488c-ba69-b4d07b6094eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:59.345491 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:59.346369 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:59.347192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:59.347192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:59.347192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:59.347192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:59.347192 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 228/460] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:59.348426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493409-577a-4f4c-b6a8-a6ccaf331878 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.348708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493409-577a-4f4c-b6a8-a6ccaf331878 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.348978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce493409-577a-4f4c-b6a8-a6ccaf331878 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.352417 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 229/461] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:59.356208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce493409-577a-4f4c-b6a8-a6ccaf331878 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.359062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.360688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-eebc4c42-257b-4926-9b30-31a5966c6534 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:59.381396 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:59.382305 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:59.383129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:59.383129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:59.383129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:59.383129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:52:59.383129 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 233/462] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:59.384288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.388816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.389123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.393990 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:59.410459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:52:59.412051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:52:59.494533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce493409-577a-4f4c-b6a8-a6ccaf331878 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.500482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 234/463] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:52:59.502902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.559002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.560087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.560386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.560671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.561416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:59.562277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.563689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.596003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 230/464] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:59.596003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.663828 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:59.698775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a393273-8ee2-426f-a39a-f8616ba035a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.738943 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:52:59.758548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efc9b89-4206-4f76-b28a-c15814cee35a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:52:59.766573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.768130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.768756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.769241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.770593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:52:59.771192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.773508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3194abf-03da-44f6-85d4-b6af601623a7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.799922 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 235/465] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:52:59.799922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c4717-0c3d-4eb4-b190-b4a47f5c86ce None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.799922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c4717-0c3d-4eb4-b190-b4a47f5c86ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.799922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754c4717-0c3d-4eb4-b190-b4a47f5c86ce None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.802694 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 236/466] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:52:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:52:59.802694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c4717-0c3d-4eb4-b190-b4a47f5c86ce None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:52:59.811922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:52:59.812956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:52:59.813407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:52:59.813858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:52:59.827855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:52:59.829776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:52:59.863649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:52:59.865784 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:52:59.867471 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:52:59.867471 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:52:59.867471 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:52:59.867471 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:52:59.867471 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 231/467] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:52:59.867471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.000253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda49fe2-0ec9-4971-9fad-04e0e7d93509 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.003481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754c4717-0c3d-4eb4-b190-b4a47f5c86ce None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.039623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcb9adb-7dc0-40ac-a6b9-aed8dd19881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.045078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9adb-7dc0-40ac-a6b9-aed8dd19881a None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.045078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9adb-7dc0-40ac-a6b9-aed8dd19881a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.045078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcb9adb-7dc0-40ac-a6b9-aed8dd19881a None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.045078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb9adb-7dc0-40ac-a6b9-aed8dd19881a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.045694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcb9adb-7dc0-40ac-a6b9-aed8dd19881a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.059698 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.081641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.082156 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 232/468] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:59 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:00.082712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.083177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.083649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.084913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.085910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.086663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.087388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.087561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.100103 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.123457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:00.125467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:00.132990 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 237/469] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:52:59 2022] POST /identity/v3/users => generated 248 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:00.134973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.312560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 233/470] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:00.386053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.426240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f8620-6b80-4ff1-8e49-2c79f1d472ac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.486908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.487617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.488727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.488727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.489011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:00.489270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.490702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.505006 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 238/471] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:00.513779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.581377 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.585406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d4af4c-c466-44a1-82a4-bcd5eeb982ad None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.617910 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:00.631579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.632549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.633251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.633369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.652494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.653958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:00.678203 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:00.680419 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:00.682264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:00.682264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:00.682264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:00.682264 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:00.682264 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 234/472] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:00.686413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:00.688636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db8331-8739-45c1-b6d9-33e161c9b8a0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.779885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c918bddc-710b-4883-8ad9-008655cec3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:00.782267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bddc-710b-4883-8ad9-008655cec3f3 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.783075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bddc-710b-4883-8ad9-008655cec3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.784855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c918bddc-710b-4883-8ad9-008655cec3f3 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.786556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bddc-710b-4883-8ad9-008655cec3f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:00.789978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c918bddc-710b-4883-8ad9-008655cec3f3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:00.838647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 239/473] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:00 2022] POST /identity/v3/users => generated 246 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:53:00.904405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa54911-ce51-4b83-a30c-bb155cb18ae6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.905436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa54911-ce51-4b83-a30c-bb155cb18ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.905436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa54911-ce51-4b83-a30c-bb155cb18ae6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.907972 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 240/474] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:00.918717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:00.919142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:00.919601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:00.932774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c844b06-3b26-4478-b98c-efb81d68273d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:00.950391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:00.952948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:01.021195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.021894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.022234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.022512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.023301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:01.023567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.025002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.038371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 235/475] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:01.049077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.090933 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 241/476] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:53:01.101190 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.116060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.174915 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.184182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a8335a-990e-4e44-bcb5-e4f56f6b147e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.301164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471dc86-c34a-4dd9-a8ae-530864a9ba27 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.309761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.311005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.313993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.313993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.314370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.319158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.369593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.371056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.372076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.372576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.374267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.377306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:01.383446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 236/477] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:01 2022] POST /identity/v3/users => generated 249 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:01.389390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 10:53:01.389390 n-d-master-1 devstack@keystone.service[80581]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 10:53:01.389390 n-d-master-1 devstack@keystone.service[80581]: [parameters: {'id': '4464ec136a544d7faac6a166f5f1b7d1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 10:53:01.389390 n-d-master-1 devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:01.420145 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return ref.to_dict() Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:01.421383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 10:53:01.422356 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 10:53:01.423238 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:01.424180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:01.427769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'id': '4464ec136a544d7faac6a166f5f1b7d1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:01.428709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 19 10:53:01.429623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:01.430443 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 242/478] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jul 19 10:53:01 2022] POST /identity/v3/roles => generated 144 bytes in 311 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:01.435342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.673217 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.683838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3757e043-755f-41a2-9923-84c88f1e0fde None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.736035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559910c-4ea9-4350-8365-3700a5cb40e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.740633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559910c-4ea9-4350-8365-3700a5cb40e9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.740913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559910c-4ea9-4350-8365-3700a5cb40e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.741187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559910c-4ea9-4350-8365-3700a5cb40e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.754796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559910c-4ea9-4350-8365-3700a5cb40e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-e559910c-4ea9-4350-8365-3700a5cb40e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:01.763431 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:01.764435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:01.770381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 237/479] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:01.778002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:01.942814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458e24a-85fb-48a3-a47b-48219d09b194 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:01.945665 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:01.988417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:01.989522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:01.990006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:01.990506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:01.991511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:01.992031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:01.993701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aecf6-6de8-4546-9c5e-45f3628690f7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:02.005044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 243/480] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:03.092647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260626f-4195-4a43-9950-0ded003b15ae None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.093292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260626f-4195-4a43-9950-0ded003b15ae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.093633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0260626f-4195-4a43-9950-0ded003b15ae None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.096252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 238/481] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:03.101840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.102336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.102434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.128514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:03.129732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:03.154128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d00609-bddd-49d9-8652-557afcc2095f None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.154794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d00609-bddd-49d9-8652-557afcc2095f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.155364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d00609-bddd-49d9-8652-557afcc2095f None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.157514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 239/482] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:03.163627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.164262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.164755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.197182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:03.199586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:03.253981 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 244/483] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:03.307766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.313800 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 240/484] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:03.340238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.512092 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.522525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecd0a9-ed07-4f96-aa83-3e0929f401c9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.524912 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.568972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.570010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.570295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.570574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.571250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c737f95-a44f-421f-a424-cf79c3246a7f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.592381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:03.608705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:03.609695 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:03.610482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:03.612709 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 245/485] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:03.620035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.647470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd284e9-25e0-4a36-b515-b127b686073e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.648578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd284e9-25e0-4a36-b515-b127b686073e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.648860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd284e9-25e0-4a36-b515-b127b686073e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.649138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd284e9-25e0-4a36-b515-b127b686073e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.671901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd284e9-25e0-4a36-b515-b127b686073e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7cd284e9-25e0-4a36-b515-b127b686073e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:03.688892 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:03.689848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:03.690861 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 241/486] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:03.691537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc0d8-6412-414e-ad52-5f48c85336ec None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.692458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc0d8-6412-414e-ad52-5f48c85336ec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.692458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdc0d8-6412-414e-ad52-5f48c85336ec None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.694557 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 242/487] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:03.701002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc0d8-6412-414e-ad52-5f48c85336ec None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.779173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db8bba7-b42e-4010-85e8-f60dd730895d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.820668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.821674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.822134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.822604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.823555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:03.824057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.825730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb77309-04a4-4a8f-8c70-4e4e3a260ac6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.838542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 246/488] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:03.841882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.842421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.842888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.858205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdc0d8-6412-414e-ad52-5f48c85336ec None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:03.863246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:03.864541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:03.881847 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.904707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:03.905844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:03.908762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:03.909808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:03.911134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:03.912851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:03.915161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:03.930791 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 243/489] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:03.932251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:03.944091 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:03.968793 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 247/490] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:03.968793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.099476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc23235e-e9a0-45fe-87b1-c7d805187296 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.105546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd678b89-c3b9-49d9-99b0-b68f2ae88eb6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.143846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.145286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.145804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.146300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.148447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.149457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.149742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.150016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.160788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.162750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.163133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.164226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.172959 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:04.185482 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:04.186573 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:04.191687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:04.191687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:04.191687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:04.191687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:04.191687 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 248/491] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:04.192735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:04.196452 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:04.200012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:04.201184 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:04.201184 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:04.201184 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:04.201184 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:04.203596 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 244/492] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:04.204813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.292588 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.327062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564cf12c-6eee-4fa4-8b5d-d3a0994d36bc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.349880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d40de-e84b-41e4-b74a-4abecafb9f5f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.390637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.391302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.391588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.391864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.392639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:04.392948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.393667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.394668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.395508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.396192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.396885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.413449 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 245/493] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:04.414410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.418902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:04.427829 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:04.429053 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:04.430328 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:04.438320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 249/494] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:04.439544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.528119 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.538487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e07738-3cc1-4f9e-809f-4a98a2164d19 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.562292 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.587789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.588979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.589264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.589545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.590294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:04.590606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.592936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.606467 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 246/495] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:04.608638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.636725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ad888-24f7-467f-b02d-d91f075ffdd6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.684217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.685309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.685765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.686348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.694889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.696715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:04.713584 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:04.714771 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:04.715751 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:04.718140 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 250/496] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:04.719248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.743140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd86c34-d6cb-413e-b5b9-80a4047ac042 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.783457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.784334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.784691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.785084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.786384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:04.786780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.788772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.805248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 247/497] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:04.805248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.871881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d15124-bdc7-44bd-9024-79a51d524e7d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:04.890392 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.903818 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:04.932590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:04.933423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:04.933732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:04.933990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:04.943661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:04.945251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:04.961309 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:04.962853 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 251/498] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:04.964134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:04.979523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951e3e1-b39c-469c-82f0-10c15192cf0f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.036468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.037602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.038164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.038728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.040503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.041276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.047961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b99e3d-345e-405c-ad52-ba7a3ffc386a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.106707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a73f6e-7c5b-4f19-9e4b-749a505cdc0d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.112282 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 248/499] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:05.113143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ac8a-f666-4421-a591-ff94526ad3e6 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.113390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ac8a-f666-4421-a591-ff94526ad3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.113678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469ac8a-f666-4421-a591-ff94526ad3e6 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.119427 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 249/500] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:05.120027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469ac8a-f666-4421-a591-ff94526ad3e6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.177499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.178213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.178497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.178776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.191908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.193446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:05.212096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:05.214541 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:05.215389 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:05.215389 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:05.215389 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:05.215389 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:05.216502 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 252/501] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:05.217596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.244264 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.252494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469ac8a-f666-4421-a591-ff94526ad3e6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.267509 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.295402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.296107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.296399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.296742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.297606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.297914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.299415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e7a3e-a298-4eef-a36b-b287de46547b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.318913 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 250/502] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:05.320231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d3fc-d00e-419d-bd29-59cf064b6cb1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.320569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d3fc-d00e-419d-bd29-59cf064b6cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.320831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494d3fc-d00e-419d-bd29-59cf064b6cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.338641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8494d3fc-d00e-419d-bd29-59cf064b6cb1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:05.339892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8494d3fc-d00e-419d-bd29-59cf064b6cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:05.343633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010e8ed2-d934-4946-9a95-97c1a8ee0f7c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.383196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.383852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.384133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.384451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.418088 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 251/503] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:05.419432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3c9a-b4d5-4ccc-95d0-3efd33b11fff None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.419717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3c9a-b4d5-4ccc-95d0-3efd33b11fff None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.419988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a3c9a-b4d5-4ccc-95d0-3efd33b11fff None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.421343 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 252/504] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:05.422122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3c9a-b4d5-4ccc-95d0-3efd33b11fff None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.472962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.474440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.509197 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.558740 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.577560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a3c9a-b4d5-4ccc-95d0-3efd33b11fff None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.604439 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 253/505] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:05.605598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.623374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.624057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.624336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.624637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.625438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:05.625744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.627200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bfe8ae-65a6-4231-80ef-bfde3065db8f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.641691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 253/506] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:05.643003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.643294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.643874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.665352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:05.666586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:05.738233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 254/507] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:05.739159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:05.765123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91457c-eed6-4c71-9e96-1419c58b5caf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.798395 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.804749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.805496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.805779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.806084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.831852 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:05.858878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b520233-8a54-450d-b029-77eb4c6adf2d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:05.897606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.899285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.900812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:05.901625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:05.901909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:05.902187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:05.913803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:05.915336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:05.934804 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:05.935856 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:05.937852 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:05.937852 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:05.937852 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:05.937852 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:05.937852 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 255/508] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:05.937852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.025380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 254/509] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:06.026486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.056635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621089af-f617-40d9-91c2-e269572878d6 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.070809 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.086289 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.096877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.097810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.098174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.098546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.110294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.111822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:06.129592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:06.131541 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:06.133226 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:06.133226 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:06.133226 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:06.133226 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:06.133226 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 256/510] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:06.133226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.149218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d27431-971e-4eea-a44e-a887f4fc657f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.185467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.186387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.186781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.187160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.196004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.197891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:06.215084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:06.217147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 255/511] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:06.218905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.246107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac64a243-ca6d-42d1-be8f-876daf535ff9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.280871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.281659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.281941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.282212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.292708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:06.300470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:06.302148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 257/512] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:06.303037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.319502 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.330634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799cec2-4dc1-4a9f-980c-402b245c96ce None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.351414 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.369097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.369755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.370048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.370319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.371045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:06.371351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.372857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.385200 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 256/513] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:06.386041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.415128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1027f0c-51a5-4ba4-b6a9-573f66911fd9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.452039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.452906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.453160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.453430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.465057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.466572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:06.487364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:06.488683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:06.489751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:06.489751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:06.489751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:06.489751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:06.489751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 258/514] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:06.490946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.498191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee9d0d-dfb3-4c87-8063-c37d0d25869b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.533510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.534097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.534374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.534648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.535372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:06.535670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.537095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.549794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 257/515] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:06.550461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.564432 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.598175 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.608827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3184ad-7053-42a0-96c4-f9ccda3bb540 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.646700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.647376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.647653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.647929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.648817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:06.649113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.650571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.664503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29094c-b931-48e9-af2c-a708ec950b45 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.669232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 259/516] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:06.670747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.703309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.704180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.704603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.704945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.705856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:06.706264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.708720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.728384 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 258/517] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:06.728384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.813126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749a628d-bf2b-447f-bbd2-8ee42e82ae69 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.825417 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.856962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.857628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.857893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.858172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.858878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.860405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.864573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1adc77-d68e-4f9d-8e42-b4f26ba600f3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:06.881241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 260/518] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:06 2022] POST /identity/v3/users => generated 247 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:06.882079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:06.899656 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:06.906421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:06.907143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:06.907436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:06.907716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:06.908521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:06.908836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:06.910313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:06.931876 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 259/519] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:06.931876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.055789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f533f6c1-0819-484a-8bb5-76a4c1bf4e5e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.079025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a08c9-effc-4d5e-93f7-49ed3fee0387 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.102714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.103646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.103928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.104232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.113914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.115426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.125080 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:07.131878 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:07.134094 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 261/520] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:07.136143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.137845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.137845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.137845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.137845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.217839 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.237018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.238526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.274439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b25b-8d6b-44b0-a55c-7419dd92cc21 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.331075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.331845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.332143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.332498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.345643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.347139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:07.368091 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:07.369144 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:07.369998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:07.369998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:07.369998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:07.369998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:07.369998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 262/521] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:07.370260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.402578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 260/522] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:07.402578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.444755 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.501175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bb306-788f-4f24-bb85-3ef56039bb6f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.531803 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.533424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab149b7-ddb6-46ec-b98d-62dcd6d27426 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.559636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.560467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.560767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.561023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.568577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.570608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.576098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.576827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.577108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.577545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.578417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:07.578723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.580168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:07.596084 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:07.597656 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:07.598995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:07.601536 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 263/523] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:07.602980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.609886 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 261/524] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:07.609886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.729850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.743514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f7697f-b1eb-49c7-8d69-3331a30cb17d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.762364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68faffb-ca85-4060-a93f-6b96339c2fb0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:07.796427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.797492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.797846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.798192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.806487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:07.807518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:07.807923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:07.808239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:07.809077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:07.809423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.811131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.813237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:07.815933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:07.835198 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 264/525] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:07.835198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:07.836394 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:07.837974 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:07.839650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:07.839650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:07.839650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:07.839650 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:07.839650 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 262/526] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:07.839650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:07.918855 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:07.962372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8136075-7305-44eb-b3dd-68cc026fb719 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.008513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.009576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.010027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.010416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.011567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=55aac242daf746b283fb3cb561b3462e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.012005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.013682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.013847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d8f2a-785f-4f62-8006-3ea74018e611 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.023333 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 263/527] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/role_assignments?user.id=55aac242daf746b283fb3cb561b3462e&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:08.025899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.053182 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.094392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817524f-3f32-4902-8302-46e608df862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.095240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817524f-3f32-4902-8302-46e608df862c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.095646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817524f-3f32-4902-8302-46e608df862c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.096554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817524f-3f32-4902-8302-46e608df862c None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.097556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817524f-3f32-4902-8302-46e608df862c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.097989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817524f-3f32-4902-8302-46e608df862c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.100949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817524f-3f32-4902-8302-46e608df862c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.137842 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 265/528] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:08.143250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817524f-3f32-4902-8302-46e608df862c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.193944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da3520-cd24-4de1-bdc6-c989052be956 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.267451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.269383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.270280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.270773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.285592 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.288945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817524f-3f32-4902-8302-46e608df862c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.289414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.293980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.329323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:08.329944 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:08.331536 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:53:08.334322 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:08.335841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.335841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.335841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.335841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.335841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.336686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 264/529] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:08.336686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.344679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.353089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 266/530] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:08.354042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.425002 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.463991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddea0d8-3505-4b24-b091-ed41633cc85d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.465297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c5385-6a17-43b6-a6a9-6d73bff2183d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.502829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.503517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.503797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.504076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.504997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.505309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.505552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.506085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.506372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.506657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.506890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.512383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2bbe7cd61ad745a9833acd3d3e4a066d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:08.512383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.512383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.516394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 265/531] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/role_assignments?user.id=2bbe7cd61ad745a9833acd3d3e4a066d&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:08.517381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.528068 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 267/532] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:08.533813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.554104 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.700020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3263ec56-1ba9-4894-952a-e6d149f4c3ba None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.716237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1748782d-c17a-419f-9d01-a64ebe2a14bb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:08.738946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa753101-a6ad-4ffe-b04f-2db24b1713a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.739609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753101-a6ad-4ffe-b04f-2db24b1713a6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.739887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753101-a6ad-4ffe-b04f-2db24b1713a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.740158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa753101-a6ad-4ffe-b04f-2db24b1713a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.804797 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:08.829170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:08.830000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:08.830282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:08.830557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:08.838406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.841348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:08.858766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:08.860476 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:08.862205 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 266/533] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:08.868565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:08.891139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753101-a6ad-4ffe-b04f-2db24b1713a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:08.895398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa753101-a6ad-4ffe-b04f-2db24b1713a6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:08.932338 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.100753 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 268/534] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 10:53:09.102277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473b1a-4480-4d2d-a709-6e078d24d9bf None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.102564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473b1a-4480-4d2d-a709-6e078d24d9bf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.102843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63473b1a-4480-4d2d-a709-6e078d24d9bf None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.104224 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 269/535] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:09.105729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a05ea5-19b7-4a93-9f74-c342adb62df3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.109203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63473b1a-4480-4d2d-a709-6e078d24d9bf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.168163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.168905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.169268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.169546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.170667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:09.170847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.172874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ef7cb-a7b8-472b-8dc0-7d73c9dfd7f8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.196319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 267/536] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:09.198625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.198997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.199536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.229431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:09.231477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:09.251809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63473b1a-4480-4d2d-a709-6e078d24d9bf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.277462 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.299341 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.302045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.303425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.303872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.304245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.317938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.319857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.328685 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 268/537] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:09.329906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:09.354822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:09.355829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:09.356726 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:09.356726 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:09.356726 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:09.356726 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:09.362849 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 270/538] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:09.369982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.469421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b112543-d3f1-4c05-806a-55a66b0b3ebd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.515110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.516225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.516672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.517113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.518512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2af38e680ecd4346b44dad744de8e50c) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:09.519287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.521218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.528648 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 269/539] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/role_assignments?user.id=2af38e680ecd4346b44dad744de8e50c&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:09.529016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a90b3b-9aea-4464-8aad-bf028d67e46c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.529910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.579417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.580920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.581360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.581983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.583003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:09.583453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.585071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.599841 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 271/540] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:09.608682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.618871 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.660763 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:09.778406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d327176e-9caf-40cf-b550-c6e9c29d533a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.793261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ad88e-352b-42a6-89ca-134f1e0b2ff3 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:09.833071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.834806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.835958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.836524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.850300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:09.852089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:09.857660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:09.858691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:09.859288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:09.859981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:09.902493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:09.919065 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:09.920032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:09.920862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:09.921456 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:09.922279 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:09.924678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 272/541] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:09.930710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 270/542] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:09.933621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:09.934084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.132775 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:10.154224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516edd5-93fa-41d5-b857-278508489320 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.169408 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:10.171893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5fbb3-7e42-49ed-b4b9-51ac58a02abb None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.238187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.240131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.240942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.241702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.243446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:10.244087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.247552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.253102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.253799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.254237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.254872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.255650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:10.255966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.257400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.274563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 273/543] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:10.280271 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 271/544] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:10.281730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.287810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.570063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa74ddbd-6fd2-4b4c-af92-e8928159620b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.575976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18251b42-a19a-4791-96a2-3dca641b65e1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.613006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.613693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.613977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.614281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.615121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=86cbfe3a2d7b4b25b4ec629118e20d5a) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:10.615437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.617217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42502548-fa2a-43a7-9646-c8f2d7a41182 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.625437 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 274/545] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/role_assignments?user.id=86cbfe3a2d7b4b25b4ec629118e20d5a&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:10.626979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb7987-212b-4b40-b918-57ccb60ed915 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.627263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb7987-212b-4b40-b918-57ccb60ed915 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.627538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb7987-212b-4b40-b918-57ccb60ed915 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.637383 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 275/546] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:10 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:10.640437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.641578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.641968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.642348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.645675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.645995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.646304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.662563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.670673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:10.690613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:10.692027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:10.692721 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:10.693561 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:10.694407 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:10.694407 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:10.694407 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:10.694407 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:10.697293 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 272/547] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:10.703675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.714649 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:10.780767 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:10.878705 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 276/548] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 19 10:53:10.909286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:10.920958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df463f89-6eba-4fec-af9a-60c5de38d30a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:10.983335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:10.985792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:10.986631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:10.987378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:10.989017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:10.990071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:10.993332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.019778 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 273/549] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:11.027153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.181567 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.219818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf4cd0-d654-4773-a2b4-1e51bbabb115 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.227597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08a2236-c112-41ed-b6c0-23fbc43fa2de None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.277603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.278127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebe2a9e-0f3a-4bf1-9959-5d091589159b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.279438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.279544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe2a9e-0f3a-4bf1-9959-5d091589159b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.280004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe2a9e-0f3a-4bf1-9959-5d091589159b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.280238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.280573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebe2a9e-0f3a-4bf1-9959-5d091589159b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.280916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.291817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.294146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.300273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebe2a9e-0f3a-4bf1-9959-5d091589159b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-1ebe2a9e-0f3a-4bf1-9959-5d091589159b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:11.312364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:11.314416 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 277/550] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:11.315980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f0fa-d08e-4ecc-889a-454fe1a3d7bb None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.317428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f0fa-d08e-4ecc-889a-454fe1a3d7bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.317428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76f0fa-d08e-4ecc-889a-454fe1a3d7bb None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.321492 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 278/551] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:11.322515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f0fa-d08e-4ecc-889a-454fe1a3d7bb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-70a38373-1c13-4514-804f-f84fbaf573dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:11.325033 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:11.326934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:11.329420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:11.338708 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 274/552] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:11.338708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.338708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.338708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.344394 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.362387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:11.363686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:11.497587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76f0fa-d08e-4ecc-889a-454fe1a3d7bb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.504839 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 275/553] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:11.506598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.552819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.554039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.554582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.556528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.557613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:11.560651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.562307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.573977 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 279/554] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:11.575824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.662287 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.703513 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:11.721745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e16cb-17cc-48f8-839e-75603cc7137f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.765553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae746f4a-8333-4553-a440-dacc1d61c580 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:11.771323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.772546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.773050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.773632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.775364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:11.776291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:11.778539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:11.806305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:11.807150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:11.807429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:11.807702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:11.820730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:11.828698 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:11.830482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:11.831979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:11.835011 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 280/555] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:11.835963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.855182 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 276/556] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:11.857461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:11.980008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afd9ce9-f727-4ada-b828-9920d108a287 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.011921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7832c-9a35-4dfb-a3cf-b172430dd29c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.026085 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.039948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.040921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.041202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.041475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.059366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.059514 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.061716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.072326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.073449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.073928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.074362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.075585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:12.076068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.078490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26d2ad-bed2-4bf9-af01-f07a55193193 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:12.081718 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:12.083681 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:12.084622 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:12.084622 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:12.084622 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:12.084622 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:12.088224 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 281/557] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:12.089223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.098899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 277/558] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:12.098899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda658fc-094c-45ee-a04a-7c2b1481e0e1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.098899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda658fc-094c-45ee-a04a-7c2b1481e0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.098899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda658fc-094c-45ee-a04a-7c2b1481e0e1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.098899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 278/559] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:12.099812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda658fc-094c-45ee-a04a-7c2b1481e0e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.246042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda658fc-094c-45ee-a04a-7c2b1481e0e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.268079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6a2c-1be8-4813-b139-b1502686cc75 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.295755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.296314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.296630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.296913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.297724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:12.298035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.299428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.317420 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 279/560] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:12.318254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.325397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.326471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.326916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.327355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.376243 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.412781 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.443308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efedd79d-870c-49ca-b021-c5a7e158ece8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.446393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.448863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.488262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.489307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.489610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.490037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.504317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.506157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1559ca97-5ff1-4c45-bcb2-935b5cc903a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:12.526733 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:12.528457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 280/561] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.530706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.549375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:12.551237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:12.591617 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 282/562] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:12.593414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.652397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 281/563] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:12.652397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.706629 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.716271 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:12.757777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13097e-a3b2-4e90-830f-bf14b213ac13 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.809438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.810326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.810605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.811026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.815122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59918d08-2b61-4363-8f94-6cddee427d9e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.819966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.821491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:12.839514 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:12.840642 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 283/564] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:12.841920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.860217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:12.860930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:12.861212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:12.861494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:12.862215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:12.862511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:12.863919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:12.876802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 282/565] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:12.878235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:12.980393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139bbdbe-c8ad-434b-bc51-da1ed5da805e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:12.993399 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.005160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c360a-e88a-4e81-a566-4d33fcc6cec1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.018629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.019728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.020013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.020277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.023609 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.032510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.033993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.043695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.044539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.044810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.045080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-408a4d7f-efac-4e3c-a7e3-c0479e89a1ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:13.055822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.057829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 284/566] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c333c4-da6d-41aa-bbef-69c619fb56af None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c333c4-da6d-41aa-bbef-69c619fb56af None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.060426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c333c4-da6d-41aa-bbef-69c619fb56af None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.064622 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 285/567] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:13.065488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c333c4-da6d-41aa-bbef-69c619fb56af None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.067621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:13.083359 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.084748 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:13.085931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 283/568] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.087581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.186160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c333c4-da6d-41aa-bbef-69c619fb56af None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.209559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef52ee1-a0cc-4707-8719-1683df1a65c0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.224328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.225336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.225698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.226145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.227116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:13.227567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.229318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.248387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.249351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.249632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.249909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] PATH_INFO: `/v3/users/glance` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.251785 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 286/569] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:13.252787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.259089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.260649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5fdee593-ce0b-401e-b05d-d8ee269bf8ae None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:13.279213 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.280310 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 284/570] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.281263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.282040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.298588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:13.299802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:13.307963 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.339019 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.373045 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 285/571] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:13.373913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.405241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4dd51d-73e9-4c59-a50a-ef5486d8fbc1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.441259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.442010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.442349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.442721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.443345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:13.443641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.445046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.457051 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 287/572] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:13.457888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.514861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61756ae5-7c91-43a7-a40e-1a31363998c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.554230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.555115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.555478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.555997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.556871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:13.557177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.558586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.568107 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 286/573] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:13.569018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.572622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6dbe59-9c4e-450a-9513-5b8d8d891df1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.575598 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.581860 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.612571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.613312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.613586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.613852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.625359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.626879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:13.644375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.645847 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.647568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:13.647568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:13.647568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:13.647568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:13.647568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 288/574] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.647568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.692773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b556b71-1247-464e-8f56-4d07995272d9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.734727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.735484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.735762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.736036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.736971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:13.737262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.738741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.754727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1663bb2-9d05-4e4f-af3c-be3db3fcb490 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.757119 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 287/575] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:13.757980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.793495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.794301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.794579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.794851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.805543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:13.813420 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.815342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 289/576] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.816998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.827700 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.840296 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:13.869839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96fc69-bc35-4a29-aa78-bbdd207841d7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.907623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.908554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.908831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.909106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.916067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.917565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.928512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a0f3a-1312-4096-9a22-df099e2fad69 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:13.932844 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.934494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:13.935405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:13.938981 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 288/577] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:13.939732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:13.965448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:13.966469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:13.966830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:13.967180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:13.979463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:13.980966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:13.998207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:13.999612 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:14.001391 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:14.001391 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:14.001391 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:14.001391 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:14.001391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 290/578] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:14.001932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.056122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d302b-4cf8-44da-9843-e398d6fd247e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.081907 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.085555 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.095965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.096676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.096952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.097228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.097997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.098287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.099701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.112441 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 289/579] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.113292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.123677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9358843e-d191-4d7e-800f-ce43084ecf26 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.158963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.159758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.160042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.160327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.171936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.173585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:14.192509 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:14.193739 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:14.196615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:14.196615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:14.196615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:14.196615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:14.196615 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 291/580] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:14.196615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.220404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6720a73-7659-405d-a078-53bbf90ce314 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.256881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.257679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.258044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.258401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.259266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.259656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.261170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.271255 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 290/581] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.272648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.310792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4cc91-22b2-4451-ab79-a719f28ba26f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.329942 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.335250 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.350821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.351567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.351728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.352014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.352836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.353135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.354578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.367906 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 292/582] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.368808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.400711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cba294-b0d2-44f3-8f4c-fee53b01dce3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.437002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.437674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.438067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.438374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.439169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.439543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.441255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.454376 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 291/583] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.455023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.479728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee7fc91-8d7d-435d-b5fa-3e598b40d6ca None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.522246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.523200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.523488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.523764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.532300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.533787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:14.548480 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:14.549499 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:14.550399 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 293/584] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:14.550890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.568892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd628a9-2536-4ffa-9eee-2a15d98b4aa4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.571395 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.604908 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.632334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.633409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.633839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.634303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.635454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.635929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.638265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.663319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 292/585] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.664317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.674281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d10f0-5cca-414a-85c8-940949700747 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.712711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.713648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.714075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.714438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.727337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.728904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:14.747482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:14.748882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:14.749758 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:14.749758 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:14.749758 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:14.749758 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:14.749758 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 294/586] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:14.749758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.790931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51bb56a-aa60-40db-8da0-1c564156a716 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.826480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.827135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.827422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.827701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.828692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=198dcf35a0894d4e824229e10573a251) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:14.829772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.830699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.836526 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 293/587] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/role_assignments?user.id=198dcf35a0894d4e824229e10573a251&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:14.837354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.862582 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.871052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06a1c6-2d8c-48bd-b876-d33ba1144c20 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:14.897179 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:14.925044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:14.925793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:14.926086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:14.926359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:14.936647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:14.938551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:14.955003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:14.956285 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:14.957738 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:14.960813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 295/588] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:14.962226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:14.988269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f12f23-5567-4e8c-a4fe-023e40e49ee7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.032719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.033741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.034239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.034518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.035329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:15.035637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.037152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.056800 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 294/589] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:15.057819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.119793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda1e403-65f5-4463-8068-78ab3c37ac01 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.165823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.166689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.167560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.167844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.176742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.178180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:15.196992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:15.197961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:15.198827 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 296/590] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:15.199958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.206694 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.222188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defead25-2c6a-4604-b57d-825a7d493e92 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.223386 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.267413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.268138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.268553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.268856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.269621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:15.270253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.271797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.285811 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 295/591] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:15.286662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.365006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9887d3-a0f2-4997-88b2-4dd34612e61b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.429820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.430816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.431221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.431633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.433035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:15.433473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4476fd-d2b0-4889-af5a-48726c578946 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.433580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.435786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.472806 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 297/592] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:15.472806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.481923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.482835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.483111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.483389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/55aac242daf746b283fb3cb561b3462e/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.504082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=55aac242daf746b283fb3cb561b3462e, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.505914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.519617 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.540640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 296/593] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:15 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/55aac242daf746b283fb3cb561b3462e/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:15.542017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.579067 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.624893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b1dc4f-d672-463c-85ba-833d83d25b61 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.675864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.676769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.677053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.677742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.678865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:15.679180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.681331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.684492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c825-db3f-4b2e-9666-bbc9702dc46a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.703623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 298/594] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:15.704812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.741234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.743189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.743473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.743749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.753286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.754203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:15.776044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:15.777133 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:53:15.778132 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:15.781685 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 297/595] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:15.783009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:15.855212 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.866439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608ce5f-77d8-4c68-8cee-6d440ca03363 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.906606 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:15.910567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6715dde-88c6-459f-9c7f-cd632ff38c85 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:15.916578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.918439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.918854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.919245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.940132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.942793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.957298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:15.959341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:15.959868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:15.960659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2bbe7cd61ad745a9833acd3d3e4a066d/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:15.978544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:15.979543 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:15.980465 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:15.980465 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:15.980465 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:15.980465 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:15.985500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=2bbe7cd61ad745a9833acd3d3e4a066d, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:15.987472 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 299/596] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:15.987642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:15.989126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.006935 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 298/597] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:15 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2bbe7cd61ad745a9833acd3d3e4a066d/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:16.009032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.162361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c0a847-8435-4c4a-9e9f-9105848e1331 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:16.174529 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:16.206614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:16.207758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:16.208261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:16.208822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:16.209820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:16.210361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:16.212055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:16.226591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 299/598] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:16.241751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.309595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a6fc4-19b2-4683-ba45-3a60ade7d2fa None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:16.395212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:16.396490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:16.397176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:16.397580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:16.399236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:16.399791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:16.402678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:16.423426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c973b086-a6a2-4bac-9f90-116a65653b89 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:16.437183 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 300/599] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Jul 19 10:53:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:16.445083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.471912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:16.473574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:16.474011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:16.474464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:16.485067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:16.488209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:16.523868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:16.524866 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:16.525735 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:16.527803 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 300/600] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:16.538090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.542699 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:16.605812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21ccf8-a4f3-4faa-9ca0-e9887838914d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:16.642211 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:16.644482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:16.645628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:16.645904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:16.646209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:16.658225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:16.659736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:16.679808 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:16.680813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:16.681683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:16.681683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:16.681683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:16.681683 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:16.681683 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 301/601] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:16.686804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.789224 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:16.796466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f7e82-c7d7-494c-b873-ca02b5244310 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:16.837326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:16.838015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:16.838299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:16.838580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:16.839325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:16.839633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:16.841054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:16.856455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf51f6d-572f-4401-b884-3a6be75d256b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:16.870859 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 302/602] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:16.876132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:16.945619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:16.946967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:16.947456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:16.947935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:16.950792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:16.951303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:16.954026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:16.999982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 301/603] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:17.008374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.119130 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:17.136692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c93942-2456-4a23-91f5-bde82c04faae None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:17.144286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853d85e5-ef3f-4bfd-be88-97c0c9a492ae None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:17.188311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a5270d-90a8-4d9c-981b-bb6ab12c7edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:17.189926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5270d-90a8-4d9c-981b-bb6ab12c7edc None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.190896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5270d-90a8-4d9c-981b-bb6ab12c7edc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.191447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a5270d-90a8-4d9c-981b-bb6ab12c7edc None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2af38e680ecd4346b44dad744de8e50c/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.208387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:17.209589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.209933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.210362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.212375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5270d-90a8-4d9c-981b-bb6ab12c7edc None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=2af38e680ecd4346b44dad744de8e50c, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:17.214363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a5270d-90a8-4d9c-981b-bb6ab12c7edc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:17.225563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:17.229205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:17.233685 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 302/604] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:17 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2af38e680ecd4346b44dad744de8e50c/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:17.235751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707cd90-f147-4dab-b883-4ac8067e99f9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.236271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707cd90-f147-4dab-b883-4ac8067e99f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.236792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707cd90-f147-4dab-b883-4ac8067e99f9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.243287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 303/605] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:17.245274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.245771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.246283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:17.260635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:17.261664 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:17.262621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:17.263623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 303/606] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:17.277300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.284408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:17.290090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:17.341751 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:17.482396 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 304/607] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:17.505939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.509323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2535ab-54fa-432e-a940-6d7784404831 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:17.567015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819daf4a-7187-4764-8290-d8634973578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:17.568060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819daf4a-7187-4764-8290-d8634973578f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.568565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819daf4a-7187-4764-8290-d8634973578f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.569038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819daf4a-7187-4764-8290-d8634973578f None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.570198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819daf4a-7187-4764-8290-d8634973578f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:17.570868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819daf4a-7187-4764-8290-d8634973578f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:17.580371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819daf4a-7187-4764-8290-d8634973578f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:17.598017 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:17.610248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 304/608] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:17.616498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819daf4a-7187-4764-8290-d8634973578f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.694683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2acb0-1da6-4814-ab9f-e04103a1690f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:17.714324 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:17.746583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819daf4a-7187-4764-8290-d8634973578f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:17.788841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:17.791284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.791850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.792523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.813753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:17.820601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:17.821839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:17.822443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:17.822918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/86cbfe3a2d7b4b25b4ec629118e20d5a/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:17.831869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:17.832899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:17.833743 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:17.842025 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 305/609] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:17.850994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:17.874653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=86cbfe3a2d7b4b25b4ec629118e20d5a, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:17.876742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:17.895004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 305/610] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:17 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/86cbfe3a2d7b4b25b4ec629118e20d5a/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:53:17.991420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebc87bb-ffc1-4c81-8da3-7a8f4fc09376 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.024096 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.034357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.035426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.035935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.036542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.037682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:18.038220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.040022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b3749f-2b87-43d2-bb8f-ead6ce326313 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.064423 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 306/611] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:18.065710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.154849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4acc16-38bc-4017-90bb-2396aef31932 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.155231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4acc16-38bc-4017-90bb-2396aef31932 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.155671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4acc16-38bc-4017-90bb-2396aef31932 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.157583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 307/612] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:18.166091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.166585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.167054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.217628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:18.219224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:18.228689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74232f25-0831-4687-b5ab-e47118da1955 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.269705 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.289891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.290859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.291145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.291421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.303567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.305123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.322539 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 308/613] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:18.330942 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:18.332877 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:18.334766 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:18.334766 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:18.334766 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:18.334766 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:18.335289 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 306/614] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:18.341028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.350515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.495319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402562e6-dfb5-4e8d-aefe-e86027478100 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.533247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.533958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.534244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.534521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.535268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:18.535637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.537048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.544777 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.550394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 309/615] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:18.556428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.634926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a11aa4-87a2-4815-a6e8-195ea63b4b06 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.713059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.713981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.714266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.714541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.739478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:18.747435 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:18.749312 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:18.750917 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:18.756493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641b11b-8a24-41e0-8adf-78b62f22380e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:18.763273 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 307/616] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:18.771237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:18.860303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:18.862238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:18.862993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:18.863727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:18.889706 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:18.889905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:18.892694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:18.953234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:18.954302 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:18.955342 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:18.962145 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 310/617] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:18.971912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.055642 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.069970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60450008-23b4-45c0-91bf-10cb2f924b1b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.145158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.146599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.147105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.147579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.148594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.150626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.152285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.171919 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 308/618] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:19.177179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.186241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f62e-defe-493d-a322-2f945aa683ea None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.254289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.255456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.255956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.256466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.259811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.260392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.262866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.308461 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 311/619] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jul 19 10:53:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:19.314658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.395266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f06c9e1-e852-4279-bbcd-ef02522ab183 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.397611 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.433996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.434743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.435027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.435615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.458847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.462291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.483377 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a203b7fa-0b6e-4bc9-a503-ebcc3babf0a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:19.487490 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:19.488445 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:19.489354 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:19.489354 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:19.489354 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:19.489354 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:19.490008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f145b74-5b13-413f-af22-70714bfa3b8a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.491884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 309/620] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:19.495594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396c77-e71a-4d5c-8544-469cc398a3bb None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.496391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396c77-e71a-4d5c-8544-469cc398a3bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.496875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14396c77-e71a-4d5c-8544-469cc398a3bb None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.498922 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 310/621] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:19.499994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396c77-e71a-4d5c-8544-469cc398a3bb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.554446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.555825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.556323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.556948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.576320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.579090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7c4b4878-e1f8-49c9-80ed-fd52d471b0bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:19.613008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:19.613970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:19.614858 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:19.614858 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:19.614858 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:19.614858 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:19.619317 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 312/622] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:19.620845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.621523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.621523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.639534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:19.640773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:19.645155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14396c77-e71a-4d5c-8544-469cc398a3bb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.692846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.694312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.694814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.696369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.697453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.698161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.699856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.717111 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 311/623] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:19.718987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.735595 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.755796 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 313/624] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:19.757386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.858703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3105494a-6078-4304-afe7-269e2ba99f38 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.900190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.901285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.901794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.902268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:19.903222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:19.903777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:19.905525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:19.918691 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:19.921610 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 312/625] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:19.922780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:19.950110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2d7b95-19d5-4a39-b87b-39c66c00efe2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:19.990104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:19.991194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:19.991647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:19.992098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.004621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.007188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:20.033761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:20.034786 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:20.035737 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 314/626] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:20.037025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.037625 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.098615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3089-9c79-4c4f-b7b4-16c890cf48ca None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.153909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff7c7a-3e28-4d1d-ab51-bbbe46189a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.157770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7c7a-3e28-4d1d-ab51-bbbe46189a31 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.157770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7c7a-3e28-4d1d-ab51-bbbe46189a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.157770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff7c7a-3e28-4d1d-ab51-bbbe46189a31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.175150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff7c7a-3e28-4d1d-ab51-bbbe46189a31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-baff7c7a-3e28-4d1d-ab51-bbbe46189a31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:20.183629 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:20.191220 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 313/627] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:20.192251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d472a-df52-499e-8b81-b054d6b5b24f None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.193150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d472a-df52-499e-8b81-b054d6b5b24f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.193150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d472a-df52-499e-8b81-b054d6b5b24f None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.193150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 314/628] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:20.193150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d472a-df52-499e-8b81-b054d6b5b24f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.202723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc360c-ffba-422f-b451-0553ed8fcb13 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.244096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.245791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.246076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.246345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.254962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.256456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.260766 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:20.275884 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:20.277074 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:20.277994 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 315/629] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:20.279436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.355723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d472a-df52-499e-8b81-b054d6b5b24f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.397005 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.403737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.404504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.404734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.405003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.405847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:20.406316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.407924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f07abc-ab99-4421-9ceb-cd1e99d6c525 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.432733 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 315/630] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:20.433895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.434182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.434469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.450358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982dff84-11b5-4202-9b85-6ba5a2c13c29 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.452636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:20.453956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:20.498796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.499966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.500411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.500919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.502216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:20.502675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.505424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.520148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 316/631] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:20.522168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.534849 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 316/632] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:20.535711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.607521 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.649520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944ea3-bb2d-4379-bafb-26ee54d88827 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.652616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec11b299-905e-4e68-9762-7215cee7d83c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.672199 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.691427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.692027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.692304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.692611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.693401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:20.693701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.694475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.695143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf67cae2-30ff-4679-b498-373cf9bd99e4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.695284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.695632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.695964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.709950 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 317/633] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:20.712939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6858-07e8-46c6-bcad-3d1ad9695721 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.713378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6858-07e8-46c6-bcad-3d1ad9695721 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.713767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f6858-07e8-46c6-bcad-3d1ad9695721 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.720426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 318/634] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:20.720426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f6858-07e8-46c6-bcad-3d1ad9695721 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.786393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.787865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.838455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f6858-07e8-46c6-bcad-3d1ad9695721 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:20.867002 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:20.884214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:20.885555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:20.886051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:20.886713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:20.904752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:20.907630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:20.912753 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 317/635] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:20.913668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:20.934922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:20.936626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:20.937782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:20.937782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:20.937782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:20.937782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:20.937782 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 319/636] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:20.937782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:20.939949 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.035224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235aade6-bc08-4a53-b65f-4485ae1f4a45 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.060195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2176e-ecfa-4368-a3b6-652006bcde43 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.072998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e496aaf-e7c4-487d-b5ad-c0a70560c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.073811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496aaf-e7c4-487d-b5ad-c0a70560c58d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.074087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496aaf-e7c4-487d-b5ad-c0a70560c58d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.074358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e496aaf-e7c4-487d-b5ad-c0a70560c58d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.085363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e496aaf-e7c4-487d-b5ad-c0a70560c58d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7e496aaf-e7c4-487d-b5ad-c0a70560c58d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:21.093389 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:21.095209 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 318/637] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:21.097121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.098765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.098765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.104317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.105361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.105743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.106113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/198dcf35a0894d4e824229e10573a251/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.114685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:21.115901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:21.127123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=198dcf35a0894d4e824229e10573a251, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.130031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.153045 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 320/638] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:20 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/198dcf35a0894d4e824229e10573a251/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:21.154456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.211753 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 319/639] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:21.212796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.225085 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.233731 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.362767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b660d69b-4a1c-42ce-b13e-84113e966f38 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.386214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044fa7b-3588-4292-b769-81217e88e3d1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.409188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.410787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.411282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.411770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.428654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.429336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.429612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.429882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.430626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.430934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.431829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.432333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.434520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.450096 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 320/640] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:21.450096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:21.469320 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:21.470364 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:21.471281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:21.471281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:21.471281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:21.471281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:21.477562 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 321/641] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:21.478384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.536490 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.579514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800f5f8-aec0-4d03-be94-17da5389ed11 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.597336 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.624597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.625751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.626213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.626767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.628176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.628781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.629286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7b1dd-2f11-477d-803c-1ea785be4d23 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.631318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.646274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 321/642] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:21.647785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.687617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.689013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.689399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.689768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.709589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:21.725950 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:21.727201 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 322/643] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:21.734017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.829637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0a03be-1f2b-4d09-9118-ae4f0b697833 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.863066 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.870180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.870992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.871265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.871551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.878522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a32064-8ac1-421c-bdbb-10408bb754d9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:21.881926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.883433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:21.900404 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:21.902578 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 322/644] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:21.905569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:21.930284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:21.930963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:21.931247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:21.931525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:21.932276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:21.932630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:21.934111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:21.937790 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:21.955297 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 323/645] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:21.955297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.065809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34b21e-3297-4ab1-a44c-c7bdacb6ec91 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.113137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.113939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.114555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.114853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.119533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8477d-408f-485d-a017-600b760a416a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.130267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.131744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:22.157347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:22.159115 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:22.162466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:22.162466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:22.162466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:22.162466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:22.162466 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 323/646] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:22.162466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.170501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.171444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.171848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.172315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.173310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.173806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.175745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.186044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 324/647] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:22.188389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.226704 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.266716 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.295711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47267758-8ffa-4a2c-bc2b-d0f78c453d25 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.333587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ac0ec-3397-4f26-ac22-7770f91763b8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.336093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.336826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.337126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.337401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.338234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.338540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.340042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.360796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 324/648] 10.222.0.15 () {56 vars in 1137 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:22.361710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.388377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.389549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.390010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.390460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.399327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.401387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:22.417833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:22.419028 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:22.420872 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:22.421744 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 325/649] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:22.422575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.490432 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.496325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5012b-911a-463d-a844-913419cf2c84 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.537786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.538671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.539077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.539818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.540855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.541242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.543166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.554086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a992f2-1106-4934-ba76-bc962f10a1ce None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.567592 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 325/650] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:22.567592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.587714 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.593425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.594334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.594674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.595011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.607172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.608806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:22.629181 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:22.630941 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:22.632061 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:22.632061 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:22.632061 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:22.632061 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:22.632061 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 326/651] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:22.632061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.719969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd58b079-76a8-492c-a038-07f8c3693c19 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.764619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.765379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.765659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.765930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.796794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e196cf78-e9eb-4fb6-9257-2680a82c0678 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:22.806253 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:22.858280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:22.858843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:22.859131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:22.859482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:22.860239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:22.860585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.862291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.879155 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 327/652] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:22.879828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:22.895097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:22.897017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:22.934626 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.022526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872bb2b-816e-4638-8f35-cddc6e4a8b85 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.048639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 326/653] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:23.049907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.090796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.092318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.092859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.093359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.108187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.111023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.126947 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:23.139862 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:23.141013 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:23.141979 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:23.142589 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 328/654] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:23.143976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.188920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc82ad83-f94d-41f7-9bcb-9d7fb2ce43e6 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.229285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.229935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.230223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.230501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.231273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:23.231584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.233029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.247097 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 327/655] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:23.247097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.295807 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.306670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9e963-18ee-4ed6-965e-6d024c715698 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.343368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.344083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.344383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.344668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.345513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=55aac242daf746b283fb3cb561b3462e) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:23.345839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.347301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.353947 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 329/656] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/role_assignments?user.id=55aac242daf746b283fb3cb561b3462e&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:23.354776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.378403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d21bf5-21a8-4f41-b1f1-ee2262b2beb9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.405398 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.425643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.426937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.427401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.427804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.446687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.448471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:23.469666 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:23.470780 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:23.477322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:23.477322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:23.477322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:23.477322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:23.477322 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 328/657] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:23.477322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.511442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1c22-bdca-47d1-8850-5d3e0be11732 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.564202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.564470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.564839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.565006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.566451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:23.566767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.568242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56971bce-7555-44c2-8d6f-904121f67fd6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.586848 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 330/658] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:23.588394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f415bb-c4e2-4366-b113-0118ba6f5bb6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.588850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f415bb-c4e2-4366-b113-0118ba6f5bb6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.589224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f415bb-c4e2-4366-b113-0118ba6f5bb6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.590934 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 331/659] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:23.592001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f415bb-c4e2-4366-b113-0118ba6f5bb6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.607800 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.619705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e3fe7a-1168-41c6-90c9-b2db65db583f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.658778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.659501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.659777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.660045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.668371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.669852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:23.684787 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:23.686003 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 329/660] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:23.686968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.709638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f415bb-c4e2-4366-b113-0118ba6f5bb6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.725685 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.747759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.748456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.748745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.749025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.749758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:23.750066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.751457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d44b35-23f2-4531-8bd3-d343d20276bf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.764254 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 332/661] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:23.770108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.770397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.770678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.787802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:23.789063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:23.801141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d39106-7eb0-448f-9f5d-1e5d87da5705 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:23.842157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:23.842811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:23.843089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:23.843354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:23.864759 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 333/662] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:23.865971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:23.868894 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.928455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:23.929916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:23.963381 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:23.989097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7630ddc0-2be0-428c-9697-ca0dac72dd34 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.026335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.027021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.027313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.027585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.028459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:24.028772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.030245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.045076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 330/663] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:24.046047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.049083 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 334/664] 10.222.0.15 () {56 vars in 1139 bytes} [Tue Jul 19 10:53:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:24.050151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.119780 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.161474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f801f1-51b4-490e-8236-851a233849d5 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.165575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de607e48-af30-4941-a44a-c25af6cd853b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.194006 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.200617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.201431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.201696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.201839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.201990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.202963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.203421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.203879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.209380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.211156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.215044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:24.222899 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:24.223869 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:24.224718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 335/665] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:24.225417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:24.227311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:24.228180 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:24.229108 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:24.229965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 331/666] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:24.230792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.342723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d318c1-e211-4586-9866-61bbe4f58bf7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.344310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a571a-4a7f-4a0f-91fb-46edc0aba779 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.365247 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.381540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.382348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.382628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.382906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.395175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.397042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.398786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.400378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.400574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.401053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:24.417130 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:24.418323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:24.419277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:24.419277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:24.419277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:24.419277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:24.423037 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 336/667] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:24.424060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.486732 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.498982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.500503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.564803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca58c88-9141-40de-990f-8edd7ce14fc6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.605922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.606605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.606892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.607166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.607922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:24.608234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.609676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.619019 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 337/668] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:24.619857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.641055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 332/669] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:24.642811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.680187 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.773813 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:24.784210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a606e96c-b802-4777-a90a-bd6835de87d9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.792794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65329dd-2a84-497c-8923-f942f981f3b5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:24.834704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.835368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.835664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.836021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.836719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:24.837076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.837740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:24.838414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.838594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:24.838995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:24.839294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:24.840497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:24.841525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:24.843410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:24.851205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 333/670] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:24.851892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:24.875660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 338/671] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:24.875660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.001635 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.010544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b41c1cc-cbbe-44eb-8e68-3eca663857a5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.017211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e36e72-144f-4cb5-9615-824384297d0a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.062469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.063851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.064057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.064438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.072946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.074329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.074606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.075022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.077105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.078690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.089576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.091062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:25.098747 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.099938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.100981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:25.100981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:25.100981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:25.100981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:25.100981 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 339/672] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:25.101333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:25.116069 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.117556 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.119368 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:25.119368 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:25.119368 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:25.119368 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:25.122384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 334/673] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:25.123213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.134540 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.233128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb87aaaf-0dc6-43bd-86cc-bcb6221fb6d4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.264498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271af4dc-f2ff-4614-95d0-2b4155ba4148 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.294132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.295674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.296169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.296701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.303228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.304801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.305414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.305913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.306982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2bbe7cd61ad745a9833acd3d3e4a066d) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.307515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.309127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.309296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.311971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.319986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 335/674] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/role_assignments?user.id=2bbe7cd61ad745a9833acd3d3e4a066d&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:25.321736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:25.328125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.330096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 340/675] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:25.331949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.343306 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.460456 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.485815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda8dbf3-4dd2-4596-a65a-82b64e095a3f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.532385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.532385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.532385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.532385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.532802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.532802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.533147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.544694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58146ba-9f42-424b-9baa-383f281718d1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.554705 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 341/676] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:25.556147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.585664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.586255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.586511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.586785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.587535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.587830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.589261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e67ee5-2b7d-41e4-94a7-dd514a7bcf75 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.606443 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 336/677] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:25.608902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b9f2-87b0-4c15-981d-75e94fccf3db None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.609396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b9f2-87b0-4c15-981d-75e94fccf3db None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.609878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b9f2-87b0-4c15-981d-75e94fccf3db None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.612693 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 337/678] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:25.613601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b9f2-87b0-4c15-981d-75e94fccf3db None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.650902 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.700339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d90ead-b1f5-4ad7-b68b-eda2a7129974 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.747581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b9f2-87b0-4c15-981d-75e94fccf3db None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.751111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.751479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.751716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.752205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.753118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:25.753545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.755055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.771794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 342/679] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:25.772827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.784382 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:25.797656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:25.798476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.798757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.799294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.807957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:25.809486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-225f11f7-3b2e-48da-a141-0a0f02a4f38a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:25.825894 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:25.827762 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 338/680] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:25.829568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:25.832599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:25.850002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:25.851976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:25.945625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de9977-b162-482f-b333-8f98ce59352a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:25.948534 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 339/681] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:25.948534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:25.987074 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.005237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.006192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.006479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.006761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.015303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.016876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:26.034279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:26.036119 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 343/682] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:26.037782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.106694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89667a46-36de-45e2-be81-8c330a11ce78 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.135686 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.166665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.167354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.167631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.167904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.168835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2af38e680ecd4346b44dad744de8e50c) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:26.169156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.170706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.178618 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 340/683] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:25 2022] GET /identity/v3/role_assignments?user.id=2af38e680ecd4346b44dad744de8e50c&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:26.179050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.221786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4d752-9cce-4100-86e8-a9e9985e835f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.307455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.310089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.311011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.311714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.313666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:26.314715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.319573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.357418 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 344/684] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:26.365287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.382350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826b248-7163-4892-b408-e0cffab6e233 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.423635 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.450561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.451570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.451861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.452395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.454055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.455701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:26.492476 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:26.494283 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:26.495872 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 341/685] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:26.497547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.520244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca009d7-79a5-4d2e-84fd-de8829d12150 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.560653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.560653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.560984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.561210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.561943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:26.562256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.563728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.577988 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.578929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 345/686] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:26.580288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.648234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9399dd-1723-41fe-b2fe-2c1376c2b494 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.686966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.687780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.688163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.688592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.739021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e5abb-f131-4e15-be78-3f7154fe21de None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:26.742444 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.767509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.769551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.798900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:26.800219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:26.800751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:26.801136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:26.802642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:26.802903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:26.805805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:26.820925 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 346/687] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:26.822747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:26.823560 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:26.907965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 342/688] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:26.909346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.004431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e15f40-ef66-431b-8175-0b3298bd9f7c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.029697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0394d-444a-4f8d-9b8b-d1d4b8432230 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.072040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.073258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.073814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.074292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.075518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:27.076047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.078127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.086516 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 343/689] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:27.087805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.100157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.101571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.102064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.102475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.104052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=86cbfe3a2d7b4b25b4ec629118e20d5a) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:27.104456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.107661 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:27.108276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.130464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 347/690] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:26 2022] GET /identity/v3/role_assignments?user.id=86cbfe3a2d7b4b25b4ec629118e20d5a&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:27.277887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c208ea92-b366-4daf-a391-7e3389ce781c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.336907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.338737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.339570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.340335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.361504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.364906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-1d1dd8f8-2654-41c1-a679-fb27f785a48f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:27.398719 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:27.399760 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:27.400747 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:27.400747 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:27.400747 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:27.400747 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:27.404398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 344/691] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:27.412534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.467324 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:27.555068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba288f-5c67-4622-b539-113df6985c71 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.582286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d41d-6567-4f4f-9814-6aedd9732ebc None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.582949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d41d-6567-4f4f-9814-6aedd9732ebc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.583231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6638d41d-6567-4f4f-9814-6aedd9732ebc None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.585030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 345/692] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:27.591853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d399-29a3-4106-beca-2754888d366d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.592164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d399-29a3-4106-beca-2754888d366d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.592426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3d399-29a3-4106-beca-2754888d366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.597801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.598523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.598766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.599035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.599767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:27.600072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.602056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.626966 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 348/693] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:27.631877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.642241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-71c3d399-29a3-4106-beca-2754888d366d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:27.643509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-71c3d399-29a3-4106-beca-2754888d366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:27.709632 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:27.723738 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 346/694] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:27.743666 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:27.749285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d399-29a3-4106-beca-2754888d366d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.754436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f23fe0-325e-4db0-ab2b-dd6666d54759 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.800783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:27.802001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:27.802534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:27.803024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:27.819392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:27.822973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:27.853984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:27.854975 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:27.855861 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:27.860979 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 349/695] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:27.868379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:27.924029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3d399-29a3-4106-beca-2754888d366d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:27.997148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f72425-bd35-4c70-b9c0-718fb652afb3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.033103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578920f-a321-4e44-a32b-131354516310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.033988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578920f-a321-4e44-a32b-131354516310 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.034260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578920f-a321-4e44-a32b-131354516310 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.034535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578920f-a321-4e44-a32b-131354516310 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.035884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.036867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.037345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.037829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.038818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:28.039339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.041084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.064750 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 350/696] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:28.072537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:28.073249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578920f-a321-4e44-a32b-131354516310 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.074738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578920f-a321-4e44-a32b-131354516310 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-1578920f-a321-4e44-a32b-131354516310 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:28.096978 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:28.097952 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:28.099034 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:28.099034 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:28.099034 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:28.099034 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:28.099034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 347/697] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:28.104105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578920f-a321-4e44-a32b-131354516310 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:28.111583 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:28.200762 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:28.261040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff570c-1caf-4a11-b3cf-33928d93d5e5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.330003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578920f-a321-4e44-a32b-131354516310 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.345201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.346029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.346533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.346818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.347863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=198dcf35a0894d4e824229e10573a251) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:28.348237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.349982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.368899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.369606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.369886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.370157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.370888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:28.371139 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 351/698] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/role_assignments?user.id=198dcf35a0894d4e824229e10573a251&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:28.371253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.372777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed198719-20c1-49df-a763-e4ed611752bb None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.386819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 348/699] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:28.392751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:28.546571 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:28.577384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ccd532-2fac-45e9-992b-ad1339a58c61 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:28.623157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b281c8-d91f-42ce-9aa4-3a605603286a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:28.623768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b281c8-d91f-42ce-9aa4-3a605603286a None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.624053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b281c8-d91f-42ce-9aa4-3a605603286a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.624319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b281c8-d91f-42ce-9aa4-3a605603286a None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.625055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b281c8-d91f-42ce-9aa4-3a605603286a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:28.626586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b281c8-d91f-42ce-9aa4-3a605603286a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:28.654417 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 352/700] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:53:28 2022] POST /identity/v3/users => generated 254 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:28.714530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423d11-6aae-45de-a696-23d8859b40f3 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.715200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423d11-6aae-45de-a696-23d8859b40f3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.715483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd423d11-6aae-45de-a696-23d8859b40f3 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.717430 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 349/701] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:28.723636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:28.724332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:28.725000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:28.747847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:28.749642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:28.837864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 353/702] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:28.871615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423d11-6aae-45de-a696-23d8859b40f3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.011429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd423d11-6aae-45de-a696-23d8859b40f3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.016366 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.063791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.064926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.065444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.065854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.079371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:29.087646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:29.088833 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:29.089706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:29.092127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 350/703] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:29.098734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.208748 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.253437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de132-5fc9-49c4-9d2a-1bfa34c3760a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.307669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.308271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.308587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.308866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.309625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:29.309935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:29.311411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:29.324312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 354/704] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:29.330026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.462867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21db9e-bf85-4ea4-bdbe-f4b4a18b21e4 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.500436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.501294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.501581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.501867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.514037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:29.515533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:29.535121 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:29.537589 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:29.539385 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:29.539385 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:29.539385 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:29.539385 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:29.539385 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 351/705] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:29.545547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.729877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b7d873-7c77-48db-89f7-7807cd7afb4d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:29.759979 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.778153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:29.779284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.779788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.780259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.781200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:29.781715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:29.783292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d990e10-f937-498c-825b-9233ccb98c84 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:29.800229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 355/706] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:29.806067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:29.841031 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:29.901977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1879254-e003-45cd-8709-770d37f282c3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.902735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1879254-e003-45cd-8709-770d37f282c3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.903134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1879254-e003-45cd-8709-770d37f282c3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.906326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 356/707] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:29.911298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccac5c-7445-481a-97c1-4e2b4ee29482 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:29.911577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccac5c-7445-481a-97c1-4e2b4ee29482 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:29.911855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ccac5c-7445-481a-97c1-4e2b4ee29482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:29.932157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09ccac5c-7445-481a-97c1-4e2b4ee29482 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:29.933458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09ccac5c-7445-481a-97c1-4e2b4ee29482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:30.005122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01a56-3bca-4196-96e6-78c5a9c86118 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.079574 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 357/708] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:30.096759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9c41-a970-47cb-80fe-ea89189f4c5d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.097368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9c41-a970-47cb-80fe-ea89189f4c5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.098056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faab9c41-a970-47cb-80fe-ea89189f4c5d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.099918 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 358/709] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:30.104783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab9c41-a970-47cb-80fe-ea89189f4c5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.111683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.113742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.114317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.114846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.126722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.129277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ab7d6a9a-3922-4e6e-8962-e3323d641a50 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:30.149225 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:30.150217 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:30.151146 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:30.154101 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 352/710] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:30.161909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.162503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.162941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.187706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:30.189681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:30.231126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faab9c41-a970-47cb-80fe-ea89189f4c5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.248302 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.273846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.274702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.275173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.275570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.276743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.278179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.303269 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 359/711] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:30 2022] POST /identity/v3/services => generated 251 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:30.303845 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 353/712] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:30.304943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.321651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.331730 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.464776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54edef92-7402-4982-b838-73f5c4c73588 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.510218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.510907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.511190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.511464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.512525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:30.512863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.517596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.548144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 360/713] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:30.553939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.555472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719779b-09f4-49a1-b1d8-9d7faad9ed22 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.608848 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.620530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.621767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.622278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.622759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] PATH_INFO: `/v3/services/network` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.623653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.625367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:30.638161 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:30.639278 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:30.640159 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:30.643177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 354/714] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/services/network => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:30.649736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.697315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7307-8d7e-4bf4-9b07-a604aa47bb7c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.728439 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.743550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.744967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.745481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.745954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.763511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad88f78e-71ec-4df4-b440-e4ed6fe08301 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.808716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.809423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.809704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.809990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.811506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] RBAC: Adding query filter params (name=network) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:30.811506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.815621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.821929 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 355/715] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:30.827544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.835856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.837829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.870265 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.948643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f96543-45e5-426d-8a0d-a04e11ec952d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:30.990106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:30.990106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:30.990106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:30.990106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:30.990719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] RBAC: Adding query filter params (type=network) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:30.990719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:30.990719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9640e84e-80b5-4247-bbf5-c06b72133f16 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:30.991458 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:30.991696 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 361/716] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:30.993828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:30.996416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 356/717] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/services?type=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:31.120423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cb918-2346-4eb4-856d-7a6a7e1d054e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.148056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476d984-ac69-4e18-91a9-3e044acd48b4 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.148471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476d984-ac69-4e18-91a9-3e044acd48b4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.148694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476d984-ac69-4e18-91a9-3e044acd48b4 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.150173 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 357/718] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:31.156448 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.158203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.158759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.159462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.169279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.170421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.170574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.170852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.185132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.186609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.196704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:31.198208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:31.213833 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:31.215088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:31.216378 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:31.216378 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:31.216378 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:31.216378 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:31.225076 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 362/719] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:31.227900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.299107 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 358/720] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:31.329442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.372386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc2989-f2bd-49e3-b8fc-10b6127d720e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.423497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.424758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.425232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.425741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.427110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:31.427569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.429800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc51812-a907-4c57-9c43-fc6f69aee0ed None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.459315 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 363/721] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:31.459315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f9a2-6e86-4e09-8934-c26eb5eb01c1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.459315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f9a2-6e86-4e09-8934-c26eb5eb01c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.459315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0f9a2-6e86-4e09-8934-c26eb5eb01c1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.465947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a84ca5-e7d1-409c-ba38-44335cbffb11 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.467626 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 364/722] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:31.469171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0f9a2-6e86-4e09-8934-c26eb5eb01c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.501461 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.515520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff2f86d-db2e-4cf7-9c4d-cc4977ea2e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.516974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f86d-db2e-4cf7-9c4d-cc4977ea2e43 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.517443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f86d-db2e-4cf7-9c4d-cc4977ea2e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.518344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f86d-db2e-4cf7-9c4d-cc4977ea2e43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.534130 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.534881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff2f86d-db2e-4cf7-9c4d-cc4977ea2e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-bff2f86d-db2e-4cf7-9c4d-cc4977ea2e43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:31.544461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:31.545507 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:31.546707 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 359/723] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:31.548761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.549248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.549624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.568661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:31.570230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:31.625081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0f9a2-6e86-4e09-8934-c26eb5eb01c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.662531 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 360/724] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:31.663820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.689839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.690859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.691245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.691649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.703176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.705281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:31.721896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:31.723077 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:31.724200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:31.730722 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 365/725] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:31.730722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.810001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631bb21d-85f8-457b-8666-85d81e6f79dd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.834182 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.858130 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:31.862605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5b794-3fc2-4b70-a02c-65445f5de3bb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:31.866152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.868075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.868605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.869066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.870104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:31.870586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:31.872188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:31.887908 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 361/726] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:31.889340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:31.914543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:31.915570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:31.918499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:31.918499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:31.932416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:31.940769 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:31.941762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:31.942588 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:31.947240 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 366/727] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:31.948410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.016787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a732952-bef0-4493-9c47-200bda3a2e3f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.056036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.057058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.057646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.058123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.059207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.061809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d971b7-4306-4071-a471-9bf6edf0f91c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.062376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.064261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.078832 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 362/728] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:32.080132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.104394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.105340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.105701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.106047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.119445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.121271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.130362 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:32.143964 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:32.144938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:32.146016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:32.146016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:32.146016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:32.146016 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:32.146016 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 367/729] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:32.148528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.175978 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.207728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20f8f1b-8836-4cad-814e-2b4c27b349c6 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.247035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.248036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.248522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.249000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.249962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.250459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.252231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.262726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 363/730] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:32.263874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.309118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aeb0d6-94ac-497f-8df1-d801d7eaf28d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.345955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.346783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.347138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.347483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.348815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2af38e680ecd4346b44dad744de8e50c) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.348815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.350323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.364700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 368/731] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/role_assignments?user.id=2af38e680ecd4346b44dad744de8e50c&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:32.365839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.385447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418c8e5-ab40-4767-bf2c-cf08ccf223c2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.387865 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.430908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.432005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.432543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.433047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.434039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.434604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.436483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.462776 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 364/732] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:32.471024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.509707 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.534891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce9f64a-ff8d-4c0b-b4e3-5fb4830c8ff3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.618290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.620497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.621281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.622069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.623022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da9df9-ef6e-4d76-9b9a-82e472d87b28 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.651458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.653541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.662534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.663353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.663634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.663908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] PATH_INFO: `/v3/users/swift` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.672162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.673689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:32.689593 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:32.690665 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:32.691616 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 365/733] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:32.693780 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:32.694669 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:32.695535 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:32.695535 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:32.695535 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:32.695535 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:32.698270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 369/734] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:32.699912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.703599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.737496 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.869105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea395442-a6f3-4776-bbed-3ec6c7125bce None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.892779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05733d55-3c27-4f0d-9074-08113727e959 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:32.922624 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:32.933747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.934840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.935319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.935790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.936987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.937519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.939300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.945240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:32.945867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:32.946156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:32.946434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:32.947175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:32.947485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:32.948931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:32.961971 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 366/735] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:32.967074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 370/736] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:32.968422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:32.968663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.061739 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.077759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78829eab-54d4-4165-ab89-22fee37b5c48 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.086283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e36a1-8a9e-40b8-9c4f-a5ac42a99766 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.116393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:33.117504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.117861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.118210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.128144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:33.131084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:33.132152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa1c7ef-46f4-4e03-9cb3-de68a17e8959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:33.133167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c7ef-46f4-4e03-9cb3-de68a17e8959 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.133674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c7ef-46f4-4e03-9cb3-de68a17e8959 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.134310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa1c7ef-46f4-4e03-9cb3-de68a17e8959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:33.149131 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:33.150762 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:33.152447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 371/737] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:33.157251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.219691 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.254912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1c7ef-46f4-4e03-9cb3-de68a17e8959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:33.258392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa1c7ef-46f4-4e03-9cb3-de68a17e8959 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:33.307024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652a9be-37f0-4940-9ca5-bf18e4514796 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.347510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:33.348719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.349103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.349533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.350687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:33.350826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:33.353325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:33.353902 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.381413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 367/738] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:32 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:33.383395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073ec0-ce6e-4a96-8ba8-1162df798c90 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.383909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073ec0-ce6e-4a96-8ba8-1162df798c90 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.384415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca073ec0-ce6e-4a96-8ba8-1162df798c90 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.384851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 372/739] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:33.386037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.386833 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 368/740] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:33.390317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073ec0-ce6e-4a96-8ba8-1162df798c90 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.510219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a3a55-b6b8-4ced-a25d-4e2272c0ec98 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.517395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca073ec0-ce6e-4a96-8ba8-1162df798c90 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.519254 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.548057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:33.548862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.549137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.549426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.553076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6100aa-7c0a-4cf1-8742-8f33c53a7c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:33.553722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6100aa-7c0a-4cf1-8742-8f33c53a7c2b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.554000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6100aa-7c0a-4cf1-8742-8f33c53a7c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.554267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6100aa-7c0a-4cf1-8742-8f33c53a7c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.560521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:33.561988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-71f5d3f4-0257-42cf-9cde-44c0be2c0d68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:33.580411 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:33.581388 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:33.582280 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:33.582280 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:33.582280 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:33.582280 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:33.582280 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 373/741] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:33.583015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c58824-a143-4a68-a342-693147421688 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.583184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c58824-a143-4a68-a342-693147421688 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.583440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c58824-a143-4a68-a342-693147421688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.601105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a0c58824-a143-4a68-a342-693147421688 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:33.602315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a0c58824-a143-4a68-a342-693147421688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:33.611140 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.631645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6100aa-7c0a-4cf1-8742-8f33c53a7c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:33.633125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6100aa-7c0a-4cf1-8742-8f33c53a7c2b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:33.674020 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 374/742] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:33.675669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26590817-9c42-44ef-9bf5-bd1af7ad93cf None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.675953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26590817-9c42-44ef-9bf5-bd1af7ad93cf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.676228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26590817-9c42-44ef-9bf5-bd1af7ad93cf None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.677657 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 375/743] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:33.678210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26590817-9c42-44ef-9bf5-bd1af7ad93cf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.754488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 369/744] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:33 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 10:53:33.755931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.756212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.756561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.774436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:33.775727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:33.778769 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.798326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26590817-9c42-44ef-9bf5-bd1af7ad93cf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.835796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:33.836633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:33.836928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:33.837260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:33.838008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:33.838322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:33.840064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:33.849394 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 370/745] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:33 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 10:53:33.850479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.856384 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 376/746] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:33.856384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:33.873328 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:33.967105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0749ae93-85be-45d0-bdc2-aaaf0a16d40a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:33.975937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0574f86-f3c1-4013-8e5b-09b6c45dd541 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.005608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.006412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.006702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.006978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.013451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.014593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.015046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.015486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.016468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.018044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.018158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.019565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.028110 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:34.033337 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:34.034470 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:34.035555 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:34.037797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 371/747] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Jul 19 10:53:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:34.038679 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:34.039494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:34.040377 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:34.040377 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:34.040377 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:34.040377 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:34.044601 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 377/748] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:34.045509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.046341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.133131 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.152857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbca8723-99cc-4bd2-8447-c29ebc537a4e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.160698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a106533-5dd4-4f27-85e4-7c6e48f4dd83 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.188161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.189253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.189778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.190222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.191228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.192807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.194226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.195031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.195314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.195586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.203896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.205378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.208091 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 378/749] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:34 2022] POST /identity/v3/services => generated 240 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:34.209305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:34.233050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:34.234049 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:34.234976 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:34.239582 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 372/750] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:34.240608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.312872 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.371009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb2894-9af4-449a-bddf-6d0259a50548 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.381252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5b6c7f-98ee-497d-896b-9fbf6f76a3b0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.411543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.412630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.413067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.413472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.414233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:34.414699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.416461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.418720 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.426654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.427333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.427617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.428007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.428773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:34.429086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.430491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.432854 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 373/751] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:34.434431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.435462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 379/752] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:34.439741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.565104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e1cf75-ff7b-4961-a3c4-c0ce82de9db1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.566319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3877c9-ca10-4364-8ed0-515a87c90c06 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.590777 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.602967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.603857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.604209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.604580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.605474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:34.605861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.607430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.609739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.611141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.611578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.611998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.621308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.626918 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 374/753] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:34.626918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.629639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:34.646471 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:34.647452 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:34.648703 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 380/754] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:34.649774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.700711 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.757951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1189e9d5-ea6e-47ad-822b-966ea9e324d0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.763556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e854a-1b3a-47c6-a96d-cbdb207cabff None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.799369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.800072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.800406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.800687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.801446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:34.801786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.802429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.803098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.803202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.803378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.803650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.804529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=198dcf35a0894d4e824229e10573a251) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:34.804840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.806277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523eeeff-7147-43cc-b26f-6289cf1f3f18 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:34.813800 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 375/755] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:34.813800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.821778 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 381/756] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/role_assignments?user.id=198dcf35a0894d4e824229e10573a251&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:34.821778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b563eb7-6a75-4b1a-a905-905980c9aa00 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.821778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b563eb7-6a75-4b1a-a905-905980c9aa00 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.821778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b563eb7-6a75-4b1a-a905-905980c9aa00 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.826568 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 382/757] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:34.827538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b563eb7-6a75-4b1a-a905-905980c9aa00 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:34.892805 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.948662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d58b63-788c-48d4-be44-b9b9ecbb4cca None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.969159 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:34.972703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b563eb7-6a75-4b1a-a905-905980c9aa00 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:34.993776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:34.994455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:34.994744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:34.995017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:34.995825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:34.996134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:34.997875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4311fa-349b-447a-a432-b0893222f516 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.011900 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 376/758] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.013251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.013537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.013818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.031466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.031708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:35.032148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.032528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.032806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.032913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:35.033668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] RBAC: Adding query filter params (interface=public, service_id=b9b3a440239b4adc98ee7b6a5e91b8a3, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:35.033980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.036441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.052141 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 383/759] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:34 2022] GET /identity/v3/endpoints?service_id=b9b3a440239b4adc98ee7b6a5e91b8a3&interface=public®ion_id=RegionOne => generated 194 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.053230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.157530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 377/760] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:35.159139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.167239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa66624-41e5-4083-9d16-941060ee595a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.177092 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:35.205287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.205950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.206233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.206554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.207393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=4578e533395642979715feec9c4de758) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:35.207705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.209718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.217897 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 384/761] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/role_assignments?user.id=4578e533395642979715feec9c4de758&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.224387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.307714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77997eee-f281-4ba6-979c-cababd9d7f15 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.321538 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:35.356530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.357239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.357525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.357802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.358517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.359927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.366651 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 378/762] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/services => generated 772 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.452685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dcbac2-ffde-4bd0-9691-64ede3b3fcbf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.494027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.494857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.495139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.495410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.508044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:35.516052 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:35.517073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:35.517889 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 385/763] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:35.526097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.650181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96a404-579d-413e-aa81-2ecdef93afa7 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.690302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.691086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.691374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.691648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.692447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:35.692758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.694158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.703796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 379/764] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:35.709391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:35.746748 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:35.837988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9fb7c3-929f-4dd0-96cf-302948fa63e9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:35.900175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:35.901402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:35.901875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:35.902335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:35.921536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:35.923336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:35.951758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:35.952779 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:35.953652 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:35.953652 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:35.953652 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:35.953652 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:35.955681 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 386/765] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:35.961449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:36.022692 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:36.101370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3d0a08-39c6-4ff4-8d1d-b9650da8aee5 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:36.147221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:36.148242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.148552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.148832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.149608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:36.149913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:36.151377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27985a2-a54f-4be5-b90f-00c9f9f073de None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:36.166842 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 380/766] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:36.172466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:36.306913 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:36.328136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560e7618-6bff-4bcd-af11-47de9436cf76 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:36.383365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:36.384565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.385338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.385805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.405583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:36.407058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:36.423218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0614743-2cdd-4ec8-b75f-36bf748ec2d6 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.423515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0614743-2cdd-4ec8-b75f-36bf748ec2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.423775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0614743-2cdd-4ec8-b75f-36bf748ec2d6 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.425481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 381/767] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:36.426699 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:36.427623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:36.428601 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 387/768] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:36.432396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.432396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.432396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.433868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:36.457415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:36.458620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:36.588027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 382/769] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:36.612465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:36.615810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4a240c-a512-4c9e-8468-256fa9add856 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:36.656965 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:36.698694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:36.699396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.699678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.699951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.700860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:36.701175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:36.702669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:36.743346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191e3cc-9307-4a04-8bfa-08fbfaa6bbf5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:36.746620 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 388/770] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:36.752265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:36.758850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:36.783475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:36.784302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.784637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.784991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] PATH_INFO: `/v3/services/network` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:36.785666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:36.787049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:36.810795 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:36.811826 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:36.812686 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 383/771] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:36 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:36.819370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:36.940823 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:36.955268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942020e-ed4b-458e-a636-fac772c91b7e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:36.978633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82cb5a-9139-45ef-a8ac-4356ec9e38aa None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:36.990819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:36.991991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:36.992517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:36.992992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.003639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.005420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:37.024495 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:37.025437 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:37.026332 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:37.026332 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:37.026332 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:37.026332 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:37.028671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 389/772] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:37.038185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.062483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.063454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.063937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.064430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.065411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:37.065907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.067529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.075346 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 384/773] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:37.079675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.141934 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:37.227284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c8e41-336f-4961-93d5-a400f042f2cd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.306840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c2ed9b-23d8-4de0-bdf9-324437a397d4 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.354246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.355202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.355661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.356091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.357017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] RBAC: Adding query filter params (type=network) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:37.357469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.359021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96badf1b-958a-4578-98d1-a4697241aaa7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.365304 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 385/774] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:37.366908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62b505-c2a2-4fbd-9307-9088ba95a6b9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.367368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62b505-c2a2-4fbd-9307-9088ba95a6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.367789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62b505-c2a2-4fbd-9307-9088ba95a6b9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.373931 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 386/775] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:37.373931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62b505-c2a2-4fbd-9307-9088ba95a6b9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.405256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.405920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.406199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.406469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.407632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:37.408169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.409761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eab659-1ea0-4fd8-b3f1-2d7e3b023a19 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.424014 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 390/776] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:37.425774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.426057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.426330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.440747 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:37.446112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:37.447559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:37.500789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62b505-c2a2-4fbd-9307-9088ba95a6b9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.537162 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 391/777] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:37.537459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.538388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.538496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.538966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.539451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.540622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] RBAC: Adding query filter params (interface=public, service_id=600153cf222e44639f2a4054f22aff8e, region_id=RegionOne) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:37.541151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.542789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.552988 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 387/778] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/endpoints?service_id=600153cf222e44639f2a4054f22aff8e&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:37.558714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.590415 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:37.648493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de35b5-99c6-49b2-b4c9-b1427efb3e16 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.655761 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:37.678489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493487e9-0c3a-4bea-b8ef-fb32139d3b57 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.684082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.684918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.685196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.685465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.692827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.694276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:37.708784 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:37.709909 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:37.710843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 392/779] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:37.712766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.721010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c14533-1661-4967-9eb7-8d78f7d1931b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.721862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c14533-1661-4967-9eb7-8d78f7d1931b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.721996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c14533-1661-4967-9eb7-8d78f7d1931b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.722241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c14533-1661-4967-9eb7-8d78f7d1931b None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.722961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c14533-1661-4967-9eb7-8d78f7d1931b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.724466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c14533-1661-4967-9eb7-8d78f7d1931b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.730168 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 388/780] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/services => generated 772 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:37.731505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42606c9-dbf3-46db-817f-f1200b41c7cc None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.731789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42606c9-dbf3-46db-817f-f1200b41c7cc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.732063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42606c9-dbf3-46db-817f-f1200b41c7cc None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.733557 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 389/781] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:37.737452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42606c9-dbf3-46db-817f-f1200b41c7cc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.848010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929a6b6-ace3-4536-a0c6-d475f9aca58b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.851805 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:37.882861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42606c9-dbf3-46db-817f-f1200b41c7cc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:37.893704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8bec49-a88e-4eb7-a1d8-ec00b29111c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.894953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bec49-a88e-4eb7-a1d8-ec00b29111c4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.895444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bec49-a88e-4eb7-a1d8-ec00b29111c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.895937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8bec49-a88e-4eb7-a1d8-ec00b29111c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.910506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8bec49-a88e-4eb7-a1d8-ec00b29111c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9f8bec49-a88e-4eb7-a1d8-ec00b29111c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:37.918990 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:37.919960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:37.920832 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 393/782] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:37.923145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79046ce4-d350-4117-a738-e65555401b3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.923517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79046ce4-d350-4117-a738-e65555401b3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.923862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79046ce4-d350-4117-a738-e65555401b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.938620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:37.939596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:37.939881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:37.940153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:37.944485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:37.944485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:37.944485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:37.946578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79046ce4-d350-4117-a738-e65555401b3c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:37.948043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79046ce4-d350-4117-a738-e65555401b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:37.959643 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 390/783] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:37.960788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:37.969663 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.035437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 394/784] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:38.046791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79046ce4-d350-4117-a738-e65555401b3c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.101300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab5f5-2e65-4689-91f8-6e99d79a9be1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.146437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.147171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.147684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.149078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.150040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:38.150851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.152790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.162048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 391/785] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.163015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.170562 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.178540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79046ce4-d350-4117-a738-e65555401b3c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.220110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba860e28-e88f-4dff-8501-940f8d2988f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.221430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860e28-e88f-4dff-8501-940f8d2988f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.221937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860e28-e88f-4dff-8501-940f8d2988f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.222478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba860e28-e88f-4dff-8501-940f8d2988f7 None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2af38e680ecd4346b44dad744de8e50c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.225056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba860e28-e88f-4dff-8501-940f8d2988f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=2af38e680ecd4346b44dad744de8e50c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.226774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba860e28-e88f-4dff-8501-940f8d2988f7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.240917 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.244420 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 395/786] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:38 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2af38e680ecd4346b44dad744de8e50c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:38.246461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6513e5-cd51-462e-9271-41f56b99d173 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.246748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6513e5-cd51-462e-9271-41f56b99d173 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.247025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6513e5-cd51-462e-9271-41f56b99d173 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.252521 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 396/787] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:38.252521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6513e5-cd51-462e-9271-41f56b99d173 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.307502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b88bdd-7824-4107-90da-d38910d42582 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.357908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be6989-08cb-48cf-9920-4028f37ad48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.359719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6989-08cb-48cf-9920-4028f37ad48e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.360220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6989-08cb-48cf-9920-4028f37ad48e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.360655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6989-08cb-48cf-9920-4028f37ad48e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.378153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be6989-08cb-48cf-9920-4028f37ad48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-07be6989-08cb-48cf-9920-4028f37ad48e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:38.389627 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:38.390834 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:38.391682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:38.392553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 392/788] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:38.394874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa302-3188-490f-918f-38d252496303 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.395221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa302-3188-490f-918f-38d252496303 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.395601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1aa302-3188-490f-918f-38d252496303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.399724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6513e5-cd51-462e-9271-41f56b99d173 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.419388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-eb1aa302-3188-490f-918f-38d252496303 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:38.421022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eb1aa302-3188-490f-918f-38d252496303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:38.442381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.442381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.442782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.442782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.458596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.460547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:38.487147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:38.488226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:38.489567 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:38.489567 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:38.489567 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:38.489567 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:38.489567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 397/789] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:38.489862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.504932 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.509295 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 393/790] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:38.510424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aa302-3188-490f-918f-38d252496303 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.570450 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.603530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2721be-9d2d-4cfe-9b1c-cf3d39eee8fa None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.617107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1aa302-3188-490f-918f-38d252496303 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.640532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.641238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.641586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.641926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.642836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:38.643207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.644869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.654475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 398/791] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.655989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.656897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.657358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.657792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.658702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:38.659257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.659929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.661223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.674327 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 394/792] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:38.675598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.736965 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.768643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3369f-7c05-4fb7-b250-dd9c322d01f5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.791083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be47639-a26b-43e4-b1d0-105b9bc2bfcc None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.806329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.807331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.807669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.808007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.809060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.810446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.812086 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:38.831439 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:38.832781 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 19 10:53:38.833613 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:38.834389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:38.835344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:38.835686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:38.836064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:38.837163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 399/793] 10.222.0.15 () {56 vars in 1129 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:38.838179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.849372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:38.851061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:38.875776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:38.876714 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:38.877615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:38.877615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:38.877615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:38.877615 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:38.884612 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 395/794] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:38.885869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:38.974178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95686b7e-1b1a-461f-9194-20a53b70d0eb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:38.997797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f10c771-b50c-499b-8939-9d401fe9562a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.025652 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.036567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.036567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.036872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.037175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.055216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.055216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.064267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.065346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.065797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.066272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.067197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:39.067674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.069289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.075187 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 396/795] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:39.076587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:39.087881 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:39.088900 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:39.089821 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:39.099227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 400/796] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:39.101054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.122845 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.204234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9038d-7229-4011-ad42-b8bf77cae267 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.221332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aea19-7128-4d41-a4a6-7a0a0615d7be None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.241134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.242140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.242638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.243109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.244001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:39.244520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.246392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.257307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.257978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.258271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.258535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.259251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:39.259553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.260970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.266168 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 397/797] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:39.267406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.272168 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 401/798] 10.222.0.15 () {56 vars in 1124 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:39.273124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.332907 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.369178 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.380519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd76c0b-5782-4c01-bc32-edb422bec061 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.381340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9656c-dc57-41a7-a083-5b0c257c9ff9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.418261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.419087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.419322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.419437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.419641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.420662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.420945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.421216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.422070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:39.422378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.423825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.433171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.436000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.449614 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 398/799] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:39.450529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:39.453658 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:39.454707 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:39.455705 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:39.462697 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 402/800] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:39.462697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.574182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf0d757-8053-494c-b929-069b80973f9b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.583174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f7b11e-8db1-4326-bb3d-4e0293cebf50 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.595283 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.618962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.620164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.620480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.620785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.625300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.626199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.626676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.627131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.628052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.629775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.632213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.633739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:39.654460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:39.655475 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:39.656380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:39.656380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:39.656380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:39.656380 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:39.657615 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 399/801] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:39.658656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.660670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 403/802] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:39.661540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.669504 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.804148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251df3c-d53c-4a3e-be7c-e390fb1e783c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.859701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.860516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.860795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.861083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.862011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:39.862320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.864011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc432826-d6aa-4049-98ed-0a314321cbde None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.867348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec1b85-cf62-4075-9477-aadddb1e94da None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:39.906448 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 400/803] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:39.909899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ed79-9f14-4019-b437-d56cd2d27aa6 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.910322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ed79-9f14-4019-b437-d56cd2d27aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.910668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a97ed79-9f14-4019-b437-d56cd2d27aa6 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.911496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:39.912426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 401/804] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:39.912638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.913112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.913214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ed79-9f14-4019-b437-d56cd2d27aa6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:39.913669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.914508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:39.914938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:39.916457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47adf063-ca22-4ad6-8ccc-1dabf8d0bf94 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:39.929106 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 404/805] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:39.930404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:39.930691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:39.930969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:39.949911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:39.951106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:39.977749 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:39.984893 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:40.035988 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 405/806] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:40.043941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a97ed79-9f14-4019-b437-d56cd2d27aa6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.051575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.080504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.081376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.081880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.082276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.096009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.098375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:40.127735 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:40.128779 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:40.129710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:40.129710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:40.129710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:40.129710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:40.129710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 402/807] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:40.130453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.189215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd685a52-a056-451e-a24e-7b952bb7ae11 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.225559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.226796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.227269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.227730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.234994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.236720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:40.251582 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:40.252796 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:40.253700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:40.256138 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 406/808] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:40.257206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.270638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f74ce7-aaff-419c-977a-0348fb6aa15e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.279805 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:40.291973 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:40.319933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.320686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.320984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.321511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] PATH_INFO: `/v3/services/network` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.322194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.324081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:40.339626 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:40.340651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 19 10:53:40.341613 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:40.344605 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 403/809] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:40.345503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.374046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcb199-4be0-461a-8e79-b379cf736f07 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.411419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.412541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.413053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.413514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.418458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:40.419173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.420888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.435186 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 407/810] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:40.436523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.491502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d2fb1-2ab3-4bda-aefa-e017aaac4a63 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.528065 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:40.532389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.533090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.533485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.533852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.534712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:40.535088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.536691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.552487 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 404/811] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:40.552487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.552755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e04ae-3fe3-4cc5-bc41-13670111013e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.589460 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:40.591485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.592326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.592745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.593124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.593954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:40.594369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.595920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807e9402-0696-4651-b889-82d97f352ba4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.601956 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 408/812] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:40.608020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93229-c316-4000-89dc-040bb215ad48 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.608302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93229-c316-4000-89dc-040bb215ad48 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.608615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a93229-c316-4000-89dc-040bb215ad48 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.614961 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 409/813] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:40.614961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a93229-c316-4000-89dc-040bb215ad48 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.733132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a93229-c316-4000-89dc-040bb215ad48 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.773193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.774377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.774659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.774937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/198dcf35a0894d4e824229e10573a251/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.776944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=198dcf35a0894d4e824229e10573a251, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.778398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.787972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab07d2e1-55a9-4a19-af5e-3a013a5f7310 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.792144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 410/814] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:40 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/198dcf35a0894d4e824229e10573a251/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:40.806436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.811450 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:40.834752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.835615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.835901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.836176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.846062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.848051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-1295faf4-84de-4c66-9db7-9ec1fb6e95ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:40.866956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:40.867918 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:40.868845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:40.871457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 405/815] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:40.873069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.873557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.874030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.894246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:40.897767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:40.945955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322c89a-c588-4bd5-a813-7f7baefda1c8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:40.983514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 406/816] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:40.984891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:40.993295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:40.993973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:40.994258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:40.994535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:40.995802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] RBAC: Adding query filter params (type=network) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:40.996118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:40.997573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.005772 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 411/817] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:41.011025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.024471 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.100877 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.109473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f2a11-c434-401e-b99e-22aef277f8ab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.148222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625fc04-a70f-4529-9d1a-119151b13d8b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.151031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.151738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.152014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.152279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.153098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:41.153397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.154827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.171406 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 407/818] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:41.172300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.207184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.208504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.209026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.209509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.221616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:41.231312 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:41.232266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:41.233141 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:41.240805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 412/819] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:41.242195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.261120 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.276711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b77ad-b10b-491d-b16f-4e551d4396ac None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.311775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.312544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.312843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.313150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.313944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.315323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.339526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 408/820] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:41 2022] POST /identity/v3/endpoints => generated 327 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:41.340463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.365461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148aa129-1447-42fc-99d7-f5ed5567117a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.398438 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.430010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.431330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.431873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.432338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/4578e533395642979715feec9c4de758/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.458162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf6dd2-2827-4222-8dbb-7d6fadcac1b9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.474366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=4578e533395642979715feec9c4de758, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.476323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.497716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.498600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.499334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.499334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.500118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:41.500476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.503225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.506093 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 413/821] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:41 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/4578e533395642979715feec9c4de758/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:53:41.515106 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 409/822] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:41.521117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.653804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a9bd2-271c-4176-942c-7930ea0207bf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.692182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.693029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.693303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.693571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.706979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.708717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5cf6184e-9bab-4d7a-bebb-742dfb4775f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:41.732997 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:41.733953 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:41.735273 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:41.735273 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:41.735273 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:41.735273 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:41.735273 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 414/823] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:41.744578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.749673 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:41.876063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6493918-c87c-471a-b1a3-6e45fd0b136f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:41.917436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:41.918482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.918954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.919431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.920395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:41.921026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:41.922712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:41.924054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66892-9c3b-44ee-90fa-d6bcbe877711 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.924358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66892-9c3b-44ee-90fa-d6bcbe877711 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.924649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff66892-9c3b-44ee-90fa-d6bcbe877711 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.928196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 415/824] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:41.931893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:41.932173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:41.932469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:41.945503 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 410/825] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:41.948750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:41.953691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:41.955200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:41.984253 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.058584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 416/826] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:42.060726 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.081979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.105674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1954bd-1c12-4187-812e-dc48b9b3aaec None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.147266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.148396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.148994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.149267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] PATH_INFO: `/v3/users/nova` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.159894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.162418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:42.181539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:42.182529 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:53:42.183496 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:42.184546 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 411/827] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:53:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:42.189417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.206996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501591ae-b1da-484f-9dc1-4b52184c14b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.248592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.249543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.249915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.250270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.251119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.252915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:42.267671 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:42.270080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:42.272044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 417/828] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:42.282353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.305487 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.318485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f522e30-9785-428f-a6ac-f2605ba6f4db None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.350509 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.364083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.364832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.365100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.365377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.366556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:42.366556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.368020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.389281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 412/829] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:42.394883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.426629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a98fa-8731-48a6-abf0-918f262a0eb9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.473843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.474982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.475515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.475935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.477092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:42.478007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.479848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.487317 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 418/830] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:42.493595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.541105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cafb57-c2b0-43bd-9ad0-d71db016efab None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.577048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.577851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.578248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.578613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.599781 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.624874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e4d9c-c26b-4cee-8272-9d2bdaac5606 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.634192 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.661203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.661830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.662599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.662977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.663372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.663620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.664266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:42.664685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.666163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.680388 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 419/831] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:42.792630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 413/832] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:53:42.794614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:42.913723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15418cf7-630a-46ec-ba36-872108ec74f4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:42.955570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:42.956416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:42.956705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:42.956982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:42.968479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:42.969974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:42.976861 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-46f4fc38-d3fb-475f-a05a-6c82f871241f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:42.988190 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:42.989228 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:42.990113 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:42.990113 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:42.990113 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:42.990113 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:42.992546 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 420/833] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:42.998420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.098572 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:43.117009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3862c-2f48-48d9-9783-e9cfb43fb061 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.120170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3eed2-e40e-4a55-b2f5-b8d57ad7e2ba None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.120506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3eed2-e40e-4a55-b2f5-b8d57ad7e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.120785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3eed2-e40e-4a55-b2f5-b8d57ad7e2ba None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.122434 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 421/834] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:43.127590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.127873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.128155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.147241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:43.149408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:43.153830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.154495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.154774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.155043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.155765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:43.156066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:43.157492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:43.169632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 414/835] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:43.177312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.232391 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 422/836] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:43.254906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.306487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8068113-b3a6-45b6-b83a-643dafeb23da None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.354261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.355627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.356561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.357292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.361852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913cac0e-2bc0-453f-a6d2-8c4e3a0cba23 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.369472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:43.371704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:43.390673 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:43.394533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:43.395461 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:43.396400 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:43.402748 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 415/837] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:43.404293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.407605 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:43.408296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.409353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.410172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.410768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.424256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:43.432752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:43.434415 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:53:43.435413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:43.438011 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 423/838] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:43.444097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.523318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a456ce-8a69-4cd8-b2b3-11cdcfd2c748 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.553615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef22f-e149-45a6-b019-de5c497c07f1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.560083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.560820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.561101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.561376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.562174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:43.562482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:43.564388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:43.579951 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 416/839] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:43.586052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.596006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.596960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.597413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.597862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.598791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:43.599238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:43.600858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:43.610581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 424/840] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:43.615700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.669105 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:43.685141 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:43.728366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bca69-9e10-434d-91c0-8d2b49ef0a3e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.749780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33dd9a-c454-4df9-a9e6-4ac7179c6e31 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.772188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.773277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.773572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.773849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.775026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2af38e680ecd4346b44dad744de8e50c) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:43.775340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:43.776868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d71cc5-e748-4b5c-bead-2208b881eaac None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:43.792381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 417/841] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/role_assignments?user.id=2af38e680ecd4346b44dad744de8e50c&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:43.796555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:43.797384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.797662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.797939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.811271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:43.812805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:43.832436 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:43.833525 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:43.834420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:43.834420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:43.834420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:43.834420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:43.834420 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 425/842] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:43.836731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9592c13-246f-434a-93d7-9f5bd368b264 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.837019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9592c13-246f-434a-93d7-9f5bd368b264 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.837293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9592c13-246f-434a-93d7-9f5bd368b264 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.839106 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 418/843] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:43.840984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:43.844699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:43.845289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:43.846148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:43.869830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:43.871865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:43.959140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06fb4ec-4ddb-4e26-8538-7c27e3fd2ce1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:43.961037 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:43.977309 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 419/844] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:44.000590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.008723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.009404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.009692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.009964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.010695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:44.011120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.012542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.025601 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 426/845] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:44.031884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.076325 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.130672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de88be66-e0a7-4dc0-86d8-511115fc6af8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.156082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab014e79-f782-441c-9f37-6ab6e30288d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.167981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.168903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.169246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.169460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.182827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:44.192735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:44.192927 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:44.193793 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:53:44.194621 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:44.196630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.197115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.197579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.198975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 420/846] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:53:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:44.199825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.206921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.208823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:44.224102 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:44.225254 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 19 10:53:44.226187 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:44.228792 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 427/847] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:44.234587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.260908 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.310451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26f6715-ab3e-4cf5-a5b2-f4c5cec69c88 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.332846 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.341147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387eb908-2878-4371-bc22-5135b81b0654 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.349073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.350181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.350763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.351115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.351950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:44.352618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.354202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.368836 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 421/848] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:44.369738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.388516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.389642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.390387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.391127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.393012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:44.393824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.396905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.436683 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 428/849] 10.222.0.15 () {56 vars in 1135 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:44.439968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.486446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7fc60b-77f8-4cbf-b3c4-7de1b4b9f046 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.524393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.525315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.525661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.526005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.538396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.540061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:44.558928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:44.560729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:44.562542 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:44.562542 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:44.562542 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:44.562542 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:44.565048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 422/850] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:44.565995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.586093 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.601542 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.606641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48c0ac5-ea88-44e5-bd8c-10b298981a1e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.642807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.643830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.644326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.644991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.681955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec92dfdc-56a6-4532-925d-16cb42fd535f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.721023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.721494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.721780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.722043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.722320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.723059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:44.723433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.724374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.724904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.747113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 423/851] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:44.749938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.811711 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.837785 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 429/852] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:44.839127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.859353 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:44.870681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf098-640c-4f38-a1c5-844533e0ffd0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:44.917959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:44.918716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.918998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.919272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.930929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:44.932515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-efcc5679-52c1-4599-a77e-e57a073e5969 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:44.948998 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:44.950012 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 424/853] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2aae-2fc7-4cc0-a64d-d62789432a38 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:44.956138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2aae-2fc7-4cc0-a64d-d62789432a38 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:44.956921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe2aae-2fc7-4cc0-a64d-d62789432a38 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:44.956921 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 425/854] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:44.956921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe2aae-2fc7-4cc0-a64d-d62789432a38 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:44.962592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0998a8f-3ec2-435c-ad04-6338e89e9b65 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.008601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.008601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.008601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.008601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.018542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.020205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-5f0f092d-aeb7-493a-a6c5-1b4743fddc1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:45.039798 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:45.040850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:45.041753 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:45.041753 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:45.041753 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:45.041753 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:45.046070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 430/855] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:45.047727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.048017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.048294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.069581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:45.070800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:45.088128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe2aae-2fc7-4cc0-a64d-d62789432a38 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.101760 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.140259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.140259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.140259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.140259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.140770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:45.141030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.142605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.156913 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 431/856] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:45.164678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 426/857] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:45.165933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.169738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.181180 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.280881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a6d241-26a2-4071-9fb5-c97f6199807e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.286602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4524e-dd8d-40e1-94f7-5c8b65400a28 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.317158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.317810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.318089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.318370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.323100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.323766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.324048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.324323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.325080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:45.325390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.326867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.343736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 432/858] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:45.343736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.370282 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.388857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.390308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.404641 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.455922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1c446-e211-4aef-baf6-2864f69af5f0 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.493147 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 427/859] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:53:45.494454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.503066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.503743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.504693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.504974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.505702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.507941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.525404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 433/860] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:45 2022] POST /identity/v3/services => generated 251 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:45.526553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.621070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159d5b1-01ef-4712-acf6-dcd5757eb851 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.632205 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.652661 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.672201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.673074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.673362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.673636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.681632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.683099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.684705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49773c4-2851-4713-a6a0-08ac0f3bc3c1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:45.698546 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:45.699500 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:45.701191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 428/861] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:45.705559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.729720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.730528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.730809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.731189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.744098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.745708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:45.766444 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:45.767449 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:45.768938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:45.768938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:45.768938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:45.768938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:45.768938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 434/862] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:45.773449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.828663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8f4cda-2cc3-4d69-a126-0987123785b9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.875303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.876500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.876830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.877106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.878223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:45.878536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.880016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.893977 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 429/863] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:45.895871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87657053-ae44-4616-9d19-cbbe0615b999 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:45.902414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:45.926584 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.939680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:45.940886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:45.941177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:45.941453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:45.942577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:45.942891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:45.944904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:45.960183 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 435/864] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:45.960769 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:45.966781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:46.009396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d7003-bcdb-4514-b326-246e41fb467b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.055722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.056472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.056753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.057498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.057852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=198dcf35a0894d4e824229e10573a251) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:46.058164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.059612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c49f37-edfc-4156-b2de-8d17b66b5b6c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.066635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 430/865] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/role_assignments?user.id=198dcf35a0894d4e824229e10573a251&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:46.068447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab3301-403f-437a-9f08-6ebd1dbf816d None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.068940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab3301-403f-437a-9f08-6ebd1dbf816d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.069219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab3301-403f-437a-9f08-6ebd1dbf816d None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.070869 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 431/866] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:46.076932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724592-0698-4407-a0bb-b5166742d220 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.077135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724592-0698-4407-a0bb-b5166742d220 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.077373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10724592-0698-4407-a0bb-b5166742d220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.095829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-10724592-0698-4407-a0bb-b5166742d220 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:46.097389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-10724592-0698-4407-a0bb-b5166742d220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:46.105354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4802e534-405e-48b7-a7af-d65aa0fbf707 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.154628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.155975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.155975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.156163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.164432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.166009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:46.182938 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:46.183917 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:46.185092 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 436/867] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:46.189876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:46.200319 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 432/868] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:46.223282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724592-0698-4407-a0bb-b5166742d220 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:46.253951 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:46.270924 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:46.330121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f1a87-5e28-4e68-b0c4-30fa74b97431 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.357988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10724592-0698-4407-a0bb-b5166742d220 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.375049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.376500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.376968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.377460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.378434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:46.378931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.381572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.393856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.394782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.395139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.395509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.396254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.397778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.398171 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 437/869] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:46.406791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:46.421342 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:46.422382 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:46.423244 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:46.427551 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 433/870] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Jul 19 10:53:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:46.428538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:46.526091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95464fa6-6e11-43b3-9465-fd88c812a873 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.541027 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:46.543060 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:46.562234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.562893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.563174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.563448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.564283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=4578e533395642979715feec9c4de758) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:46.564640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.566123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.569725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61364bc-4718-454c-b068-0a1bd22d3f39 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.576624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 438/871] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:46 2022] GET /identity/v3/role_assignments?user.id=4578e533395642979715feec9c4de758&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:46.612326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.613077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.613372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.613651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.614458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:46.614771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.616316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfe73d-6620-4565-bd20-6ace338c85ba None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.622116 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 434/872] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:46.627521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:46.747992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811a044-6802-4809-9896-9ac25c7396eb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:46.787221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:46.788253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:46.788768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:46.789260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:46.790172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:46.790779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:46.792381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e959a-8f85-46f5-820a-3382be6ad761 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:46.798125 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 439/873] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:46 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:47.656235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e57c3b-ab6c-46a8-9dc1-2aaf50bb0824 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:47.656806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e57c3b-ab6c-46a8-9dc1-2aaf50bb0824 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:47.656806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e57c3b-ab6c-46a8-9dc1-2aaf50bb0824 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:47.658444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 435/874] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:47.664060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:47.664526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:47.664725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:47.685528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:47.686738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:47.724623 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:47.757937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 440/875] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:47 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:47.780861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e57c3b-ab6c-46a8-9dc1-2aaf50bb0824 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:47.889505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e57c3b-ab6c-46a8-9dc1-2aaf50bb0824 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:47.923824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:47.924581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:47.924863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:47.925140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:47.925813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:47.927235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:47.939753 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:47.940848 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:47.941710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 436/876] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:47.946996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.051652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950223c5-624d-40db-a644-5fc54f48db8b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.086861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.087525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.087808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.088082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.088824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:48.089130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.090579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.095737 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 441/877] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:48.101447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.114522 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:48.202898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c064ef-6233-4bba-b48b-5698b6c16709 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.241522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.242197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.242476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.242752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.243525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:48.243837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.245258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e82896-494e-4dac-92cf-d709a36c6c0a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.251101 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 437/878] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:48.256771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.281286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a30c9-cffb-491c-9e90-2e04adee3587 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.281611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a30c9-cffb-491c-9e90-2e04adee3587 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.281844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a30c9-cffb-491c-9e90-2e04adee3587 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.283586 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 438/879] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:48.289067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.289350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.289725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.294418 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:48.309465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:48.310755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:48.362074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e07c627-5d11-442e-abfe-870a118eca0b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.392487 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 439/880] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:48.398159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.398880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.399164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.399440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.400649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] RBAC: Adding query filter params (interface=public, service_id=b17cbbf210fc4c25bef7c8c1f85977d5, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:48.400965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.402455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.408503 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 442/881] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/endpoints?service_id=b17cbbf210fc4c25bef7c8c1f85977d5&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:48.414101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.415471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.419914 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:48.518458 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:48.521414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0356635d-e1ad-432e-9df1-9331adbd91bb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.532276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d6da4-0aaa-43e3-aa6f-b3bacc1f6d67 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.557745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.558554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.558833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.559102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.559762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.561238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.573103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:48.573562 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:48.574505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:48.575338 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:48.577443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.577931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.578400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.579288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.579993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 443/882] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:48.580970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.581877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.588940 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 440/883] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/services => generated 1011 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 10:53:48.703109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ed35-1b5c-4e7a-8855-ba676c606c4d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.742361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.743461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.743971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.744497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.745449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:48.745974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.747739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d68a1-bc50-4803-82e5-e580b8851d86 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.753931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 444/884] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:48.761438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.762117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70b61-2618-482e-a220-8a26e86d162f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.762378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70b61-2618-482e-a220-8a26e86d162f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.762661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e70b61-2618-482e-a220-8a26e86d162f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.764198 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 445/885] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:48.769687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.769948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.770174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.788507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:48.789718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:48.817827 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:48.855629 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:48.871365 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 446/886] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:48.898555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:48.903423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc574d82-a560-46b8-9593-18299bac59d0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:48.943443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:48.944270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.944580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.944857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.945577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:48.945883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:48.947266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de45c6-6353-4a6c-83fd-0b44bd73ebe0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:48.952153 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 441/887] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:48.953535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac013a-d3e3-47a3-b324-91c9197f3148 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.953818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac013a-d3e3-47a3-b324-91c9197f3148 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.954090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac013a-d3e3-47a3-b324-91c9197f3148 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.955514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 442/888] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:48.961511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:48.961801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:48.962082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:48.980124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:48.981393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:49.023917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665dfb17-f90c-4a57-b62a-9ce8045b6c60 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.079613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.080859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.081359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.081815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.087469 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 443/889] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:48 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:49.094977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:49.103922 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:49.104994 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:49.105849 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:49.106498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:49.110262 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 447/890] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:49.116729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:49.145738 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:49.197145 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:49.238252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ccdf7-934c-422a-ad3a-072535469c1b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.264018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271da3a-2c02-47e2-af17-d4b6e261fde1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.280461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.281337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.281618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.281890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.282897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:49.284796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:49.302580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.303401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.303766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.304140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.305022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:49.305390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:49.307029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:49.309382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 444/891] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:49 2022] POST /identity/v3/services => generated 269 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:53:49.318187 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 448/892] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:49.323669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:49.448638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea33f7-34f9-4699-8f37-3a75e5023f9f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.471034 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:49.489258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.490616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.490938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.491210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.502761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:49.504221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:49.522322 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:49.523246 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:49.524331 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:49.524331 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:49.524331 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:49.524331 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:49.524331 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 445/893] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:49.530874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:49.636258 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:49.660170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e4a936-d257-47d4-973a-9a14c1f70a1a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.696762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.697478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.697763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.698085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.698822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:49.699128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:49.700551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:49.714185 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 449/894] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:49.721545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:49.857264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d362744-bed4-42f5-af7a-0a4c0de83e6a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:49.912897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:49.914432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:49.914936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:49.915436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:49.928678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:49.931385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:49.960072 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:49.961100 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:49.962066 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:49.962804 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 446/895] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:49.969156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.078702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edeeefcd-37da-4f32-b137-1068df97cf5a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.115867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.121263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.121263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.121263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.121263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:50.121263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.121263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.129752 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.140899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 450/896] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:50.146805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.190557 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.269410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc4b4-4674-4637-8ae2-47a48b214899 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.304783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.305448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.305733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.306008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.377659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.379156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.414466 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.484098 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 447/897] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:50.490268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.610145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d047f4-ec13-4292-bb3f-b183e7bdea9e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.647093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.647813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.648096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.648393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.659985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.661578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-964e5a09-fa2d-4733-b46c-318b78e4495f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:50.680277 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:50.681279 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:50.682494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:50.682494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:50.682494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:50.682494 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:50.682494 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 451/898] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:50.689050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.733662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b16a6-de01-4180-b195-04c58c615902 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.734185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b16a6-de01-4180-b195-04c58c615902 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.734260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b16a6-de01-4180-b195-04c58c615902 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.736429 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 452/899] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:50.743512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.743934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.744389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.774335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:50.776295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:50.801935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffb137-3461-426d-a117-e9ae8794c545 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:50.837209 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.840968 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:50.849348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:50.850338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:50.851022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:50.851485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:50.852913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:50.853462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:50.855634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:50.863016 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 453/900] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:50 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:50.869684 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 448/901] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:50.878109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:50.888290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.012409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ada128-df87-4094-a0ff-294d715c42f0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.012889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe10962-2642-4e88-a80a-e4624880bc58 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.052584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.053744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.054173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.054586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.063707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.065027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.065309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.065586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.066263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.067671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.069755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.071500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:51.081663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:51.082734 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:51.083635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 449/902] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:51.090274 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:51.091214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:51.092791 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:51.093778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.094992 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 454/903] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:51.101107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.160311 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:51.166069 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:51.219649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d97d930-add8-4bf9-987c-1f2ca2cbd520 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.225767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa5ea1-53b6-43c0-8025-35bafff30b18 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.259747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.260519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.260775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.261152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.261765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:51.262099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.263508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca2e62-a60b-49c1-bb7c-f3b6f859c495 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.265606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.266045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.266330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.266612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.267437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:51.267703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.269348 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 450/904] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:51.269517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76773762-12fd-45d8-86e0-f60da50fd40f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.276651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129040d-696e-47c9-8e2b-c28db2ba71d8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.276920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129040d-696e-47c9-8e2b-c28db2ba71d8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.277205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129040d-696e-47c9-8e2b-c28db2ba71d8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.278874 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 451/905] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:51 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:51.279266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129040d-696e-47c9-8e2b-c28db2ba71d8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.288331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 455/906] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:51.289622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.289885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.290185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.307105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:51.308299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:51.382791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 456/907] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:51 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:51.384060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.409002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129040d-696e-47c9-8e2b-c28db2ba71d8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.416519 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:51.431243 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:51.450155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.450830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.451127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.451391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.452161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:51.452506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.453890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.463948 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 452/908] 10.222.0.15 () {56 vars in 1114 bytes} [Tue Jul 19 10:53:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:51.463948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.498846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f349d7-c22f-4739-ad6a-74ddc9fda814 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.537272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.538444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.538444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.538444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.539201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] RBAC: Adding query filter params (role.id=3d9a2d1ce36f4b88b096a7baa926e184, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=4578e533395642979715feec9c4de758) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:51.539512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.541003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.546743 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 457/909] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:53:51 2022] GET /identity/v3/role_assignments?user.id=4578e533395642979715feec9c4de758&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=3d9a2d1ce36f4b88b096a7baa926e184 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:51.547431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.585119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77638083-98b7-4f3d-bd5d-47bae9642bf3 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.629018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f42a65c-dcd2-4fa6-857c-cc37a9f0c3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.629692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a65c-dcd2-4fa6-857c-cc37a9f0c3d0 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.629992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a65c-dcd2-4fa6-857c-cc37a9f0c3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.630299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f42a65c-dcd2-4fa6-857c-cc37a9f0c3d0 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.631062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42a65c-dcd2-4fa6-857c-cc37a9f0c3d0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.632520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f42a65c-dcd2-4fa6-857c-cc37a9f0c3d0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.656381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 453/910] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:53:51 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:51.656381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60975ae2-3482-4004-87a9-703fb7a9a742 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.656381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60975ae2-3482-4004-87a9-703fb7a9a742 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.656381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60975ae2-3482-4004-87a9-703fb7a9a742 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.656381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 454/911] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:51.658447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.659206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.659206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.677915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:51.679026 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:51.679189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:51.688531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc91c13-77c1-4ae8-89db-b5210becf2c7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.744259 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:51.745965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.747222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.747612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.748250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.749155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.751912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.785142 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 455/912] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:51.785763 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 458/913] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:51.802183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:51.929307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0cf293-e0ae-41e8-a3e6-96791de9015b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:51.974320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:51.975134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:51.975425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:51.975677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:51.976323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:51.977780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:51.990218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:51.991187 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:51.992205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 456/914] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Jul 19 10:53:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:51.997531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:52.114551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dce596-8300-42b7-bfde-ce7bfaa13cf1 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:52.149584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:52.150571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:52.150855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:52.151131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:52.151842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:52.152150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:52.153568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:52.163534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 459/915] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:52.165010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:52.199358 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:52.277272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca6da6-b0ac-4ad0-bdca-e04c38439633 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:52.312218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:52.312839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:52.313122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:52.313398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:52.314114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:52.314422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:52.315795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:52.326111 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 457/916] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:52.327482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:52.342123 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:52.439761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25497a4b-42c6-4c40-98a3-d621563db289 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:52.474462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:52.475127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:52.475409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:52.475686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:52.476531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] RBAC: Adding query filter params (interface=public, service_id=1afc971e6c1d483197520ce9740ee7de, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:52.476848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:52.478255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4a68e9-4ec2-49e7-a180-1b860203b17b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:52.484275 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 460/917] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:52 2022] GET /identity/v3/endpoints?service_id=1afc971e6c1d483197520ce9740ee7de&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:52.489780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:52.590624 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:52.596682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5172dd8a-48a3-4be5-9caa-2d089a851441 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:52.632317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4189781d-1f9b-4643-bee2-bab9f148602b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:52.633011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189781d-1f9b-4643-bee2-bab9f148602b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:52.633291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189781d-1f9b-4643-bee2-bab9f148602b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:52.633564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4189781d-1f9b-4643-bee2-bab9f148602b None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:52.634256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189781d-1f9b-4643-bee2-bab9f148602b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:52.635633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4189781d-1f9b-4643-bee2-bab9f148602b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:52.648706 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 458/918] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:52 2022] GET /identity/v3/services => generated 1497 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:53:53.602895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f49e0e-6516-40fb-98fd-a46aaca7fe8a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.603973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f49e0e-6516-40fb-98fd-a46aaca7fe8a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.604498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f49e0e-6516-40fb-98fd-a46aaca7fe8a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.606363 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 461/919] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:53.612270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8976a-1a90-4f86-9745-178c3d7633d2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.613173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8976a-1a90-4f86-9745-178c3d7633d2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.613674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf8976a-1a90-4f86-9745-178c3d7633d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.631343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7cf8976a-1a90-4f86-9745-178c3d7633d2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:53.632565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7cf8976a-1a90-4f86-9745-178c3d7633d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:53.704119 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 459/920] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:53.726657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f49e0e-6516-40fb-98fd-a46aaca7fe8a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.818830 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:53.846996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c7150-b592-43b5-a889-91a60e355016 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.847282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c7150-b592-43b5-a889-91a60e355016 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.847636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c7150-b592-43b5-a889-91a60e355016 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.850289 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 460/921] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:53.857112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6ee0-064d-41dd-86e2-e0a1ac6f927d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.857694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6ee0-064d-41dd-86e2-e0a1ac6f927d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.858182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e6ee0-064d-41dd-86e2-e0a1ac6f927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.858922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f49e0e-6516-40fb-98fd-a46aaca7fe8a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:53.875938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0e3e6ee0-064d-41dd-86e2-e0a1ac6f927d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:53.877780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0e3e6ee0-064d-41dd-86e2-e0a1ac6f927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:53.903998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e3919-905d-4e80-ba89-2f7c742964b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:53.904872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3919-905d-4e80-ba89-2f7c742964b3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.905156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3919-905d-4e80-ba89-2f7c742964b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.905434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e3919-905d-4e80-ba89-2f7c742964b3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.918650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e3919-905d-4e80-ba89-2f7c742964b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4c8e3919-905d-4e80-ba89-2f7c742964b3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:53.926873 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:53.927981 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:53.929189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 462/922] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:53.929860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dfffd-80fa-4aa2-a1e2-90029cf7d69d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.929860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dfffd-80fa-4aa2-a1e2-90029cf7d69d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.930556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8dfffd-80fa-4aa2-a1e2-90029cf7d69d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.931505 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 463/923] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:53.934362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dfffd-80fa-4aa2-a1e2-90029cf7d69d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:53.965784 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 461/924] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:53.967175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:53.967462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:53.967737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:53.991475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:53.992718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:54.008688 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.071085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 462/925] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:54.071312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8dfffd-80fa-4aa2-a1e2-90029cf7d69d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.072487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.121669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.122288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.122573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.122860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.123626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:54.123937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.125433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.127503 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.136670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 464/926] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:54.137617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.202329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6c0c-ad01-43a1-a137-0d6bc3a43984 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.240511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.241440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.241803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.242143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.242840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.244219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.246394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda47542-b117-4229-9986-a751a3e51a64 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:54.256671 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:54.257685 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:54.258564 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 463/927] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:54.259369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.278009 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.289215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.289880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.290160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.290432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.291243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.292714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.294094 n-d-master-1 devstack@keystone.service[80581]: WARNING keystone.server.flask.common [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 10:53:54.313421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 10:53:54.313421 n-d-master-1 devstack@keystone.service[80581]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 10:53:54.313421 n-d-master-1 devstack@keystone.service[80581]: [parameters: {'id': '5f3159f984044327930071c040941eeb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 10:53:54.313421 n-d-master-1 devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f3159f984044327930071c040941eeb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f3159f984044327930071c040941eeb. Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:54.321017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 10:53:54.322017 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 19 10:53:54.323157 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 10:53:54.324438 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 10:53:54.325551 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:54.326514 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'id': '5f3159f984044327930071c040941eeb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.327714 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:54.329203 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 5f3159f984044327930071c040941eeb. Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 465/928] 10.222.0.15 () {60 vars in 1140 bytes} [Tue Jul 19 10:53:54 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:54.331303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.377564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c657f22c-dcf9-4686-9ce8-ad0a21fee277 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.386386 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.422191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.423561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.424021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.424640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.447601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.450094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:54.475914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:54.476925 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:54.477838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:54.477838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:54.477838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:54.477838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:54.477838 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 464/929] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:54.478210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.483007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a644fa-93ce-4818-975b-71cc183619b9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.523136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.523813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.524099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.524401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.525221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:54.525852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.527878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.535951 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 466/930] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:54.536803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.558049 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.601640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a42aa-7cb8-456a-b433-24aecd5d3cd2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.643408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.644549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.644835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.645109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.653358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544ff4a-ef13-425a-91dc-db6b55edd13c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.653822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.655009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:54.669706 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:54.670651 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 465/931] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:54.672202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.673343 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.696504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.697176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.697461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.697737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.698579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:54.698920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.700404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.713669 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 467/932] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:54.719241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.777006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a397c13e-6353-4ef2-8e41-3de3c47f57ba None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.803587 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.812317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.813007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.813287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.813564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.814270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:54.814601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.815949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.820252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf867922-0cac-4e76-a250-9228b3128bf5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.820739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 466/933] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:54.821511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.855327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.856066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.856377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.856650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.857395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:54.857695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.859117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643a1327-2bfa-4961-aac2-5def46db5f41 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:54.876094 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 468/934] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:54.877559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9625-b358-4bfe-909b-f57e1ca8fa60 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.877848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9625-b358-4bfe-909b-f57e1ca8fa60 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.878120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce9625-b358-4bfe-909b-f57e1ca8fa60 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.879710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 469/935] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:54.880498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9625-b358-4bfe-909b-f57e1ca8fa60 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:54.934636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a757f5bc-a458-4b44-8925-de471e28344e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:54.937180 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:54.977536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:54.978368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:54.978650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:54.978920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:54.987805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:54.989337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-8fcaddb3-57ec-4c0d-b4c5-b29d13e0756c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:55.006154 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:55.007201 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:55.008148 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 467/936] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:55.009473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.009632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.009905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.027391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce9625-b358-4bfe-909b-f57e1ca8fa60 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.029408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:55.031263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:55.073788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.074604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.074958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.075243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.076049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] RBAC: Adding query filter params (interface=public, service_id=96df5d4364f24e00afb2deb7d653c5ab, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:55.076380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.077787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.088181 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 470/937] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:53:54 2022] GET /identity/v3/endpoints?service_id=96df5d4364f24e00afb2deb7d653c5ab&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:55.088181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.089007 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.120181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 468/938] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:55.121069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.202158 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.205724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ad3f7e-6919-452d-8f88-5de481756249 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.226859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b63ebef-7aa5-4d68-90e9-20bd747c9564 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.243022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.243689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.243964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.244281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.245158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:55.245459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.246897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.263489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.264162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.269667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.269799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 471/939] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:55.269919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.270009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.270094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.270094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.282892 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 469/940] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:53:55.282892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.334668 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.391572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c8bc2b-67b2-4d0b-acb4-92ad74abdeaf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.395229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada04b4-b62e-468f-8c69-ff5fb31aef42 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.433226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.434048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.434409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.434668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.434766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.435769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.436056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.436331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.437167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.438693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.448662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.450920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:55.454059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:55.454972 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:55.456246 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 472/941] 10.222.0.15 () {56 vars in 1132 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:55.462250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:55.470123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:55.471037 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:55.472504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:55.472504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:55.472504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:55.472504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:55.472504 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 470/942] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:55.478882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.495481 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.598683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15fcaab-e52f-4d5b-b8fb-3243f8e30bed None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.609514 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.618926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacacdf0-6037-4a8f-9328-d86844f6338b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.638169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.639079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.639258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.639542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.640264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:55.640630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.642080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.648426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 473/943] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:55.656749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.671910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.672730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.673085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.673436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.674306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:55.674720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.676285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.689552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 471/944] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:55.695451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.764666 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.789451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc9bebe-4466-4298-a66b-720a4684a921 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.821901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c8db88-ba63-4818-83fa-23a72501546f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:55.840646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.841323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.841656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.841939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.843189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:55.843506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.845519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.853864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 474/945] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:55.856870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:55.857669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:55.857945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:55.858213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:55.861298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.870565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:55.872193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:53:55.889136 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:55.890092 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:53:55.890977 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:55.895191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 472/946] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:55.896053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:55.915938 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:55.970375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e703c-3779-4d8d-a40f-ec79dd8dd55e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.002695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e217815c-ba25-400d-9b62-9f78ab4c402e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.006600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.007454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.007560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.007849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:56.008840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:56.009953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:56.036230 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 475/947] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:53:56.074241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.075296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.075751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.076176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:56.077190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:56.077733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:56.079531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129a17d-80de-4848-98c6-1d8c9985cbd6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:56.093931 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 473/948] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:56.099775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:56.120745 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:56.222901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9567c3-fe81-4a8a-8faf-23ee9e0f47d6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:56.262381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc20ac3-97fc-4367-aed6-44ca8e8eb65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:56.263281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc20ac3-97fc-4367-aed6-44ca8e8eb65f None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:56.263563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc20ac3-97fc-4367-aed6-44ca8e8eb65f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:56.263841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc20ac3-97fc-4367-aed6-44ca8e8eb65f None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/4578e533395642979715feec9c4de758/roles/3d9a2d1ce36f4b88b096a7baa926e184` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:56.266056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc20ac3-97fc-4367-aed6-44ca8e8eb65f None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=4578e533395642979715feec9c4de758, role_id=3d9a2d1ce36f4b88b096a7baa926e184)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:56.267512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc20ac3-97fc-4367-aed6-44ca8e8eb65f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:56.285587 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 476/949] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:53:56 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/4578e533395642979715feec9c4de758/roles/3d9a2d1ce36f4b88b096a7baa926e184 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:53:57.118564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6555c-5341-4fb5-a42b-c4b1fd2afab2 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.119124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6555c-5341-4fb5-a42b-c4b1fd2afab2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.119124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c6555c-5341-4fb5-a42b-c4b1fd2afab2 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.120793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 474/950] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:57.126147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.126610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.126689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.146341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:57.148021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:57.212290 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.221442 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 477/951] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:57.245418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6555c-5341-4fb5-a42b-c4b1fd2afab2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.326976 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.360649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c6555c-5341-4fb5-a42b-c4b1fd2afab2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.398582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780379db-598f-400e-baba-0535c61beca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.399666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780379db-598f-400e-baba-0535c61beca8 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.400144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780379db-598f-400e-baba-0535c61beca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.400655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780379db-598f-400e-baba-0535c61beca8 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.401889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780379db-598f-400e-baba-0535c61beca8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.403533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780379db-598f-400e-baba-0535c61beca8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.405132 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.server.flask.common [None req-780379db-598f-400e-baba-0535c61beca8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 19 10:53:57.418449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.sql.core [None req-780379db-598f-400e-baba-0535c61beca8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 10:53:57.418449 n-d-master-1 devstack@keystone.service[80580]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 10:53:57.418449 n-d-master-1 devstack@keystone.service[80580]: [parameters: {'user_id': '7719b79c404845889666009d487b048a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 10:53:57.418449 n-d-master-1 devstack@keystone.service[80580]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80580) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-780379db-598f-400e-baba-0535c61beca8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:57.436218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:57.437324 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application yield resource Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application next(self.gen) Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise self.value Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application session.commit() Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 10:53:57.438304 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.session.flush() Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application compat.raise_( Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 10:53:57.439207 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 10:53:57.440818 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application conn.query(q) Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result.read() Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 10:53:57.441729 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [parameters: {'user_id': '7719b79c404845889666009d487b048a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:57.442563 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 19 10:53:57.443390 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 19 10:53:57.446140 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 19 10:53:57.446140 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 19 10:53:57.446140 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 10:53:57.446140 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 10:53:57.446140 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 19 10:53:57.446140 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.449008 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 475/952] 10.222.0.15 () {60 vars in 1131 bytes} [Tue Jul 19 10:53:57 2022] POST /identity/v3/users => generated 160 bytes in 204 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:57.456054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.465324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708ffd-ec11-4f57-b119-b51345711b25 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.465751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708ffd-ec11-4f57-b119-b51345711b25 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.465931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71708ffd-ec11-4f57-b119-b51345711b25 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.473988 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 476/953] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:57.479724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.480014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.480292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.502052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:57.503615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:57.582433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6396f0-2328-4a77-af5f-7386ab7e61e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.592382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 477/954] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:57.609562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.634626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.635519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.635806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.636097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.644573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.646059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:57.662758 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:57.663772 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:57.664792 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 478/955] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:57.670254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.686558 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.729257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18261d-8c81-4b22-9bc6-78e38145a802 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.737279 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.766200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.767506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.768008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.768528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.769415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.771322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:57.784855 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:57.786032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:53:57.786887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:57.788300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7112417-c3d0-4092-8f3f-eeaf68adc0b6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.794946 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 478/956] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:57.796129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:57.826424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.827108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.827392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.827671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.828509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:57.828816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.830378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.872702 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 479/957] 10.222.0.15 () {56 vars in 1101 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:57.908789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb450898-0479-453a-96c6-628dad2c68f1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:57.940108 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:57.949290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:57.950029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:57.950314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:57.950667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:57.951410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:57.952146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:57.953679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:57.959935 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 479/958] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:57.966012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.078648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37e749a-bc0f-468a-b450-9e3e4f13cda9 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.094003 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:58.116421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.117098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.117381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.117654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.118366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:58.118688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:58.120061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef7eb07-f58a-4616-aabb-ed7dc230a921 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:58.125926 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 480/959] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:53:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:58.131622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.238695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06242920-f044-4087-bd11-8fe6cc4bfd9e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.274309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c417c9-d9a8-4929-a3c8-87290cbfae3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.274976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c417c9-d9a8-4929-a3c8-87290cbfae3f None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.275253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c417c9-d9a8-4929-a3c8-87290cbfae3f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.275531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c417c9-d9a8-4929-a3c8-87290cbfae3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.276640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c417c9-d9a8-4929-a3c8-87290cbfae3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:58.278011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c417c9-d9a8-4929-a3c8-87290cbfae3f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:58.300318 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 480/960] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:53:58 2022] POST /identity/v3/endpoints => generated 349 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:53:58.316373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a98c2-3fad-459e-87db-e32fd61fc5f7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.316932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a98c2-3fad-459e-87db-e32fd61fc5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.317047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a98c2-3fad-459e-87db-e32fd61fc5f7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.318453 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 481/961] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:53:58.324682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.324973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.325251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.343290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:58.344535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:58.397523 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:58.424945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd1da-fcbb-4faa-97fb-66548ff618ad None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.425291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd1da-fcbb-4faa-97fb-66548ff618ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.425518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620dd1da-fcbb-4faa-97fb-66548ff618ad None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.427131 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 482/962] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:53:58.432740 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 481/963] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:53:58.432912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.433111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.433321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.452319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:53:58.453559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:53:58.455018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.528014 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 483/964] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:53:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:53:58.551287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.563541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f81d93-2f72-488c-abc2-dcd935b613c0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.602738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.603645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.603948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.604386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.605001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:58.606373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:58.619414 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:58.620481 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:53:58.621311 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 482/965] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:53:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:58.626735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.657406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f1451-6aff-4fc1-80e9-4fc4126a1727 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.667251 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:58.669824 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:58.699646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.700512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.700875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.701128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.713946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:53:58.722453 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:58.723463 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:58.724457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 484/966] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jul 19 10:53:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:53:58.729725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.740091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5ac25a-5dc8-45e8-a2c0-a6841325acc0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.775765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.777186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.777439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.777725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.778805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:58.779110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:58.780855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:58.786560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 483/967] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:58.791908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.844616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cc0b9e-d686-499b-b80c-5aabacb2a231 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.880131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.880832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.881173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.881604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.882382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:58.882800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:58.884151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:58.899763 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 485/968] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:53:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:53:58.899922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9012c1af-e56a-4a4f-96dc-f0aa80229ad3 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:58.900449 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:58.903711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:58.936136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:58.936766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:58.937044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:58.937314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:58.938019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] RBAC: Adding query filter params (type=compute) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:58.938321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:58.939246 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:58.939685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:58.944901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 484/969] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:53:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:59.023571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e621ea71-761c-4a5d-8c9d-7597b226863c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:59.069658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:59.070665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.071044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.071414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.084524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:59.086192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:53:59.105641 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:59.106605 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:59.107504 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:53:59.107504 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:53:59.107504 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:53:59.107504 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:59.107504 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 486/970] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:59.111991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:59.221513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc5540-1e8e-498a-830a-08517ca38cce None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:59.257994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:59.258669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.258951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.259226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.259956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:59.260260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:59.261701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:59.273953 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 485/971] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:59.279745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:59.366718 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:59.387247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a597ab33-3cf6-4641-8d51-73fea0db5756 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:59.424078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:59.424955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.425243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.425518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.434126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:59.435622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:53:59.452468 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:53:59.453485 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 19 10:53:59.454519 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:53:59.456716 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 487/972] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:53:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:53:59.459436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:59.494740 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:59.570630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f5cd09-bc76-49d4-a244-42e9fd60c291 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:59.606379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:59.607209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.607582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.607950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.608913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:53:59.609325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:59.610852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:59.629270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 486/973] 10.222.0.15 () {56 vars in 1149 bytes} [Tue Jul 19 10:53:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:53:59.634861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:53:59.757370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a3eb3-23df-4684-b445-e17e0069c31a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:53:59.806018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:53:59.806660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:53:59.806941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:53:59.807203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:53:59.820198 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:53:59.882802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:53:59.884479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:53:59.991223 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 488/974] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:53:59 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:53:59.996773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.104786 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.131613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f374c661-0984-4787-8e4c-b2821550ead0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.172336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.173450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.173935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.174425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.187042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.188548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9dc8bc7f-cf93-4f8a-9425-07551854b533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:00.207800 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:00.209123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:00.210150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:00.210150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:00.210150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:00.210150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:00.210150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 487/975] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:00.216653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.263386 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.329843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75075a4-a034-4267-8030-e0770ab3ef28 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.358116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267a389-dd64-460b-bc38-f7eddf9595fa None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.358681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267a389-dd64-460b-bc38-f7eddf9595fa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.358681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267a389-dd64-460b-bc38-f7eddf9595fa None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.360109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 488/976] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:00.366547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.367294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.367733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.371777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.372999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.373418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.373834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.374715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:00.375029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.376435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.385166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:00.386378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:00.390003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 489/977] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:00.396372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.466208 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 489/978] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:00.490160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.512535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9987595f-57f6-43f3-a8a3-35cedbdbcae4 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.514536 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.559212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.560133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.560524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.560804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.565516 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.569219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.570731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:54:00.587395 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:00.588405 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:00.589323 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 490/979] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:00.594785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.612417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6845bb36-4e1f-42de-8aef-e5324cf32be1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.653730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.654867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.655153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.655418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.656078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.657996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:00.670888 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:00.672052 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:00.672928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 490/980] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:00.678453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.737712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a4d3-ef94-42e6-81de-0043e0ad624f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.785863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13262e53-4723-4df0-be12-26fb7d81ed02 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.798763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.799819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.800316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.800807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.802241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:00.802785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.805496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.815441 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.822623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.823295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.823564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.823832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.824574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:00.824877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.826236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:00.832529 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 491/981] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:00.833314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.837090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 491/982] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:00.844532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:00.860575 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:00.942513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a1c03-8a32-445b-bfed-ad4af84ecca3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.967218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d6f4c-e2a8-4dc3-a2d4-4494ed0413d1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:00.979484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:00.980152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:00.980465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:00.980749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:00.981589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] RBAC: Adding query filter params (role.id=3d9a2d1ce36f4b88b096a7baa926e184, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=4578e533395642979715feec9c4de758) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:00.981903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:00.983382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a945d39-e7a6-4d9f-a09c-1677914926a1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:01.000663 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 492/983] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/role_assignments?user.id=4578e533395642979715feec9c4de758&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=3d9a2d1ce36f4b88b096a7baa926e184 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:01.005184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:01.006185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:01.006716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:01.007166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:01.008079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:01.008611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:01.010215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:01.016712 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 492/984] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:54:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:01.021955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab988-563c-45df-973f-4cf1250074d5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:01.022387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab988-563c-45df-973f-4cf1250074d5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:01.022679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ab988-563c-45df-973f-4cf1250074d5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:01.022791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:01.024284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 493/985] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:01.030368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:01.030688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:01.030931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:01.052210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:01.053933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:01.099396 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:01.137157 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 494/986] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:01.150496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc42504-959f-4225-ab81-2e3ec22a03ac None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:01.161224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:01.182935 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:01.190658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:01.191335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:01.191607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:01.191879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:01.192714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] RBAC: Adding query filter params (interface=admin, service_id=96df5d4364f24e00afb2deb7d653c5ab, region_id=RegionOne) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:01.193026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:01.195061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:01.200585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 493/987] 10.222.0.15 () {56 vars in 1249 bytes} [Tue Jul 19 10:54:01 2022] GET /identity/v3/endpoints?service_id=96df5d4364f24e00afb2deb7d653c5ab&interface=admin®ion_id=RegionOne => generated 193 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:01.205923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:01.275437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e51dd1-0d03-49fc-a268-8b5d72499835 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:01.310966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935b780-3df4-4c72-a30f-36eef762bf97 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:01.322108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b16c43e-2a34-42f1-9fc9-d617507e8822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:01.322806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16c43e-2a34-42f1-9fc9-d617507e8822 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:01.323090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16c43e-2a34-42f1-9fc9-d617507e8822 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:01.323371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b16c43e-2a34-42f1-9fc9-d617507e8822 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:01.324119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16c43e-2a34-42f1-9fc9-d617507e8822 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:01.325559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b16c43e-2a34-42f1-9fc9-d617507e8822 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:01.337734 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:01.341002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 495/988] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:54:01 2022] POST /identity/v3/services => generated 242 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:54:01.361273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422054be-dd5d-46c2-8b2d-d4f78681e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:01.361987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422054be-dd5d-46c2-8b2d-d4f78681e161 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:01.362200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422054be-dd5d-46c2-8b2d-d4f78681e161 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:01.362474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422054be-dd5d-46c2-8b2d-d4f78681e161 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:01.363175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422054be-dd5d-46c2-8b2d-d4f78681e161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:01.364658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422054be-dd5d-46c2-8b2d-d4f78681e161 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:01.372037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 494/989] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:54:01 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 10:54:03.082299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec233-1081-4b14-8b34-d731fa158932 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.082972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec233-1081-4b14-8b34-d731fa158932 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.082972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dec233-1081-4b14-8b34-d731fa158932 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.084564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 496/990] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:54:03.090018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2f064-160f-4995-84b5-10132636059e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.090534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2f064-160f-4995-84b5-10132636059e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.090534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2f064-160f-4995-84b5-10132636059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.108785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c0f2f064-160f-4995-84b5-10132636059e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:03.109984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0f2f064-160f-4995-84b5-10132636059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:03.180993 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 495/991] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:03.202844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec233-1081-4b14-8b34-d731fa158932 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.290222 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:03.317247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dec233-1081-4b14-8b34-d731fa158932 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.353173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:03.354023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.354305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.354580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] PATH_INFO: `/v3/services/image` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.355263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:03.356755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-81613ef9-12c5-4db3-8ee7-bd867445577e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:03.369554 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:03.370700 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:03.371614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 497/992] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:03.380416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2f064-160f-4995-84b5-10132636059e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.393307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88e52f-2d0e-4b6e-8403-6f41f1b0d4e0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.393599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88e52f-2d0e-4b6e-8403-6f41f1b0d4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.393925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88e52f-2d0e-4b6e-8403-6f41f1b0d4e0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.395296 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 498/993] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:54:03.401016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceef02-d74e-4121-8748-262defdaef7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.401302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceef02-d74e-4121-8748-262defdaef7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.401577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ceef02-d74e-4121-8748-262defdaef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.421450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c0ceef02-d74e-4121-8748-262defdaef7a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:03.422653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c0ceef02-d74e-4121-8748-262defdaef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:03.490339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2f064-160f-4995-84b5-10132636059e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.499331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 499/994] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:03.501056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3448-f071-48b5-9aec-7669ac1c6cdd None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.501369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3448-f071-48b5-9aec-7669ac1c6cdd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.501637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d3448-f071-48b5-9aec-7669ac1c6cdd None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.502923 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 500/995] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:03.504649 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:03.508494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.508778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.509051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.527536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:03.528274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:03.528738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:03.528991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.529273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.529546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.530254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] RBAC: Adding query filter params (name=image) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:03.530565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:03.531924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:03.536777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 496/996] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:03.537546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.593146 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:03.604518 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 501/997] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:03 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:03.605659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.638864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f2b2d-1fe4-4675-bf09-925295b72ed2 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.674040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:03.674852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.675128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.675395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.676045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:03.677452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:03.690147 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:03.691192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:03.692223 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 497/998] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:03.693287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.716724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc63ba-c471-43ef-9bb0-e8edd18de1f1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.734992 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:03.750845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:03.751506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.751784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.752061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.752802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:03.753111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:03.754486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:03.759218 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 502/999] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services?type=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:03.759787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.798415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f171c3-6d5f-4810-a7d2-f45f768c4ea8 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.842298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:03.843133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.843482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.843704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.844397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:03.845819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:03.850242 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:03.859123 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:03.860236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:03.861364 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 498/1000] 10.222.0.15 () {56 vars in 1126 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:03.866694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.897723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034e2a96-3208-41e8-88ca-8f8d8c0c1dd6 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.940944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:03.941704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:03.942051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:03.942332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:03.943033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:03.943336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:03.944802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:03.954400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 503/1001] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:03.955530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:03.978029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4d78e6-bab0-4ce4-9793-9bdf2ec16c61 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:03.981035 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:04.016515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:04.017193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.017542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.017764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.018451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:04.018760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:04.020198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:04.025650 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 499/1002] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:04.031400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:04.075786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bc575c-a783-42dc-9893-8da6873d165b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:04.104708 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:04.117688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:04.118364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.119144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.119417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.120138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] RBAC: Adding query filter params (type=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:04.120479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:04.122562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:04.133061 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 504/1003] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:54:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:04.134193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:04.150804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918d825-a9a4-4eba-9bc2-d685cca9fac9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:04.186567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:04.187240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.187519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.187789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.188535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:04.188842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:04.190226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:04.201189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 500/1004] 10.222.0.15 () {56 vars in 1122 bytes} [Tue Jul 19 10:54:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:04.202191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:04.239326 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:04.246213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af733ce-3626-4634-b4fd-c78751ac78de None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:04.283374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:04.284035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.284321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.284626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.285536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] RBAC: Adding query filter params (interface=public, service_id=e62222e52ffb458593fbb2e0a1527fbb, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:04.285852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:04.287343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:04.297687 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 505/1005] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:54:04 2022] GET /identity/v3/endpoints?service_id=e62222e52ffb458593fbb2e0a1527fbb&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:04.298354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:04.312305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae53c0d6-bd24-412d-a08e-c25a87f40809 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:04.351012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0cf08-3867-4ddd-aa91-a23d135a13b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:04.351781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0cf08-3867-4ddd-aa91-a23d135a13b3 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.352066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0cf08-3867-4ddd-aa91-a23d135a13b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.352340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0cf08-3867-4ddd-aa91-a23d135a13b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.353104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0cf08-3867-4ddd-aa91-a23d135a13b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:04.354481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b0cf08-3867-4ddd-aa91-a23d135a13b3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:04.363046 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:04.384380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 501/1006] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:54:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:04.424602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df935cc-1e15-4860-98a4-c41371508a88 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:04.470973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81991ce-d40a-4886-838d-4d5722645c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:04.471649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81991ce-d40a-4886-838d-4d5722645c41 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:04.471920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81991ce-d40a-4886-838d-4d5722645c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:04.472468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81991ce-d40a-4886-838d-4d5722645c41 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:04.472935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81991ce-d40a-4886-838d-4d5722645c41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:04.474357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81991ce-d40a-4886-838d-4d5722645c41 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:04.486665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 506/1007] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:54:04 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 10:54:05.791044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880cfc5-8db4-40de-a744-cb4d6ed51265 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:05.791629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880cfc5-8db4-40de-a744-cb4d6ed51265 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:05.791629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c880cfc5-8db4-40de-a744-cb4d6ed51265 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:05.792965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 502/1008] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:05.798661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb371c82-d041-49ca-9263-e30dece7589c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:05.799123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb371c82-d041-49ca-9263-e30dece7589c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:05.799202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb371c82-d041-49ca-9263-e30dece7589c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:05.816549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bb371c82-d041-49ca-9263-e30dece7589c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:05.817725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb371c82-d041-49ca-9263-e30dece7589c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:05.888379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 507/1009] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:05 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:05.911274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880cfc5-8db4-40de-a744-cb4d6ed51265 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:06.008415 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:06.019981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c880cfc5-8db4-40de-a744-cb4d6ed51265 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:06.061379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a326b-3b82-4317-8634-352f855f377f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:06.062068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a326b-3b82-4317-8634-352f855f377f None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.062348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a326b-3b82-4317-8634-352f855f377f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.062622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a326b-3b82-4317-8634-352f855f377f None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.063369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a326b-3b82-4317-8634-352f855f377f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:06.064789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a326b-3b82-4317-8634-352f855f377f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:06.084677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 503/1010] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:54:05 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:06.413351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b36d63-b978-41b5-a208-6a4343bde2f1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.414651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b36d63-b978-41b5-a208-6a4343bde2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.414941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b36d63-b978-41b5-a208-6a4343bde2f1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.416539 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 508/1011] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:06.421937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.422194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.422493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.440732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:06.441905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:06.513561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914dcc2-21f4-4788-9789-ec5cb2a5870d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.513866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914dcc2-21f4-4788-9789-ec5cb2a5870d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.514111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a914dcc2-21f4-4788-9789-ec5cb2a5870d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.515510 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 509/1012] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:06.519928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 504/1013] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:06 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:06.520623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.520913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.521193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.538336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:06.539595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:06.543200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:06.585935 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:06.620395 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 510/1014] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:06 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:06.634824 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:06.638392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:06.659194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbca136-c6be-4d51-bc34-7d48b77ae76f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:06.696717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:06.698018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.698414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.698696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.700540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:06.702520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:06.705020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 505/1015] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:06.710515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:06.747901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf332e2-0d9e-431c-b1f6-d3158512ce16 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:06.788466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:06.789384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.789690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.789991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.790675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:06.792187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:06.805114 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:06.806766 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:06.807635 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 511/1016] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:54:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:06.812338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:06.826599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9196cd-93ed-45d4-9e39-67be683e9851 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:06.856407 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:06.863498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:06.864162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.864480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.864753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.865460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:06.866945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:06.887342 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:06.895687 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 506/1017] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:54:06 2022] POST /identity/v3/projects => generated 311 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:54:06.926240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e05fb-731f-4e16-867a-260ecb9c0f0d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:06.968519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:06.969226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:06.969544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:06.969812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:06.970586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:06.970919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:06.972461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:06.983594 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 512/1018] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:54:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:06.984887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:07.110807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a95a751-c93a-4b36-a0c9-6669419ab268 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:07.150578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:07.151261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:07.151539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:07.151807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:07.152860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] RBAC: Adding query filter params (type=compute) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:07.153164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:07.154534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddc108c-15f1-4126-b727-a19d5ed70dda None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:07.160842 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 507/1019] 10.222.0.15 () {56 vars in 1112 bytes} [Tue Jul 19 10:54:06 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:07.166801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:07.274865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a77b608-6b77-4974-993e-8980a19ffe14 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:07.278816 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:07.313375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f746f-c8cd-4440-b14f-c7aea839357e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:07.314016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f746f-c8cd-4440-b14f-c7aea839357e None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:07.314317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f746f-c8cd-4440-b14f-c7aea839357e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:07.314580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f746f-c8cd-4440-b14f-c7aea839357e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:07.315345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f746f-c8cd-4440-b14f-c7aea839357e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:07.316737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f746f-c8cd-4440-b14f-c7aea839357e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:07.344375 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 513/1020] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:54:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:08.131395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d56a-2da6-4e5d-871a-f41ee079514c None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:08.131977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d56a-2da6-4e5d-871a-f41ee079514c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:08.131977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e6d56a-2da6-4e5d-871a-f41ee079514c None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:08.133598 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 508/1021] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:08.139979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:08.140584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:08.140584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:08.159041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:08.160940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:08.251133 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 514/1022] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:08.273247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d56a-2da6-4e5d-871a-f41ee079514c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:08.337863 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:08.378423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e6d56a-2da6-4e5d-871a-f41ee079514c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:08.412843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:08.413639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:08.414074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:08.414189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] PATH_INFO: `/v3/services/image` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:08.414847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:08.416210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:08.427851 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:08.429050 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:08.429953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:08.432683 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 509/1023] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Jul 19 10:54:08 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:08.435067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:08.532029 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:08.549852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f84a5-c78f-46bf-b898-5280b905d940 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:08.586276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:08.586939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:08.587236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:08.587507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:08.588242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] RBAC: Adding query filter params (name=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:08.588526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:08.589928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:08.595293 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 515/1024] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:08.600881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:08.707062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5cba1-8562-42b8-9ea6-ca1da14f4fc4 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:08.732944 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:08.743025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:08.743696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:08.743969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:08.744235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:08.744981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] RBAC: Adding query filter params (type=image) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:08.745269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:08.746641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:08.751986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 510/1025] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:08.757900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:08.863078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5884e88-31c6-4e57-a85a-5f1cd4279a15 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:08.898643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:08.899291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:08.899569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:08.899844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:08.900655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] RBAC: Adding query filter params (interface=public, service_id=1881a13dc3684432bdf045a73cf22ebb, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:08.900972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:08.902351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c302c1-db82-4345-a083-d79b6580a162 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:08.908236 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 516/1026] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:54:08 2022] GET /identity/v3/endpoints?service_id=1881a13dc3684432bdf045a73cf22ebb&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:08.913754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:09.016726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f1d65-c77d-4fa2-9283-e44c0ecb6e85 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:09.059443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d2e86-4077-4e3e-baee-c623edb1791a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:09.060123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2e86-4077-4e3e-baee-c623edb1791a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.061716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2e86-4077-4e3e-baee-c623edb1791a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.061716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d2e86-4077-4e3e-baee-c623edb1791a None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.061716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2e86-4077-4e3e-baee-c623edb1791a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:09.063254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60d2e86-4077-4e3e-baee-c623edb1791a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:09.073578 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 511/1027] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:54:08 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:54:09.129234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c694f-8fb1-4f78-b876-664ed06c8059 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.129430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c694f-8fb1-4f78-b876-664ed06c8059 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.129675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4c694f-8fb1-4f78-b876-664ed06c8059 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.131413 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 517/1028] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:09.137244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.137776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.137853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.158912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:09.160463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:09.222901 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:09.248538 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 512/1029] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:09.270625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c694f-8fb1-4f78-b876-664ed06c8059 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:09.288850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:09.386553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4c694f-8fb1-4f78-b876-664ed06c8059 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:09.422371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da8922-a625-4bf9-be2a-41a3a2bfc3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:09.423220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da8922-a625-4bf9-be2a-41a3a2bfc3fc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.423509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da8922-a625-4bf9-be2a-41a3a2bfc3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.423784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da8922-a625-4bf9-be2a-41a3a2bfc3fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.424984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da8922-a625-4bf9-be2a-41a3a2bfc3fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:09.426512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80da8922-a625-4bf9-be2a-41a3a2bfc3fc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:09.433128 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 518/1030] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:09.434440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:09.503544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9204b3-45df-4910-9926-06bd3dab3eb4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.503839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9204b3-45df-4910-9926-06bd3dab3eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.504113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9204b3-45df-4910-9926-06bd3dab3eb4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.505790 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 519/1031] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:54:09.511020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.511313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.511604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.529528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:09.530701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:09.543188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2a1edf-288c-46d1-84d1-24d077c816dc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:09.579615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:09.580297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.580601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.580876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.581599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:09.583039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:09.604041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 520/1032] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:09.608397 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 513/1033] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:54:09 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:09.627775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:09.644084 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:09.743296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c8b6c-3c32-4a74-b56b-c5f69540e559 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:09.781969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:09.782799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.783082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.783359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.794975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:09.803235 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:09.804229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:09.805266 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 521/1034] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jul 19 10:54:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:09.810770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:09.859579 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:09.920526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9086b41-0075-4f99-aa5c-5858e5c3cffe None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:09.954863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:09.955537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:09.955815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:09.956104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:09.956871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:09.957176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:09.958549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:09.967392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 514/1035] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:54:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:09.972866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.047399 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.080302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9a439-da9f-4198-9e77-3df795f8c28a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.116552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.117402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.117686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.117937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.131451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.133024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:10.151763 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:10.153281 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:10.154237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:10.154237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:10.154237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:10.154237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:10.154237 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 522/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:10.159799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.275810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52ef14-800a-4985-b919-795810dfaf11 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.278751 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.317967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.318635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.318918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.319188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.319923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:10.320241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.321759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.338538 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 515/1037] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:10.339856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.459476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090160f8-5e0a-493f-9146-5e24b41ff2de None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.486394 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.501557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.502379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.502658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.502931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.511942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.513510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:54:10.531204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:10.532214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:54:10.533808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:10.534751 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 523/1038] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:10.538164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.647646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2206c38a-50fd-4c98-b437-c7786c90327f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.685944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.686617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.686982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.687433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.688546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:10.688972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.690584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:10.713798 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 516/1039] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:10.715918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:10.846590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9058942-106e-4b75-a7b7-32a965e81394 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:10.883270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c892dd89-8b62-4e99-9bba-4c19b6447c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:10.884238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892dd89-8b62-4e99-9bba-4c19b6447c14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:10.884728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892dd89-8b62-4e99-9bba-4c19b6447c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:10.885177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c892dd89-8b62-4e99-9bba-4c19b6447c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:10.942209 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:10.960500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892dd89-8b62-4e99-9bba-4c19b6447c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:10.961968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c892dd89-8b62-4e99-9bba-4c19b6447c14 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.084598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 524/1040] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:10 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:11.093766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.122433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2c35b-8107-481d-a247-05880f3f447d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.122758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2c35b-8107-481d-a247-05880f3f447d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.123458 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.124078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2c35b-8107-481d-a247-05880f3f447d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.125680 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 525/1041] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:54:11.130919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602425-6350-4c00-b2bb-081816da190d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.131206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602425-6350-4c00-b2bb-081816da190d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.131515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84602425-6350-4c00-b2bb-081816da190d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.149877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-84602425-6350-4c00-b2bb-081816da190d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:11.151420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84602425-6350-4c00-b2bb-081816da190d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:11.215950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2f73-e31a-4ccb-8977-3bae7f07e3a1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.248390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 526/1042] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:11.253298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.254281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.254708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.255114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.265836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602425-6350-4c00-b2bb-081816da190d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.267055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.268541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:11.287130 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:11.288232 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:11.289218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:11.289218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:11.289218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:11.289218 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:11.289218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 517/1043] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:11.293358 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.297130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.378084 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.403492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84602425-6350-4c00-b2bb-081816da190d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.411895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808be80-003e-4082-a9b4-160fbb58e62d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.444512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.445406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.445694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.445966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] PATH_INFO: `/v3/services/image` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.446637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.448120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.451320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.452008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.452415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.452699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.453486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:11.453803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.455225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:11.462123 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:11.463413 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 19 10:54:11.464505 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:11.471178 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 527/1044] 10.222.0.15 () {56 vars in 1105 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/services/image => generated 86 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:11.471694 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 518/1045] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:11.472200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.477637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.562487 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.588468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053c7c95-47ff-4ef1-96f0-23514ed1434e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.589839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d1e226-9c37-4d3b-9b59-b815bf8a6438 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.622402 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.624630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.625419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.625701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.626115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.626849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] RBAC: Adding query filter params (name=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:11.627128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.628484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.628604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.629240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.630023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.630300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.638314 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 528/1046] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:11.638476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.639412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.639517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:54:11.654455 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:11.655443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:11.656395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 519/1047] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:11.661472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.747385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3853-ceb8-49dd-a889-b0d41bf648db None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.767728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0431c4-b7ba-4618-a3f2-9c8e60715ed6 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.781425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.782087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.782362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.782658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.783352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] RBAC: Adding query filter params (type=image) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:11.783647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.785065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc131da-2a1c-4d16-b2f1-7fc1327fabaa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.789880 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 529/1048] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:11.791127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74d66-40b5-41b9-97e4-fdb1c159b8ef None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.791409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74d66-40b5-41b9-97e4-fdb1c159b8ef None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.791683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74d66-40b5-41b9-97e4-fdb1c159b8ef None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.792941 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 530/1049] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:11.795454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74d66-40b5-41b9-97e4-fdb1c159b8ef None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.804515 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.805442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.806309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.806832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.807144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.807948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:11.808258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.809748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59143a2e-328e-4b60-85eb-f28a763e999b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.821927 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 520/1050] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:11.827101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.827101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.827101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.842153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:11.843340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:11.890206 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:11.898312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74d66-40b5-41b9-97e4-fdb1c159b8ef None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:11.910158 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 521/1051] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:11 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:11.910988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:11.936317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:11.937015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:11.937296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:11.937576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:11.938367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:11.939843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:11.958797 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 531/1052] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:54:11 2022] POST /identity/v3/endpoints => generated 327 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:54:11.959843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:12.029646 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:12.033503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469bad2-123b-4e77-85d3-edf9343f5c38 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:12.083797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:12.084894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:12.085512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:12.085991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:12.086901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdd715e-87a9-4f09-bc6f-b2c250ba4edf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:12.087453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] RBAC: Adding query filter params (role.id=3d9a2d1ce36f4b88b096a7baa926e184, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2af38e680ecd4346b44dad744de8e50c) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:12.088023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:12.089864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:12.096811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 522/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/role_assignments?user.id=2af38e680ecd4346b44dad744de8e50c&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=3d9a2d1ce36f4b88b096a7baa926e184 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:12.130917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:12.131734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:12.132016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:12.132288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:12.146120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:12.154383 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:12.155397 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:12.156230 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 532/1054] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:12.162290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:12.209390 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:12.270835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48db56c1-aef5-4a76-9aa6-9476affb5a9e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:12.307489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:12.308517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:12.309010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:12.309468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:12.310541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:12.310996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:12.312591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:12.322055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 523/1055] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:12.328080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:12.442937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14b51bf-575c-4ffc-b8cf-e7f3dfce918a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:12.470134 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:12.484811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:12.485701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:12.485985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:12.486261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] PATH_INFO: `/v3/users/2814162ec6494f0b83b08519947f748d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:12.502302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] RBAC: Authorizing `identity:get_user(user_id=2814162ec6494f0b83b08519947f748d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:12.503838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:12.506063 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 533/1056] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:12 2022] GET /identity/v3/users/2814162ec6494f0b83b08519947f748d => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:12.513151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:12.623442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98679ab-81ee-4254-b303-16db9c3b8d4f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:12.626088 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:12.663533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:12.664193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:12.664565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:12.664841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:12.739339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:12.740842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:12.852783 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 524/1057] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:12.855183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:12.959753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9964-0615-419c-af45-fe83db2db8a5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:12.995333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf6637e-e3cf-4091-bceb-46a9ae57edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:12.996181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6637e-e3cf-4091-bceb-46a9ae57edbc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:12.996534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6637e-e3cf-4091-bceb-46a9ae57edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:12.996848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf6637e-e3cf-4091-bceb-46a9ae57edbc None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:12.998088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6637e-e3cf-4091-bceb-46a9ae57edbc None admin] RBAC: Authorizing `identity:get_project(project_id=3177582a285642058803331c26afe89e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:12.999629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf6637e-e3cf-4091-bceb-46a9ae57edbc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:13.001534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 534/1058] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:12 2022] GET /identity/v3/projects/3177582a285642058803331c26afe89e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:13.007833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:13.011197 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:13.132878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367456b2-73d4-4d08-90fd-05d4971c760c None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:13.170945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:13.171968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:13.172517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:13.172986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:13.174022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=3177582a285642058803331c26afe89e, user.id=2814162ec6494f0b83b08519947f748d) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:13.174530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:13.176207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efa982-b269-42b4-86b0-4df5e2b5371e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:13.182708 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 525/1059] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:13 2022] GET /identity/v3/role_assignments?user.id=2814162ec6494f0b83b08519947f748d&scope.project.id=3177582a285642058803331c26afe89e&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:14.025035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc9ba1-6dfd-4a38-a379-5fb0b46dd98e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.025566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc9ba1-6dfd-4a38-a379-5fb0b46dd98e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.025674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc9ba1-6dfd-4a38-a379-5fb0b46dd98e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.027206 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 535/1060] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:14.032887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.033357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.033433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.050986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:14.052141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:14.112500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab2972-6181-4ecb-82e5-dee64fb014ab None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.112890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab2972-6181-4ecb-82e5-dee64fb014ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.113046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dab2972-6181-4ecb-82e5-dee64fb014ab None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.114628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 536/1061] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:54:14.119665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.119927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.120209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.127339 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.134645 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 526/1062] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:14.140564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:14.141831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:14.157245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.189612 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.217048 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 537/1063] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:14.240441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.271144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e8df6e-38dd-43d3-bcee-9dcfc320d42d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.313796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.314356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.314646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.314925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.357112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5499e48-a724-41e4-b4cd-1d122a666434 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.385913 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.389998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.391757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.399385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.400218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.400539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.400811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.414493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:14.423007 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:14.424229 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:14.425126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 538/1064] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:14.431347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.482402 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.524019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 527/1065] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:14.525363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.561038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221eab4-6de0-4e95-a436-0b011bc05720 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.599533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.600176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.600567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.600848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.601598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:14.601906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.603290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.612072 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 539/1066] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:14.617679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.636648 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.641308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf622b7-2b90-4ee5-99e8-a6d2b4bc57a6 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.678316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.679222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.679610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.679879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.691134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.692638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:14.710605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:14.711742 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:14.712670 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:14.712670 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:14.712670 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:14.712670 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:14.712670 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 528/1067] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:14.718373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.733056 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:14.736832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d32dfd-49c0-4579-ae01-7c31611e0823 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.774890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.775685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.775964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.776234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.788040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.789565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:14.806984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:14.808160 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:14.809569 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:14.809569 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:14.809569 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:14.809569 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:14.813427 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 540/1068] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:14.814159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:14.830082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65f65ef-20a4-4bd9-bb94-ec0757630780 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.868137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.868746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.869023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.869292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.870016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:14.870316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.871691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.884314 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 529/1069] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:14.925629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f99330-3e90-4638-8c3c-ce670e474714 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:14.963771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:14.964479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:14.964767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:14.965043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:14.965787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:14.966096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:14.967527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:14.981170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 541/1070] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:14.987099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.001237 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.109015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ac18fb-e486-4979-bae5-1e23fa98325a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.146106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.146867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.148765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.148765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] PATH_INFO: `/v3/users/nova` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.156282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.157870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-655dac0e-5638-4270-aa02-cff672d7adce None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:54:15.172636 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:15.173712 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:15.174821 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 530/1071] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:54:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:15.180029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.195958 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.198473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ed18-ca2f-4a79-889d-93d78dca56c8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.198748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ed18-ca2f-4a79-889d-93d78dca56c8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.199023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a2ed18-ca2f-4a79-889d-93d78dca56c8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.200702 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 531/1072] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:15.205970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.206254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.206529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.223325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:15.224545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:15.278541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493725b3-d5c2-457a-9aa6-1bec9af7463b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.288040 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.293737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 532/1073] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:15.312282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.313011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.313313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.313585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.314496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:15.314804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.316237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.316710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.333400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 542/1074] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:15.339001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.411185 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.415146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397095c-445b-4b21-8a97-37e21295ecdc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.442808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfa2e9-4ea3-4d67-bfb2-77f8daa65879 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.456010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.456854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.457167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.457416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.468126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:15.477393 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:15.478583 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:15.479646 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 533/1075] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:15.484019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.484153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.485064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.485345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.485614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.497570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.499181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:15.518150 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:15.519194 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:15.520081 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:15.520081 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:15.520081 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:15.520081 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:15.520081 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 543/1076] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:15.525199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.550211 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.592047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955fe40-68a7-4fc7-b275-741ec9db919f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.625549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.626215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.626494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.626766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.627507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:15.627807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.627970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c32c5-0475-42f9-81f3-6d4ce089f4fc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.629210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.637361 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 534/1077] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:15.643079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.655860 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.668478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.669090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.669371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.669649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.670370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:15.670677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.672057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.683418 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 544/1078] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:15.689009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.744814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f8bbb-419e-48cb-b1d3-e5c64af4c42a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.766896 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.780047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8a974-762a-471b-952c-988092c30467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.780961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8a974-762a-471b-952c-988092c30467 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.781242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8a974-762a-471b-952c-988092c30467 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.781518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8a974-762a-471b-952c-988092c30467 None admin] PATH_INFO: `/v3/users/2814162ec6494f0b83b08519947f748d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.783167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8a974-762a-471b-952c-988092c30467 None admin] RBAC: Authorizing `identity:get_user(user_id=2814162ec6494f0b83b08519947f748d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.784646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e8a974-762a-471b-952c-988092c30467 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.786309 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 535/1079] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/users/2814162ec6494f0b83b08519947f748d => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:15.792213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8a974-762a-471b-952c-988092c30467 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.798054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b22bb-9fbc-46da-a88b-91a8b34fb96c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.835900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.836770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.837057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.837326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.845999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.847464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:54:15.862096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:15.863193 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:15.864078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 545/1080] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:15.869249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.897809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8a974-762a-471b-952c-988092c30467 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:15.911895 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:15.932509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:15.933303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:15.933579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:15.933847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:15.935026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] RBAC: Authorizing `identity:get_project(project_id=3177582a285642058803331c26afe89e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:15.936492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:15.938224 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 536/1081] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/projects/3177582a285642058803331c26afe89e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:15.944244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:15.974333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6189a69-9634-48a0-8e7c-8c19669243f5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:16.003797 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:16.009173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:16.009843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.010123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.010396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.011209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:16.011519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:16.013000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:16.024868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 546/1082] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:54:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:16.031165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:16.050329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca6610-db5b-4d9e-9110-f8e9b1d6d71a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:16.084175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051dcc76-6a3b-42b3-bf8b-cf794a763417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:16.085097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dcc76-6a3b-42b3-bf8b-cf794a763417 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.085383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dcc76-6a3b-42b3-bf8b-cf794a763417 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.085653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051dcc76-6a3b-42b3-bf8b-cf794a763417 None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e/users/2814162ec6494f0b83b08519947f748d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.087834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dcc76-6a3b-42b3-bf8b-cf794a763417 None admin] RBAC: Authorizing `identity:create_grant(project_id=3177582a285642058803331c26afe89e, user_id=2814162ec6494f0b83b08519947f748d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:16.089296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051dcc76-6a3b-42b3-bf8b-cf794a763417 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:16.103464 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 537/1083] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:54:15 2022] PUT /identity/v3/projects/3177582a285642058803331c26afe89e/users/2814162ec6494f0b83b08519947f748d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:54:16.147195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87474303-c10e-47d5-8aca-42a3b652bac5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:16.149049 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:16.189627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698eb0b-16fc-4bc2-a690-69323430f8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:16.190441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698eb0b-16fc-4bc2-a690-69323430f8c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:16.190724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698eb0b-16fc-4bc2-a690-69323430f8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:16.190995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698eb0b-16fc-4bc2-a690-69323430f8c7 None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2af38e680ecd4346b44dad744de8e50c/roles/3d9a2d1ce36f4b88b096a7baa926e184` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:16.193365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698eb0b-16fc-4bc2-a690-69323430f8c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=2af38e680ecd4346b44dad744de8e50c, role_id=3d9a2d1ce36f4b88b096a7baa926e184)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:16.194843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698eb0b-16fc-4bc2-a690-69323430f8c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:16.210306 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 547/1084] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:54:16 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/2af38e680ecd4346b44dad744de8e50c/roles/3d9a2d1ce36f4b88b096a7baa926e184 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:54:18.123322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63767-4003-4f5b-a299-bd767ffce6c3 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.123904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63767-4003-4f5b-a299-bd767ffce6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.123904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b63767-4003-4f5b-a299-bd767ffce6c3 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.125245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 538/1085] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:18.131446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5fe27-3c86-4293-b74c-8b0eb6fd9fa4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.131948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5fe27-3c86-4293-b74c-8b0eb6fd9fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.132083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5fe27-3c86-4293-b74c-8b0eb6fd9fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.150721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-38f5fe27-3c86-4293-b74c-8b0eb6fd9fa4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:18.151955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38f5fe27-3c86-4293-b74c-8b0eb6fd9fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:18.235068 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 548/1086] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:18.258560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b63767-4003-4f5b-a299-bd767ffce6c3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.261652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb05f-dff4-4bfd-9ba1-e5af72e9e336 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.261970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb05f-dff4-4bfd-9ba1-e5af72e9e336 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.262247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeb05f-dff4-4bfd-9ba1-e5af72e9e336 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.263655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 549/1087] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:18.269467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.269754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.270028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.288091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:18.289346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:18.361981 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 550/1088] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:18.369519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b63767-4003-4f5b-a299-bd767ffce6c3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.385444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.388006 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:18.408884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.409690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.409804 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:18.409968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.410234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.421587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:18.429212 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:18.430251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:18.431149 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 539/1089] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:18.436482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.490546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22ddd93-eef1-4c1c-b1f9-54acee0f7888 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.532434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.533240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.533522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.533801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.542782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ff05-628e-4230-b9db-c4bdcd2f6b6e None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.544057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:18.552400 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:18.553379 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:18.554260 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 551/1090] 10.222.0.15 () {56 vars in 1120 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:18.559860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.581265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.581951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.582232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.582513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.583280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:18.583587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:18.585026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:18.596737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 540/1091] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:18.600986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.645453 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:18.651584 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:18.670534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae6eb48-35dc-42e6-bcd1-d74b83fe76cf None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.703893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a50ce-3a38-46d0-aca8-f0d69aafd306 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.705639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.706318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.706598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.706874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.707618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:18.707925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:18.709343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:18.718127 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 552/1092] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:18.724923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.751854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.752763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.753046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.753317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] PATH_INFO: `/v3/users/2814162ec6494f0b83b08519947f748d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.754547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] RBAC: Authorizing `identity:get_user(user_id=2814162ec6494f0b83b08519947f748d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:18.755992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:18.757712 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 541/1093] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/users/2814162ec6494f0b83b08519947f748d => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:18.763655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:18.840538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678b7eb-29c1-4bd9-beac-713b154e65ba None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.876047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.876879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.877175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.877436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.882486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316577ed-62cf-4b83-a592-b9a83c892697 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:18.892371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:18.893708 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:18.894471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:18.898781 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:18.931108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:18.931336 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:18.932233 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:18.933176 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:18.933176 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:18.933176 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:18.933176 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:18.933399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:18.933399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:18.933399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:18.933877 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 553/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:18.944373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.019662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.021175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.070438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b020e-b8ea-4343-a5d6-6f597fdb19c8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.106213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.106878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.107166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.107443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:19.108176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:19.108517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.109915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.123022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 554/1095] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:19.128778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.135817 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 542/1096] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:54:19.141946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.152627 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:19.189929 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:19.240546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331c971-9b8a-43b6-bb0d-b750bb9e3bb7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.254486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67323c8b-0a73-472f-a94f-3142505b7a69 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.277757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.278553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.278832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.279102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:19.287286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.288819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.292099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.293000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.293275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.293549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:19.294752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] RBAC: Authorizing `identity:get_project(project_id=3177582a285642058803331c26afe89e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.296183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.297950 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 543/1097] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:19 2022] GET /identity/v3/projects/3177582a285642058803331c26afe89e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:54:19.304611 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:19.305770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:19.307223 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 555/1098] 10.222.0.15 () {56 vars in 1093 bytes} [Tue Jul 19 10:54:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:54:19.307818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.311672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.390143 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:19.416777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1161a66-9bdb-40fa-b0ad-3a51fa70aa7a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.422596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4ed4d7-59ec-4ff9-8325-430da03837a5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.442291 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:19.453218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.453888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.454170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.454447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:19.455281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=3177582a285642058803331c26afe89e, user.id=2814162ec6494f0b83b08519947f748d) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:19.455589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.457062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.461646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.462345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.462623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.474069 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 544/1099] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:19 2022] GET /identity/v3/role_assignments?user.id=2814162ec6494f0b83b08519947f748d&scope.project.id=3177582a285642058803331c26afe89e&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:19.474305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:19.474305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:19.474305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.474305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.490163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 556/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Tue Jul 19 10:54:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:19.498410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.622429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f57905-dd3d-416c-ae4d-f5633c687234 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.663122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.663789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.664072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.664374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:19.676219 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:19.739342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:19.740847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:19.843047 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 545/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:19.848974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:19.956471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07370d0-0c67-4c27-93ff-05ff6d6ffcbc None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:19.994264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:19.995082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:19.995363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:19.995635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:20.007458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:20.009019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:20.027508 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:20.028590 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:20.029802 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:54:20.029802 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:20.029802 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:54:20.029802 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:20.029802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 557/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:20.035053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:20.079301 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:20.136210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359ff7a-1f1d-41fb-8a8f-a7311a19a56d None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:20.172247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:20.172952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:20.173230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:20.173506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:20.174235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:20.174538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:20.175908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:20.187757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 546/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:20.193639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:20.222688 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:20.296268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e37381a-cfb6-43db-b17c-3b721e25bec5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:20.331706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:20.332532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:20.332814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:20.333091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:20.340032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:20.341524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:54:20.355331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:20.356237 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:20.357325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 558/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:20.362613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:20.465775 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:20.469394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c0574-7437-4d72-b9f6-2e8b1019b296 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:20.509268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:20.509890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:20.510215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:20.510499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:20.511481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:20.511798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:20.513516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75529b2-b508-4b22-bd54-cab7c1a29d5f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:20.527648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 547/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:54:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:20.534537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:20.661107 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:20.693187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616ed3ef-6a5f-4de5-ad41-f7c628ed6f13 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:20.736755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:20.737426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:20.737713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:20.737991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:20.738864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] RBAC: Adding query filter params (role.id=3d9a2d1ce36f4b88b096a7baa926e184, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=2af38e680ecd4346b44dad744de8e50c) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:20.739382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:20.741523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085247ce-b3c9-46a0-abd8-3f824b5531b0 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:20.749767 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 559/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:20 2022] GET /identity/v3/role_assignments?user.id=2af38e680ecd4346b44dad744de8e50c&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=3d9a2d1ce36f4b88b096a7baa926e184 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:21.594017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b2743-2fa6-4adf-a124-cebf952cc7ec None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:21.595190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b2743-2fa6-4adf-a124-cebf952cc7ec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:21.595190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b2743-2fa6-4adf-a124-cebf952cc7ec None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:21.596926 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 548/1107] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:21.603295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:21.603867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:21.603867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:21.628174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:21.629928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:21.723757 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 560/1108] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:21.755345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b2743-2fa6-4adf-a124-cebf952cc7ec None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:21.870300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b2743-2fa6-4adf-a124-cebf952cc7ec None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:21.907307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ae720-b575-4254-a400-21e9c9fb6bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:21.908114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ae720-b575-4254-a400-21e9c9fb6bec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:21.908419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ae720-b575-4254-a400-21e9c9fb6bec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:21.908696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ae720-b575-4254-a400-21e9c9fb6bec None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:21.909901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ae720-b575-4254-a400-21e9c9fb6bec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:21.911344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7ae720-b575-4254-a400-21e9c9fb6bec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:21.913034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 549/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:21.919673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:22.011328 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:22.032051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3771fce-4b4d-4cab-a016-069fc660a683 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:22.074813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64497d0-6bf9-4ce7-acfd-05cb748a3ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:22.075582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64497d0-6bf9-4ce7-acfd-05cb748a3ac2 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:22.075867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64497d0-6bf9-4ce7-acfd-05cb748a3ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:22.076144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64497d0-6bf9-4ce7-acfd-05cb748a3ac2 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:22.076954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64497d0-6bf9-4ce7-acfd-05cb748a3ac2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:22.078594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64497d0-6bf9-4ce7-acfd-05cb748a3ac2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:22.100966 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 561/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:54:21 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:24.184643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965fbf-8887-499b-a699-191930bfcad0 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:24.185193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965fbf-8887-499b-a699-191930bfcad0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:24.185193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67965fbf-8887-499b-a699-191930bfcad0 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:24.186585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 550/1111] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:24.191971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:24.192443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:24.192529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:24.210150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:24.211357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:24.284873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 562/1112] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:24.308842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965fbf-8887-499b-a699-191930bfcad0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:24.339979 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:24.418429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67965fbf-8887-499b-a699-191930bfcad0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:24.453233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:24.454091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:24.454373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:24.454647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] PATH_INFO: `/v3/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:24.456133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] RBAC: Authorizing `identity:get_role(role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:24.457543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:24.458979 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 551/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:24 2022] GET /identity/v3/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 223 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:24.465144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:24.538731 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:24.577110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7206cd-5d09-4cad-91ce-d23ad6287cb9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:24.612647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:24.613529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:24.613811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:24.614087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] PATH_INFO: `/v3/users/9bc384b7b807421a9260574382b42bf6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:24.627882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] RBAC: Authorizing `identity:get_user(user_id=9bc384b7b807421a9260574382b42bf6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:24.629384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:24.631126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 563/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:24 2022] GET /identity/v3/users/9bc384b7b807421a9260574382b42bf6 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:24.637867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:24.740899 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:24.747074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b5145a-7ff0-4b21-a943-e2327c76c1c0 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:24.784857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:24.785527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:24.785805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:24.786070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:24.863094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:24.864495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:24.970734 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:24.978998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 552/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:24.985414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:25.095828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8835d83-2df1-4037-8afc-970ff8f2082f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:25.120911 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:25.132337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb062ef-91d6-4cb6-84c1-c7f02042a79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:25.133239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb062ef-91d6-4cb6-84c1-c7f02042a79c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:25.133522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb062ef-91d6-4cb6-84c1-c7f02042a79c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:25.133798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb062ef-91d6-4cb6-84c1-c7f02042a79c None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:25.135163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb062ef-91d6-4cb6-84c1-c7f02042a79c None admin] RBAC: Authorizing `identity:get_project(project_id=3177582a285642058803331c26afe89e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:25.136654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb062ef-91d6-4cb6-84c1-c7f02042a79c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:25.138387 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 564/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:24 2022] GET /identity/v3/projects/3177582a285642058803331c26afe89e => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:25.144989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:25.247827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15adf85-33ee-4f77-8d0f-2bdf7ff7ee1f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:25.283234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:25.283881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:25.284155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:25.284455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:25.285278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] RBAC: Adding query filter params (role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=3177582a285642058803331c26afe89e, user.id=9bc384b7b807421a9260574382b42bf6) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:25.285580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:25.287013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa38edd5-7078-49c2-ad31-643639d76a28 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:25.292613 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 553/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:25 2022] GET /identity/v3/role_assignments?user.id=9bc384b7b807421a9260574382b42bf6&scope.project.id=3177582a285642058803331c26afe89e&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:27.300275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd188ee2-6929-4950-a0ed-49149f032e4c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:27.300994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd188ee2-6929-4950-a0ed-49149f032e4c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:27.300994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd188ee2-6929-4950-a0ed-49149f032e4c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:27.302273 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 565/1118] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:27.308580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:27.309564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:27.309564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:27.326663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:27.327872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:27.389331 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:27.403298 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 554/1119] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:27.429776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd188ee2-6929-4950-a0ed-49149f032e4c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:27.540643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd188ee2-6929-4950-a0ed-49149f032e4c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:27.576873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:27.577618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:27.577893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:27.578164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] PATH_INFO: `/v3/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:27.579633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] RBAC: Authorizing `identity:get_role(role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:27.581034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:27.582437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 566/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:27 2022] GET /identity/v3/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:27.589304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:27.706958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10a3aff-59da-4dc8-93a9-c390b1168e43 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:27.748255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:27.749195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:27.749478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:27.749749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] PATH_INFO: `/v3/users/9bc384b7b807421a9260574382b42bf6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:27.751119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] RBAC: Authorizing `identity:get_user(user_id=9bc384b7b807421a9260574382b42bf6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:27.752993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:27.754792 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 555/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:27 2022] GET /identity/v3/users/9bc384b7b807421a9260574382b42bf6 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:27.761473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:27.826428 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:27.870301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5497f-d035-412e-896e-6ae4644abc71 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:27.906227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fa5188-7c1b-4741-8084-5ab0b565c4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:27.907082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa5188-7c1b-4741-8084-5ab0b565c4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:27.907364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa5188-7c1b-4741-8084-5ab0b565c4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:27.907620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fa5188-7c1b-4741-8084-5ab0b565c4d1 None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:27.908890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa5188-7c1b-4741-8084-5ab0b565c4d1 None admin] RBAC: Authorizing `identity:get_project(project_id=3177582a285642058803331c26afe89e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:27.910297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fa5188-7c1b-4741-8084-5ab0b565c4d1 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:27.912027 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 567/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:27 2022] GET /identity/v3/projects/3177582a285642058803331c26afe89e => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:54:27.918514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:27.989963 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:28.039450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388ce10f-91e7-4f87-a7c8-cce0a44d2a16 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:28.092410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46f480-e8c3-494b-a24c-494503176f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:28.093346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46f480-e8c3-494b-a24c-494503176f26 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:28.093626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46f480-e8c3-494b-a24c-494503176f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:28.093898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46f480-e8c3-494b-a24c-494503176f26 None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e/users/9bc384b7b807421a9260574382b42bf6/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:28.096369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46f480-e8c3-494b-a24c-494503176f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=3177582a285642058803331c26afe89e, user_id=9bc384b7b807421a9260574382b42bf6, role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:28.097871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46f480-e8c3-494b-a24c-494503176f26 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:28.113036 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 556/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:54:27 2022] PUT /identity/v3/projects/3177582a285642058803331c26afe89e/users/9bc384b7b807421a9260574382b42bf6/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:54:30.134667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26319b-118c-4d7e-bda7-d6e648ba91b0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:30.135220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26319b-118c-4d7e-bda7-d6e648ba91b0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:30.135220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26319b-118c-4d7e-bda7-d6e648ba91b0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:30.136675 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 568/1124] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:30.142000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:30.142440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:30.142556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:30.161265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:30.162456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:30.231970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 557/1125] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:30.255672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26319b-118c-4d7e-bda7-d6e648ba91b0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:30.361242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26319b-118c-4d7e-bda7-d6e648ba91b0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:30.388248 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:30.398179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:30.399046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:30.399323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:30.399593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] PATH_INFO: `/v3/roles/b44c20e022b0412bbd8fa1c0fe308c7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:30.401321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] RBAC: Authorizing `identity:get_role(role_id=b44c20e022b0412bbd8fa1c0fe308c7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:30.402710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:30.404076 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 569/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:30 2022] GET /identity/v3/roles/b44c20e022b0412bbd8fa1c0fe308c7a => generated 223 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:30.410515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:30.459373 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:30.516678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91d5466-731b-4695-b87e-2497e232c8e5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:30.551881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:30.552772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:30.553046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:30.553317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] PATH_INFO: `/v3/users/9bc384b7b807421a9260574382b42bf6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:30.554530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] RBAC: Authorizing `identity:get_user(user_id=9bc384b7b807421a9260574382b42bf6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:30.555958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:30.557648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 558/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:30 2022] GET /identity/v3/users/9bc384b7b807421a9260574382b42bf6 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:30.563717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:30.674761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd8180-2869-45cd-9ccf-3fb1dd28dc7b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:30.709375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:30.710008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:30.710288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:30.710557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:30.772250 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:30.780375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:30.782187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:30.883998 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 570/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:30.890352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:30.992125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bcc50a-331f-4a08-a37b-6102f098f2da None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:31.009807 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:31.029203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de50ebe9-b6fa-4880-bbb9-71f3551ab4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:31.030063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ebe9-b6fa-4880-bbb9-71f3551ab4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:31.030345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ebe9-b6fa-4880-bbb9-71f3551ab4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:31.030616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de50ebe9-b6fa-4880-bbb9-71f3551ab4b2 None admin] PATH_INFO: `/v3/projects/3177582a285642058803331c26afe89e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:31.032180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ebe9-b6fa-4880-bbb9-71f3551ab4b2 None admin] RBAC: Authorizing `identity:get_project(project_id=3177582a285642058803331c26afe89e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:31.033651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de50ebe9-b6fa-4880-bbb9-71f3551ab4b2 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:31.035379 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 559/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:30 2022] GET /identity/v3/projects/3177582a285642058803331c26afe89e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:31.042116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:31.137882 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:31.144447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904e7d70-15e4-45f2-ad49-737ad47869c7 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:31.179683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:31.180425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:31.180737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:31.180967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:31.181884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] RBAC: Adding query filter params (role.id=b44c20e022b0412bbd8fa1c0fe308c7a, scope.project.id=3177582a285642058803331c26afe89e, user.id=9bc384b7b807421a9260574382b42bf6) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:31.182284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:31.183839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc806f6-df1b-478a-80a4-d07b9752aca2 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:31.190907 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 571/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:31 2022] GET /identity/v3/role_assignments?user.id=9bc384b7b807421a9260574382b42bf6&scope.project.id=3177582a285642058803331c26afe89e&role.id=b44c20e022b0412bbd8fa1c0fe308c7a => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:33.263219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f9f5-32ec-4210-8958-cc9ba7e6c831 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:33.263830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f9f5-32ec-4210-8958-cc9ba7e6c831 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:33.263830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92f9f5-32ec-4210-8958-cc9ba7e6c831 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:33.265155 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 560/1131] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:33.270577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:33.271018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:33.271120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:33.289939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:33.291135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:33.362584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 572/1132] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:33.386213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f9f5-32ec-4210-8958-cc9ba7e6c831 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:33.493081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92f9f5-32ec-4210-8958-cc9ba7e6c831 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:33.528544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b6c1c-db5c-40f9-8c7b-6f7fba62096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:33.529333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6c1c-db5c-40f9-8c7b-6f7fba62096f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:33.529617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6c1c-db5c-40f9-8c7b-6f7fba62096f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:33.529882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b6c1c-db5c-40f9-8c7b-6f7fba62096f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:33.531111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b6c1c-db5c-40f9-8c7b-6f7fba62096f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:33.532912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b6c1c-db5c-40f9-8c7b-6f7fba62096f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:33.534557 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 561/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:33.540685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:33.630998 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:33.641665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9d213-e71a-4198-bad3-c55c422e371d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:33.677442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba42188-04bc-43d2-b5fd-94766b80cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:33.678096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba42188-04bc-43d2-b5fd-94766b80cedc None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:33.678376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba42188-04bc-43d2-b5fd-94766b80cedc None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:33.678647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba42188-04bc-43d2-b5fd-94766b80cedc None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:33.679341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba42188-04bc-43d2-b5fd-94766b80cedc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:33.680820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba42188-04bc-43d2-b5fd-94766b80cedc None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:33.707050 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 573/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:54:33 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:35.762616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37eed-fa40-405f-b054-9e4ec481c68e None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:35.763207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37eed-fa40-405f-b054-9e4ec481c68e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:35.763207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca37eed-fa40-405f-b054-9e4ec481c68e None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:35.764569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 562/1135] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:35.769831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:35.770264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:35.770361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:35.787575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:35.788788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:35.856410 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 574/1136] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:35.881062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca37eed-fa40-405f-b054-9e4ec481c68e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:35.941656 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:35.995772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca37eed-fa40-405f-b054-9e4ec481c68e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:36.030858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45eab79-4091-405e-8a3a-a6b9a4daf898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:36.031576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45eab79-4091-405e-8a3a-a6b9a4daf898 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:36.031856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45eab79-4091-405e-8a3a-a6b9a4daf898 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:36.032475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45eab79-4091-405e-8a3a-a6b9a4daf898 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:36.033701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45eab79-4091-405e-8a3a-a6b9a4daf898 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:36.035137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45eab79-4091-405e-8a3a-a6b9a4daf898 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:36.036819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 563/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:54:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:36.042917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:36.113983 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:36.145884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94565c54-c28f-4df5-a1ec-5bec41f2fc8f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:36.181755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee5a18c-51c5-4e1f-b600-63944847bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:36.182423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a18c-51c5-4e1f-b600-63944847bef5 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:36.182692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a18c-51c5-4e1f-b600-63944847bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:36.182978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee5a18c-51c5-4e1f-b600-63944847bef5 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:36.183765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5a18c-51c5-4e1f-b600-63944847bef5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:36.185215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee5a18c-51c5-4e1f-b600-63944847bef5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:36.207189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 575/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:54:36 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:38.243615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c731-9f39-4d77-b364-dc7accfeeb0b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:38.244188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c731-9f39-4d77-b364-dc7accfeeb0b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:38.244188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c731-9f39-4d77-b364-dc7accfeeb0b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:38.245577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 564/1139] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:38.251087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:38.251533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:38.251623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:38.269089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:38.270290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:38.341489 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 576/1140] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:38.364815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c731-9f39-4d77-b364-dc7accfeeb0b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:38.474240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c731-9f39-4d77-b364-dc7accfeeb0b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:38.495698 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:38.511132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:38.512389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:38.512801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:38.513077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:38.523183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:38.530861 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:38.531972 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:38.533403 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 565/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:38.538663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:38.600195 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:38.643261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e70039-6294-40cc-9f4b-7dd88a860d67 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:38.679792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:38.680480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:38.680763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:38.681034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:38.681779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:38.682084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:38.683534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:38.691806 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 577/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:38.697788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:38.801974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a977b88-ed09-479e-a3a0-46282db637dc None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:38.839823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca424a-029c-436a-aa93-14934466384f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:38.840738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca424a-029c-436a-aa93-14934466384f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:38.841016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca424a-029c-436a-aa93-14934466384f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:38.841289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca424a-029c-436a-aa93-14934466384f None admin] PATH_INFO: `/v3/users/1802e1009ae6433e856c6e2b9d2ce875` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:38.856444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca424a-029c-436a-aa93-14934466384f None admin] RBAC: Authorizing `identity:get_user(user_id=1802e1009ae6433e856c6e2b9d2ce875)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:38.857826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca424a-029c-436a-aa93-14934466384f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:38.859509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 566/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:38 2022] GET /identity/v3/users/1802e1009ae6433e856c6e2b9d2ce875 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:38.865475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:38.969022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f508f8-939c-4dbb-9e60-14c7e0e95053 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:38.990891 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:39.006712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:39.007361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:39.007638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:39.007910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:39.081997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:39.083475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:39.188760 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 578/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:39.194825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca424a-029c-436a-aa93-14934466384f None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:39.237102 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:39.299282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca424a-029c-436a-aa93-14934466384f None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:39.334255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae38712a-9b99-45cb-a91f-b1489e053ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:39.335138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38712a-9b99-45cb-a91f-b1489e053ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:39.335425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38712a-9b99-45cb-a91f-b1489e053ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:39.335691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae38712a-9b99-45cb-a91f-b1489e053ca9 None admin] PATH_INFO: `/v3/projects/e61461faca96441791ed9f365c72f8d5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:39.336920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38712a-9b99-45cb-a91f-b1489e053ca9 None admin] RBAC: Authorizing `identity:get_project(project_id=e61461faca96441791ed9f365c72f8d5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:39.338376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae38712a-9b99-45cb-a91f-b1489e053ca9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:39.340246 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 567/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:39 2022] GET /identity/v3/projects/e61461faca96441791ed9f365c72f8d5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:39.346679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:39.367850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:39.450316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e485b-5173-45f3-98d6-419e1903961b None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:39.485332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:39.485980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:39.486259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:39.486535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:39.487358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=e61461faca96441791ed9f365c72f8d5, user.id=1802e1009ae6433e856c6e2b9d2ce875) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:39.487671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:39.489141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33617cc3-94ae-47c8-8410-4fb0ab8ebe0a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:39.494859 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 579/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:39 2022] GET /identity/v3/role_assignments?user.id=1802e1009ae6433e856c6e2b9d2ce875&scope.project.id=e61461faca96441791ed9f365c72f8d5&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:41.488777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4c77-a812-4a7e-a279-88213fdbfc19 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:41.489359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4c77-a812-4a7e-a279-88213fdbfc19 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:41.489359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f4c77-a812-4a7e-a279-88213fdbfc19 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:41.490791 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 568/1147] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:41.496851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:41.497325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:41.497421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:41.515598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:41.516838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:41.585126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 580/1148] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:41.607987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4c77-a812-4a7e-a279-88213fdbfc19 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:41.711401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f4c77-a812-4a7e-a279-88213fdbfc19 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:41.718758 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:41.749304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:41.750015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:41.750291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:41.750558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:41.761147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:41.768673 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:41.769776 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:41.770831 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 569/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:41.776222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:41.792498 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:41.881457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a6b95-4bc1-4907-babe-da09c8f2f42c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:41.918963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:41.919634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:41.919914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:41.920189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:41.920961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:41.921268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:41.922646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:41.930952 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 581/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:41.937072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:42.038009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65c2592-3362-4016-8ccb-b6b191b10a42 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:42.074618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632b719-aded-4319-9eff-338979f81214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:42.075502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632b719-aded-4319-9eff-338979f81214 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:42.075784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632b719-aded-4319-9eff-338979f81214 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:42.076053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632b719-aded-4319-9eff-338979f81214 None admin] PATH_INFO: `/v3/users/1802e1009ae6433e856c6e2b9d2ce875` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:42.077344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632b719-aded-4319-9eff-338979f81214 None admin] RBAC: Authorizing `identity:get_user(user_id=1802e1009ae6433e856c6e2b9d2ce875)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:42.078787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632b719-aded-4319-9eff-338979f81214 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:42.080492 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 570/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:41 2022] GET /identity/v3/users/1802e1009ae6433e856c6e2b9d2ce875 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:42.086419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:42.166584 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:42.192206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa22e3-47bd-4cf5-8bec-dde90891a2ac None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:42.226328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efa8b1-afd2-470a-a0fb-3e58abcf746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:42.227175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa8b1-afd2-470a-a0fb-3e58abcf746c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:42.227451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa8b1-afd2-470a-a0fb-3e58abcf746c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:42.227721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa8b1-afd2-470a-a0fb-3e58abcf746c None admin] PATH_INFO: `/v3/projects/e61461faca96441791ed9f365c72f8d5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:42.228960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efa8b1-afd2-470a-a0fb-3e58abcf746c None admin] RBAC: Authorizing `identity:get_project(project_id=e61461faca96441791ed9f365c72f8d5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:42.230395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efa8b1-afd2-470a-a0fb-3e58abcf746c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:42.232100 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 582/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:42 2022] GET /identity/v3/projects/e61461faca96441791ed9f365c72f8d5 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:42.238445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632b719-aded-4319-9eff-338979f81214 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:42.273104 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:42.341725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632b719-aded-4319-9eff-338979f81214 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:42.376603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad75a78-9a11-4059-b433-e7154b05e954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:42.377484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75a78-9a11-4059-b433-e7154b05e954 None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:42.377758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75a78-9a11-4059-b433-e7154b05e954 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:42.378023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75a78-9a11-4059-b433-e7154b05e954 None admin] PATH_INFO: `/v3/projects/e61461faca96441791ed9f365c72f8d5/users/1802e1009ae6433e856c6e2b9d2ce875/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:42.380064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad75a78-9a11-4059-b433-e7154b05e954 None admin] RBAC: Authorizing `identity:create_grant(project_id=e61461faca96441791ed9f365c72f8d5, user_id=1802e1009ae6433e856c6e2b9d2ce875, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:42.381518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad75a78-9a11-4059-b433-e7154b05e954 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:42.395566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 571/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:54:42 2022] PUT /identity/v3/projects/e61461faca96441791ed9f365c72f8d5/users/1802e1009ae6433e856c6e2b9d2ce875/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:54:44.378903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcf07-2c59-48bb-866b-6349e547fa5a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:44.379432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcf07-2c59-48bb-866b-6349e547fa5a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:44.379432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096bcf07-2c59-48bb-866b-6349e547fa5a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:44.380787 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 583/1154] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:44.386769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:44.387301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:44.387301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:44.404979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:44.406160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:44.480769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 572/1155] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:54:44.504379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bcf07-2c59-48bb-866b-6349e547fa5a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:44.609489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096bcf07-2c59-48bb-866b-6349e547fa5a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:44.646810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:44.647517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:44.647795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:44.648067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:44.659484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:44.667089 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:44.668158 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:44.669420 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 584/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:44.674606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:44.701322 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:44.776607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7abce-dad2-404d-bf78-8e2115403d2d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:44.811491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:44.812151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:44.812456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:44.812724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:44.813467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:44.813764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:44.815138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:44.824079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 573/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:44.830369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:44.834561 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:44.935529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf07d3-14a5-4366-9bc3-5eef8de26ad2 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:44.970671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:44.971540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:44.971824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:44.972095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] PATH_INFO: `/v3/users/1802e1009ae6433e856c6e2b9d2ce875` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:44.973372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] RBAC: Authorizing `identity:get_user(user_id=1802e1009ae6433e856c6e2b9d2ce875)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:44.974815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:44.976507 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 585/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:44 2022] GET /identity/v3/users/1802e1009ae6433e856c6e2b9d2ce875 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:44.982581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:45.070988 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:45.088389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd953f-783d-4175-af73-a0cbe8a903b9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:45.124635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:45.125300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:45.125580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:45.125854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:45.200601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:45.202032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:45.288284 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:45.304380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 574/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:45.310601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:45.386127 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:45.419567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74727768-cdea-4145-a0bf-cd747ba1899a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:45.454599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bd8bf-d4ad-4b97-94b3-3f1710defd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:45.455391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bd8bf-d4ad-4b97-94b3-3f1710defd44 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:45.455678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bd8bf-d4ad-4b97-94b3-3f1710defd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:45.455954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bd8bf-d4ad-4b97-94b3-3f1710defd44 None admin] PATH_INFO: `/v3/projects/e61461faca96441791ed9f365c72f8d5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:45.457219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bd8bf-d4ad-4b97-94b3-3f1710defd44 None admin] RBAC: Authorizing `identity:get_project(project_id=e61461faca96441791ed9f365c72f8d5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:45.458664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bd8bf-d4ad-4b97-94b3-3f1710defd44 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:45.460387 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 586/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:45 2022] GET /identity/v3/projects/e61461faca96441791ed9f365c72f8d5 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:45.466772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:45.566292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b84f49f-9854-4470-8095-472e4937f0b8 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:45.601605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:45.602262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:45.602538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:45.602787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:45.603637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=e61461faca96441791ed9f365c72f8d5, user.id=1802e1009ae6433e856c6e2b9d2ce875) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:45.603944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:45.605412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f9fb42-58eb-46db-acbe-5d850107298f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:45.611554 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 575/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:45 2022] GET /identity/v3/role_assignments?user.id=1802e1009ae6433e856c6e2b9d2ce875&scope.project.id=e61461faca96441791ed9f365c72f8d5&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:47.659295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb447-be88-4179-af3e-3a85fec23b8b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:47.659884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb447-be88-4179-af3e-3a85fec23b8b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:47.659884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdbb447-be88-4179-af3e-3a85fec23b8b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:47.661242 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 587/1162] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:47.666545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:47.667001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:47.667107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:47.684722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:47.685897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:47.733548 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:47.756172 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 576/1163] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:47.778194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb447-be88-4179-af3e-3a85fec23b8b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:47.886034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdbb447-be88-4179-af3e-3a85fec23b8b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:47.921895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:47.922451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:47.922730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:47.923011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:47.933314 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:47.993058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:47.994507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:48.110281 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 588/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:48.116752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:48.226866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0b861-427c-4a5a-aa40-2dacdcd414c2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:48.264594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:48.265404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:48.265682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:48.265957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:48.273911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:48.275375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-3d670598-4927-46cd-9214-d243ab47f535 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:48.290959 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:48.292221 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:54:48.293411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 577/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:54:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:48.299329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:48.346331 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:48.407269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53c07c6-613b-489d-bcd7-3fd513d1abbe None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:48.443724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:48.444394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:48.444701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:48.444980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:48.445697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:48.446003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:48.447385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330c9022-aba2-4561-9029-fa8d4687d8ea None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:48.455044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 589/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Tue Jul 19 10:54:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:50.457927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c731-2977-4bb5-9985-5361bd2d9f72 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:50.458450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c731-2977-4bb5-9985-5361bd2d9f72 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:50.458450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6c731-2977-4bb5-9985-5361bd2d9f72 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:50.459749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 578/1167] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:50.465155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748038-431b-47a1-b808-fd7944cc241c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:50.465618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748038-431b-47a1-b808-fd7944cc241c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:50.465711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29748038-431b-47a1-b808-fd7944cc241c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:50.483376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-29748038-431b-47a1-b808-fd7944cc241c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:50.484604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29748038-431b-47a1-b808-fd7944cc241c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:50.556665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 590/1168] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:50.579233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c731-2977-4bb5-9985-5361bd2d9f72 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:50.626224 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:50.688924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6c731-2977-4bb5-9985-5361bd2d9f72 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:50.724314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb02c37-7cd8-4fd4-bd0f-fe2e20a12c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:50.725005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb02c37-7cd8-4fd4-bd0f-fe2e20a12c4e None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:50.725288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb02c37-7cd8-4fd4-bd0f-fe2e20a12c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:50.725557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb02c37-7cd8-4fd4-bd0f-fe2e20a12c4e None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:50.726292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb02c37-7cd8-4fd4-bd0f-fe2e20a12c4e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:50.727665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb02c37-7cd8-4fd4-bd0f-fe2e20a12c4e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:50.744679 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 579/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Tue Jul 19 10:54:50 2022] POST /identity/v3/domains => generated 267 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:52.796404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416525d-f961-4078-9168-5c75fd2df591 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:52.796998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416525d-f961-4078-9168-5c75fd2df591 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:52.796998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416525d-f961-4078-9168-5c75fd2df591 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:52.798347 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 591/1170] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:52.804132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:52.804576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:52.804735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:52.822777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:52.823961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:52.895027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 580/1171] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:52.920043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416525d-f961-4078-9168-5c75fd2df591 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:52.960705 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:53.036136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416525d-f961-4078-9168-5c75fd2df591 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:53.074800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2894e804-e670-4cc4-a7c9-1a3e6ad15367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:53.075693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e804-e670-4cc4-a7c9-1a3e6ad15367 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:53.076080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e804-e670-4cc4-a7c9-1a3e6ad15367 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:53.076327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2894e804-e670-4cc4-a7c9-1a3e6ad15367 None admin] PATH_INFO: `/v3/domains/1196b117d840428fa14986bf40ef6335` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:53.088604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894e804-e670-4cc4-a7c9-1a3e6ad15367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1196b117d840428fa14986bf40ef6335)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:53.090093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2894e804-e670-4cc4-a7c9-1a3e6ad15367 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:53.091923 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 592/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Tue Jul 19 10:54:52 2022] GET /identity/v3/domains/1196b117d840428fa14986bf40ef6335 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:53.098295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:53.133291 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:53.209073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c463274-bc79-4381-95a6-865aa0b0fb40 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:53.246481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9167cee-aacc-4220-b3e6-370a62636357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:53.247137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167cee-aacc-4220-b3e6-370a62636357 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:53.247412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167cee-aacc-4220-b3e6-370a62636357 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:53.247687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9167cee-aacc-4220-b3e6-370a62636357 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:53.248458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9167cee-aacc-4220-b3e6-370a62636357 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:53.249894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9167cee-aacc-4220-b3e6-370a62636357 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:53.276698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 581/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:54:53 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:55.354202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478b9b4-dc32-47d9-802c-a1a602493294 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:55.354724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478b9b4-dc32-47d9-802c-a1a602493294 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:55.354724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478b9b4-dc32-47d9-802c-a1a602493294 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:55.356018 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 593/1174] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:55.361738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:55.362190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:55.362280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:55.383138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:55.384330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:55.456856 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 582/1175] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:55.482230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478b9b4-dc32-47d9-802c-a1a602493294 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:55.588887 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:55.600378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478b9b4-dc32-47d9-802c-a1a602493294 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:55.637165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90868207-eb57-486f-9e39-1fc1b588f694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:55.638203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868207-eb57-486f-9e39-1fc1b588f694 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:55.638489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868207-eb57-486f-9e39-1fc1b588f694 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:55.638767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90868207-eb57-486f-9e39-1fc1b588f694 None admin] PATH_INFO: `/v3/domains/1196b117d840428fa14986bf40ef6335` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:55.640130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90868207-eb57-486f-9e39-1fc1b588f694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=1196b117d840428fa14986bf40ef6335)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:55.641581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90868207-eb57-486f-9e39-1fc1b588f694 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:55.643241 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 594/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Tue Jul 19 10:54:55 2022] GET /identity/v3/domains/1196b117d840428fa14986bf40ef6335 => generated 267 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:55.649465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:55.669535 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:55.777288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d33006-77f6-46df-a359-311e7d24f7ab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:55.815239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fccf6d-690e-4c0f-a926-ba7cc067f824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:55.815905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccf6d-690e-4c0f-a926-ba7cc067f824 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:55.816190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccf6d-690e-4c0f-a926-ba7cc067f824 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:55.816492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fccf6d-690e-4c0f-a926-ba7cc067f824 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:55.817215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fccf6d-690e-4c0f-a926-ba7cc067f824 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:55.818664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fccf6d-690e-4c0f-a926-ba7cc067f824 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:55.842372 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 583/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:54:55 2022] POST /identity/v3/users => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:54:57.966255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232425-9f69-4a83-ba4d-8933a6b3751b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:57.966816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232425-9f69-4a83-ba4d-8933a6b3751b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:57.966816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f232425-9f69-4a83-ba4d-8933a6b3751b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:57.968195 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 595/1178] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:54:57.973809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:57.974266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:57.974371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:57.992280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:54:57.993509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:54:58.058011 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:58.064365 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 584/1179] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:54:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:54:58.090976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232425-9f69-4a83-ba4d-8933a6b3751b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:58.198209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f232425-9f69-4a83-ba4d-8933a6b3751b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:58.234239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:58.234950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:58.235277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:58.235558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:58.245918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:54:58.253529 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:54:58.254614 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:54:58.255731 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 596/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:54:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:54:58.261403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:58.363248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c830497b-c3ef-4cca-bb8c-cf3605a9cd21 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:58.398344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:58.399016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:58.399300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:58.399575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:58.400333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:58.400672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:58.402050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:58.410856 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 585/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:54:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:58.416976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:58.443474 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:58.520635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf91c9-078e-49d1-a9cc-454b194e7747 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:58.555134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:58.556002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:58.556282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:58.556586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] PATH_INFO: `/v3/users/a438fddf34774dbf80d372fec8848582` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:58.570287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] RBAC: Authorizing `identity:get_user(user_id=a438fddf34774dbf80d372fec8848582)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:58.571744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:58.573513 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 597/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:54:58 2022] GET /identity/v3/users/a438fddf34774dbf80d372fec8848582 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:58.579545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:58.640540 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:58.684311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b5e8a-bfd1-4f23-85e9-125bd686d003 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:58.719864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:58.720488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:58.720807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:58.721080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:58.791373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:58.792783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:58.853789 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:58.896829 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 586/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:54:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:54:58.903020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:58.988637 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:54:59.009656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab73ef57-05d5-4adb-884f-46c0accf949e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:59.047547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3fc8be-2ce3-4347-8b6c-504254c9ce22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:59.048473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc8be-2ce3-4347-8b6c-504254c9ce22 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:59.048756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc8be-2ce3-4347-8b6c-504254c9ce22 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:59.049012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3fc8be-2ce3-4347-8b6c-504254c9ce22 None admin] PATH_INFO: `/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:59.050233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fc8be-2ce3-4347-8b6c-504254c9ce22 None admin] RBAC: Authorizing `identity:get_project(project_id=10929d65ca1d4c4fb62498b1f73cdd8f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:59.051679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3fc8be-2ce3-4347-8b6c-504254c9ce22 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:59.053475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 598/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:54:58 2022] GET /identity/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:54:59.060296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:54:59.172194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b137b56-5fab-4130-ac28-c97b47579901 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:54:59.211847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:54:59.212525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:54:59.212803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:54:59.213072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:54:59.213895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=10929d65ca1d4c4fb62498b1f73cdd8f, user.id=a438fddf34774dbf80d372fec8848582) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:54:59.214201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:54:59.215631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffd91d-536d-4bda-a5b6-b7aeddad461f None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:54:59.221284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 587/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:54:59 2022] GET /identity/v3/role_assignments?user.id=a438fddf34774dbf80d372fec8848582&scope.project.id=10929d65ca1d4c4fb62498b1f73cdd8f&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:01.227138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440da782-a9f7-415a-a82f-b8ee8337ab12 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:01.227709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440da782-a9f7-415a-a82f-b8ee8337ab12 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:01.227709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440da782-a9f7-415a-a82f-b8ee8337ab12 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:01.229115 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 599/1186] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:55:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:01.234572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:01.235024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:01.235112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:01.253373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:01.254562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:01.272976 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:01.335111 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 588/1187] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:01.359131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440da782-a9f7-415a-a82f-b8ee8337ab12 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:01.467582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440da782-a9f7-415a-a82f-b8ee8337ab12 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:01.503316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:01.504107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:01.504392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:01.504696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:01.516471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:01.524084 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:01.525185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:55:01.529426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 600/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:55:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:01.531512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:01.636979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494f526-bdeb-496a-88a2-0affc5ad5864 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:01.672503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:01.673189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:01.673468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:01.673739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:01.674471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:01.674774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:01.676151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:01.684577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 589/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:55:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:01.690808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:01.702588 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:01.796637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e0409e-c655-404d-8fe1-89c2fd22d912 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:01.830642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:01.831510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:01.831789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:01.832068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] PATH_INFO: `/v3/users/a438fddf34774dbf80d372fec8848582` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:01.833265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] RBAC: Authorizing `identity:get_user(user_id=a438fddf34774dbf80d372fec8848582)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:01.834703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:01.836429 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 601/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:55:01 2022] GET /identity/v3/users/a438fddf34774dbf80d372fec8848582 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:01.842562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:01.861803 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:01.945232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b55214-81b5-4761-bd1a-fc27d9d9e609 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:01.980456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb88eb-0a39-44a5-ae5e-c7eb2e0237a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:01.981316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb88eb-0a39-44a5-ae5e-c7eb2e0237a8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:01.981594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb88eb-0a39-44a5-ae5e-c7eb2e0237a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:01.981865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb88eb-0a39-44a5-ae5e-c7eb2e0237a8 None admin] PATH_INFO: `/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:01.983103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb88eb-0a39-44a5-ae5e-c7eb2e0237a8 None admin] RBAC: Authorizing `identity:get_project(project_id=10929d65ca1d4c4fb62498b1f73cdd8f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:01.984563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb88eb-0a39-44a5-ae5e-c7eb2e0237a8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:01.986312 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 590/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:55:01 2022] GET /identity/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f => generated 361 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:01.994516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:02.086429 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:02.112519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e64612-65bc-4105-a2db-d70b44137213 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:02.146930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52980837-84a9-48d8-9213-6d2deecb94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:02.147818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52980837-84a9-48d8-9213-6d2deecb94fa None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:02.148097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52980837-84a9-48d8-9213-6d2deecb94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:02.148391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52980837-84a9-48d8-9213-6d2deecb94fa None admin] PATH_INFO: `/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f/users/a438fddf34774dbf80d372fec8848582/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:02.150436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52980837-84a9-48d8-9213-6d2deecb94fa None admin] RBAC: Authorizing `identity:create_grant(project_id=10929d65ca1d4c4fb62498b1f73cdd8f, user_id=a438fddf34774dbf80d372fec8848582, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:02.151865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52980837-84a9-48d8-9213-6d2deecb94fa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:02.167236 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 602/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:55:01 2022] PUT /identity/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f/users/a438fddf34774dbf80d372fec8848582/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:55:04.196872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3c0d-0dfb-4c22-93e4-5dabc09b9941 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:04.197512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3c0d-0dfb-4c22-93e4-5dabc09b9941 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:04.197512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3a3c0d-0dfb-4c22-93e4-5dabc09b9941 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:04.198848 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 591/1193] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:55:04.205085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:04.205672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:04.205672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:04.225033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:55:04.226412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:55:04.303897 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 603/1194] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:55:04.327922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a3c0d-0dfb-4c22-93e4-5dabc09b9941 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:04.423473 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:04.444149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3a3c0d-0dfb-4c22-93e4-5dabc09b9941 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:04.482006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:04.482809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:04.483088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:04.483359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:04.495528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:55:04.503504 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:55:04.504887 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:55:04.505986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 592/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:55:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:55:04.511417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:04.585222 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:04.622004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ade0c6-243d-421d-9c92-b0a4c276e57f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:04.658782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:04.659455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:04.659737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:04.660008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:04.660789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:04.661097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:04.662788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:04.671654 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 604/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:55:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:04.678410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:04.799252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b32514-2b5e-44c9-97cd-82b110efef33 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:04.833810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:04.834683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:04.834959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:04.835281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] PATH_INFO: `/v3/users/a438fddf34774dbf80d372fec8848582` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:04.836657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] RBAC: Authorizing `identity:get_user(user_id=a438fddf34774dbf80d372fec8848582)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:04.838108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:04.839817 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 593/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Tue Jul 19 10:55:04 2022] GET /identity/v3/users/a438fddf34774dbf80d372fec8848582 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:04.847923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:04.957737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b5474f-324d-4772-b818-fdd53fd58fc5 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:04.984021 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:04.998120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:04.999019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:04.999465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:04.999867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:05.077094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:05.078554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:05.194236 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 605/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:55:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:55:05.200451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:05.217873 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:05.333573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de7597-36ee-4154-8bb9-bf08c020f862 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:05.371327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff8f1e-cef1-4b87-99b3-00cd2b851ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:05.372178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8f1e-cef1-4b87-99b3-00cd2b851ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:05.372490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8f1e-cef1-4b87-99b3-00cd2b851ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:05.372760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff8f1e-cef1-4b87-99b3-00cd2b851ff4 None admin] PATH_INFO: `/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:05.374060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff8f1e-cef1-4b87-99b3-00cd2b851ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=10929d65ca1d4c4fb62498b1f73cdd8f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:05.375506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff8f1e-cef1-4b87-99b3-00cd2b851ff4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:05.377387 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 594/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Tue Jul 19 10:55:05 2022] GET /identity/v3/projects/10929d65ca1d4c4fb62498b1f73cdd8f => generated 361 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:05.383757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:55:05.413688 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:05.489806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba670793-ec22-4f97-9981-317b403fb896 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:55:05.535830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:55:05.536511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:55:05.537113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:55:05.537397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:55:05.538230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=10929d65ca1d4c4fb62498b1f73cdd8f, user.id=a438fddf34774dbf80d372fec8848582) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:55:05.538572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:55:05.540017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf64fe53-8f31-4ef3-885e-35d0798c39ef None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:55:05.547616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 606/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:55:05 2022] GET /identity/v3/role_assignments?user.id=a438fddf34774dbf80d372fec8848582&scope.project.id=10929d65ca1d4c4fb62498b1f73cdd8f&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:55:15.366061 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=60 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:55:15.544982 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=54 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:03.603993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb46c4f-82c1-4529-ad57-a4353c981daf None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:03.604722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb46c4f-82c1-4529-ad57-a4353c981daf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:03.604722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb46c4f-82c1-4529-ad57-a4353c981daf None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:03.608608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 595/1201] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:03.614293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:03.614979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:03.614979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:03.640532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:03.642244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:03.768370 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 607/1202] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 19 10:56:03.806778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb46c4f-82c1-4529-ad57-a4353c981daf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:03.982644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb46c4f-82c1-4529-ad57-a4353c981daf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:04.059482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:04.060833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:04.061125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:04.061289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:04.073552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:04.075099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:04.109421 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:04.110845 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:04.112985 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:04.112985 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:04.112985 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:04.112985 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:04.116182 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 596/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:04.124468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:04.338224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c4f43b-a977-4e81-b0ec-25e34bad5056 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:04.392689 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:04.402187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:04.403373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:04.403805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:04.404313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:04.405737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:04.406303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:04.409157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bc4e31-1edf-482c-9ced-cdd296192b13 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:04.436415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 608/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:04.441980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:04.529085 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:04.595851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a85363-9b4c-49fb-afcb-5ff0681bcfa5 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:04.649286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3345f13-120f-4af3-a199-9d835a05ae00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:04.650567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345f13-120f-4af3-a199-9d835a05ae00 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:04.650765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345f13-120f-4af3-a199-9d835a05ae00 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:04.651203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3345f13-120f-4af3-a199-9d835a05ae00 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:04.652702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3345f13-120f-4af3-a199-9d835a05ae00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:04.655677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3345f13-120f-4af3-a199-9d835a05ae00 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:04.688681 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 597/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Tue Jul 19 10:56:04 2022] POST /identity/v3/users => generated 251 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 10:56:07.518292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d2b9-7015-4199-8a68-8fddd6faa3c7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:07.518925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d2b9-7015-4199-8a68-8fddd6faa3c7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:07.518925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e22d2b9-7015-4199-8a68-8fddd6faa3c7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:07.520586 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 609/1206] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:07.526936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:07.527496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:07.527496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:07.549396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:07.554838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:07.652931 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 598/1207] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:07.667639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22d2b9-7015-4199-8a68-8fddd6faa3c7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:07.835541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e22d2b9-7015-4199-8a68-8fddd6faa3c7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:07.884183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:07.885278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:07.885731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:07.886222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:07.898401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:56:07.906376 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:07.907778 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:07.908971 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 610/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:56:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:56:07.913962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:07.961870 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:08.058376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c21083-8fd1-4cc0-9991-b08eba8d0b2c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:08.115087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:08.115948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:08.116337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:08.116657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:08.117869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:08.118227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:08.119848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:08.139639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 599/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:56:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:56:08.146108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:08.241925 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:08.321287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ef84b-f378-4d88-a247-41b4fda394fa None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:08.381604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:08.382932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:08.383219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:08.383490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:08.402538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:08.404059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:08.424970 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:08.426271 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:08.427159 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:08.427159 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:08.427159 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:08.427159 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:08.427159 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 611/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:08.432716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:08.565592 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:08.568950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea8f3a-8d42-4457-b46d-eda8a94e14ea None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:08.609489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:08.610193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:08.610474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:08.610739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:08.611486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:08.611787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:08.613260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:08.640488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 600/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:08.646448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:08.827961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f897671-d061-41a5-b4c8-9bc6399a338f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:08.830758 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:08.900835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:08.902151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:08.902804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:08.903390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:08.914161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:08.916408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:56:08.937587 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:08.938737 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:08.939709 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 612/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:56:08.950842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:09.085886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb223b-250c-4e4d-bde8-14ccf8afc7dd None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:09.134180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:09.134893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:09.135172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:09.135470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:09.136557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:09.136897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:09.139444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:09.164840 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 601/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jul 19 10:56:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:09.170682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:09.321265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc659b3c-ff5e-41d3-af16-1d441bd84ebb None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:09.364265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956228-51a6-4731-be42-305f7085babd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:09.365022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956228-51a6-4731-be42-305f7085babd None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:09.365302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956228-51a6-4731-be42-305f7085babd None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:09.365628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7956228-51a6-4731-be42-305f7085babd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:09.400586 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:09.450234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956228-51a6-4731-be42-305f7085babd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:09.451863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7956228-51a6-4731-be42-305f7085babd None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:09.571663 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 613/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:56:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:56:09.577902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:09.599609 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:09.698095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9bb67-6918-494b-bbf2-e986fbf861ec None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:09.739835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:09.740757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:09.741003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:09.741313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:09.753697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:09.755270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:09.774459 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:09.775605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:09.776618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:09.776618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:09.776618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:09.776618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:09.782163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956228-51a6-4731-be42-305f7085babd None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:09.784412 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 602/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:09.851120 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:09.904695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7956228-51a6-4731-be42-305f7085babd None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:09.946627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:09.948036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:09.948414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:09.948696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:09.949762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:09.950068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:09.951660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:09.966181 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 614/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:56:09.971863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:10.055186 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:10.094503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773995ee-7628-48bd-bb4d-70e906279ffa None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:10.138398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:10.139249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:10.139531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:10.139794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:10.148173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:10.149774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:56:10.165488 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:10.166733 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:10.168771 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:10.171690 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 603/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:56:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:10.173457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:10.304291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9978fc-a94d-4da2-8a22-35df3335aa62 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:10.331974 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:10.350133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:10.350802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:10.351128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:10.351388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:10.352312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:10.352676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:10.354160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85574ac6-8cc1-4966-bcd2-9c42ee6b3a14 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:10.374311 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 615/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:56:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:10.375657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:10.496495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eb5273-e063-4e79-841a-f268b91f5521 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:10.529793 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:10.536629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:10.537280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:10.537632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:10.537863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:10.538705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=a53c17ba16b146b78da33383a6be1f61) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:10.538982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:10.540450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c04e2-c214-4c86-9624-b025248a012d None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:10.546507 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 604/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:56:10 2022] GET /identity/v3/role_assignments?user.id=a53c17ba16b146b78da33383a6be1f61&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:12.705206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2e6e4-5026-4b74-9cb0-aa0e821475ce None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:12.705794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2e6e4-5026-4b74-9cb0-aa0e821475ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:12.705794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f2e6e4-5026-4b74-9cb0-aa0e821475ce None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:12.707373 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 616/1220] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:12.713719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:12.714474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:12.714762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:12.737482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:12.738886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:12.818734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 605/1221] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:12.843986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2e6e4-5026-4b74-9cb0-aa0e821475ce None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:12.974483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f2e6e4-5026-4b74-9cb0-aa0e821475ce None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:13.020727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:13.021539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:13.021857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:13.022175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:13.035221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:56:13.043667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:13.045062 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:13.045921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 617/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:56:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:13.051894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:13.173311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312436b2-0734-4729-a210-0da4ae15a713 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:13.203089 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:13.218891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:13.219732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:13.220124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:13.220517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:13.221426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] RBAC: Adding query filter params (name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:13.221675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:13.223224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:13.234505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 606/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:56:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:56:13.240835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:13.309399 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:13.370820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc9002-7172-4a47-89b7-57552997154c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:13.409844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:13.410736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:13.411084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:13.411422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:13.423170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:13.424703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:13.442868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:13.444046 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:13.445214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:13.445214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:13.445214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:13.445214 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:13.445214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 618/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:13.450349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:13.563885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7638222-fd43-46ce-9738-a3c48b821096 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:13.599388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:13.600054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:13.600330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:13.600618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:13.601336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:13.601635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:13.602999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:13.616094 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 607/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:13.622053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:13.727139 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:13.736520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449e07a-c33a-4469-b0a9-0ef8c430ae8a None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:13.779416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:13.780471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:13.780813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:13.781133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:13.790013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:13.791463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:56:13.806351 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:13.807544 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:13.813752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 619/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:13.814557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:13.868512 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:13.931390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead08dc-0540-4900-9e42-16e83a8bca23 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:13.967384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:13.968061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:13.968362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:13.968639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:13.969480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:13.969786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:13.971227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:13.990784 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 608/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jul 19 10:56:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:13.996646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:14.109334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2750eb18-ea81-455a-95aa-f57742e9fcaa None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:14.145608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:14.146412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:14.146677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:14.146949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:14.157844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:14.159542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:14.179685 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:14.180961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:14.181898 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:14.181898 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:14.181898 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:14.181898 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:14.181898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 620/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:14.187308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:14.311056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c2d5b-8fe2-444f-850c-d5e6b1c34495 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:14.313974 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:14.352503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:14.353175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:14.353471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:14.353720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:14.354482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:14.354828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:14.356336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:14.371190 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 609/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:14.377260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:14.388762 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:14.489278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f57732f-9233-4fb5-8f8d-39a220e14079 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:14.523925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:14.524920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:14.525128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:14.525410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:14.533442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:14.534999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:56:14.551520 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:14.552808 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:14.553934 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 621/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:56:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:56:14.559198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:14.672384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0220f7-4fe3-4efc-8bbd-b23daaec4946 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:14.711964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:14.712797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:14.713135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:14.713493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:14.714360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:14.714788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:14.716549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f73e23-f431-4afb-bfa0-b25cdc897d51 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:14.731548 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 610/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:14.742049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:14.825849 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:14.863490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861f9ff4-02c3-404d-8e15-560f590c7925 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:14.901868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b56412-4bd7-474a-9c78-7de50c8c96fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:14.902900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56412-4bd7-474a-9c78-7de50c8c96fe None admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:14.903252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56412-4bd7-474a-9c78-7de50c8c96fe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:14.903530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b56412-4bd7-474a-9c78-7de50c8c96fe None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/a53c17ba16b146b78da33383a6be1f61/roles/549b18a5a975414491c2f7a4a73b5608` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:14.921288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b56412-4bd7-474a-9c78-7de50c8c96fe None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=a53c17ba16b146b78da33383a6be1f61, role_id=549b18a5a975414491c2f7a4a73b5608)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:14.923178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b56412-4bd7-474a-9c78-7de50c8c96fe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:14.936166 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 622/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:56:14 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/a53c17ba16b146b78da33383a6be1f61/roles/549b18a5a975414491c2f7a4a73b5608 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 10:56:17.058140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dbae7-4861-46ad-a1d9-eeec937aee32 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:17.058508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dbae7-4861-46ad-a1d9-eeec937aee32 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:17.058508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dbae7-4861-46ad-a1d9-eeec937aee32 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:17.059946 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 611/1233] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:17.066023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:17.066547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:17.066633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:17.084059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:17.085313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:17.170519 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 623/1234] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:17.194837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dbae7-4861-46ad-a1d9-eeec937aee32 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:17.235718 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:17.345680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dbae7-4861-46ad-a1d9-eeec937aee32 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:17.391121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:17.392433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:17.393051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:17.393496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:17.408509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:56:17.416228 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:17.418239 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:17.420076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 612/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Tue Jul 19 10:56:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:17.424303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:17.492815 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:17.555777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e511432a-9760-400c-a887-04bfc72cc0be None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:17.600337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:17.601182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:17.601587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:17.602036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:17.603212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] RBAC: Adding query filter params (name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:17.603753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:17.606143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:17.617443 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 624/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Tue Jul 19 10:56:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:17.624717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:17.726879 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:17.748178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9c6df-6003-4c8a-9e5b-64b7b4814165 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:17.807027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:17.807841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:17.808114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:17.808411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:17.821785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:17.823432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:17.842984 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:17.844332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:17.845554 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:17.845554 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:17.845554 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:17.845554 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:17.845554 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 613/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:17.852511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:17.991102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98f93b-774c-4af6-9c1a-201089774e40 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:18.003835 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:18.036961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:18.037829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:18.038309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:18.038756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:18.039613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:18.039978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:18.044105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:18.058312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 625/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:18.064489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:18.188960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce3681-c492-406e-b44f-d85d291cb079 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:18.230844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:18.232201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:18.232724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:18.233204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:18.238549 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:18.247552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:18.249266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:56:18.267536 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:18.268757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:18.269736 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:18.272524 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 614/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:18.276090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:18.406122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2374c1-bfdf-468a-90ce-85c00b5d4917 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:18.450722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:18.451306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:18.451591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:18.451864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:18.452751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:18.453171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:18.454813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:18.475611 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 626/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jul 19 10:56:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:56:18.481632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:18.609619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5fcebe-c33d-45fc-9908-e6e928c48ffb None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:18.656880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:18.657545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:18.657831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:18.658114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:18.738053 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:18.746921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:18.749097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:18.890068 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 615/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:56:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:56:18.896025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:18.934868 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:19.024003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62e8229-0b24-4601-9d06-e69133405d9d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:19.081499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:19.082456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:19.082789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:19.083232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:19.096736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:19.098268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:19.123005 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:19.124209 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:19.125368 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:19.125368 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:19.125368 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:19.125368 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:19.125368 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 627/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:19.130494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:19.250088 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:19.257780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0843b63f-af89-4259-baa4-8c595c75253b None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:19.306892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:19.307634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:19.307894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:19.308190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:19.309093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:19.309735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:19.311146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:19.325451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 616/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:56:19.331854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:19.431924 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:19.468278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2a682-06ec-486a-a6ed-d88a19337ee8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:19.513812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:19.514640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:19.514926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:19.515207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:19.523090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:19.524732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:56:19.541122 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:19.542417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:19.543576 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 628/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:56:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:19.548997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:19.687204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca06004-afc4-4f5d-8de9-c27230c9d618 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:19.738942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:19.740056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:19.740559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:19.741067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:19.742322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:19.742808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:19.744892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b7ca48-1cb8-4e02-aa37-dfb14708c10e None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:19.766594 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 617/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:56:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:19.774265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:19.903685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7362c-9115-4976-861e-0ffb2cb5508d None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:19.942894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:19.943491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:19.943771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:19.944044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:19.945017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] RBAC: Adding query filter params (role.id=549b18a5a975414491c2f7a4a73b5608, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=a53c17ba16b146b78da33383a6be1f61) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:19.945396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:19.946857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6774e7ae-b91a-4393-a62e-7689b078ae1b None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:19.962429 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 629/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:56:19 2022] GET /identity/v3/role_assignments?user.id=a53c17ba16b146b78da33383a6be1f61&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=549b18a5a975414491c2f7a4a73b5608 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:22.310225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194030-9491-4db5-9bcd-8827c0dd9488 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:22.310777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194030-9491-4db5-9bcd-8827c0dd9488 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:22.310777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c194030-9491-4db5-9bcd-8827c0dd9488 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:22.312062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 618/1247] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:22.319038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:22.319541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:22.319647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:22.325848 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:22.340901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:22.342503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:22.441244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 630/1248] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:22.468725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194030-9491-4db5-9bcd-8827c0dd9488 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:22.489885 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:22.596996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c194030-9491-4db5-9bcd-8827c0dd9488 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:22.653596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:22.653820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:22.655111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:22.655111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:22.669993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:56:22.679085 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:22.680261 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:22.681251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 619/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:56:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:22.687422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:22.811674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c542c03-8f8b-4d7a-9e26-18f8ec90c635 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:22.844570 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:22.850612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:22.851326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:22.851632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:22.851986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:22.852912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:22.853271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:22.854920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:22.865251 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 631/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:56:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:22.871314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:22.985399 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:23.014443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e4e548-543e-43e1-a930-704bb35ac28a None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:23.063987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:23.064832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:23.065129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:23.065381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:23.079147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:23.080678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:23.101061 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:23.102994 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:23.105032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:23.105032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:23.105032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:23.105032 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:23.105032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 620/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:23.110297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:23.239473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b2b5f-4a20-433d-9828-e5712e8a66e8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:23.282884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:23.283506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:23.283834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:23.284138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:23.284913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:23.285265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:23.286851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:23.301046 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 632/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:23.307545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:23.417295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ce309-0419-4f25-ac15-6f885a619fb1 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:23.447258 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:23.458553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:23.459481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:23.459763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:23.460036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:23.469565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:23.471229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:56:23.492939 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:23.494276 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:23.497484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 621/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:23.500877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:23.571674 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:23.628174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e6027-b63e-4df6-b2c9-4e7e666d81ae None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:23.671640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:23.672181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:23.672683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:23.672880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:23.673602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:23.673909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:23.675891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:23.697043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 633/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jul 19 10:56:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:23.703762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:23.850619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c97c67-67e6-42bd-afb1-14b4729b5992 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:23.895603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:23.896265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:23.896580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:23.896848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:23.960701 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:23.975737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:23.977401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:24.106565 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 622/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:56:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 19 10:56:24.112683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:24.262351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b0971e-1b4f-45c6-8b10-9e436b71f03e None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:24.277375 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:24.300646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:24.301398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:24.301676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:24.302043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:24.312950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:24.314406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:24.332460 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:24.339870 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:24.341129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:24.341129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:24.341129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:24.341129 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:24.341129 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 634/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:24.341569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:24.441830 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:24.457016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be200c-9619-4b96-80aa-523750ef5e29 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:24.495397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:24.496064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:24.496371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:24.496641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:24.497417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:24.497717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:24.499104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:24.511317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 623/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:24.518762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:24.630283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36418d04-de42-49cf-a8dd-a7bd7bdcea9c None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:24.670900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:24.671794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:24.672073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:24.672369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:24.681061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:24.682804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:56:24.698839 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:24.700088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:24.701628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 635/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:56:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:24.706887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:24.843691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd1da7-9e8e-4dca-80fa-d3855ec625d7 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:24.886023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:24.886798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:24.887049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:24.887358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:24.888366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:24.888687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:24.890301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e906d-fcb6-4d96-b260-356b1a3790f4 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:24.904748 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 624/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:56:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 10:56:24.911584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:24.941783 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:25.033811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30def701-cb53-48b2-82c5-6ef057358efe None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:25.078049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:25.078713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:25.078996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:25.079271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:25.080100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=a53c17ba16b146b78da33383a6be1f61) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:25.080437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:25.081924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a1e0a1-e322-46f6-8cd7-364e97107577 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:25.088174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 636/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:56:24 2022] GET /identity/v3/role_assignments?user.id=a53c17ba16b146b78da33383a6be1f61&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=c71870b3a21e455080504ab36dac896f => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:27.213211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e668-64ba-4671-8645-afe0da2cb760 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:27.213794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e668-64ba-4671-8645-afe0da2cb760 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:27.213794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5e668-64ba-4671-8645-afe0da2cb760 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:27.215155 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 625/1261] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:27.220502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:27.220935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:27.221026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:27.238160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:27.239343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:27.321267 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 637/1262] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:27.344262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e668-64ba-4671-8645-afe0da2cb760 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:27.361690 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:27.462006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a5e668-64ba-4671-8645-afe0da2cb760 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:27.501014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:27.501836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:27.502114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:27.502384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:27.513409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:56:27.520956 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:27.521947 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:27.522820 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 626/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:27.528569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:27.552444 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:27.635011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93da63f3-3e42-4ebf-b403-04f6810f806a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:27.670213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:27.670879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:27.671154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:27.671425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:27.672158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:27.672466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:27.673862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:27.684801 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 638/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:56:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:27.691035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:27.770350 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:27.810441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad01c00f-46a4-489c-b4bd-1e5b28ee3f85 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:27.849992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:27.850790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:27.851068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:27.851343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:27.862497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:27.863960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:27.881274 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:27.882268 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:27.883205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:27.883205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:27.883205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:27.883205 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:27.883205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 627/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:27.889042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:27.973985 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:27.993743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a815e6a-6a10-4461-8003-77cc978c5545 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:28.028111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:28.028797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:28.029081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:28.029357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:28.030072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:28.030380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:28.031762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:28.043316 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 639/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:28.049437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:28.153628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec8a326-acf0-46ea-8c03-474e42ae25f8 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:28.173846 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:28.193899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:28.194709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:28.194991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:28.195262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:28.203182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:28.204666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:56:28.219126 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:28.220759 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:28.221961 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 628/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:28.226410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:28.328481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a18675-f429-4ee4-821c-376c1cb2d97f None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:28.364103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:28.364795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:28.365078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:28.365350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:28.366193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:28.366505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:28.367943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:28.377113 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:28.386398 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 640/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jul 19 10:56:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:28.392405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:28.497503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558e15-5b6f-409d-83a9-6e8f03406155 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:28.533432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:28.534231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:28.534511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:28.534781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:28.547476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:28.548984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:28.567064 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:28.568095 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:28.569236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:28.569236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:28.569236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:28.569236 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:28.569236 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 629/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:28.574199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:28.677854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40270ffb-3965-43e5-afa4-edbb02b1cc72 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:28.713295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:28.713952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:28.714234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:28.714508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:28.715225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:28.715528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:28.716982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:28.728959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 641/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:28.735316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:28.773275 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:28.847020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5cb8f-aa9a-4245-b501-198ce5892979 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:28.882129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:28.882936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:28.883211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:28.883481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:28.890570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:28.892024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:56:28.906539 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:28.907564 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:28.908829 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 630/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:28.914011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:28.974996 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:29.017732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52c25cf-30e9-4fa8-8738-883616541821 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:29.052849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:29.053424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:29.053704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:29.053983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:29.054799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:29.055100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:29.056567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fdff55-a64a-49d2-8deb-92bb7bc644e8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:29.068944 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 642/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:56:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:29.075127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:29.170381 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:29.180467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08960810-039f-4665-9867-9cfc2880ca95 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:29.215641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6de07e-8334-4ea1-a4cf-6031c8a3f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:29.216711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6de07e-8334-4ea1-a4cf-6031c8a3f3eb None admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:29.216928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6de07e-8334-4ea1-a4cf-6031c8a3f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:29.217199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6de07e-8334-4ea1-a4cf-6031c8a3f3eb None admin] PATH_INFO: `/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/a53c17ba16b146b78da33383a6be1f61/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:29.219267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6de07e-8334-4ea1-a4cf-6031c8a3f3eb None admin] RBAC: Authorizing `identity:create_grant(project_id=5209fa56576f4c589b359c96bcb1c94c, user_id=a53c17ba16b146b78da33383a6be1f61, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:29.220738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6de07e-8334-4ea1-a4cf-6031c8a3f3eb None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:29.234545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 631/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Tue Jul 19 10:56:29 2022] PUT /identity/v3/projects/5209fa56576f4c589b359c96bcb1c94c/users/a53c17ba16b146b78da33383a6be1f61/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 10:56:31.248625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980801b-c210-405d-892b-9f8ca680e64f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:31.249277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980801b-c210-405d-892b-9f8ca680e64f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:31.249277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980801b-c210-405d-892b-9f8ca680e64f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:31.250789 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 643/1274] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:31.256174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:31.256747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:31.256747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:31.273978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:31.275156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:31.358865 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 632/1275] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:31.383012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980801b-c210-405d-892b-9f8ca680e64f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:31.501333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980801b-c210-405d-892b-9f8ca680e64f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:31.519860 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:31.538584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:31.539382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:31.539662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:31.539932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:31.552282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 19 10:56:31.562226 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:31.563304 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:31.564435 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 644/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Tue Jul 19 10:56:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:31.569912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:31.674565 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:31.695786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4be1f2-b1a0-4762-8c41-689deca12cd8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:31.733326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:31.734135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:31.734464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:31.734768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:31.735703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:31.736019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:31.737676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:31.754597 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 633/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Tue Jul 19 10:56:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:31.761126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:31.876992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db637a-7b51-4c1e-96af-1b7fbff840a3 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:31.915404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:31.916203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:31.916522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:31.916802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:31.928589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:31.929972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:31.947626 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:31.948770 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:31.949662 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:31.949662 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:31.949662 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:31.949662 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:31.949662 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 645/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:31.955550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:32.061753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65c214c-2afb-4ac6-bb2e-9596be33a4ed None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:32.096606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:32.097269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:32.097547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:32.097821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:32.098552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:32.098860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:32.100278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:32.112704 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 634/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:32.118670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:32.151388 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:32.225839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c41d76-3765-4dd7-a6ad-2050b7ae7a02 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:32.258433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:32.259225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:32.259503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:32.259772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:32.268067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:32.269569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 10:56:32.283910 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:32.285040 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:32.286204 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 646/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:32.291209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:32.295194 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:32.395923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add39527-f8d0-48eb-9cfc-68e87e1ce8b3 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:32.436740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:32.437408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:32.437688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:32.437960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:32.438794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:32.439097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:32.440553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:32.457985 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 635/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Tue Jul 19 10:56:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:32.464289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:32.576768 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:32.588421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09cef87-b9c2-4753-bd57-f5a350fd0608 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:32.624645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:32.625298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:32.625586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:32.625860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:32.692212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:32.693720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:32.788376 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:32.800256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 647/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Tue Jul 19 10:56:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 19 10:56:32.806577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:32.869857 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:32.915185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18b4015-17de-48dc-8c2e-176c6caf4cc7 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:32.949579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:32.950361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:32.950637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:32.950909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:32.961222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:32.962661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 10:56:32.981125 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:32.982875 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:32.984323 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 19 10:56:32.984323 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 10:56:32.984323 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 19 10:56:32.984323 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:32.984323 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 636/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 10:56:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:32.989196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:33.094159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229be49e-5fb8-4c04-832f-1cdc1a528795 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:33.130411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:33.130974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:33.131258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:33.131520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:33.132228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:33.132560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:33.133914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:33.145809 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 648/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Tue Jul 19 10:56:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:33.151728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:33.255929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80593d94-6216-44b2-8f84-295cf7c58886 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:33.271891 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:33.294514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:33.295389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:33.295673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:33.295944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:33.303473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:33.304996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 19 10:56:33.318953 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:33.319999 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 10:56:33.321191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 637/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Tue Jul 19 10:56:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:33.326315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:33.378302 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:33.431046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1ee5e1-5ca5-4002-ba54-382f1cc1ae98 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:33.467119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:33.467755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:33.468036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:33.468311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:33.469131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:33.469439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:33.470885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b827a-5774-4f53-9664-890e61285a8a None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:33.483379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 649/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Tue Jul 19 10:56:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:33.489694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:33.601638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a9b3e-a3b7-4d6b-be49-d6417c826f04 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:33.638820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:33.639576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:33.639854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:33.640127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:33.640998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] RBAC: Adding query filter params (role.id=c71870b3a21e455080504ab36dac896f, scope.project.id=5209fa56576f4c589b359c96bcb1c94c, user.id=a53c17ba16b146b78da33383a6be1f61) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:33.641309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:33.642752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0c63d-f04c-4dc0-a4c3-c26d2d963bec None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:33.649155 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 638/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Tue Jul 19 10:56:33 2022] GET /identity/v3/role_assignments?user.id=a53c17ba16b146b78da33383a6be1f61&scope.project.id=5209fa56576f4c589b359c96bcb1c94c&role.id=c71870b3a21e455080504ab36dac896f => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:35.683877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf6c0-3bff-4bad-92e2-253d4110bd28 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:35.684620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf6c0-3bff-4bad-92e2-253d4110bd28 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:35.684620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cabf6c0-3bff-4bad-92e2-253d4110bd28 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:35.685841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 650/1288] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:35.691371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:35.691850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:35.691961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:35.710428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:35.711567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:35.746337 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:35.794520 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 639/1289] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:35.817817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf6c0-3bff-4bad-92e2-253d4110bd28 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:35.938726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cabf6c0-3bff-4bad-92e2-253d4110bd28 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:35.950813 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:35.977677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:35.978476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:35.978760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:35.979036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:35.979689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:35.981114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:35.993500 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:35.994955 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:35.995984 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 651/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:56:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:36.001587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:36.103974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa244c78-751f-4f0e-8b80-d5bdf3392e82 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:36.138549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:36.139211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:36.139541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:36.139815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:36.140555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] RBAC: Adding query filter params (name=placement) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:36.140864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:36.142266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546cb45-dcde-4b3c-af11-4dc6d07fe5ee None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:36.147128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 640/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jul 19 10:56:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:36.153155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:36.257734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077612d-5474-4467-b76a-21305e1bfd64 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:36.293406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:36.294053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:36.294336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:36.294613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:36.295311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:36.295695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:36.297103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d348bbe-c489-4651-b7b8-4280f038499d None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:36.301947 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 652/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jul 19 10:56:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:38.308941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0f49d-8701-4835-8fc9-157bdcc5ad0c None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:38.309493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0f49d-8701-4835-8fc9-157bdcc5ad0c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:38.309493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0f49d-8701-4835-8fc9-157bdcc5ad0c None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:38.310753 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 641/1293] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:38.316073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5855-a37d-4d52-9669-eaa325cb9656 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:38.316556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5855-a37d-4d52-9669-eaa325cb9656 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:38.316657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fe5855-a37d-4d52-9669-eaa325cb9656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:38.334670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-32fe5855-a37d-4d52-9669-eaa325cb9656 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:38.335880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32fe5855-a37d-4d52-9669-eaa325cb9656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:38.367971 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:38.407861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 653/1294] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:38.431781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0f49d-8701-4835-8fc9-157bdcc5ad0c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:38.470580 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:38.555145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0f49d-8701-4835-8fc9-157bdcc5ad0c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:38.591259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23709c6-db1e-46a0-9745-24704ff962e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:38.591817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23709c6-db1e-46a0-9745-24704ff962e5 None admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:38.592096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23709c6-db1e-46a0-9745-24704ff962e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:38.592395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23709c6-db1e-46a0-9745-24704ff962e5 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:38.593144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23709c6-db1e-46a0-9745-24704ff962e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:38.594511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23709c6-db1e-46a0-9745-24704ff962e5 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:38.611092 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 642/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Tue Jul 19 10:56:38 2022] POST /identity/v3/services => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:56:40.629306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b6696-4743-43eb-a6aa-c0a933c1d5b9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:40.629891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b6696-4743-43eb-a6aa-c0a933c1d5b9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:40.629891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930b6696-4743-43eb-a6aa-c0a933c1d5b9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:40.631253 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 654/1296] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:40.636556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:40.637010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:40.637110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:40.654351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:40.655525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:40.735859 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 643/1297] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:40 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:40.758950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b6696-4743-43eb-a6aa-c0a933c1d5b9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:40.870725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930b6696-4743-43eb-a6aa-c0a933c1d5b9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:40.908258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:40.909003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:40.909282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:40.909552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:40.910198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:40.911581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:40.923792 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:40.925109 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:40.926095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 655/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:56:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 10:56:40.932009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:40.952447 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:41.035383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026e2303-a158-4fcd-beab-2c9df4b4f2dd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:41.071923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:41.072628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:41.072910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:41.073181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:41.073900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:41.074201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:41.075581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:41.080857 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 644/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jul 19 10:56:40 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:41.087048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:41.122386 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:41.194297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c976fb61-4b08-4379-90a8-8a9c21638736 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:41.229730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:41.230373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:41.230653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:41.230928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:41.231714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] RBAC: Adding query filter params (interface=public, service_id=5b86feffb1684042bf6e7388a9d34c8a, region_id=RegionOne) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:41.232022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:41.233444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbba38-2c2f-4605-9f68-3001dcd7cd89 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:41.238768 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 656/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Tue Jul 19 10:56:41 2022] GET /identity/v3/endpoints?service_id=5b86feffb1684042bf6e7388a9d34c8a&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:41.244634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:41.330307 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:41.349954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d3060-849c-4bcf-a84d-ab8bee519ca9 None admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:41.390228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa9bed4-4b43-4455-b217-448d08b4ed37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:41.390912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bed4-4b43-4455-b217-448d08b4ed37 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:41.391197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bed4-4b43-4455-b217-448d08b4ed37 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:41.391472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa9bed4-4b43-4455-b217-448d08b4ed37 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:41.392165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9bed4-4b43-4455-b217-448d08b4ed37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:41.393582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa9bed4-4b43-4455-b217-448d08b4ed37 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:41.400633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 645/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Tue Jul 19 10:56:41 2022] GET /identity/v3/services => generated 2191 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 10:56:43.400593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb92d6-3bb4-4c91-8320-dd1a83a5b481 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:43.401131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb92d6-3bb4-4c91-8320-dd1a83a5b481 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:43.401131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fb92d6-3bb4-4c91-8320-dd1a83a5b481 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:43.402500 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 657/1302] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:56:43.408213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:43.408671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:43.408807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:43.428401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:56:43.429624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:56:43.507406 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 646/1303] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:56:43 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 10:56:43.531058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb92d6-3bb4-4c91-8320-dd1a83a5b481 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:43.630305 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:43.638511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fb92d6-3bb4-4c91-8320-dd1a83a5b481 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:43.673308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:43.674022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:43.674306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:43.674605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:43.675439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:43.676874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 10:56:43.691178 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 10:56:43.692416 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 10:56:43.693654 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 658/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Tue Jul 19 10:56:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 10:56:43.700859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:43.781522 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:43.806815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36195b2-293c-4c93-b9e2-2732713bdf82 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:43.842184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:43.842860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:43.843144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:43.843420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:43.844164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 10:56:43.844495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:43.845877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88affb0b-f8c0-4217-b7a8-b3d2e4810494 None admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:43.851316 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 647/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Tue Jul 19 10:56:43 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 10:56:43.857380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:56:43.963489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912d6de4-0027-4d10-8d8d-1dc0fb2d09a8 None admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:56:43.999224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71484236-298c-48f8-8edb-688ff40c48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:56:43.999935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71484236-298c-48f8-8edb-688ff40c48a4 None admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:56:44.000218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71484236-298c-48f8-8edb-688ff40c48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:56:44.000525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71484236-298c-48f8-8edb-688ff40c48a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:56:44.001278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71484236-298c-48f8-8edb-688ff40c48a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:56:44.002663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71484236-298c-48f8-8edb-688ff40c48a4 None admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:56:44.025649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 659/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Tue Jul 19 10:56:43 2022] POST /identity/v3/endpoints => generated 331 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 10:56:53.848295 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=30 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:56:54.020487 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:50.481403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4143ed7-a1a2-4ca2-bd29-0bb4371f2524 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:50.482361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4143ed7-a1a2-4ca2-bd29-0bb4371f2524 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:50.482796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4143ed7-a1a2-4ca2-bd29-0bb4371f2524 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:50.489373 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 648/1307] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:57:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:50.491823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234b43-b3c9-4733-b2bd-e28b5ece6ffc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:50.492393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234b43-b3c9-4733-b2bd-e28b5ece6ffc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:50.492797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234b43-b3c9-4733-b2bd-e28b5ece6ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:50.585724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-89234b43-b3c9-4733-b2bd-e28b5ece6ffc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:50.587289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89234b43-b3c9-4733-b2bd-e28b5ece6ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:50.712672 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 660/1308] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:50.777636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d665-7023-4242-9f00-660fd56edb7b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:50.778306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d665-7023-4242-9f00-660fd56edb7b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:50.778795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d4d665-7023-4242-9f00-660fd56edb7b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:50.780788 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 649/1309] 10.222.0.15 () {54 vars in 965 bytes} [Tue Jul 19 10:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:57:50.790071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b893-d9f5-44dd-a07e-d3d985065382 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:50.790556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b893-d9f5-44dd-a07e-d3d985065382 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:50.791031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04b893-d9f5-44dd-a07e-d3d985065382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:50.891233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c04b893-d9f5-44dd-a07e-d3d985065382 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:50.892487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c04b893-d9f5-44dd-a07e-d3d985065382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:50.916182 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:50.978034 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 661/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Jul 19 10:57:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:57:50.991102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4d665-7023-4242-9f00-660fd56edb7b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:50.993233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f1d4d665-7023-4242-9f00-660fd56edb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:51.220694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d4d665-7023-4242-9f00-660fd56edb7b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:51.380383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:51.381135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:51.381463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:51.381819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:51.383588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:51.457701 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:51.570684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:51.573744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba45dc5-286f-47a6-a67d-dfbf3d6bed88 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:51.630235 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 650/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:57:54.251068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc1f90-4e26-49bb-8a40-8d68d507cee5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:54.251626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc1f90-4e26-49bb-8a40-8d68d507cee5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:54.251626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc1f90-4e26-49bb-8a40-8d68d507cee5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:54.253350 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 662/1312] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:54.259017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23e87-8fa9-4f66-9c65-10cc0c327f4a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:54.259627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23e87-8fa9-4f66-9c65-10cc0c327f4a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:54.259710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab23e87-8fa9-4f66-9c65-10cc0c327f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:54.347662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fab23e87-8fa9-4f66-9c65-10cc0c327f4a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:54.348838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fab23e87-8fa9-4f66-9c65-10cc0c327f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:54.457769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 651/1313] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:54.501492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc1f90-4e26-49bb-8a40-8d68d507cee5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:54.504637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-49cc1f90-4e26-49bb-8a40-8d68d507cee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:54.667506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc1f90-4e26-49bb-8a40-8d68d507cee5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:54.752362 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:54.755688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:54.756374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:54.756920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:54.757240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:54.759496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:54.885131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:54.888132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615695fa-c6eb-4e4a-8938-ba44bf1cc1ef service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:54.916614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 663/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:57:57.427616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25faeb-901e-4de9-9f84-14843c91d055 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:57.428197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25faeb-901e-4de9-9f84-14843c91d055 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:57.428197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25faeb-901e-4de9-9f84-14843c91d055 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:57.429488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 652/1315] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:57:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:57:57.435499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4333-84e7-48fe-b751-6bfb72a1a73a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:57.436050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4333-84e7-48fe-b751-6bfb72a1a73a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:57.436050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d4333-84e7-48fe-b751-6bfb72a1a73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:57.508454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc7d4333-84e7-48fe-b751-6bfb72a1a73a None None] MFA Rules not processed for user `50527b1e60e34ba8b7cd042824c4e1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:57:57.509720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc7d4333-84e7-48fe-b751-6bfb72a1a73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:57.566468 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:57.615350 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 664/1316] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:57:57 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:57:57.656689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25faeb-901e-4de9-9f84-14843c91d055 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:57:57.659119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6a25faeb-901e-4de9-9f84-14843c91d055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:57.669716 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:57.784908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25faeb-901e-4de9-9f84-14843c91d055 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:57:57.863660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:57:57.864312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:57:57.864629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:57:57.864876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:57:57.866569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:57:57.941685 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:57:57.995684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:57:57.997194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34c76-e4e6-4481-ac69-27d9fb9f4a1d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:57:58.018601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 653/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:57:57 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:00.671798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b0f3-1b02-401d-86a0-d5bd7dcbc1e6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:00.672776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b0f3-1b02-401d-86a0-d5bd7dcbc1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:00.672776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085b0f3-1b02-401d-86a0-d5bd7dcbc1e6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:00.673797 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 665/1318] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:00.679476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4c77-f4ea-408d-83a1-a66ee7009fd5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:00.679979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4c77-f4ea-408d-83a1-a66ee7009fd5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:00.679979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f4c77-f4ea-408d-83a1-a66ee7009fd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:00.750008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7a9f4c77-f4ea-408d-83a1-a66ee7009fd5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:00.751259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a9f4c77-f4ea-408d-83a1-a66ee7009fd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:00.858276 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 654/1319] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:00.910330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe56ce-e356-481d-866d-b7189e93c1fb None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:00.910603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe56ce-e356-481d-866d-b7189e93c1fb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:00.910881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fe56ce-e356-481d-866d-b7189e93c1fb None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:00.912292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 666/1320] 10.222.0.15 () {54 vars in 965 bytes} [Tue Jul 19 10:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:00.919263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88cd58-56be-4028-8488-48961ce41070 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:00.919602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88cd58-56be-4028-8488-48961ce41070 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:00.919924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88cd58-56be-4028-8488-48961ce41070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:00.945437 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:01.003974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4c88cd58-56be-4028-8488-48961ce41070 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:01.005214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c88cd58-56be-4028-8488-48961ce41070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:01.088425 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 655/1321] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Jul 19 10:58:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:01.097855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe56ce-e356-481d-866d-b7189e93c1fb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:01.099404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2fe56ce-e356-481d-866d-b7189e93c1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:01.210450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fe56ce-e356-481d-866d-b7189e93c1fb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:01.289776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:01.290419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:01.290697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:01.290965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:01.292707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:01.302439 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:01.417310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:01.418768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50e96b1-1506-4c62-b654-935a382be85e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:01.437456 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 667/1322] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:04.841781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceeac9-eb0d-48cf-a843-9c5ffb0ad888 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:04.842327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceeac9-eb0d-48cf-a843-9c5ffb0ad888 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:04.842327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ceeac9-eb0d-48cf-a843-9c5ffb0ad888 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:04.843911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 656/1323] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:04.849181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215df07c-35d1-4309-b831-9c09321ecf1d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:04.849675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215df07c-35d1-4309-b831-9c09321ecf1d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:04.849761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215df07c-35d1-4309-b831-9c09321ecf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:04.925445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-215df07c-35d1-4309-b831-9c09321ecf1d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:04.926713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-215df07c-35d1-4309-b831-9c09321ecf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:05.001790 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:05.063288 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 668/1324] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:05.113576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceeac9-eb0d-48cf-a843-9c5ffb0ad888 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:05.115908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80ceeac9-eb0d-48cf-a843-9c5ffb0ad888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:05.268334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ceeac9-eb0d-48cf-a843-9c5ffb0ad888 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:05.282456 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:05.358522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:05.359177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:05.359458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:05.359730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:05.361503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:05.492150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:05.493554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f73168d-4d6c-4e97-875b-6c8aac6e1468 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:05.515365 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 657/1325] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:07.667652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20fe6-94d3-4359-9e39-663911f6e57f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:07.668335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20fe6-94d3-4359-9e39-663911f6e57f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:07.668335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a20fe6-94d3-4359-9e39-663911f6e57f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:07.669564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 669/1326] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:07.675530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e16bb-fbf9-4c30-824b-b18b06b6a443 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:07.676059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e16bb-fbf9-4c30-824b-b18b06b6a443 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:07.676244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e16bb-fbf9-4c30-824b-b18b06b6a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:07.729190 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:07.753291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cf4e16bb-fbf9-4c30-824b-b18b06b6a443 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:07.754609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf4e16bb-fbf9-4c30-824b-b18b06b6a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:07.866962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 658/1327] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:07.904473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20fe6-94d3-4359-9e39-663911f6e57f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:07.906187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8a20fe6-94d3-4359-9e39-663911f6e57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:08.020421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a20fe6-94d3-4359-9e39-663911f6e57f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:08.109264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:08.109917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:08.110197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:08.110443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:08.112101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:08.129767 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:08.226864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:08.228316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016abdb8-0eff-45f5-af1d-68fa4975231f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:08.248793 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 670/1328] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:10.481530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc67ee-35c4-47d1-85d2-4eec21c7c01b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:10.482356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc67ee-35c4-47d1-85d2-4eec21c7c01b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:10.482535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cc67ee-35c4-47d1-85d2-4eec21c7c01b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:10.483963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 659/1329] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:10.490070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0955-a9ea-4440-a3d2-401be71fff32 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:10.490777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0955-a9ea-4440-a3d2-401be71fff32 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:10.490777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20b0955-a9ea-4440-a3d2-401be71fff32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:10.574965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e20b0955-a9ea-4440-a3d2-401be71fff32 None None] MFA Rules not processed for user `50527b1e60e34ba8b7cd042824c4e1bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:10.575617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e20b0955-a9ea-4440-a3d2-401be71fff32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:10.664289 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:10.703655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 671/1330] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:10.746077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc67ee-35c4-47d1-85d2-4eec21c7c01b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:10.747681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e7cc67ee-35c4-47d1-85d2-4eec21c7c01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:10.863843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cc67ee-35c4-47d1-85d2-4eec21c7c01b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:10.886585 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:10.947716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:10.948574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:10.948953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:10.949315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:10.951113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:11.091788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:11.094620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930691db-83dc-4408-822a-5d5710382b1a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:11.129049 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 660/1331] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:13.538307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c1385-dacb-45fa-9f34-16546197934b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:13.539036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c1385-dacb-45fa-9f34-16546197934b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:13.539036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628c1385-dacb-45fa-9f34-16546197934b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:13.540215 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 672/1332] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:13.545918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319384f3-e30a-40e2-a195-77e2f7cd8af0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:13.546726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319384f3-e30a-40e2-a195-77e2f7cd8af0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:13.546726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319384f3-e30a-40e2-a195-77e2f7cd8af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:13.625306 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:13.629072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-319384f3-e30a-40e2-a195-77e2f7cd8af0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:13.630320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-319384f3-e30a-40e2-a195-77e2f7cd8af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:13.752492 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 661/1333] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:13.797696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c1385-dacb-45fa-9f34-16546197934b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:13.800782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-628c1385-dacb-45fa-9f34-16546197934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:13.923346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628c1385-dacb-45fa-9f34-16546197934b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:14.017537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:14.018264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:14.018549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:14.018832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:14.020714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:14.059388 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:14.163574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:14.165313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c86652a-faad-424c-b0d1-f624b8f58822 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:14.186663 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 673/1334] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:16.344952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e891-cd96-45f1-af02-5138ddee1b8e None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:16.345634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e891-cd96-45f1-af02-5138ddee1b8e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:16.345634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0e891-cd96-45f1-af02-5138ddee1b8e None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:16.347028 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 662/1335] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:16.353519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e29f1-1b83-46dc-9b34-2538423b102f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:16.354321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e29f1-1b83-46dc-9b34-2538423b102f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:16.354481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e29f1-1b83-46dc-9b34-2538423b102f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:16.430986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5c7e29f1-1b83-46dc-9b34-2538423b102f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:16.436528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c7e29f1-1b83-46dc-9b34-2538423b102f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:16.525254 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:16.552263 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 674/1336] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:16.593291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0e891-cd96-45f1-af02-5138ddee1b8e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:16.594836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a2d0e891-cd96-45f1-af02-5138ddee1b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:16.721962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0e891-cd96-45f1-af02-5138ddee1b8e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:16.754996 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:16.806078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:16.806731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:16.807009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:16.807280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:16.808977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:16.934792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:16.936188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe7112-02a5-428f-95ee-4ec893ef2d44 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:16.960419 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 663/1337] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:58:19.567096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e38b4-8474-4f2f-ab0b-d7067b25df49 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:19.567921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e38b4-8474-4f2f-ab0b-d7067b25df49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:19.567921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21e38b4-8474-4f2f-ab0b-d7067b25df49 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:19.569130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 675/1338] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:58:19.575462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d595-f891-4b2d-9b10-d2cc76a631e1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:19.576013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d595-f891-4b2d-9b10-d2cc76a631e1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:19.576013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021d595-f891-4b2d-9b10-d2cc76a631e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:19.657456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7021d595-f891-4b2d-9b10-d2cc76a631e1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:19.658764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7021d595-f891-4b2d-9b10-d2cc76a631e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:19.669110 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:19.768027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 664/1339] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:19 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:19.809841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e38b4-8474-4f2f-ab0b-d7067b25df49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:19.812150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a21e38b4-8474-4f2f-ab0b-d7067b25df49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:19.920033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21e38b4-8474-4f2f-ab0b-d7067b25df49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:19.996083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:19.996852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:19.997187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:19.997521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:19.999303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:20.037672 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:20.119827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:20.121323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431aaf2a-5a36-4897-9d10-842be7b1e612 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:20.144225 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 676/1340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:19 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:24.445714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f6f8-32c4-43ec-b954-9b3677616cb8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:24.446624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f6f8-32c4-43ec-b954-9b3677616cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:24.446624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641f6f8-32c4-43ec-b954-9b3677616cb8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:24.447810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 665/1341] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:24.454123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9f52c-3634-46b7-9665-63c932c705b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:24.454664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9f52c-3634-46b7-9665-63c932c705b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:24.454664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9f52c-3634-46b7-9665-63c932c705b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:24.538750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6bf9f52c-3634-46b7-9665-63c932c705b3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:24.539979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bf9f52c-3634-46b7-9665-63c932c705b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:24.644728 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:24.659059 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 677/1342] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:24.698855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f6f8-32c4-43ec-b954-9b3677616cb8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:24.700508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f641f6f8-32c4-43ec-b954-9b3677616cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:24.851297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641f6f8-32c4-43ec-b954-9b3677616cb8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:24.911303 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:24.966467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:24.967272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:24.967597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:24.968065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:24.970011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:25.125102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:25.127714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745a7dbe-2224-4aba-b185-2eda9e3ad8cf service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:25.151775 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 666/1343] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:27.817138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb68364-8da3-488b-8d5e-c738904cc756 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:27.817839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb68364-8da3-488b-8d5e-c738904cc756 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:27.817839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb68364-8da3-488b-8d5e-c738904cc756 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:27.819681 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 678/1344] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:27.825950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13713d5-a7d6-4998-9ca5-dc14e4a8b431 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:27.826497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13713d5-a7d6-4998-9ca5-dc14e4a8b431 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:27.826497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13713d5-a7d6-4998-9ca5-dc14e4a8b431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:27.903270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d13713d5-a7d6-4998-9ca5-dc14e4a8b431 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:27.904473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d13713d5-a7d6-4998-9ca5-dc14e4a8b431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:27.926741 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:28.021568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 667/1345] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:28.060557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb68364-8da3-488b-8d5e-c738904cc756 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:28.062276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-edb68364-8da3-488b-8d5e-c738904cc756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:28.180074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb68364-8da3-488b-8d5e-c738904cc756 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:28.258082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:28.258735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:28.259013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:28.259288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:28.260992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:28.309610 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:28.397327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:28.400026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eae8af-4473-46e2-884a-8d5902b61fc9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:28.437567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 679/1346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:33.263607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32d9c-b46e-414e-9bd1-567e965d4154 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:33.264159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32d9c-b46e-414e-9bd1-567e965d4154 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:33.264528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f32d9c-b46e-414e-9bd1-567e965d4154 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:33.266733 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 668/1347] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:33.272763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba083c5-3040-45dd-a7e0-97a2efcfb898 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:33.273520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba083c5-3040-45dd-a7e0-97a2efcfb898 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:33.273520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba083c5-3040-45dd-a7e0-97a2efcfb898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:33.354942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dba083c5-3040-45dd-a7e0-97a2efcfb898 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:33.357086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dba083c5-3040-45dd-a7e0-97a2efcfb898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:33.477815 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:33.481745 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 680/1348] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:33.522715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32d9c-b46e-414e-9bd1-567e965d4154 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:33.524269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45f32d9c-b46e-414e-9bd1-567e965d4154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:33.697872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f32d9c-b46e-414e-9bd1-567e965d4154 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:33.750004 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:33.780154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:33.780854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:33.781140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:33.781416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:33.783084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:33.916574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:33.918119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46adafa-7f6b-41a4-9f38-463856838831 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:33.937644 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 669/1349] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:38.993313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b28348-433a-4436-98c3-3d762ce97883 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:38.993313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b28348-433a-4436-98c3-3d762ce97883 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:38.995266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b28348-433a-4436-98c3-3d762ce97883 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:38.998201 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 681/1350] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 10:58:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:58:39.006168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8596-b31c-43e4-8199-358ee34296d1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:39.007007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8596-b31c-43e4-8199-358ee34296d1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:39.007007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861f8596-b31c-43e4-8199-358ee34296d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:39.142038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-861f8596-b31c-43e4-8199-358ee34296d1 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:39.143398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-861f8596-b31c-43e4-8199-358ee34296d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:39.164961 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:39.297234 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 670/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 10:58:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:44.152420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ba68-8c18-47b4-bf69-4a552027f4f0 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:44.153260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ba68-8c18-47b4-bf69-4a552027f4f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:44.153260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120ba68-8c18-47b4-bf69-4a552027f4f0 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:44.154485 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 682/1352] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 10:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:44.160236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecdd27-2b05-4df4-85af-9f3d64d6ed80 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:44.160784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecdd27-2b05-4df4-85af-9f3d64d6ed80 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:44.161220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fecdd27-2b05-4df4-85af-9f3d64d6ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:44.284922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8fecdd27-2b05-4df4-85af-9f3d64d6ed80 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:44.286169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8fecdd27-2b05-4df4-85af-9f3d64d6ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:44.366488 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:44.418668 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 671/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 10:58:44 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:45.763284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2731-9e1c-44a5-9b3d-7e3fa5f7da5d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:45.763807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2731-9e1c-44a5-9b3d-7e3fa5f7da5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:45.763807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2731-9e1c-44a5-9b3d-7e3fa5f7da5d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:45.765382 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 683/1354] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 10:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:45.770872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4309c-ac8b-4e18-a0f1-ac7df80e2c55 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:45.771314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4309c-ac8b-4e18-a0f1-ac7df80e2c55 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:45.771419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4309c-ac8b-4e18-a0f1-ac7df80e2c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:45.858532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aff4309c-ac8b-4e18-a0f1-ac7df80e2c55 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:45.859825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aff4309c-ac8b-4e18-a0f1-ac7df80e2c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:45.985628 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 672/1355] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 10:58:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:49.513150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490a245-1cd0-41d7-9440-f9227f321c85 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:49.514082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490a245-1cd0-41d7-9440-f9227f321c85 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:49.514608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a490a245-1cd0-41d7-9440-f9227f321c85 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:49.516201 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 684/1356] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:49.524186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2535a-c242-4c1c-bd4a-de3b222dd97c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:49.525675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2535a-c242-4c1c-bd4a-de3b222dd97c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:49.525966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2535a-c242-4c1c-bd4a-de3b222dd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:49.581266 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:49.631477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-60f2535a-c242-4c1c-bd4a-de3b222dd97c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:49.633118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60f2535a-c242-4c1c-bd4a-de3b222dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:49.773857 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 673/1357] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:49.836547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bd2cb-9fa6-4fc9-8992-82a7472bf188 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:49.836742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bd2cb-9fa6-4fc9-8992-82a7472bf188 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:49.837110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bd2cb-9fa6-4fc9-8992-82a7472bf188 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:49.838614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 685/1358] 10.222.0.15 () {54 vars in 962 bytes} [Tue Jul 19 10:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:49.848845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12e451-b5b4-487b-9924-845ea35391b5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:49.849690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12e451-b5b4-487b-9924-845ea35391b5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:49.850295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12e451-b5b4-487b-9924-845ea35391b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:49.945765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0b12e451-b5b4-487b-9924-845ea35391b5 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:49.947088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0b12e451-b5b4-487b-9924-845ea35391b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:50.025460 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:50.108995 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 674/1359] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jul 19 10:58:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:58:50.127268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bd2cb-9fa6-4fc9-8992-82a7472bf188 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:50.128919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c83bd2cb-9fa6-4fc9-8992-82a7472bf188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:50.315532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bd2cb-9fa6-4fc9-8992-82a7472bf188 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:50.415259 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:50.472645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:50.473308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:50.473723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:50.474011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:50.475731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:50.578954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:50.581439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db708ad-eae8-4504-a486-890cfff270a0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:50.607780 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 686/1360] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:58:52.863360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9283a-560b-4fb1-9cab-fd1d36a18760 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:52.863910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9283a-560b-4fb1-9cab-fd1d36a18760 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:52.863910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9283a-560b-4fb1-9cab-fd1d36a18760 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:52.865556 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 675/1361] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:52.871142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92727fe6-3a87-464b-8c46-bf3e4ab1b31c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:52.871547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92727fe6-3a87-464b-8c46-bf3e4ab1b31c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:52.871880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92727fe6-3a87-464b-8c46-bf3e4ab1b31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:52.947226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-92727fe6-3a87-464b-8c46-bf3e4ab1b31c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:52.948526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92727fe6-3a87-464b-8c46-bf3e4ab1b31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:52.993660 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:53.072003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 687/1362] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:53.129651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9283a-560b-4fb1-9cab-fd1d36a18760 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:53.132915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-23a9283a-560b-4fb1-9cab-fd1d36a18760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:53.313642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9283a-560b-4fb1-9cab-fd1d36a18760 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:53.324130 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:53.446894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:53.447680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:53.448056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:53.448424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:53.450191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:53.565401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:53.567191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016cde8-6dd4-4174-b0fa-199db587c18b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:53.590924 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 676/1363] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:58:56.013979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862984c4-05d2-435b-a9a8-fcf08e8fef6e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:56.014520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862984c4-05d2-435b-a9a8-fcf08e8fef6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:56.014896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862984c4-05d2-435b-a9a8-fcf08e8fef6e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:56.016788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 688/1364] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:56.022605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f095ac-1de0-402e-b3ae-c2e37be69991 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:56.023039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f095ac-1de0-402e-b3ae-c2e37be69991 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:56.023163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f095ac-1de0-402e-b3ae-c2e37be69991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:56.044383 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:56.113389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-38f095ac-1de0-402e-b3ae-c2e37be69991 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:56.114665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38f095ac-1de0-402e-b3ae-c2e37be69991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:56.240759 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 677/1365] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:56.294047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3757-a0cf-46b3-a1ee-5fc64878c7b4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:56.294333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3757-a0cf-46b3-a1ee-5fc64878c7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:56.294778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e3757-a0cf-46b3-a1ee-5fc64878c7b4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:56.300825 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 689/1366] 10.222.0.15 () {54 vars in 962 bytes} [Tue Jul 19 10:58:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:56.307796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b233b-62da-4bcc-9205-96a4f2b71d06 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:56.308716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b233b-62da-4bcc-9205-96a4f2b71d06 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:56.309531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5b233b-62da-4bcc-9205-96a4f2b71d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:56.391084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-be5b233b-62da-4bcc-9205-96a4f2b71d06 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:56.392282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be5b233b-62da-4bcc-9205-96a4f2b71d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:56.428633 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:56.522726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 678/1367] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jul 19 10:58:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:56.532011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3757-a0cf-46b3-a1ee-5fc64878c7b4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:56.533853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-226e3757-a0cf-46b3-a1ee-5fc64878c7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:56.747717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e3757-a0cf-46b3-a1ee-5fc64878c7b4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:58:56.773376 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:56.878023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:58:56.878684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:56.878965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:56.879229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:56.881040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:56.981437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:58:56.983233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eef751e-8c6f-40fb-be90-c868c8557b71 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:58:57.010536 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 690/1368] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:58:59.288208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afbcc0-f3fd-4755-9e47-0030d17174b8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:59.295058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afbcc0-f3fd-4755-9e47-0030d17174b8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:59.295058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81afbcc0-f3fd-4755-9e47-0030d17174b8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:59.296577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 679/1369] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:58:59 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:58:59.308079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387f410-8c54-4f0a-b135-6f10592eecde None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:58:59.308079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387f410-8c54-4f0a-b135-6f10592eecde None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:58:59.308079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387f410-8c54-4f0a-b135-6f10592eecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:58:59.374019 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:59.448590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f387f410-8c54-4f0a-b135-6f10592eecde None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:58:59.449823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f387f410-8c54-4f0a-b135-6f10592eecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:59.666178 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 691/1370] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:58:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:58:59.712679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afbcc0-f3fd-4755-9e47-0030d17174b8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:58:59.714672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-81afbcc0-f3fd-4755-9e47-0030d17174b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:58:59.905667 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:58:59.912002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81afbcc0-f3fd-4755-9e47-0030d17174b8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:00.042748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:00.043812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:00.044314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:00.044857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:00.046786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:00.146402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:00.148511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec096b-198c-4431-922d-80513e481bd6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:00.166318 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:00.170570 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 680/1371] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:58:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:01.356968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb239-f316-4a38-8fe3-166a077a5cba None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:01.357561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb239-f316-4a38-8fe3-166a077a5cba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:01.357561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caeb239-f316-4a38-8fe3-166a077a5cba None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:01.359153 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 692/1372] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:01.371317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790bf4-d771-4c8c-936f-c5cd880eca6e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:01.371871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790bf4-d771-4c8c-936f-c5cd880eca6e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:01.372428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5790bf4-d771-4c8c-936f-c5cd880eca6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:01.516981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d5790bf4-d771-4c8c-936f-c5cd880eca6e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:01.518715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d5790bf4-d771-4c8c-936f-c5cd880eca6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:01.652146 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 681/1373] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:01.981414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e2ee-78db-4944-a707-010be9a8bc79 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:01.981414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e2ee-78db-4944-a707-010be9a8bc79 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:01.988174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b76e2ee-78db-4944-a707-010be9a8bc79 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:01.988174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 693/1374] 10.222.0.15 () {54 vars in 964 bytes} [Tue Jul 19 10:59:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:01.992981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174f53-80e9-4315-b224-de4ce7050518 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:01.993558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174f53-80e9-4315-b224-de4ce7050518 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:01.994051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa174f53-80e9-4315-b224-de4ce7050518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.110721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aa174f53-80e9-4315-b224-de4ce7050518 None None] MFA Rules not processed for user `55aac242daf746b283fb3cb561b3462e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:02.111921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa174f53-80e9-4315-b224-de4ce7050518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.134383 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:02.199594 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 682/1375] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Jul 19 10:59:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:02.208095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e2ee-78db-4944-a707-010be9a8bc79 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:02.210160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b76e2ee-78db-4944-a707-010be9a8bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.342083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b76e2ee-78db-4944-a707-010be9a8bc79 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:02.347385 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:02.430442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:02.431319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:02.431319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:02.431647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.433373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.471867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0fb8-b5eb-4bec-ab09-38e3a4743ecc None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:02.472527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0fb8-b5eb-4bec-ab09-38e3a4743ecc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:02.472527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b0fb8-b5eb-4bec-ab09-38e3a4743ecc None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.476744 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 683/1376] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:59:02.479323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095cf7-574f-496d-b665-8407abb91ac4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:02.479612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095cf7-574f-496d-b665-8407abb91ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:02.479928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94095cf7-574f-496d-b665-8407abb91ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.555043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-94095cf7-574f-496d-b665-8407abb91ac4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:02.556277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-94095cf7-574f-496d-b665-8407abb91ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.560946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:02.562392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:02.582074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 694/1377] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:02.665525 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 684/1378] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:02.710127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:02.716388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:02.762979 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:02.839383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf794d-049a-4285-9949-0e6065d0bca2 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:02.977293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:02.977967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:02.978245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:02.978640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:02.980544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:03.037116 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:03.093894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:03.096090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f71b92-819b-4e05-ad60-0980323f71fb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:03.122006 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 695/1379] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:05.270568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86df42-320d-4b9e-8691-b101790566ad None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:05.271160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86df42-320d-4b9e-8691-b101790566ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:05.271160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af86df42-320d-4b9e-8691-b101790566ad None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:05.272862 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 685/1380] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:05.278748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2d21e-7411-40b3-bf24-2b6c6f4dde6d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:05.279266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2d21e-7411-40b3-bf24-2b6c6f4dde6d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:05.279388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2d21e-7411-40b3-bf24-2b6c6f4dde6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:05.372626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ba2d21e-7411-40b3-bf24-2b6c6f4dde6d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:05.373871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ba2d21e-7411-40b3-bf24-2b6c6f4dde6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:05.525004 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 696/1381] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:05.578223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86df42-320d-4b9e-8691-b101790566ad None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:05.579894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af86df42-320d-4b9e-8691-b101790566ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:05.611527 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:05.744992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af86df42-320d-4b9e-8691-b101790566ad None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:05.864430 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:05.890288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:05.890956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:05.891238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:05.891513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:05.893269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:06.031846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:06.033654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b532eb68-b135-4f59-8677-29c44d7da5c4 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:06.057569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 686/1382] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:08.176208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a91fc-05e0-49b4-9a44-0e723517b1aa None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:08.176766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a91fc-05e0-49b4-9a44-0e723517b1aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:08.177036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a91fc-05e0-49b4-9a44-0e723517b1aa None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:08.178553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 697/1383] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:08.184326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc5bc-0371-4923-849c-c87cc7d72979 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:08.184899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc5bc-0371-4923-849c-c87cc7d72979 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:08.185120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11dc5bc-0371-4923-849c-c87cc7d72979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:08.263666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c11dc5bc-0371-4923-849c-c87cc7d72979 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:08.265084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c11dc5bc-0371-4923-849c-c87cc7d72979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:08.338444 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:08.400883 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 687/1384] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:08.429148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a91fc-05e0-49b4-9a44-0e723517b1aa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:08.431015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b58a91fc-05e0-49b4-9a44-0e723517b1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:08.460099 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:08.609568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a91fc-05e0-49b4-9a44-0e723517b1aa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:08.726702 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:08.753568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:08.754237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:08.754521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:08.754801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:08.756572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:08.865444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:08.867050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33125fbc-d273-4577-93af-2ce6404281d4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:08.889282 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 698/1385] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:10.966706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368add-bb22-46a1-9499-633a7702a67b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:10.967557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368add-bb22-46a1-9499-633a7702a67b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:10.967557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee368add-bb22-46a1-9499-633a7702a67b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:10.968696 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 688/1386] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:10.977375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e920df-f3e8-44a8-8835-e02399e68df7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:10.978006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e920df-f3e8-44a8-8835-e02399e68df7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:10.978006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e920df-f3e8-44a8-8835-e02399e68df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:11.051647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-22e920df-f3e8-44a8-8835-e02399e68df7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:11.052825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22e920df-f3e8-44a8-8835-e02399e68df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:11.114762 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:11.163452 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 699/1387] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:11.208755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368add-bb22-46a1-9499-633a7702a67b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:11.210319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ee368add-bb22-46a1-9499-633a7702a67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:11.389664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee368add-bb22-46a1-9499-633a7702a67b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:11.460583 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:11.551932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:11.552736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:11.552999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:11.553285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:11.555246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:11.681288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:11.683500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e62a5a-3088-4951-8700-ab7866c02296 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:11.713742 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 689/1388] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:14.192772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9b06-9c25-4df0-9578-47e30f150e6a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:14.193462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9b06-9c25-4df0-9578-47e30f150e6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:14.193462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0db9b06-9c25-4df0-9578-47e30f150e6a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:14.194799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 700/1389] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:14.201745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c9b0-d120-4958-8f52-8088bc65dbae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:14.202374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c9b0-d120-4958-8f52-8088bc65dbae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:14.202374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c9b0-d120-4958-8f52-8088bc65dbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:14.283014 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:14.287013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3917c9b0-d120-4958-8f52-8088bc65dbae None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:14.289354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3917c9b0-d120-4958-8f52-8088bc65dbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:14.405476 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 690/1390] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:14.453666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9b06-9c25-4df0-9578-47e30f150e6a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:14.455363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0db9b06-9c25-4df0-9578-47e30f150e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:14.643734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0db9b06-9c25-4df0-9578-47e30f150e6a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:14.693552 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:14.794031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:14.794724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:14.795014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:14.795293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:14.797069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:14.908481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:14.910768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608148ec-0652-4c37-9316-0d616ed5e626 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:14.936898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 701/1391] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:17.063108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc34e7-67e6-4e70-9c99-24c813390781 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:17.064032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc34e7-67e6-4e70-9c99-24c813390781 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:17.064032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc34e7-67e6-4e70-9c99-24c813390781 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:17.065940 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 691/1392] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:17.072909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431492a3-27bb-4041-9e37-1c32fe6a97d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:17.073470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431492a3-27bb-4041-9e37-1c32fe6a97d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:17.073470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431492a3-27bb-4041-9e37-1c32fe6a97d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:17.138950 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:17.147973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-431492a3-27bb-4041-9e37-1c32fe6a97d9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:17.149210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-431492a3-27bb-4041-9e37-1c32fe6a97d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:17.257685 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 702/1393] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:17.303313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc34e7-67e6-4e70-9c99-24c813390781 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:17.304884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-85bc34e7-67e6-4e70-9c99-24c813390781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:17.459705 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:17.487434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc34e7-67e6-4e70-9c99-24c813390781 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:17.627878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:17.628475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:17.628761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:17.629029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:17.630737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:17.737566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:17.739180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1b6c3-4bc7-4a3f-b74e-932181eb045a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:17.743255 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:17.760592 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 692/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:18.462469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7baddb-d551-4817-9a42-c9161d46f2f6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:18.463099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7baddb-d551-4817-9a42-c9161d46f2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:18.463099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7baddb-d551-4817-9a42-c9161d46f2f6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:18.464325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 703/1395] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:18.470001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014291-f09a-4b2f-af3c-b1541799e14d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:18.470521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014291-f09a-4b2f-af3c-b1541799e14d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:18.470658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59014291-f09a-4b2f-af3c-b1541799e14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:18.541935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-59014291-f09a-4b2f-af3c-b1541799e14d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:18.543272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-59014291-f09a-4b2f-af3c-b1541799e14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:18.651457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 693/1396] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:18.726642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2d703-b1e1-49e1-9b44-417db89a95ca None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:18.726931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2d703-b1e1-49e1-9b44-417db89a95ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:18.727172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2d703-b1e1-49e1-9b44-417db89a95ca None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:18.728598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 704/1397] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jul 19 10:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:18.734340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56695-3673-4e14-bd31-08e40947a689 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:18.734637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56695-3673-4e14-bd31-08e40947a689 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:18.735060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd56695-3673-4e14-bd31-08e40947a689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:18.822756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5cd56695-3673-4e14-bd31-08e40947a689 None None] MFA Rules not processed for user `2bbe7cd61ad745a9833acd3d3e4a066d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:18.824011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5cd56695-3673-4e14-bd31-08e40947a689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:18.832594 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:18.915857 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 694/1398] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 10:59:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:18.924293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2d703-b1e1-49e1-9b44-417db89a95ca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:18.926094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53d2d703-b1e1-49e1-9b44-417db89a95ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:19.038002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2d703-b1e1-49e1-9b44-417db89a95ca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:19.072313 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:19.126721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:19.127385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:19.127664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:19.127945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:19.129642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:19.245496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:19.246953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517f6a00-5e06-4a49-9567-6d7e4a0afd40 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:19.268007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 705/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:19.854545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7ec00-1ff9-43bc-b2ad-d1e2444444ed None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:19.855175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7ec00-1ff9-43bc-b2ad-d1e2444444ed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:19.855412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7ec00-1ff9-43bc-b2ad-d1e2444444ed None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:19.857256 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 695/1400] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:19.863505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0253214-e521-42b5-afdf-70325886d861 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:19.864104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0253214-e521-42b5-afdf-70325886d861 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:19.864298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0253214-e521-42b5-afdf-70325886d861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:19.940401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0253214-e521-42b5-afdf-70325886d861 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:19.941647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0253214-e521-42b5-afdf-70325886d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:19.949484 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:20.009665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca42845-9118-47c5-839b-135ab6f34fae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:20.010240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca42845-9118-47c5-839b-135ab6f34fae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:20.010674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca42845-9118-47c5-839b-135ab6f34fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:20.073640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 706/1401] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:20.088089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1ca42845-9118-47c5-839b-135ab6f34fae None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:20.089353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ca42845-9118-47c5-839b-135ab6f34fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:20.122357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0253214-e521-42b5-afdf-70325886d861 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:20.123643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0253214-e521-42b5-afdf-70325886d861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:20.191249 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 696/1402] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 10:59:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:20.238199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b440e-f98b-4f05-bfba-ef6f2abd485b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:20.238488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b440e-f98b-4f05-bfba-ef6f2abd485b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:20.238767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b440e-f98b-4f05-bfba-ef6f2abd485b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:20.240195 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 697/1403] 10.222.0.15 () {54 vars in 943 bytes} [Tue Jul 19 10:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 10:59:20.247383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:20.247744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:20.248087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:20.253153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0253214-e521-42b5-afdf-70325886d861 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:20.279328 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:20.279893 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:20.341018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] MFA Rules not processed for user `198dcf35a0894d4e824229e10573a251`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:20.342268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:20.385122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:20.386115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:20.386400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:20.386778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:20.388553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:20.461778 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 698/1404] 10.222.0.15 () {58 vars in 1040 bytes} [Tue Jul 19 10:59:20 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:20.472760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:20.483393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36fa00c-a55b-4bb9-a5ee-b50773b467dd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:20.488054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:20.489757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f12931-edef-4674-84d0-841f0fba9c74 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:20.509154 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 707/1405] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 10:59:20.570929 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:20.610001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:20.610828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:20.611113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:20.611390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:20.613264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:20.712413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:20.714063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19bb9ef-5839-4c19-a366-9af39971a3b2 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:20.723883 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 699/1406] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 10:59:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 10:59:22.667793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4a70-e785-46af-a995-f61a8b36df02 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:22.668428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4a70-e785-46af-a995-f61a8b36df02 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:22.668566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4a70-e785-46af-a995-f61a8b36df02 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:22.670908 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 708/1407] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 10:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:22.676649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06686-37c0-4afc-b498-5137b8df1d69 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:22.677197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06686-37c0-4afc-b498-5137b8df1d69 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:22.677555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e06686-37c0-4afc-b498-5137b8df1d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:22.773179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b6e06686-37c0-4afc-b498-5137b8df1d69 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:22.774414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b6e06686-37c0-4afc-b498-5137b8df1d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:22.851795 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:22.905340 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 700/1408] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 10:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:22.955620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4a70-e785-46af-a995-f61a8b36df02 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:22.957792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f0c4a70-e785-46af-a995-f61a8b36df02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:23.001049 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:23.174262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4a70-e785-46af-a995-f61a8b36df02 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:23.306825 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:23.322076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:23.323087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:23.323368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:23.323657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:23.325463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:23.439226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:23.440865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294837c3-baf6-4138-b268-42cb025c69d6 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:23.464298 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 709/1409] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:32.902916 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=16 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:33.460695 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=49 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:43.024829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08228e57-c068-41ba-bbb8-95120d1cb8ad None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:43.025435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08228e57-c068-41ba-bbb8-95120d1cb8ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:43.025435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08228e57-c068-41ba-bbb8-95120d1cb8ad None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:43.026749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 701/1410] 10.222.0.15 () {54 vars in 918 bytes} [Tue Jul 19 10:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:43.032277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002aa3-58cb-4c53-bea4-20dc18c4adc2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:43.032823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002aa3-58cb-4c53-bea4-20dc18c4adc2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:43.032953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2002aa3-58cb-4c53-bea4-20dc18c4adc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:43.114305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d2002aa3-58cb-4c53-bea4-20dc18c4adc2 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:43.115528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2002aa3-58cb-4c53-bea4-20dc18c4adc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:43.228098 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 710/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jul 19 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:43.244122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d94f-1c3b-44ef-aa6f-3ba1a9af10be None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:43.244437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d94f-1c3b-44ef-aa6f-3ba1a9af10be None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:43.244716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a03d94f-1c3b-44ef-aa6f-3ba1a9af10be None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:43.246116 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 702/1412] 10.222.0.15 () {54 vars in 918 bytes} [Tue Jul 19 10:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:43.251131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecd73f-9e14-4c78-8245-ba49cfd80280 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:43.251421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecd73f-9e14-4c78-8245-ba49cfd80280 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:43.251704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ecd73f-9e14-4c78-8245-ba49cfd80280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:43.331031 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:43.333835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-25ecd73f-9e14-4c78-8245-ba49cfd80280 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:43.335655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25ecd73f-9e14-4c78-8245-ba49cfd80280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:43.459957 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 711/1413] 10.222.0.15 () {58 vars in 1015 bytes} [Tue Jul 19 10:59:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:45.972234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11483591-1c96-4be6-b70c-1dbcfbdf2ff4 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:45.972888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11483591-1c96-4be6-b70c-1dbcfbdf2ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:45.972888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11483591-1c96-4be6-b70c-1dbcfbdf2ff4 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:45.974239 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 10:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:45.979922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bdfa4-a6a3-426e-ba51-a94d71d94863 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:45.980439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bdfa4-a6a3-426e-ba51-a94d71d94863 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:45.980547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5bdfa4-a6a3-426e-ba51-a94d71d94863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:46.045755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ec5bdfa4-a6a3-426e-ba51-a94d71d94863 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:46.047134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec5bdfa4-a6a3-426e-ba51-a94d71d94863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:46.105422 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:46.152435 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 10:59:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:46.195569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11483591-1c96-4be6-b70c-1dbcfbdf2ff4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:46.197570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-11483591-1c96-4be6-b70c-1dbcfbdf2ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:46.353920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11483591-1c96-4be6-b70c-1dbcfbdf2ff4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:46.429957 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:46.482332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:46.482985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:46.483269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:46.483541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:46.485223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:46.580035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:46.581683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bdcf9-2260-47a5-9972-2d3c6011a816 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:46.600081 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 704/1416] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:47.493633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efd673-bf7e-459f-972b-14c143fc9e2b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:47.494254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efd673-bf7e-459f-972b-14c143fc9e2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:47.494254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efd673-bf7e-459f-972b-14c143fc9e2b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:47.495578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:47.500893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fae622-b8b7-4532-8026-256b3e1aaa12 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:47.501369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fae622-b8b7-4532-8026-256b3e1aaa12 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:47.501471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fae622-b8b7-4532-8026-256b3e1aaa12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:47.583827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-91fae622-b8b7-4532-8026-256b3e1aaa12 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:47.585046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91fae622-b8b7-4532-8026-256b3e1aaa12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:47.612307 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:47.683699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:47.849918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efd673-bf7e-459f-972b-14c143fc9e2b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:47.851366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87efd673-bf7e-459f-972b-14c143fc9e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:48.002499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efd673-bf7e-459f-972b-14c143fc9e2b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:48.052677 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:48.134296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:48.134864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:48.135147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:48.135418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:48.137219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:48.237412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:48.239027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6794f04-94b9-49bf-9bf5-c4f84456e20e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:48.258147 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 714/1419] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:49.156854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d70669-9f75-4efb-a09e-4142f5be7da4 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:49.157413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d70669-9f75-4efb-a09e-4142f5be7da4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:49.157413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d70669-9f75-4efb-a09e-4142f5be7da4 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:49.158817 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:49.164073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ced098-8739-4ec3-82ad-1907210641eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:49.164607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ced098-8739-4ec3-82ad-1907210641eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:49.164716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ced098-8739-4ec3-82ad-1907210641eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:49.220198 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:49.244175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c0ced098-8739-4ec3-82ad-1907210641eb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:49.245459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c0ced098-8739-4ec3-82ad-1907210641eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:49.350896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:49.504309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d70669-9f75-4efb-a09e-4142f5be7da4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:49.506764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1d70669-9f75-4efb-a09e-4142f5be7da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:49.662808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d70669-9f75-4efb-a09e-4142f5be7da4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:49.675874 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:49.790404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:49.791095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:49.791374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:49.791642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:49.793399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:49.890897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:49.892563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d517a87-0cd3-42be-9646-05001cae700d service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:49.911010 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 707/1422] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:50.774944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94beff-96ef-456e-9240-b4b07f5894cc None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:50.775527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94beff-96ef-456e-9240-b4b07f5894cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:50.775527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d94beff-96ef-456e-9240-b4b07f5894cc None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:50.776919 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:50.782358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08927-9024-4724-bcec-a0d9c7c2dbad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:50.782782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08927-9024-4724-bcec-a0d9c7c2dbad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:50.782909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a08927-9024-4724-bcec-a0d9c7c2dbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:50.802756 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:50.863784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d3a08927-9024-4724-bcec-a0d9c7c2dbad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:50.865041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3a08927-9024-4724-bcec-a0d9c7c2dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:50.966444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:51.116036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94beff-96ef-456e-9240-b4b07f5894cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:51.117671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d94beff-96ef-456e-9240-b4b07f5894cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:51.245649 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:51.287023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d94beff-96ef-456e-9240-b4b07f5894cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:51.423140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:51.423801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:51.424081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:51.424441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:51.426054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:51.508083 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:51.523345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:51.525053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a69fa3-2ce3-4233-8945-19c28ef7ad2e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:51.545315 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 717/1425] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:52.399067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620688e-5023-4f38-b7ea-772795dad6d2 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:52.399639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620688e-5023-4f38-b7ea-772795dad6d2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:52.399639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5620688e-5023-4f38-b7ea-772795dad6d2 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:52.401080 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:52.406226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7208-a70b-442d-bf33-1709556b58a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:52.406705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7208-a70b-442d-bf33-1709556b58a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:52.406800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef7208-a70b-442d-bf33-1709556b58a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:52.492469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-67ef7208-a70b-442d-bf33-1709556b58a9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:52.493694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-67ef7208-a70b-442d-bf33-1709556b58a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:52.596806 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:52.745616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620688e-5023-4f38-b7ea-772795dad6d2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:52.747151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5620688e-5023-4f38-b7ea-772795dad6d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:52.836159 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:52.900988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5620688e-5023-4f38-b7ea-772795dad6d2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:53.024360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:53.025025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:53.025307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:53.025586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:53.027271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:53.077626 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:53.123276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:53.124926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed610d71-cec4-4f37-903a-efe9b9f92682 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:53.144505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 710/1428] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:53.961671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4b68-ad19-4909-be74-10d947a32783 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:53.962317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4b68-ad19-4909-be74-10d947a32783 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:53.962317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de4b68-ad19-4909-be74-10d947a32783 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:53.963628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:53.969049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d871c-cfbd-49df-a429-2ab41cade8a6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:53.969511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d871c-cfbd-49df-a429-2ab41cade8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:53.969634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d871c-cfbd-49df-a429-2ab41cade8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:54.049643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3c4d871c-cfbd-49df-a429-2ab41cade8a6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:54.050850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3c4d871c-cfbd-49df-a429-2ab41cade8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:54.155353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:54.309525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4b68-ad19-4909-be74-10d947a32783 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:54.311042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93de4b68-ad19-4909-be74-10d947a32783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:54.361829 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:54.464677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de4b68-ad19-4909-be74-10d947a32783 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:54.587391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:54.587961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:54.588232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:54.588532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:54.590164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:54.597553 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:54.691353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:54.693105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62352594-840a-4a8e-ac3a-69cd5ad568e9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:54.712001 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 720/1431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:55.525733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a61d0d-16a8-408a-b223-577485c33532 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:55.526364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a61d0d-16a8-408a-b223-577485c33532 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:55.526364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a61d0d-16a8-408a-b223-577485c33532 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:55.527725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:55.533497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a400-39da-4dcd-a42b-f5c3c39f4147 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:55.533956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a400-39da-4dcd-a42b-f5c3c39f4147 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:55.534198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0145a400-39da-4dcd-a42b-f5c3c39f4147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:55.611041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0145a400-39da-4dcd-a42b-f5c3c39f4147 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:55.612272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0145a400-39da-4dcd-a42b-f5c3c39f4147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:55.683589 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:55.715364 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:55.869452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a61d0d-16a8-408a-b223-577485c33532 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:55.870889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80a61d0d-16a8-408a-b223-577485c33532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:55.888988 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:56.026255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a61d0d-16a8-408a-b223-577485c33532 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:56.118948 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:56.147124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:56.148165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:56.148642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:56.148925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:56.150706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:56.253555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:56.255169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8936d28-5422-4b85-876d-4a96d8e34e0e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:56.275713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 713/1434] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:57.080726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e3f9d-3a56-4a63-a70e-895f437eeed1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:57.081952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e3f9d-3a56-4a63-a70e-895f437eeed1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:57.081952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907e3f9d-3a56-4a63-a70e-895f437eeed1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:57.082660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:57.087989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb8cd-abc0-4307-9a68-81ede5399801 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:57.088520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb8cd-abc0-4307-9a68-81ede5399801 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:57.088520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dbb8cd-abc0-4307-9a68-81ede5399801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:57.165999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-51dbb8cd-abc0-4307-9a68-81ede5399801 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:57.167074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-51dbb8cd-abc0-4307-9a68-81ede5399801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:57.211964 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:57.271482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 10:59:57.419772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e3f9d-3a56-4a63-a70e-895f437eeed1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:57.421222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-907e3f9d-3a56-4a63-a70e-895f437eeed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:57.576855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907e3f9d-3a56-4a63-a70e-895f437eeed1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:57.636011 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:57.702074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:57.702636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:57.702903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:57.703192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:57.704905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:57.800202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:57.801873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cef122e-e838-4580-9f96-5f7c407e0934 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:57.820885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 723/1437] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 10:59:58.635655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf866-930d-4660-b4f0-5e81cdbe0da6 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:58.636231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf866-930d-4660-b4f0-5e81cdbe0da6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:58.636231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93bf866-930d-4660-b4f0-5e81cdbe0da6 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:58.637652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 10:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 10:59:58.643233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861f09-1aa9-48b3-af44-7823acbf6061 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:58.643775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861f09-1aa9-48b3-af44-7823acbf6061 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:58.643775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8861f09-1aa9-48b3-af44-7823acbf6061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:58.727138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a8861f09-1aa9-48b3-af44-7823acbf6061 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 10:59:58.728435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8861f09-1aa9-48b3-af44-7823acbf6061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:58.730884 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:58.894292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 10:59:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 10:59:59.047438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bf866-930d-4660-b4f0-5e81cdbe0da6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 10:59:59.049030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b93bf866-930d-4660-b4f0-5e81cdbe0da6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:59.209052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93bf866-930d-4660-b4f0-5e81cdbe0da6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 10:59:59.237815 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 10:59:59.345420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 10:59:59.346096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 10:59:59.346369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 10:59:59.346662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 10:59:59.348424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 10:59:59.447836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 10:59:59.449555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a401b15-6586-424c-808f-8bba70ac0df6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 10:59:59.469611 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 716/1440] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 10:59:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:01.436310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ac29-9056-4a82-9d96-c924405ad34f None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:01.436910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ac29-9056-4a82-9d96-c924405ad34f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:01.436910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c7ac29-9056-4a82-9d96-c924405ad34f None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:01.438444 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:01.444294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846baf3f-cf98-4bf9-8f59-0c38dc6ab6c8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:01.444889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846baf3f-cf98-4bf9-8f59-0c38dc6ab6c8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:01.444994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846baf3f-cf98-4bf9-8f59-0c38dc6ab6c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:01.488904 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:01.515057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-846baf3f-cf98-4bf9-8f59-0c38dc6ab6c8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:01.516316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-846baf3f-cf98-4bf9-8f59-0c38dc6ab6c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:01.619470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:00:01.659325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ac29-9056-4a82-9d96-c924405ad34f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:01.661744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38c7ac29-9056-4a82-9d96-c924405ad34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:01.779368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c7ac29-9056-4a82-9d96-c924405ad34f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:01.813567 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:01.860930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:01.861584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:01.861869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:01.862145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:01.863827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:01.989134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:01.990631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7580d157-abeb-49b4-9d07-d383f3919afb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:02.014944 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 726/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:04.230783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60549-40fa-462f-af5d-f4af20fef2b9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:04.231413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60549-40fa-462f-af5d-f4af20fef2b9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:04.231413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da60549-40fa-462f-af5d-f4af20fef2b9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:04.232755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:04.238394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e793b-b5b8-4629-8e18-7343d0451262 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:04.238861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e793b-b5b8-4629-8e18-7343d0451262 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:04.238962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e793b-b5b8-4629-8e18-7343d0451262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:04.304818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df4e793b-b5b8-4629-8e18-7343d0451262 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:04.306059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df4e793b-b5b8-4629-8e18-7343d0451262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:04.319548 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:04.408698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:04.447826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da60549-40fa-462f-af5d-f4af20fef2b9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:04.449418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1da60549-40fa-462f-af5d-f4af20fef2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:04.566368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da60549-40fa-462f-af5d-f4af20fef2b9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:04.580865 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:04.660020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:04.661369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:04.661657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:04.661949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:04.663618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:04.787585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:04.789104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed618c-3b3b-4bb8-a230-04a0d74a4ba4 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:04.809976 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 719/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:00:07.276759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5725-53ef-4a6e-984d-f93a88009fc4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:07.277345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5725-53ef-4a6e-984d-f93a88009fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:07.277345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dc5725-53ef-4a6e-984d-f93a88009fc4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:07.278754 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:07.285381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d6ce-056a-406f-b596-d71336f17c01 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:07.286147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d6ce-056a-406f-b596-d71336f17c01 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:07.286324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d6ce-056a-406f-b596-d71336f17c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:07.341502 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:07.361795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4df4d6ce-056a-406f-b596-d71336f17c01 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:07.363060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4df4d6ce-056a-406f-b596-d71336f17c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:07.468089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:07.508356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5725-53ef-4a6e-984d-f93a88009fc4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:07.509901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2dc5725-53ef-4a6e-984d-f93a88009fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:07.619892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dc5725-53ef-4a6e-984d-f93a88009fc4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:07.663471 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:07.701148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:07.701799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:07.702078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:07.702349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:07.704430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:07.955179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:07.956775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef94f5d-9744-47fc-b7f7-0febaebf2bd5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:07.978732 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 729/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:10.141751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fd96-50ce-48d8-9858-bc5d36e061b8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:10.142361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fd96-50ce-48d8-9858-bc5d36e061b8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:10.142361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205fd96-50ce-48d8-9858-bc5d36e061b8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:10.143797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:10.150734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d0b88-1b28-443d-8dde-eb4bae7b7e6d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:10.151245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d0b88-1b28-443d-8dde-eb4bae7b7e6d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:10.151660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950d0b88-1b28-443d-8dde-eb4bae7b7e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:10.224849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-950d0b88-1b28-443d-8dde-eb4bae7b7e6d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:10.226066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-950d0b88-1b28-443d-8dde-eb4bae7b7e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:10.248547 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:10.327926 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:10.370544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fd96-50ce-48d8-9858-bc5d36e061b8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:10.372932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f205fd96-50ce-48d8-9858-bc5d36e061b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:10.497745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205fd96-50ce-48d8-9858-bc5d36e061b8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:10.518398 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:10.575312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:10.575960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:10.576236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:10.576542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:10.578231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:10.704516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:10.705842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96734dc-a682-4bf9-af64-5e5ee1faa92d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:10.727716 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 722/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:12.913853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831b959-6e64-456f-8b49-054ad3e4c562 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:12.914461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831b959-6e64-456f-8b49-054ad3e4c562 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:12.914461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3831b959-6e64-456f-8b49-054ad3e4c562 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:12.915859 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:12.921469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5ea91-917f-4591-b016-0cc32713ee4b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:12.921947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5ea91-917f-4591-b016-0cc32713ee4b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:12.922054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e5ea91-917f-4591-b016-0cc32713ee4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:12.990167 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:12.994276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-26e5ea91-917f-4591-b016-0cc32713ee4b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:12.997263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-26e5ea91-917f-4591-b016-0cc32713ee4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:13.126137 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:13.165277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831b959-6e64-456f-8b49-054ad3e4c562 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:13.166797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3831b959-6e64-456f-8b49-054ad3e4c562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:13.285362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3831b959-6e64-456f-8b49-054ad3e4c562 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:13.357600 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:13.386514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:13.387176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:13.387466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:13.387717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:13.389752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:13.511468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:13.512965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0285f7a5-e7df-411e-801e-126ab468b1eb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:13.533478 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 732/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:15.646771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d40498-30dc-49d0-9367-6842a2bb0a60 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:15.647414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d40498-30dc-49d0-9367-6842a2bb0a60 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:15.647414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d40498-30dc-49d0-9367-6842a2bb0a60 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:15.648778 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:15.654850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8382a1-29c7-4877-a0d8-4f8803fdda6e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:15.655376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8382a1-29c7-4877-a0d8-4f8803fdda6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:15.655376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8382a1-29c7-4877-a0d8-4f8803fdda6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:15.726445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ac8382a1-29c7-4877-a0d8-4f8803fdda6e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:15.727664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ac8382a1-29c7-4877-a0d8-4f8803fdda6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:15.758082 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:15.834680 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:15.874214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d40498-30dc-49d0-9367-6842a2bb0a60 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:15.875945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c1d40498-30dc-49d0-9367-6842a2bb0a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:16.004487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d40498-30dc-49d0-9367-6842a2bb0a60 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:16.035780 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:16.086116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:16.086773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:16.087049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:16.087316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:16.088973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:16.206512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:16.207932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8671cd-7699-4252-8fc4-920e35c6a7cf service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:16.227095 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 725/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:18.324427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a2fc-86d7-4673-aad5-99ac55559829 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:18.325019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a2fc-86d7-4673-aad5-99ac55559829 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:18.325019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a2fc-86d7-4673-aad5-99ac55559829 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:18.326312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:18.332683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb9539-5683-4857-85ae-7d247ca22afd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:18.333215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb9539-5683-4857-85ae-7d247ca22afd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:18.333306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb9539-5683-4857-85ae-7d247ca22afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:18.414925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-37eb9539-5683-4857-85ae-7d247ca22afd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:18.416925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-37eb9539-5683-4857-85ae-7d247ca22afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:18.428655 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:18.548111 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:18.586678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a2fc-86d7-4673-aad5-99ac55559829 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:18.588194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b202a2fc-86d7-4673-aad5-99ac55559829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:18.711883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a2fc-86d7-4673-aad5-99ac55559829 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:18.777322 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:18.799606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:18.800644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:18.801000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:18.801339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:18.803212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:18.925797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:18.927171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451502a-d147-4b5f-a972-adcba8c6488e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:18.948921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 735/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:21.074151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38df3-dfba-436b-8a36-734d71a9c23c None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:21.074723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38df3-dfba-436b-8a36-734d71a9c23c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:21.074723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf38df3-dfba-436b-8a36-734d71a9c23c None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:21.076102 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:21.082339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8298-8013-4634-8aba-dcf392b3d2c8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:21.082870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8298-8013-4634-8aba-dcf392b3d2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:21.082870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac8298-8013-4634-8aba-dcf392b3d2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:21.159048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b6ac8298-8013-4634-8aba-dcf392b3d2c8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:21.160266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6ac8298-8013-4634-8aba-dcf392b3d2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:21.202604 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:21.265929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:21.303578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38df3-dfba-436b-8a36-734d71a9c23c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:21.305217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eaf38df3-dfba-436b-8a36-734d71a9c23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:21.421616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf38df3-dfba-436b-8a36-734d71a9c23c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:21.462862 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:21.502390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:21.503067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:21.503347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:21.503632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:21.505415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:21.621580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:21.622937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e16497-4ede-4690-9a52-a6dbce840e3b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:21.642090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 728/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:23.714872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad7f47-e2f9-4042-af3a-90fd6901c7aa None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:23.715434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad7f47-e2f9-4042-af3a-90fd6901c7aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:23.715434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ad7f47-e2f9-4042-af3a-90fd6901c7aa None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:23.716863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:23.722666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b5d03-e21e-48ea-86bd-ddc8b38d9b22 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:23.723159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b5d03-e21e-48ea-86bd-ddc8b38d9b22 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:23.723282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786b5d03-e21e-48ea-86bd-ddc8b38d9b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:23.795713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-786b5d03-e21e-48ea-86bd-ddc8b38d9b22 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:23.796971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-786b5d03-e21e-48ea-86bd-ddc8b38d9b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:23.819427 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:23.906731 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:23.944781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad7f47-e2f9-4042-af3a-90fd6901c7aa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:23.946314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96ad7f47-e2f9-4042-af3a-90fd6901c7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:24.068908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ad7f47-e2f9-4042-af3a-90fd6901c7aa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:24.141947 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:24.149938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:24.150590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:24.150873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:24.151152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:24.152913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:24.274696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:24.276188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f0744-561b-44ca-a4d5-6bed8374d9a9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:24.295124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 738/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:26.335072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb347-af1d-4132-8a4e-4a997c2fb6dd None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:26.335628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb347-af1d-4132-8a4e-4a997c2fb6dd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:26.335628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471bb347-af1d-4132-8a4e-4a997c2fb6dd None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:26.336970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:26.342567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c44b-58fc-425c-ab53-b0828de58387 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:26.343066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c44b-58fc-425c-ab53-b0828de58387 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:26.343066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be1c44b-58fc-425c-ab53-b0828de58387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:26.411256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8be1c44b-58fc-425c-ab53-b0828de58387 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:26.412489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8be1c44b-58fc-425c-ab53-b0828de58387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:26.461775 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:26.517411 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:00:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:26.555145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bb347-af1d-4132-8a4e-4a997c2fb6dd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:26.558045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-471bb347-af1d-4132-8a4e-4a997c2fb6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:26.670570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471bb347-af1d-4132-8a4e-4a997c2fb6dd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:26.724172 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:26.752956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:26.753611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:26.753890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:26.754165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:26.755805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:26.870528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:26.871981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56729911-5361-460f-8d86-aea644cdb2fe service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:26.890673 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 731/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:36.515380 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=22 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:36.888231 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=66 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:46.616874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c298e-d865-48de-8e9e-92f9ddcc6587 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:46.617513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c298e-d865-48de-8e9e-92f9ddcc6587 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:46.617513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5c298e-d865-48de-8e9e-92f9ddcc6587 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:46.618869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 740/1471] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:46.624360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c1c1-dd20-4c6e-a9f1-25f1dfb93f36 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:46.624853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c1c1-dd20-4c6e-a9f1-25f1dfb93f36 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:46.624951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b7c1c1-dd20-4c6e-a9f1-25f1dfb93f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:46.693212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54b7c1c1-dd20-4c6e-a9f1-25f1dfb93f36 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:46.694728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54b7c1c1-dd20-4c6e-a9f1-25f1dfb93f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:46.798341 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 732/1472] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:46.886492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec94f7-e699-4404-a897-fbc28368d1c5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:46.886867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec94f7-e699-4404-a897-fbc28368d1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:46.887085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ec94f7-e699-4404-a897-fbc28368d1c5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:46.888506 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 741/1473] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jul 19 11:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:46.893752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe900-a221-4f41-af76-525012a73118 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:46.894073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe900-a221-4f41-af76-525012a73118 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:46.894346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08fe900-a221-4f41-af76-525012a73118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:46.974563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f08fe900-a221-4f41-af76-525012a73118 None None] MFA Rules not processed for user `2bbe7cd61ad745a9833acd3d3e4a066d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:46.975792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f08fe900-a221-4f41-af76-525012a73118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:46.998829 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:47.059695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 733/1474] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 11:00:46 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:47.067693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec94f7-e699-4404-a897-fbc28368d1c5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:47.069222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5ec94f7-e699-4404-a897-fbc28368d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:47.174417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ec94f7-e699-4404-a897-fbc28368d1c5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:47.251349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:47.252002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:47.252293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:47.252590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:47.254242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:47.309393 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:47.368752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:47.370196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b10c-bb0d-4351-8800-e1d0a0331673 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:47.391639 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 742/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:49.507048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f0e67-c5e4-4405-8d89-d477c8205c3e None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:49.507571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f0e67-c5e4-4405-8d89-d477c8205c3e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:49.507571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f0e67-c5e4-4405-8d89-d477c8205c3e None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:49.509094 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 734/1476] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:00:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:49.514803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee91ea-4e65-486e-a219-588f26b140c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:49.515257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee91ea-4e65-486e-a219-588f26b140c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:49.515382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee91ea-4e65-486e-a219-588f26b140c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:49.587460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-92ee91ea-4e65-486e-a219-588f26b140c2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:49.588786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92ee91ea-4e65-486e-a219-588f26b140c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:49.694506 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 743/1477] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:49.718313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f0e67-c5e4-4405-8d89-d477c8205c3e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:49.719919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4e1f0e67-c5e4-4405-8d89-d477c8205c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:49.855915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f0e67-c5e4-4405-8d89-d477c8205c3e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:49.910541 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:49.957806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:49.958507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:49.958783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:49.959055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:49.959794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:49.961664 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:00:49.961664 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:00:49.961664 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:00:49.962809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64036a8a-2383-45ab-90b5-57ba4dcad9e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:49.982723 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 735/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Tue Jul 19 11:00:49 2022] GET /identity/v3/projects => generated 2553 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:00:52.074799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb99a-3148-46ae-9c5f-2e1eb0ce0526 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:52.075342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb99a-3148-46ae-9c5f-2e1eb0ce0526 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:52.075342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fb99a-3148-46ae-9c5f-2e1eb0ce0526 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:52.076923 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 744/1479] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:00:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:52.083250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318de76-d851-40e3-9fa9-5208a493bcbb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:52.083746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318de76-d851-40e3-9fa9-5208a493bcbb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:52.083849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318de76-d851-40e3-9fa9-5208a493bcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:52.156810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d318de76-d851-40e3-9fa9-5208a493bcbb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:52.158033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d318de76-d851-40e3-9fa9-5208a493bcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:52.380820 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 736/1480] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:52.430206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb99a-3148-46ae-9c5f-2e1eb0ce0526 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:52.430206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a70fb99a-3148-46ae-9c5f-2e1eb0ce0526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:52.440862 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:52.602212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fb99a-3148-46ae-9c5f-2e1eb0ce0526 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:52.687081 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:52.720965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:52.721647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:52.721930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:52.722206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:52.723883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:52.822385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:52.824013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709f454f-fdff-4891-9294-69b33d836a31 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:52.842964 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 745/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:55.034451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a7ee7-9dcc-4b96-928b-55ce06935ba1 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:55.035015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a7ee7-9dcc-4b96-928b-55ce06935ba1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:55.035015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a7ee7-9dcc-4b96-928b-55ce06935ba1 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:55.036281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 737/1482] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:55.041802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8132-6b9a-403b-8af6-858ba50b2631 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:55.042285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8132-6b9a-403b-8af6-858ba50b2631 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:55.042285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af8132-6b9a-403b-8af6-858ba50b2631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:55.112493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-34af8132-6b9a-403b-8af6-858ba50b2631 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:55.113726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34af8132-6b9a-403b-8af6-858ba50b2631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:55.163247 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:55.217979 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 746/1483] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:55.255251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a7ee7-9dcc-4b96-928b-55ce06935ba1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:55.256868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f1a7ee7-9dcc-4b96-928b-55ce06935ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:55.281983 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:55.368002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a7ee7-9dcc-4b96-928b-55ce06935ba1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:55.446213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:55.446877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:55.447162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:55.447434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:55.450770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:55.539661 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:55.576849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:55.578282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf76840-8006-4e00-9678-b4a11b61211f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:55.598617 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 738/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:00:57.728283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed025a8b-79c7-46aa-ad5c-22686713646e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:57.728892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed025a8b-79c7-46aa-ad5c-22686713646e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:57.728892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed025a8b-79c7-46aa-ad5c-22686713646e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:57.730557 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 747/1485] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:00:57.736130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64bfbd-4eff-43a4-b738-e5297ddaed54 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:57.736690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64bfbd-4eff-43a4-b738-e5297ddaed54 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:57.736690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea64bfbd-4eff-43a4-b738-e5297ddaed54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:57.808746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ea64bfbd-4eff-43a4-b738-e5297ddaed54 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:00:57.809964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ea64bfbd-4eff-43a4-b738-e5297ddaed54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:57.912228 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 739/1486] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:00:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:00:57.951016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed025a8b-79c7-46aa-ad5c-22686713646e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:00:57.952610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed025a8b-79c7-46aa-ad5c-22686713646e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:58.066000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed025a8b-79c7-46aa-ad5c-22686713646e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:00:58.139273 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:00:58.141128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:00:58.141885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:00:58.142299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:00:58.142616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:00:58.144795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:00:58.257954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:00:58.259405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455885-14b5-403a-8057-d2b449c43a95 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:00:58.277830 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 748/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:00:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:01:00.468198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb42ab-2922-4dfd-8358-c6a4d1e6b7ea None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:00.468840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb42ab-2922-4dfd-8358-c6a4d1e6b7ea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:00.468938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb42ab-2922-4dfd-8358-c6a4d1e6b7ea None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:00.470667 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 740/1488] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:01:00.476687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f489e10-cf99-40aa-9683-1321cf1fde3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:00.477158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f489e10-cf99-40aa-9683-1321cf1fde3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:00.477257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f489e10-cf99-40aa-9683-1321cf1fde3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:00.544921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f489e10-cf99-40aa-9683-1321cf1fde3c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:00.546153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f489e10-cf99-40aa-9683-1321cf1fde3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:00.608370 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:00.658999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 749/1489] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:01:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:01:00.700002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb42ab-2922-4dfd-8358-c6a4d1e6b7ea None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:00.701635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aafb42ab-2922-4dfd-8358-c6a4d1e6b7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:00.740864 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:00.820025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb42ab-2922-4dfd-8358-c6a4d1e6b7ea None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:00.901898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:00.902551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:00.902828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:00.903095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:00.904774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:00.996017 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:01.027032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:01.028602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102fbe9-1aa8-4aec-ace4-66cbb61173a1 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:01.047570 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 741/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:01:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:01:03.297357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c4c3-7075-4ad2-a722-3354beac7ee6 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:03.297952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c4c3-7075-4ad2-a722-3354beac7ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:03.297952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464c4c3-7075-4ad2-a722-3354beac7ee6 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:03.299283 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 750/1491] 10.222.0.15 () {54 vars in 926 bytes} [Tue Jul 19 11:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:01:03.305812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388781ac-2739-42a9-946a-3e9e37f89be5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:03.306340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388781ac-2739-42a9-946a-3e9e37f89be5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:03.306340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388781ac-2739-42a9-946a-3e9e37f89be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:03.379145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-388781ac-2739-42a9-946a-3e9e37f89be5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:01:03.380285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-388781ac-2739-42a9-946a-3e9e37f89be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:03.481110 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 742/1492] 10.222.0.15 () {58 vars in 1023 bytes} [Tue Jul 19 11:01:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:01:03.520536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c4c3-7075-4ad2-a722-3354beac7ee6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:01:03.522075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2464c4c3-7075-4ad2-a722-3354beac7ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:03.634063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464c4c3-7075-4ad2-a722-3354beac7ee6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:01:03.710052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:01:03.710697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:01:03.710978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:01:03.711248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:01:03.712909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:01:03.722080 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:03.829794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:01:03.831252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252c4798-c540-47ff-8de3-fffcef4ad074 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:01:03.849715 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 751/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:01:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:01:13.478783 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=82 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:01:13.847270 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=50 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:31.937251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:31.938183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:31.938183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:32.036263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:02:32.038204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:32.141392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 743/1494] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:02:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:02:32.153594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:32.154129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:32.154129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:32.238008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:02:32.239259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:32.343214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 752/1495] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:02:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:02:32.348294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:32.349559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:32.361696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a80cf-c3ab-4da8-a95d-c9813b0fad37 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:32.426299 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:32.463738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:32.464522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:32.464799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:32.465070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:32.465803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:02:32.466106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:32.467128 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:32.467128 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:02:32.467128 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:02:32.468016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:32.485973 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 744/1496] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:02:32.497983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:32.508200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1d947-9c8d-442e-bd76-3ab2841d7606 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:32.576606 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:32.611664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:32.612324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:32.612652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:32.612923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:32.613604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:32.615342 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:32.615342 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:02:32.615342 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:02:32.616563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:32.679091 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 753/1497] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:02:32 2022] POST /identity/v3/projects => generated 379 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:02:32.683542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:32.685127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:32.721534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0eb1a2-cf7b-4965-9560-5b4360438fa5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:32.824492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:32.825205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:32.825478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:32.825760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:32.826440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:32.827455 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:32.827455 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:02:32.827455 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:02:32.828643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:32.888327 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 745/1498] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:02:32 2022] POST /identity/v3/users => generated 290 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:02:32.892842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:32.894353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:32.971115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dfebfb-0b42-4bf6-9bae-982fd14917a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:33.074726 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:33.090392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:33.091077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:33.091361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:33.091633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:33.092373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:33.093505 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:33.093505 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:02:33.093505 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:02:33.094379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:33.108453 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 754/1499] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:02:33.113410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:33.115461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:33.130053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ee52c3-9689-4784-afcf-d2bdd520ffc3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:33.161464 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:33.243200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:33.243893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:33.244168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:33.244465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:33.245294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:33.246259 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:33.246259 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:02:33.246259 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:02:33.247136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9a3f22-7aeb-42e2-9b8c-745698c3ac0a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:33.259581 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 746/1500] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:02:33 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:02:33.264407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:33.265919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:33.307544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196ae47c-b29b-48b8-ac45-42692b7c118c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:33.424066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:33.425186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:33.425736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:33.426049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] PATH_INFO: `/v3/projects/5eefa23c846e4911bc69d32d299fed0c/users/95548e0a348c41028452f2e05de35a6d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:33.451527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eefa23c846e4911bc69d32d299fed0c, user_id=95548e0a348c41028452f2e05de35a6d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:33.452630 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:33.452630 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:02:33.452630 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:02:33.454597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ec95b-2dc7-4112-904b-dca93639d1bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:33.482590 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 755/1501] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:02:33 2022] PUT /identity/v3/projects/5eefa23c846e4911bc69d32d299fed0c/users/95548e0a348c41028452f2e05de35a6d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:02:33.499203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e327b-9563-4897-bcdc-f44f43cdfc70 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:33.499484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e327b-9563-4897-bcdc-f44f43cdfc70 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:33.499791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e327b-9563-4897-bcdc-f44f43cdfc70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:33.558957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-199e327b-9563-4897-bcdc-f44f43cdfc70 None None] MFA Rules not processed for user `95548e0a348c41028452f2e05de35a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:02:33.560186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-199e327b-9563-4897-bcdc-f44f43cdfc70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:33.644180 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 747/1502] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:02:33.657803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172f02f-7b03-43ee-a8e2-c3526d2b7282 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:33.658069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172f02f-7b03-43ee-a8e2-c3526d2b7282 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:33.658388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6172f02f-7b03-43ee-a8e2-c3526d2b7282 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:33.659819 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 756/1503] 10.222.0.15 () {54 vars in 964 bytes} [Tue Jul 19 11:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:02:33.664771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690aee0-106d-4da8-8153-4693ee806eed None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:33.665058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690aee0-106d-4da8-8153-4693ee806eed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:33.665331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690aee0-106d-4da8-8153-4693ee806eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:33.696393 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:33.743237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1690aee0-106d-4da8-8153-4693ee806eed None None] MFA Rules not processed for user `55aac242daf746b283fb3cb561b3462e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:02:33.744542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1690aee0-106d-4da8-8153-4693ee806eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:33.827834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 748/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Jul 19 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:02:33.839071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172f02f-7b03-43ee-a8e2-c3526d2b7282 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:33.840754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6172f02f-7b03-43ee-a8e2-c3526d2b7282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:33.896647 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:33.966368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6172f02f-7b03-43ee-a8e2-c3526d2b7282 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:34.051451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:34.052145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:34.052471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:34.052747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:34.054425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:34.161575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:34.163036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:34.166698 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:34.182818 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 757/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:02:34.227614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3eb0-b1c9-477c-9b84-cae45add794d None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:34.228080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3eb0-b1c9-477c-9b84-cae45add794d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:34.228176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa3eb0-b1c9-477c-9b84-cae45add794d None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:34.229553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 749/1506] 10.222.0.15 () {52 vars in 829 bytes} [Tue Jul 19 11:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:02:34.233555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:34.234805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:34.346669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18131c59-5a72-4d43-8fac-4f3f337c9a3e service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:34.456532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:34.457329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:34.457609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:34.457887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] PATH_INFO: `/v3/users/95548e0a348c41028452f2e05de35a6d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:34.473531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95548e0a348c41028452f2e05de35a6d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:34.474582 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:34.474582 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:02:34.474582 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:02:34.475849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:34.486612 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:34.548100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95548e0a348c41028452f2e05de35a6d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:34.548570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95548e0a348c41028452f2e05de35a6d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:34.564502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95548e0a348c41028452f2e05de35a6d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:34.565005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95548e0a348c41028452f2e05de35a6d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:34.577590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95548e0a348c41028452f2e05de35a6d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:34.604852 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 758/1507] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:02:34 2022] DELETE /identity/v3/users/95548e0a348c41028452f2e05de35a6d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:02:34.611136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:34.611451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:34.611761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:34.672090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:02:34.673328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:34.755187 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:34.767607 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 750/1508] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:02:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:02:34.777645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:34.779018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:34.898667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc69bab-515d-4886-8695-c250b82354a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:34.957552 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:34.981188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:34.981854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:34.982137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:34.982409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:34.984089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:35.100672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:35.102493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e6bc8-c3e1-4930-a5a9-80361af6fb60 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:35.123463 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 759/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:02:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:02:35.546922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:02:35.548235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:02:35.561856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efef76-d2b7-4aa2-bf9a-b52b51346003 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:02:35.675229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:02:35.675999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:02:35.676276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:02:35.676580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] PATH_INFO: `/v3/projects/5eefa23c846e4911bc69d32d299fed0c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:02:35.686837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eefa23c846e4911bc69d32d299fed0c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:02:35.687874 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:02:35.687874 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:02:35.687874 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:02:35.689101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:02:35.749460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eefa23c846e4911bc69d32d299fed0c', 'request_id': 'req-7e88921c-179b-40a7-bbb0-358aaee05415'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:35.760191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eefa23c846e4911bc69d32d299fed0c', 'request_id': 'req-7e88921c-179b-40a7-bbb0-358aaee05415'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:35.773741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eefa23c846e4911bc69d32d299fed0c', 'request_id': 'req-7e88921c-179b-40a7-bbb0-358aaee05415'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:35.796448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] The token cache is being invalidate because project 5eefa23c846e4911bc69d32d299fed0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:02:35.796728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:35.797149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e88921c-179b-40a7-bbb0-358aaee05415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:02:35.798601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 751/1510] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:02:35 2022] DELETE /identity/v3/projects/5eefa23c846e4911bc69d32d299fed0c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:02:45.120615 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=62 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:02:45.794425 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:05:49.648027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ead0-267e-4072-8d9f-240becc2ff70 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:49.648677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ead0-267e-4072-8d9f-240becc2ff70 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:49.648677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59ead0-267e-4072-8d9f-240becc2ff70 None None] PATH_INFO: `/v3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:49.649921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 760/1511] 10.222.0.16 () {54 vars in 925 bytes} [Tue Jul 19 11:05:49 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:49.664159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd63bb-053c-4e75-84b7-843204230883 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:49.664856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd63bb-053c-4e75-84b7-843204230883 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:49.664856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd63bb-053c-4e75-84b7-843204230883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:49.820434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a4dd63bb-053c-4e75-84b7-843204230883 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:49.822523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a4dd63bb-053c-4e75-84b7-843204230883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:49.967159 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 752/1512] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 19 11:05:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:51.431949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082983ae-0d0c-4234-afed-d10870e06090 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:51.432609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082983ae-0d0c-4234-afed-d10870e06090 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:51.432835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082983ae-0d0c-4234-afed-d10870e06090 None None] PATH_INFO: `/v3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:51.434515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 761/1513] 10.222.0.49 () {54 vars in 925 bytes} [Tue Jul 19 11:05:51 2022] GET /identity/v3 => generated 255 bytes in 5 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:05:51.441325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0366f6-6d75-4107-a52d-599056b79d0c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:51.442110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0366f6-6d75-4107-a52d-599056b79d0c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:51.442110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0366f6-6d75-4107-a52d-599056b79d0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:51.465609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5a0366f6-6d75-4107-a52d-599056b79d0c None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:51.466921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a0366f6-6d75-4107-a52d-599056b79d0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:51.477959 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 753/1514] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jul 19 11:05:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:59.436624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491ed35-a6bb-4e4a-98cc-63073b86ab09 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:59.437301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491ed35-a6bb-4e4a-98cc-63073b86ab09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:59.437301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491ed35-a6bb-4e4a-98cc-63073b86ab09 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:59.438518 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 762/1515] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jul 19 11:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:05:59.444929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:59.445523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:59.445898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:59.476572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:05:59.478638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:05:59.494040 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 754/1516] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 11:05:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:05:59.502471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491ed35-a6bb-4e4a-98cc-63073b86ab09 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:59.519936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491ed35-a6bb-4e4a-98cc-63073b86ab09 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:59.525803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11327c-bd5b-4b0d-986a-f2b78baf4828 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:59.526534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11327c-bd5b-4b0d-986a-f2b78baf4828 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:59.526872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11327c-bd5b-4b0d-986a-f2b78baf4828 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:59.527247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11327c-bd5b-4b0d-986a-f2b78baf4828 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:59.537301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11327c-bd5b-4b0d-986a-f2b78baf4828 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:59.539184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11327c-bd5b-4b0d-986a-f2b78baf4828 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:59.550974 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 763/1517] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:05:59.818452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:05:59.830021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee9340d-f12e-48b1-a6f6-2a5b67cf8a48 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:05:59.836828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65cbe7f-7ed6-4648-b044-818ab8f6e695 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:05:59.837598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cbe7f-7ed6-4648-b044-818ab8f6e695 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:05:59.837941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cbe7f-7ed6-4648-b044-818ab8f6e695 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:05:59.838279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65cbe7f-7ed6-4648-b044-818ab8f6e695 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:05:59.849086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cbe7f-7ed6-4648-b044-818ab8f6e695 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:05:59.850867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65cbe7f-7ed6-4648-b044-818ab8f6e695 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:05:59.863336 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 755/1518] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:05:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:09.545868 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:09.858177 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:18.847950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a0c80-0605-485a-a3e5-baa5f846ab8e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:18.848765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a0c80-0605-485a-a3e5-baa5f846ab8e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:18.848912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a0c80-0605-485a-a3e5-baa5f846ab8e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:18.850791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 11:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:06:18.857678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13937f-616b-4412-bc60-f6f80ac0ddfb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:18.858311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13937f-616b-4412-bc60-f6f80ac0ddfb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:18.858311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa13937f-616b-4412-bc60-f6f80ac0ddfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:18.951489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fa13937f-616b-4412-bc60-f6f80ac0ddfb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:18.953545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fa13937f-616b-4412-bc60-f6f80ac0ddfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:19.081229 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 11:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:19.248408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a0c80-0605-485a-a3e5-baa5f846ab8e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:19.250490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e5a0c80-0605-485a-a3e5-baa5f846ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:19.380235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a0c80-0605-485a-a3e5-baa5f846ab8e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:19.386045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63583202-9fc5-41e9-80d0-b462202838e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:19.386727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63583202-9fc5-41e9-80d0-b462202838e7 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:19.387014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63583202-9fc5-41e9-80d0-b462202838e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:19.387293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63583202-9fc5-41e9-80d0-b462202838e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:19.396777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63583202-9fc5-41e9-80d0-b462202838e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:19.398460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63583202-9fc5-41e9-80d0-b462202838e7 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:19.409514 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 765/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:20.334683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f7548-5944-47d1-ac35-35e1ddef1d6d None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:20.335579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f7548-5944-47d1-ac35-35e1ddef1d6d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:20.335579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f7548-5944-47d1-ac35-35e1ddef1d6d None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:20.337245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 757/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 19 11:06:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:06:20.343270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7e609-34a0-4bce-ba29-4e9cb5b5f3fb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:20.343837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7e609-34a0-4bce-ba29-4e9cb5b5f3fb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:20.343951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b7e609-34a0-4bce-ba29-4e9cb5b5f3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:20.366705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28b7e609-34a0-4bce-ba29-4e9cb5b5f3fb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:20.367963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28b7e609-34a0-4bce-ba29-4e9cb5b5f3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:20.380389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 766/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 19 11:06:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:20.542773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f7548-5944-47d1-ac35-35e1ddef1d6d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:20.559746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f7548-5944-47d1-ac35-35e1ddef1d6d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:20.565880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67395c7-1fda-4b64-a8e9-ed643d51a982 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:20.566577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67395c7-1fda-4b64-a8e9-ed643d51a982 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:20.566936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67395c7-1fda-4b64-a8e9-ed643d51a982 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:20.567213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67395c7-1fda-4b64-a8e9-ed643d51a982 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:20.580110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67395c7-1fda-4b64-a8e9-ed643d51a982 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:20.581773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67395c7-1fda-4b64-a8e9-ed643d51a982 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:20.593788 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 758/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:24.522874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58afbd-ff1f-4d0b-9f05-03df3295416a None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:24.523518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58afbd-ff1f-4d0b-9f05-03df3295416a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:24.523518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58afbd-ff1f-4d0b-9f05-03df3295416a None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:24.524948 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:06:24.531081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49286a15-94e9-4e20-a61b-4b955a4783af None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:24.531627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49286a15-94e9-4e20-a61b-4b955a4783af None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:24.531627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49286a15-94e9-4e20-a61b-4b955a4783af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:24.552372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-49286a15-94e9-4e20-a61b-4b955a4783af None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:24.553654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49286a15-94e9-4e20-a61b-4b955a4783af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:24.562228 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:06:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:24.655949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58afbd-ff1f-4d0b-9f05-03df3295416a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:24.658034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e58afbd-ff1f-4d0b-9f05-03df3295416a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:24.760893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58afbd-ff1f-4d0b-9f05-03df3295416a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:24.765124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4709875c-62f2-4126-8425-c19c62aa166d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:24.765882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709875c-62f2-4126-8425-c19c62aa166d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:24.766222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709875c-62f2-4126-8425-c19c62aa166d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:24.766541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4709875c-62f2-4126-8425-c19c62aa166d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:24.778136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709875c-62f2-4126-8425-c19c62aa166d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:24.779948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4709875c-62f2-4126-8425-c19c62aa166d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:24.791837 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 768/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:26.943281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6965a-33d1-4167-a5f0-ad2aa1a28c44 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:26.944210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6965a-33d1-4167-a5f0-ad2aa1a28c44 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:26.944210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6965a-33d1-4167-a5f0-ad2aa1a28c44 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:26.946045 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 19 11:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:06:26.952600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80485eeb-7032-47d9-9626-e87fcd1d217d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:26.953491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80485eeb-7032-47d9-9626-e87fcd1d217d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:26.953491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80485eeb-7032-47d9-9626-e87fcd1d217d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:26.974949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-80485eeb-7032-47d9-9626-e87fcd1d217d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:06:26.976188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80485eeb-7032-47d9-9626-e87fcd1d217d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:06:26.985582 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 19 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:06:27.024146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6965a-33d1-4167-a5f0-ad2aa1a28c44 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:06:27.036546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6965a-33d1-4167-a5f0-ad2aa1a28c44 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:06:27.040653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bfc38-d3e2-4c5b-961b-2805f3b66730 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:06:27.041370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bfc38-d3e2-4c5b-961b-2805f3b66730 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:06:27.041650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bfc38-d3e2-4c5b-961b-2805f3b66730 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:06:27.041918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bfc38-d3e2-4c5b-961b-2805f3b66730 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:06:27.053155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bfc38-d3e2-4c5b-961b-2805f3b66730 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:06:27.054868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bfc38-d3e2-4c5b-961b-2805f3b66730 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:06:27.067279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 761/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:06:36.969255 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:06:37.062388 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=65 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:07:20.908698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76970205-7527-4a7e-8a30-4dc4f6c54e89 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:20.909498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76970205-7527-4a7e-8a30-4dc4f6c54e89 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:20.909498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76970205-7527-4a7e-8a30-4dc4f6c54e89 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:20.911256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 770/1531] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:07:20.918748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2923-73c8-4e5a-9d31-3cf0db7a4245 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:07:20.919298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2923-73c8-4e5a-9d31-3cf0db7a4245 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:07:20.919894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa2923-73c8-4e5a-9d31-3cf0db7a4245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:07:20.951990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-75fa2923-73c8-4e5a-9d31-3cf0db7a4245 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:07:20.953589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-75fa2923-73c8-4e5a-9d31-3cf0db7a4245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:07:20.972529 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 762/1532] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:07:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:07:30.945088 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:01.199419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.200053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.200053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.229557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:01.231034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:01.245502 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 771/1533] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:01.255835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6b455-b3b9-4523-8ed1-eebda9bbf2c9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.256990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6b455-b3b9-4523-8ed1-eebda9bbf2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.257477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb6b455-b3b9-4523-8ed1-eebda9bbf2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.281156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ecb6b455-b3b9-4523-8ed1-eebda9bbf2c9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:01.283527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ecb6b455-b3b9-4523-8ed1-eebda9bbf2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:01.299298 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 763/1534] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:01.304727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.321904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246d4eeb-9e9b-4a02-be9d-a4ba520c5d3b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.332516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.333235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.333525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.333803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.334569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:01.334882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.335971 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:08:01.335971 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:08:01.335971 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:08:01.336946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.348519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9042-74ad-47e9-bb2f-b32ef9defb03 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.349293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9042-74ad-47e9-bb2f-b32ef9defb03 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.349768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9042-74ad-47e9-bb2f-b32ef9defb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.360660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 772/1535] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:01.380637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aede9042-74ad-47e9-bb2f-b32ef9defb03 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:01.382501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aede9042-74ad-47e9-bb2f-b32ef9defb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:01.386512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.400381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a8210-516e-4ed6-b452-f27c28048d14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.400723 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 764/1536] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:01.407845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.408631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.409064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.409354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.410093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.412098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.433276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.433609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.433833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.472701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:01.473921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:01.487890 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 773/1537] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/projects => generated 383 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:08:01.490135 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 765/1538] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:01.494238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.500376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.515355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84cb37-2e81-4e07-b850-134b99562610 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.613481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c67a3-4116-40b8-8c88-87304f40544b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.626744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.627572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.627858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.628134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.628935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:01.629152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.629268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.629815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.630112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.630398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.631139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.631448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26593dcc-2475-49aa-bfe4-98c457c62887 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.632205 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:08:01.632205 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:08:01.632205 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:08:01.633501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.656585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 766/1539] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:01.658162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.658448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.658821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.683365 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 774/1540] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:01.687965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:01.688973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.690171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:01.711688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 767/1541] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:01.718533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4316f5c-a7c9-4f49-b2fb-a1948309164a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.720094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.738583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d583d47-62ed-4858-b7d1-7b0977434bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.739642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583d47-62ed-4858-b7d1-7b0977434bde admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.740137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583d47-62ed-4858-b7d1-7b0977434bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.740641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d583d47-62ed-4858-b7d1-7b0977434bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.742000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d583d47-62ed-4858-b7d1-7b0977434bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.751789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d583d47-62ed-4858-b7d1-7b0977434bde admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.758887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5d2ce7-f23d-4d35-a397-bcd4ef885653 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.770101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.771207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.771699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.772177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.773776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.776385 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:08:01.776385 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:08:01.776385 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:08:01.778683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.780564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 775/1542] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:01.782884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.783418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.784068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.825474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:01.827416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:01.850502 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 776/1543] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:01.851768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.865918 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 768/1544] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:01.868209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:01.869077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ba98e2-1b1c-4c0f-be58-030edb317af3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:01.970057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:01.971183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:01.971666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:01.972180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:01.973156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:01.975043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:01.995174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 777/1545] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:01 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:02.000176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.011994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0268bde-b0f9-4262-ba55-7cae2d06f5c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.032814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.034292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.035088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.035789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.037079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.039587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.083851 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:02.092900 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 778/1546] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:01 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:02.095163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.112532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a38d74-0111-4281-b6aa-8d0e1ed7ba72 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.117893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7137da58-fa4a-4060-bfd6-0653782cd475 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.127634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.129065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.129690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.130180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] PATH_INFO: `/v3/projects/61866424cee54c0f8838926d9f9d60ea/users/897c72d4797b4282b621db6c63b520d8/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.139189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.141036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.141036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.141279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.142680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:02.143289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.147095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.166006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=61866424cee54c0f8838926d9f9d60ea, user_id=897c72d4797b4282b621db6c63b520d8, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.169783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.191092 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 769/1547] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:02.196810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.200762 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 779/1548] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:02 2022] PUT /identity/v3/projects/61866424cee54c0f8838926d9f9d60ea/users/897c72d4797b4282b621db6c63b520d8/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:02.205970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.241721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84007b-8cf4-4ace-9759-8a80151824f9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.332506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f4836-8654-4cc4-85bd-9e75bd6414ae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.339812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338566c-6013-45ad-a570-b8e93f562d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.340945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338566c-6013-45ad-a570-b8e93f562d74 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.341444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338566c-6013-45ad-a570-b8e93f562d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.341919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338566c-6013-45ad-a570-b8e93f562d74 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.349654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338566c-6013-45ad-a570-b8e93f562d74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.353240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338566c-6013-45ad-a570-b8e93f562d74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.411232 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 780/1549] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:02 2022] POST /identity/v3/projects => generated 381 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:08:02.413328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.413954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.414430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.424390 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:02.451668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] MFA Rules not processed for user `897c72d4797b4282b621db6c63b520d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:02.453289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:02.504424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.506300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.506300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.506655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.507917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.517501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.552377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 781/1550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:02.552377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.558801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 770/1551] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:02.572083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.604208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032905b0-8999-45dd-bae2-e34b80239523 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.742793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.743905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.744450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.744939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.745933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.748152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.752777 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:02.782982 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 771/1552] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:02.784686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.793611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc9b80-7aad-45e1-a3e7-5c6bbf58391b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.809616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.810782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.811351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.811832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.813178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:02.822673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:02.898836 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 782/1553] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:02 2022] POST /identity/v3/users => generated 291 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:02.900323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:02.935802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935c919-1d08-472d-b1e8-7e4c56b81554 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.948943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fcf9de-cfd5-4c81-b3fa-f76847f0b19f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:02.952932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcabeca-ad2f-4f0e-8f39-66f1997bc6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.954586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcabeca-ad2f-4f0e-8f39-66f1997bc6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.956886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcabeca-ad2f-4f0e-8f39-66f1997bc6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.956886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcabeca-ad2f-4f0e-8f39-66f1997bc6d2 admin admin] PATH_INFO: `/v3/projects/6860dafc30f944e195a9b0f5c570080c/users/6e97ce6e781a4278ae9f4cb4b39f0663/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.974051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:02.975071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:02.975513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:02.975926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:02.997836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.001485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.048796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcabeca-ad2f-4f0e-8f39-66f1997bc6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6860dafc30f944e195a9b0f5c570080c, user_id=6e97ce6e781a4278ae9f4cb4b39f0663, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.057330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcabeca-ad2f-4f0e-8f39-66f1997bc6d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.068799 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 772/1554] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:03.070309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.116736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 783/1555] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:02 2022] PUT /identity/v3/projects/6860dafc30f944e195a9b0f5c570080c/users/6e97ce6e781a4278ae9f4cb4b39f0663/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:03.119451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b154a2-522c-44d9-be6e-22136bcfea38 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.119962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b154a2-522c-44d9-be6e-22136bcfea38 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.120581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b154a2-522c-44d9-be6e-22136bcfea38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.124611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb073f-c539-4dc5-acc8-126e4c3de937 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.203338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-80b154a2-522c-44d9-be6e-22136bcfea38 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.204585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80b154a2-522c-44d9-be6e-22136bcfea38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.297188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1480c8a6-4c03-409d-92a9-eb7e063d611d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.297188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480c8a6-4c03-409d-92a9-eb7e063d611d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.297188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480c8a6-4c03-409d-92a9-eb7e063d611d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.297188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1480c8a6-4c03-409d-92a9-eb7e063d611d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.297916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480c8a6-4c03-409d-92a9-eb7e063d611d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.299046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1480c8a6-4c03-409d-92a9-eb7e063d611d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.301232 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 784/1556] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.305111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1de6-19eb-4a56-8579-1b201aa416fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.305967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1de6-19eb-4a56-8579-1b201aa416fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.306653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95d1de6-19eb-4a56-8579-1b201aa416fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.327865 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 773/1557] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:03.330188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f7a9-58f3-4e4b-8bab-427bf36ac23e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.330753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f7a9-58f3-4e4b-8bab-427bf36ac23e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.331204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700f7a9-58f3-4e4b-8bab-427bf36ac23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.346702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e95d1de6-19eb-4a56-8579-1b201aa416fe None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.347963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e95d1de6-19eb-4a56-8579-1b201aa416fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.357511 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 785/1558] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.360544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.361657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.362217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.370976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3700f7a9-58f3-4e4b-8bab-427bf36ac23e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.373267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3700f7a9-58f3-4e4b-8bab-427bf36ac23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.396106 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 774/1559] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.396106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecd023-7660-4ef1-b406-6a1cdac438b0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.396106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecd023-7660-4ef1-b406-6a1cdac438b0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.396106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecd023-7660-4ef1-b406-6a1cdac438b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.405687 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:03.415940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] MFA Rules not processed for user `6e97ce6e781a4278ae9f4cb4b39f0663`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.418059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.425386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-19ecd023-7660-4ef1-b406-6a1cdac438b0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.428509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-19ecd023-7660-4ef1-b406-6a1cdac438b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.441444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 775/1560] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.455881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ac85-998a-4c6a-acf0-f8076604a88b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.457461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ac85-998a-4c6a-acf0-f8076604a88b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.458206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08ac85-998a-4c6a-acf0-f8076604a88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.490810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ed08ac85-998a-4c6a-acf0-f8076604a88b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.493823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed08ac85-998a-4c6a-acf0-f8076604a88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.515109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 776/1561] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.515109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a28b85-6432-4988-ac25-95fcb1d445f2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.515109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a28b85-6432-4988-ac25-95fcb1d445f2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.515109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a28b85-6432-4988-ac25-95fcb1d445f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.545886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-55a28b85-6432-4988-ac25-95fcb1d445f2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.547670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55a28b85-6432-4988-ac25-95fcb1d445f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.552424 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 786/1562] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.552424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.565816 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 777/1563] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.568647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ebe68-4802-4e29-a1d2-b8d1d5587115 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.569468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ebe68-4802-4e29-a1d2-b8d1d5587115 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.570050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425ebe68-4802-4e29-a1d2-b8d1d5587115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.576205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c325b622-d90e-4af2-9780-6e2652f9139f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.586657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99343775-d4e4-4d1b-bfc8-99f0805c6aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.587917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99343775-d4e4-4d1b-bfc8-99f0805c6aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.588468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99343775-d4e4-4d1b-bfc8-99f0805c6aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.589328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99343775-d4e4-4d1b-bfc8-99f0805c6aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.590748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99343775-d4e4-4d1b-bfc8-99f0805c6aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.594748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99343775-d4e4-4d1b-bfc8-99f0805c6aa6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.600788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-425ebe68-4802-4e29-a1d2-b8d1d5587115 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.602780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-425ebe68-4802-4e29-a1d2-b8d1d5587115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.612926 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 778/1564] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.614400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa762-cb4f-4c82-bc74-6a4c1a3b8003 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.614690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa762-cb4f-4c82-bc74-6a4c1a3b8003 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.614962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfa762-cb4f-4c82-bc74-6a4c1a3b8003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.622229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 787/1565] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:03.624736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.625255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.625766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.637693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aedfa762-cb4f-4c82-bc74-6a4c1a3b8003 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.638923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aedfa762-cb4f-4c82-bc74-6a4c1a3b8003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.647666 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 779/1566] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.649067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.649354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.649627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.663315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.665697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.669880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:03.671104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:03.680115 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 780/1567] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.680837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.686437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 788/1568] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:03.689628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.697792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3c2540-c10d-4e60-bc3a-f21b6b520184 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.703101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.704084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.704390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.704671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.705483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.707559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.712325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda36a9-dc5f-4963-aad8-4020c278ac22 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.720231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.721573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.721861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.722134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.722878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:03.723369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.726393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.741834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 781/1569] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:03 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:03.743928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.753958 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 789/1570] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:03.755662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.770306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed7c60-0e95-4295-8f13-123e8c12d494 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.775834 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:03.836979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.838021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.838367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.838619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] PATH_INFO: `/v3/projects/47e4d3b6d5264ec3b6a77fb5832d0e47/users/f6a01f4d995040c98bba01aa537c9793/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.849985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f76a335-13ca-427c-8f65-f6396799d693 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.856520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.857598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.858027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.858160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e4d3b6d5264ec3b6a77fb5832d0e47, user_id=f6a01f4d995040c98bba01aa537c9793, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.858461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.859673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:03.860170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.863102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.863269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.882453 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 782/1571] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:03.883535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.884280 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 790/1572] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:03 2022] PUT /identity/v3/projects/47e4d3b6d5264ec3b6a77fb5832d0e47/users/f6a01f4d995040c98bba01aa537c9793/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:03.885900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:03.908254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0182ed-bf73-4064-b193-0c278392863c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.974723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e945f4f-7558-4fcf-b01d-251d2ca7e974 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:03.981956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.983146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.983555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.983934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.985212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:03.985620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.987625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:03.988911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:03.989642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:03.989929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:03.990206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:03.990993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:03.991294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:03.993115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.005176 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 791/1573] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:04.007336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.015834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 783/1574] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:04.016927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.030318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab6e786-1bd8-4c99-9e82-03075bc1e247 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.033084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91e8e-4dc0-409b-af83-e7529c4e7a3b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.035969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.036950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.037225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.037525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] PATH_INFO: `/v3/users/897c72d4797b4282b621db6c63b520d8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.038795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.038982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] RBAC: Authorizing `identity:delete_user(user_id=897c72d4797b4282b621db6c63b520d8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.039580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.039961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.040059 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:08:04.040059 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:08:04.040059 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:08:04.040327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.044901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.045104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:04.045104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.046053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.063314 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 792/1575] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:04.064296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.077756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048302d-9e46-4cd6-9ef2-bb63172c85b2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.083467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.084185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.084506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.084783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.085569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.087647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.107822 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:04.113525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 793/1576] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/users => generated 297 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.114717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.126263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653b895b-e0be-49b3-bc1b-5de82395d8cd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.131849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.132639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.133362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.133362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.133892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.135990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.141419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '897c72d4797b4282b621db6c63b520d8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:04.151567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '897c72d4797b4282b621db6c63b520d8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:04.169757 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 794/1577] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.171555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.176278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '897c72d4797b4282b621db6c63b520d8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:04.177118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '897c72d4797b4282b621db6c63b520d8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:04.190134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f31fe38-f767-4b66-8e53-0ba6c279591b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '897c72d4797b4282b621db6c63b520d8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:04.197499 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 784/1578] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:04 2022] DELETE /identity/v3/users/897c72d4797b4282b621db6c63b520d8 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:04.199132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.199529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.199909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.234113 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:04.235202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] MFA Rules not processed for user `f6a01f4d995040c98bba01aa537c9793`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:04.235951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.280399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23313d-709b-4e86-99e0-fefa9221b558 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.321958 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 785/1579] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:04.321958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.322715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.351021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.351708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.351989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.352263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.353009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.354947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.386185 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 795/1580] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.391376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.393413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.433410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b776df8-adfd-45ad-ac03-97646fe85912 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.468545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a69aa51-138f-4549-bc55-ef225f7347f5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.474604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.475520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.476093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.476485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.477319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.479728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.501552 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:04.522736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 796/1581] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.523712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.525537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.533177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.534152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.534600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.535078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.536037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.538505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.572983 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 786/1582] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/projects => generated 377 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.574927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.577742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.604140 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:04.629535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eef353-6f9f-4c13-8503-0c42bd6172ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.690842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950980d-981c-4a62-880a-b54af5cb7e7c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.698316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.699425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.699874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.700331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.701742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.704820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.719032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 787/1583] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:04 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:04.720537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.722426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5dc69-1ab2-491d-a635-76fee7e22753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.723389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dc69-1ab2-491d-a635-76fee7e22753 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.723660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.724519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dc69-1ab2-491d-a635-76fee7e22753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.724809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5dc69-1ab2-491d-a635-76fee7e22753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.725810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5dc69-1ab2-491d-a635-76fee7e22753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.728148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5dc69-1ab2-491d-a635-76fee7e22753 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.739517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cfc31-4581-4629-b13f-d7c5ebe406b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.746134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.747218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.747562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.748055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.749130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.752571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.766032 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 797/1584] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/projects => generated 395 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.768135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.768654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.769101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.788678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 788/1585] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/users => generated 300 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.790374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.794181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.800007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:04.801990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.815117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60344f1-a565-4f98-acc6-70f53f69efa9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.898895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.899591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.899873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.900149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.900281 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 798/1586] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:04.900985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.902966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.906270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.908555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:04.930377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6909f1b8-2f14-4532-a2a1-2bad5603a852 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:04.940264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:04.941557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:04.942176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:04.942825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:04.944398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:04.945918 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 789/1587] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.947001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.947857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:04.984767 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 799/1588] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/users => generated 292 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:04.984767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:04.994609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef8acd8-6224-4bc8-9c61-a2167f85cfc7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.002049 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:05.053418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737eb007-2984-4aca-851d-52e5b581c078 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.059476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.060507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.060826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.061565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.061835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.063845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.078135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.079213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.079629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.080033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.081123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.083772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.094446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 790/1589] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:05.096667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.098283 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:05.111613 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 800/1590] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:04 2022] POST /identity/v3/users => generated 289 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:05.111613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.117654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3c6284-ff25-4306-977b-d1efb4a9aa86 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.123913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ecc112-f3af-4606-9a6a-25205158bfb3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.125733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.126899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.127406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.127854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] PATH_INFO: `/v3/projects/232ec43724bd48498479b2c45764116f/users/df02f9ea242048cda173d6b255b18b93/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.130181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.131120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.131510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.132410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.133458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.136645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.155074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=232ec43724bd48498479b2c45764116f, user_id=df02f9ea242048cda173d6b255b18b93, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.157050 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:08:05.157050 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:08:05.157050 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:08:05.161201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.162264 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 801/1591] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:05 2022] POST /identity/v3/users => generated 298 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:05.163195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.174224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64e270d-e025-4e35-b33b-dac33bfd260d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.182053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 791/1592] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:05 2022] PUT /identity/v3/projects/232ec43724bd48498479b2c45764116f/users/df02f9ea242048cda173d6b255b18b93/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:05.183004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.184816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:05.261800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234aaaf2-a3e9-4b92-bd7b-ace1f34f8b0a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.267959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.269288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.269953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.270450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.275688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.276785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.277251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.277713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.278959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.281751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.286237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.287943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.295801 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 802/1593] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.296095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.303356 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 792/1594] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:05.304943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.307273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f92a8-7989-4c92-98db-672b7aeba379 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.312315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.313039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.313331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.313584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.314325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.316421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.316918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f514d-8e95-4f0d-90e0-047e30bfd856 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.323082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.323935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.324385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.324824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.325793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.328113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.346839 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 803/1595] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:05 2022] POST /identity/v3/users => generated 298 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:05.348694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.357058 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 793/1596] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.357058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.366647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2103d03b-2f37-4e01-acc5-0bfef8967291 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.372058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348a2eb-054d-4bc9-9a16-509229cf3c5a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.374068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.374925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.375356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.375693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.376709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.380092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.380331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.381695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.382235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.384414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.385792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.388125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.402848 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 804/1597] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.402848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.405921 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 794/1598] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.410522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.422254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4c7356-133d-42b7-975e-9f251197fc3d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.429566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f736d-a5bb-4a1a-975e-8bdbd5011d95 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.433652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.434934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.435456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.436075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.438056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.438806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.439210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.439666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.440114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.441647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.442005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.444615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.465212 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 805/1599] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.465446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 795/1600] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.465813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.471307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.484484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61190b1-215f-49f7-b276-dae1066e0bb8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.490583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953e080-06bf-4424-a45b-a1d013def1fd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.494552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.496077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.496699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.497244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.498631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.500828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.504687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.504942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.505971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.506699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.509753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.517187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.547242 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 806/1601] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.547242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.555527 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 796/1602] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.556883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.563111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf657a-eec1-4ba5-b0d5-9b181fb30d8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.571130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.572547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.573169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.573681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.574793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.576180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b6bce-707f-4aae-bf00-1c9283dc2057 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.577227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.584874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.585950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.586420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.586888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.588158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.591735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.596985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 807/1603] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.604441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.619715 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 797/1604] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.619715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.621040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40cfa5-554e-4127-82b3-9599653c947c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.629707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.631252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.632135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.632303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.633730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.636843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.638534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6136f-254e-46a4-bbec-53c4711b94ba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.646996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.648150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.648698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.649188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.650600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.653874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.675969 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 808/1605] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.675969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.680449 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 798/1606] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:05.682460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.694519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e155c-db80-465c-aaf0-d11fa3ee4827 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.698517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49d6f20-e9c9-446d-844f-47c95bbcc6ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.700400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.701349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.701631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.702111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] PATH_INFO: `/v3/projects/b3604802d3684957b78e2f9a649e8211/users/c7d660c8cdfb4d7e94fb4f137f4c540b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.708587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.710665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.711173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.711658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] PATH_INFO: `/v3/projects/232ec43724bd48498479b2c45764116f/users/df02f9ea242048cda173d6b255b18b93/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.716045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=232ec43724bd48498479b2c45764116f, user_id=df02f9ea242048cda173d6b255b18b93, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.720918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.726784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3604802d3684957b78e2f9a649e8211, user_id=c7d660c8cdfb4d7e94fb4f137f4c540b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.730048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.747307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 809/1607] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:05 2022] PUT /identity/v3/projects/232ec43724bd48498479b2c45764116f/users/df02f9ea242048cda173d6b255b18b93/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:05.749177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.759956 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 799/1608] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:05 2022] PUT /identity/v3/projects/b3604802d3684957b78e2f9a649e8211/users/c7d660c8cdfb4d7e94fb4f137f4c540b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:05.760643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.773430 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:05.842359 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:05.861194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26442e7-31ae-4d1d-827b-a86575761758 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.877060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa8ee2-360a-4141-b10e-947a24ad46a3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:05.882477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.883865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.884281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.884675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] PATH_INFO: `/v3/projects/8ce810d95b994f41ba75267cbeaa9377/users/49fd9615857544d783832d148d0720ce/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.903711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ce810d95b994f41ba75267cbeaa9377, user_id=49fd9615857544d783832d148d0720ce, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.909442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:05.931287 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 800/1609] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:05 2022] PUT /identity/v3/projects/8ce810d95b994f41ba75267cbeaa9377/users/49fd9615857544d783832d148d0720ce/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:05.932655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:05.961321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:05.962369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:05.962802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:05.963207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] PATH_INFO: `/v3/projects/5c2a1983f2d641c0a54a81c491508ca9/users/8e750646a0444391ad41fac5fefc9df3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:05.982788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2a1983f2d641c0a54a81c491508ca9, user_id=8e750646a0444391ad41fac5fefc9df3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:05.986235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.005665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 810/1610] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:05 2022] PUT /identity/v3/projects/5c2a1983f2d641c0a54a81c491508ca9/users/8e750646a0444391ad41fac5fefc9df3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:06.007231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:06.031775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a60250-c3bf-4b75-9284-5093fc30f569 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:06.108019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c877fcaa-1c69-4c5e-a7d2-25dcde07151a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:06.113655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:06.114778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.115233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.115590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] PATH_INFO: `/v3/projects/afa33f27a7db4720954fe8cbaf17668a/users/285bcd7f1a884301986daa4bbd3ab9fd/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.125131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:06.126877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.127299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.127646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] PATH_INFO: `/v3/projects/f284b55ae58940dda163b1faa2a81971/users/784d8e3197b3464d9e2f939adf4551f5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.135743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afa33f27a7db4720954fe8cbaf17668a, user_id=285bcd7f1a884301986daa4bbd3ab9fd, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:06.139282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.147703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f284b55ae58940dda163b1faa2a81971, user_id=784d8e3197b3464d9e2f939adf4551f5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:06.151519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.159403 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 811/1611] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:06 2022] PUT /identity/v3/projects/afa33f27a7db4720954fe8cbaf17668a/users/285bcd7f1a884301986daa4bbd3ab9fd/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:06.161091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:06.171522 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 801/1612] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:05 2022] PUT /identity/v3/projects/f284b55ae58940dda163b1faa2a81971/users/784d8e3197b3464d9e2f939adf4551f5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:06.173241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:06.181564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.214758 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:06.280597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c3c5c-02a1-405f-9c09-431560f1261b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:06.280863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a60af-34e3-45bb-a06e-8e2f2aae899c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:06.286174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:06.286669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20972b4-1564-4869-8883-7a6f07bc0296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:06.287310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.287678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.287854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20972b4-1564-4869-8883-7a6f07bc0296 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.288071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20972b4-1564-4869-8883-7a6f07bc0296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.288250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] PATH_INFO: `/v3/projects/61866424cee54c0f8838926d9f9d60ea` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.288733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20972b4-1564-4869-8883-7a6f07bc0296 admin admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364/users/5f87308f44ee4edcb8db3cdc5cf0c54d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.290126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61866424cee54c0f8838926d9f9d60ea)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:06.292917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.293797 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:06.312923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20972b4-1564-4869-8883-7a6f07bc0296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5699b6d4baf348dbaac4add1d8545364, user_id=5f87308f44ee4edcb8db3cdc5cf0c54d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:06.316242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20972b4-1564-4869-8883-7a6f07bc0296 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.335485 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 812/1613] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:06 2022] PUT /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364/users/5f87308f44ee4edcb8db3cdc5cf0c54d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:06.337935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e33a2-64bf-4f73-bd80-f2958e138371 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.338438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e33a2-64bf-4f73-bd80-f2958e138371 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.339286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e33a2-64bf-4f73-bd80-f2958e138371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.372285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61866424cee54c0f8838926d9f9d60ea', 'request_id': 'req-9de85853-ab0a-4e72-9c32-9b2bf852a400'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:06.379474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-782e33a2-64bf-4f73-bd80-f2958e138371 None None] MFA Rules not processed for user `df02f9ea242048cda173d6b255b18b93`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.381557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-782e33a2-64bf-4f73-bd80-f2958e138371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.383757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61866424cee54c0f8838926d9f9d60ea', 'request_id': 'req-9de85853-ab0a-4e72-9c32-9b2bf852a400'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:06.393651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61866424cee54c0f8838926d9f9d60ea', 'request_id': 'req-9de85853-ab0a-4e72-9c32-9b2bf852a400'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:06.408966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] The token cache is being invalidate because project 61866424cee54c0f8838926d9f9d60ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:06.409405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:06.410287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9de85853-ab0a-4e72-9c32-9b2bf852a400 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:06.422759 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 802/1614] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:06 2022] DELETE /identity/v3/projects/61866424cee54c0f8838926d9f9d60ea => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:06.422759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.422759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.422759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.457813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] MFA Rules not processed for user `c7d660c8cdfb4d7e94fb4f137f4c540b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.459627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.480836 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 813/1615] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.482714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed556-fef5-43d1-9cef-6c4b2ca0e121 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.483153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed556-fef5-43d1-9cef-6c4b2ca0e121 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.483567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fed556-fef5-43d1-9cef-6c4b2ca0e121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.522977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46fed556-fef5-43d1-9cef-6c4b2ca0e121 None None] MFA Rules not processed for user `49fd9615857544d783832d148d0720ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.526462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46fed556-fef5-43d1-9cef-6c4b2ca0e121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.568279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 803/1616] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.569794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:06.572204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.633042 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 814/1617] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.635093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb5ae-72f9-446f-99c9-9a7670c87c72 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.635661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb5ae-72f9-446f-99c9-9a7670c87c72 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.636136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7eb5ae-72f9-446f-99c9-9a7670c87c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.639645 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:06.668142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16038e-6dc1-4a36-aaa1-82579d91f9c0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:06.673839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e259764-1753-4c63-8664-edc15f1b4988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:06.674506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6d7eb5ae-72f9-446f-99c9-9a7670c87c72 None None] MFA Rules not processed for user `285bcd7f1a884301986daa4bbd3ab9fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.674644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259764-1753-4c63-8664-edc15f1b4988 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.674828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259764-1753-4c63-8664-edc15f1b4988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.675099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e259764-1753-4c63-8664-edc15f1b4988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.675864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259764-1753-4c63-8664-edc15f1b4988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:06.675992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d7eb5ae-72f9-446f-99c9-9a7670c87c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.677586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e259764-1753-4c63-8664-edc15f1b4988 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.688980 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 804/1618] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:06 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:06.690804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38cf4d-439d-42f9-8730-543bd6137f8a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.691001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38cf4d-439d-42f9-8730-543bd6137f8a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.691140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38cf4d-439d-42f9-8730-543bd6137f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.728436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6e38cf4d-439d-42f9-8730-543bd6137f8a None None] MFA Rules not processed for user `784d8e3197b3464d9e2f939adf4551f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.729720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e38cf4d-439d-42f9-8730-543bd6137f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.737116 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:06.770325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 815/1619] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.772703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.773197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.773670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.821350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] MFA Rules not processed for user `5f87308f44ee4edcb8db3cdc5cf0c54d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.821666 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 805/1620] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.823124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.823867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e762ec-b6c3-4875-ba1a-8036a842fd81 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.824304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e762ec-b6c3-4875-ba1a-8036a842fd81 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.828797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e762ec-b6c3-4875-ba1a-8036a842fd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.864275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-81e762ec-b6c3-4875-ba1a-8036a842fd81 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:06.865630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-81e762ec-b6c3-4875-ba1a-8036a842fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.875902 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 806/1621] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.877439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1089c60-3f20-444a-ab73-4aa55e02c85e None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.877711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1089c60-3f20-444a-ab73-4aa55e02c85e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.877980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1089c60-3f20-444a-ab73-4aa55e02c85e None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.879367 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 807/1622] 10.222.0.15 () {54 vars in 962 bytes} [Tue Jul 19 11:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:06.880088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1089c60-3f20-444a-ab73-4aa55e02c85e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:06.886033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c1089c60-3f20-444a-ab73-4aa55e02c85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.927993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1089c60-3f20-444a-ab73-4aa55e02c85e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:06.936774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:06.937473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:06.937766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:06.938048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:06.939296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:06.942491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:06.982464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 816/1623] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:06.983966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:06.988058 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 808/1624] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/projects => generated 399 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:06.988966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:06.989315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.010798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3f67-ef87-437e-bdb2-1c24ea39c9c2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.075334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc83a47a-2d08-4909-b7fe-273d73d798f0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.082112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.083034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.083310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.083581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] PATH_INFO: `/v3/projects/5c2a1983f2d641c0a54a81c491508ca9/users/8e750646a0444391ad41fac5fefc9df3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.085933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c2a1983f2d641c0a54a81c491508ca9, user_id=8e750646a0444391ad41fac5fefc9df3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.089206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.112665 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 809/1625] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:06 2022] PUT /identity/v3/projects/5c2a1983f2d641c0a54a81c491508ca9/users/8e750646a0444391ad41fac5fefc9df3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:07.114217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.116070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:07.132607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.134353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.135113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.135846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.137837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.142579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.160816 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:07.198030 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 817/1626] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:06 2022] POST /identity/v3/projects => generated 383 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.199560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.203040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:07.216861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b569f0b-c719-457b-8030-9359327a284d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.285718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795acf6-36a7-47ad-9b42-f634657535c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.286427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795acf6-36a7-47ad-9b42-f634657535c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.286715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795acf6-36a7-47ad-9b42-f634657535c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.286996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795acf6-36a7-47ad-9b42-f634657535c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.287857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795acf6-36a7-47ad-9b42-f634657535c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.289893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795acf6-36a7-47ad-9b42-f634657535c4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.322708 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 810/1627] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.322708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54677b-a6c7-4fe5-8c14-0ffd3efb3532 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.322708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54677b-a6c7-4fe5-8c14-0ffd3efb3532 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.322708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54677b-a6c7-4fe5-8c14-0ffd3efb3532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.323649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d4363-a0b7-4fab-8fc6-cadb6a9416b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.336610 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:07.344626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ca54677b-a6c7-4fe5-8c14-0ffd3efb3532 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:07.346796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ca54677b-a6c7-4fe5-8c14-0ffd3efb3532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:07.418711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.419569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.419918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.420327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.421245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.424680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.441819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 811/1628] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:07.445435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.445435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.445435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.461939 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 818/1629] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.463534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.468521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:07.491417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:07.492686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:07.544261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84e559-ac5a-4282-88b1-2135c1645301 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.551265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735efca1-b078-4eb3-bfc3-457a39882977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.551628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efca1-b078-4eb3-bfc3-457a39882977 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.551936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efca1-b078-4eb3-bfc3-457a39882977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.552220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735efca1-b078-4eb3-bfc3-457a39882977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.553007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735efca1-b078-4eb3-bfc3-457a39882977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.554999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735efca1-b078-4eb3-bfc3-457a39882977 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.555530 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:07.584811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 812/1630] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:07.586437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.595126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 819/1631] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/projects => generated 393 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.595126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.595126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.595126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.604716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e4c51-8b8d-4501-be79-cdeb03e37a6f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.637394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] MFA Rules not processed for user `8e750646a0444391ad41fac5fefc9df3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:07.639371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:07.700208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.701928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.701928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.702244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.703356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.705785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.740232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 813/1632] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/users => generated 306 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.740232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.747359 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 820/1633] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:07.748612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.757410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cca8caf-e0ff-4f47-914f-8012cccca573 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.764774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.765819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.766244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.766653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.767068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b0a2b8-fac4-4b69-ac16-0e1a1a9592c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.767776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.770561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.775815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.776834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.777304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.777788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.778966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.783485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.795424 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:07.804415 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 814/1634] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/users => generated 298 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.806028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.822906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf88548-fc7a-4f35-ada7-1f29b3031dec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.831531 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 821/1635] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/users => generated 294 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.831531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.833411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.834530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.834960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.835411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.836719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:07.837379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.839978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.844774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4c7d9-057c-4804-9e13-e00050e43889 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.851234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.852050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.852447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.852882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.853895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.856307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.857857 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 815/1636] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:07.858858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.888412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 822/1637] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/users => generated 296 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.889529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.904289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ad09c-c12c-4dce-8b65-3c0315c24eaa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.910912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.912060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.912610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.913054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.914146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.917965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.946492 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 823/1638] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:07 2022] POST /identity/v3/users => generated 303 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:07.951479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:07.964117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c5fd0-7ebc-4d72-bcb0-1f15391630d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.970127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3654d-f6d2-4c46-8251-326d7174fa8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.971148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3654d-f6d2-4c46-8251-326d7174fa8e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.971546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3654d-f6d2-4c46-8251-326d7174fa8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.972061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3654d-f6d2-4c46-8251-326d7174fa8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.972218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd327f68-07a9-4d6d-8cc0-d87d39a35df2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:07.973080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3654d-f6d2-4c46-8251-326d7174fa8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:07.974914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3654d-f6d2-4c46-8251-326d7174fa8e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:07.978376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:07.979072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.979347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.979614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.992497 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 824/1639] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:07.995557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d48b8a-2c83-4191-a42f-1746ef1856e9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:07.996015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d48b8a-2c83-4191-a42f-1746ef1856e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:07.996509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d48b8a-2c83-4191-a42f-1746ef1856e9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:07.999295 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 825/1640] 10.222.0.15 () {54 vars in 962 bytes} [Tue Jul 19 11:08:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:08.000895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d48b8a-2c83-4191-a42f-1746ef1856e9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.023771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d48b8a-2c83-4191-a42f-1746ef1856e9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.026014 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:08.032281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.033448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.033953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.034439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.035818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.039070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.053213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.054872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.061541 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 826/1641] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:08.063071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.071525 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 816/1642] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:07 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:08.072965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.077533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d18ae3-fec0-469e-9fa8-0b34a79a3bef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.086673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.087847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.088564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.089595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.091145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.091979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9724fcd4-c322-45cd-9ed3-1ba4b538507b service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.094195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.099799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.100841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.101274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.101981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.102866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.105865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.117471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 827/1643] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:08.117471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.134626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f92eda-499f-488d-9a0e-942222e45ab4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.142439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.143566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.144016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.144508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.145742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.146175 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 817/1644] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:08 2022] POST /identity/v3/projects => generated 401 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:08.147173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.148580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.167864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 828/1645] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:08.169287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.193785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f500d2b-7b3a-446a-a84a-154ba517f330 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.233767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0bb2a-09ed-4b11-af38-c8d8e19e051f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.239155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03734b3-1787-4dc4-ab1d-d819563ad8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.239895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03734b3-1787-4dc4-ab1d-d819563ad8e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.240201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03734b3-1787-4dc4-ab1d-d819563ad8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.240547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03734b3-1787-4dc4-ab1d-d819563ad8e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.241312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03734b3-1787-4dc4-ab1d-d819563ad8e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.243297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03734b3-1787-4dc4-ab1d-d819563ad8e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.255913 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 818/1646] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:08.257337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.257606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.257888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.278425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:08.280031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:08.315884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.317422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.317866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.318307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] PATH_INFO: `/v3/projects/f8ab28a7c92b4dc18bfc788449a6c316/users/46e0b8e0c22a4cf28cb444c0dec3e731/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.345674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ab28a7c92b4dc18bfc788449a6c316, user_id=46e0b8e0c22a4cf28cb444c0dec3e731, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.350587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.372258 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 819/1647] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jul 19 11:08:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:08.373372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.378072 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 829/1648] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:08 2022] PUT /identity/v3/projects/f8ab28a7c92b4dc18bfc788449a6c316/users/46e0b8e0c22a4cf28cb444c0dec3e731/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:08.380298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.395934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b2fe08-44dc-4e7b-ac7a-03c0532682cf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.468673 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:08.488076 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=10,keystone:SELECT=90 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:08.508896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f3e7c4-2c11-4888-86fb-19762a7ac570 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.510004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.511645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.512310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.512879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] PATH_INFO: `/v3/projects/1e2ea7b2794f47198a18f33c4216850e/users/7f1c961d89084d03aa7a7f8c963ee7b5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.519308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.520711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.521189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.521673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] PATH_INFO: `/v3/projects/b58243a8bec844608c599a6c01e5e792/users/4138966312ad41d7a69fea8036fe7695/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.553157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58243a8bec844608c599a6c01e5e792, user_id=4138966312ad41d7a69fea8036fe7695, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.554095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2ea7b2794f47198a18f33c4216850e, user_id=7f1c961d89084d03aa7a7f8c963ee7b5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.558734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.559137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.581093 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 830/1649] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:08 2022] PUT /identity/v3/projects/b58243a8bec844608c599a6c01e5e792/users/4138966312ad41d7a69fea8036fe7695/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:08.584167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.584652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 820/1650] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:08 2022] PUT /identity/v3/projects/1e2ea7b2794f47198a18f33c4216850e/users/7f1c961d89084d03aa7a7f8c963ee7b5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:08.586506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.690065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092a058f-ad86-410c-a290-ad59e1127df7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.710591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dced-cec9-49b0-9a2c-b09c5246eda5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.719614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.721915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.723361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.723650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] PATH_INFO: `/v3/projects/1554a7044e07480b88de96f9562c1b7a/users/b55cd36678fa4bfeabdde72c4b9a463b/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.743048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1554a7044e07480b88de96f9562c1b7a, user_id=b55cd36678fa4bfeabdde72c4b9a463b, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.745847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.763779 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 821/1651] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:08 2022] PUT /identity/v3/projects/1554a7044e07480b88de96f9562c1b7a/users/b55cd36678fa4bfeabdde72c4b9a463b/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:08.764405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.797546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.798400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.800558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.800942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.801883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.804533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.838148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 831/1652] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:08 2022] POST /identity/v3/users => generated 301 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:08.840397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.860203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fcf356-11e1-4797-97f4-d63c1f92b0ff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.881737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b61145-1977-4b58-a84d-d436ecf28f32 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:08.888035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.889269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.889752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.890313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] PATH_INFO: `/v3/projects/dc426599e38543e3a00c093be0998dd2/users/a6eba41fd50a48649ec569f2882fc465/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.914379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc426599e38543e3a00c093be0998dd2, user_id=a6eba41fd50a48649ec569f2882fc465, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.919028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.953196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 822/1653] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:08 2022] PUT /identity/v3/projects/dc426599e38543e3a00c093be0998dd2/users/a6eba41fd50a48649ec569f2882fc465/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:08.954254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:08.972673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:08.973506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:08.973904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:08.974325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:08.975461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:08.977503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:08.994081 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 832/1654] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:08.994081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.004567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998e5ddf-96fb-483c-9932-3e07c67ffaa4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.007287 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:09.014338 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:09.072547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf17482-7712-4744-80b7-04857c51a5b0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.082415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.083527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.084020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.084556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.102728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.103796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.104138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.104600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.105520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.107261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.123561 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 833/1655] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:09.123561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.132060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a15be3-aa65-40d9-9f1f-2f96b1f1d38d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.136993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.137701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.137977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.138461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.139231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.140982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.159073 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 834/1656] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:09.159073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.170810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e865-6403-4deb-81e6-ba4daff5b166 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.176991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.177814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.178184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.178549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.179398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.181470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.185126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.188075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.202488 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 835/1657] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:09.203467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.206747 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 823/1658] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:09.208337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.210727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:09.218033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44423b19-f089-40f9-ae7f-6cfa9c49661f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.224532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.225825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.226606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.227289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.229393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.232081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.237342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dfa037-7101-4103-b63a-bd8b11ed0353 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.245816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.247221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.247750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.248234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] PATH_INFO: `/v3/users/6e97ce6e781a4278ae9f4cb4b39f0663` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.250877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e97ce6e781a4278ae9f4cb4b39f0663)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.253033 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 836/1659] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:09.254483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.254949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.268829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775af70d-5ec1-4752-b88b-ab923945bff4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.275562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.277150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.277359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.277913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.279517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.282531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.301370 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 837/1660] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:09.301370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.319766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f840cd2a-0db3-4f1d-83f5-d33c77a580d4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.330076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.331583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.332124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.332618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] PATH_INFO: `/v3/projects/f8ab28a7c92b4dc18bfc788449a6c316/users/46e0b8e0c22a4cf28cb444c0dec3e731/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.336612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ab28a7c92b4dc18bfc788449a6c316, user_id=46e0b8e0c22a4cf28cb444c0dec3e731, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.342366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.348879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e97ce6e781a4278ae9f4cb4b39f0663'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:09.362211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e97ce6e781a4278ae9f4cb4b39f0663'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:09.366516 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 838/1661] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:09 2022] PUT /identity/v3/projects/f8ab28a7c92b4dc18bfc788449a6c316/users/46e0b8e0c22a4cf28cb444c0dec3e731/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:09.367689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.393830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e97ce6e781a4278ae9f4cb4b39f0663'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:09.395008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e97ce6e781a4278ae9f4cb4b39f0663'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:09.409969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e97ce6e781a4278ae9f4cb4b39f0663'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:09.424287 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 824/1662] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:09 2022] DELETE /identity/v3/users/6e97ce6e781a4278ae9f4cb4b39f0663 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:09.425660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.428733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:09.472395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcab18-9177-4a04-b10f-dce8539e696a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.514329 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:09.574423 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:09.586454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.587707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d2deb0-acda-405b-a619-6a91add08f7e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.589790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.590958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.591427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] PATH_INFO: `/v3/projects/b58243a8bec844608c599a6c01e5e792/users/4138966312ad41d7a69fea8036fe7695/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.596000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=b58243a8bec844608c599a6c01e5e792, user_id=4138966312ad41d7a69fea8036fe7695, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.596789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.598305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.598841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.599447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] PATH_INFO: `/v3/projects/1e2ea7b2794f47198a18f33c4216850e/users/7f1c961d89084d03aa7a7f8c963ee7b5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.600619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.604260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2ea7b2794f47198a18f33c4216850e, user_id=7f1c961d89084d03aa7a7f8c963ee7b5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.608606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.623024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 839/1663] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:09 2022] PUT /identity/v3/projects/b58243a8bec844608c599a6c01e5e792/users/4138966312ad41d7a69fea8036fe7695/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:09.624308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.634778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:09.645364 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 825/1664] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:09 2022] PUT /identity/v3/projects/1e2ea7b2794f47198a18f33c4216850e/users/7f1c961d89084d03aa7a7f8c963ee7b5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:09.646296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.648074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:09.734973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10c1c3-f9bc-4aca-9bac-1247dd33295a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.744218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.745885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.746470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.747180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.749104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.753663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.755708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cfd00e-eb35-4922-b378-f38b1df35bca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.773941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d475b2-bcd2-4366-80a9-54fe305542d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.775276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d475b2-bcd2-4366-80a9-54fe305542d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.775706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d475b2-bcd2-4366-80a9-54fe305542d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.776093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d475b2-bcd2-4366-80a9-54fe305542d2 admin admin] PATH_INFO: `/v3/projects/1554a7044e07480b88de96f9562c1b7a/users/b55cd36678fa4bfeabdde72c4b9a463b/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.780517 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 826/1665] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:09 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:09.782542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d475b2-bcd2-4366-80a9-54fe305542d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1554a7044e07480b88de96f9562c1b7a, user_id=b55cd36678fa4bfeabdde72c4b9a463b, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.785566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:09.787658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d475b2-bcd2-4366-80a9-54fe305542d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.787863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:09.803970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b880c8-5f90-44e6-a867-44549f4b6cb6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:09.808720 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 840/1666] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:09 2022] PUT /identity/v3/projects/1554a7044e07480b88de96f9562c1b7a/users/b55cd36678fa4bfeabdde72c4b9a463b/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:09.816114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f50832-b1e9-445b-83b9-eb9a3659e37d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.816963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f50832-b1e9-445b-83b9-eb9a3659e37d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.818821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f50832-b1e9-445b-83b9-eb9a3659e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.876014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-69f50832-b1e9-445b-83b9-eb9a3659e37d None None] MFA Rules not processed for user `46e0b8e0c22a4cf28cb444c0dec3e731`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:09.878680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69f50832-b1e9-445b-83b9-eb9a3659e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:09.895106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0486af-5fa1-404f-b829-58b8fddc19ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:09.896294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0486af-5fa1-404f-b829-58b8fddc19ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.896714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0486af-5fa1-404f-b829-58b8fddc19ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.899207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0486af-5fa1-404f-b829-58b8fddc19ce admin admin] PATH_INFO: `/v3/projects/dc426599e38543e3a00c093be0998dd2/users/a6eba41fd50a48649ec569f2882fc465/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.900208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0486af-5fa1-404f-b829-58b8fddc19ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc426599e38543e3a00c093be0998dd2, user_id=a6eba41fd50a48649ec569f2882fc465, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:09.903066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0486af-5fa1-404f-b829-58b8fddc19ce admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:09.938186 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 827/1667] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:09 2022] PUT /identity/v3/projects/dc426599e38543e3a00c093be0998dd2/users/a6eba41fd50a48649ec569f2882fc465/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:09.939881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d55c-2f4b-4d44-9812-8822ee583e5f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:09.940173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d55c-2f4b-4d44-9812-8822ee583e5f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:09.940488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d7d55c-2f4b-4d44-9812-8822ee583e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:09.962191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-41d7d55c-2f4b-4d44-9812-8822ee583e5f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:09.963915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-41d7d55c-2f4b-4d44-9812-8822ee583e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.029563 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 841/1668] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.029563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.029563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.029563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.050114 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:10.067805 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 828/1669] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.069705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c019-4e28-41e2-87a2-82a553c7c5c6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.069992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c019-4e28-41e2-87a2-82a553c7c5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.070270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd55c019-4e28-41e2-87a2-82a553c7c5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.097295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] MFA Rules not processed for user `4138966312ad41d7a69fea8036fe7695`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:10.100846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.110916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fd55c019-4e28-41e2-87a2-82a553c7c5c6 None None] MFA Rules not processed for user `7f1c961d89084d03aa7a7f8c963ee7b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:10.112332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fd55c019-4e28-41e2-87a2-82a553c7c5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.191459 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:10.208848 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 842/1670] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.210284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.217864 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 829/1671] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.219647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.219966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.220222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.228256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead8a22-73ac-4e48-b646-47764ad2a226 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:10.234813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7fe2d7-6854-42d9-aa54-0c83f41922b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:10.235964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe2d7-6854-42d9-aa54-0c83f41922b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.236447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe2d7-6854-42d9-aa54-0c83f41922b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.236796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7fe2d7-6854-42d9-aa54-0c83f41922b6 admin admin] PATH_INFO: `/v3/projects/c3600ce6f9ce4e74bbe4885216741573/users/d5c36018cd5145148fa4e7c6132545bf/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.256639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] MFA Rules not processed for user `b55cd36678fa4bfeabdde72c4b9a463b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:10.258227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.258398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fe2d7-6854-42d9-aa54-0c83f41922b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3600ce6f9ce4e74bbe4885216741573, user_id=d5c36018cd5145148fa4e7c6132545bf, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:10.263572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7fe2d7-6854-42d9-aa54-0c83f41922b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:10.286280 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 843/1672] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:10 2022] PUT /identity/v3/projects/c3600ce6f9ce4e74bbe4885216741573/users/d5c36018cd5145148fa4e7c6132545bf/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:10.289022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.289721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.290177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.332539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] MFA Rules not processed for user `a6eba41fd50a48649ec569f2882fc465`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:10.334043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.374818 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 830/1673] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.376642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.379204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.425786 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 844/1674] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.427575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.429931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.489496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1923f3a-17cc-4b33-bf00-308c620e8416 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:10.494328 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:10.501749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7088240e-52a3-4b2f-abb1-ab8b8e397326 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:10.505978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a915dfe-e265-4ab1-bf05-c4142f157451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:10.506704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915dfe-e265-4ab1-bf05-c4142f157451 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.506991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915dfe-e265-4ab1-bf05-c4142f157451 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.507268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a915dfe-e265-4ab1-bf05-c4142f157451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.569753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e702a235-ba0a-4f69-9e56-893e83ca5c6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:10.570435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a235-ba0a-4f69-9e56-893e83ca5c6f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.570760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a235-ba0a-4f69-9e56-893e83ca5c6f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.570906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e702a235-ba0a-4f69-9e56-893e83ca5c6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.584618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a915dfe-e265-4ab1-bf05-c4142f157451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:10.586653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a915dfe-e265-4ab1-bf05-c4142f157451 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:10.600843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 845/1675] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:10.603271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a7ddd-8188-4c5e-967e-d0f1773afdf5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.603838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a7ddd-8188-4c5e-967e-d0f1773afdf5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.604319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a7ddd-8188-4c5e-967e-d0f1773afdf5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.607069 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 846/1676] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:10.609386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.609881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.610369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.621732 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:10.642083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:10.644276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.651168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702a235-ba0a-4f69-9e56-893e83ca5c6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:10.652883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e702a235-ba0a-4f69-9e56-893e83ca5c6f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:10.658296 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 847/1677] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.659849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.674623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5eadb-f899-4772-a237-4897ac15f544 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:10.677020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 831/1678] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:10.678473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.678835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.679483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.688718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:10.689664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.689962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.690289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.691684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:10.694941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:10.702089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:10.703470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.739160 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 848/1679] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/projects => generated 395 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:10.739160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.741237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:10.807820 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 832/1680] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:10.808287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.824222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6bf57-ead4-4d90-a828-dc74fee281b7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:10.832331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6af03-ad5b-4f09-962d-39cfe8eb8941 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:10.837753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:10.839025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.839178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.839556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.883701 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:10.917518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:10.918480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:10.918771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:10.919050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:10.919790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:10.921824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:10.947127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 833/1681] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:10 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:10.948112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.958804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:10.960850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:10.978700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 849/1682] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:10.979333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:10.981098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.056607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cd000c-91be-4812-8d41-bef97f32a968 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.063734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.064670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.065055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.065440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.091121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15328d00-7009-4669-82b9-f85c729c3610 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.097384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.098117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.098406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.098687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.122524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.122524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.140108 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 850/1683] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:11.141897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.168300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.168525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164947e-48e7-4285-bcb1-319b6206e3d0 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.170121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.177187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.177819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.178274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.180424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.181619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.185565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.195600 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 834/1684] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:11.209238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.211693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.230086 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 851/1685] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:11.236543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.242710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb88a042-45b3-474c-b7e5-51f64aec9e85 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.249794 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:11.256641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.258109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaad25-4c9e-4809-9e15-a04709467ad7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.266254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.267496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.268311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.268665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.269769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.272238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.272512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.273162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.273655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] PATH_INFO: `/v3/projects/6860dafc30f944e195a9b0f5c570080c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.284486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6860dafc30f944e195a9b0f5c570080c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.288488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.289372 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 852/1686] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:11.291246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.293487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.332998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7ce92-71cb-45a0-8eed-fb2ef2720d8b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.348461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.349708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.350297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.350860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.394200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6860dafc30f944e195a9b0f5c570080c', 'request_id': 'req-5cf2d963-5e8e-431e-a05a-c45019966b67'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:11.396605 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:11.405272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6860dafc30f944e195a9b0f5c570080c', 'request_id': 'req-5cf2d963-5e8e-431e-a05a-c45019966b67'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:11.423821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6860dafc30f944e195a9b0f5c570080c', 'request_id': 'req-5cf2d963-5e8e-431e-a05a-c45019966b67'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:11.449554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] The token cache is being invalidate because project 6860dafc30f944e195a9b0f5c570080c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:11.450082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:11.451463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:11.456477 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 835/1687] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:11 2022] DELETE /identity/v3/projects/6860dafc30f944e195a9b0f5c570080c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:11.460460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.464156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.466577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.469184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.482907 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 853/1688] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:11.484564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.508813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2694c725-65cd-4496-991e-e9acd2a4834a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.602391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf2d963-5e8e-431e-a05a-c45019966b67 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.610488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.612082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.612610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.612974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] PATH_INFO: `/v3/projects/55c62fe0535e481989cca3a37b222ddf/users/6c607a1d8a40406db8520b166d778500/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.640583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55c62fe0535e481989cca3a37b222ddf, user_id=6c607a1d8a40406db8520b166d778500, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.645374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.678582 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 836/1689] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:11 2022] PUT /identity/v3/projects/55c62fe0535e481989cca3a37b222ddf/users/6c607a1d8a40406db8520b166d778500/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:11.680311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:11.693800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.709673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.710884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.711383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.711880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.715738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.856420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417cd318-c631-4464-b05a-8572a5c30008 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:11.858503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.862659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:11.862978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de18743-07c0-40f3-997f-4806b7533656 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.863580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.863868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.864147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] PATH_INFO: `/v3/users/df02f9ea242048cda173d6b255b18b93` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.865758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] RBAC: Authorizing `identity:delete_user(user_id=df02f9ea242048cda173d6b255b18b93)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:11.868246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:11.884856 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 854/1690] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:11 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:11.887576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d266e0-060f-4656-9d0f-f2d7212ed20d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:11.888065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d266e0-060f-4656-9d0f-f2d7212ed20d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:11.888575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d266e0-060f-4656-9d0f-f2d7212ed20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:11.959309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-91d266e0-060f-4656-9d0f-f2d7212ed20d None None] MFA Rules not processed for user `6c607a1d8a40406db8520b166d778500`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:11.965797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-91d266e0-060f-4656-9d0f-f2d7212ed20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:11.988944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df02f9ea242048cda173d6b255b18b93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.003607 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:12.011052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df02f9ea242048cda173d6b255b18b93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.041270 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:12.077471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df02f9ea242048cda173d6b255b18b93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.079816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df02f9ea242048cda173d6b255b18b93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.095186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df02f9ea242048cda173d6b255b18b93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.104166 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 837/1691] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:11 2022] DELETE /identity/v3/users/df02f9ea242048cda173d6b255b18b93 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:12.105359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:12.107079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:12.186097 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 855/1692] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:12.186097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.186097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.186097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.191255 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 856/1693] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:12 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:12.201641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:12.206075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:12.290794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04e17a-cd8c-4b7b-91ae-ab69734d3cee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:12.307071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:12.308083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.308737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.308737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] PATH_INFO: `/v3/users/f6a01f4d995040c98bba01aa537c9793` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.312535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6a01f4d995040c98bba01aa537c9793)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:12.315802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:12.434525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6a01f4d995040c98bba01aa537c9793'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.436149 n-d-master-1 devstack@keystone.service[80581]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 19 11:08:12.436870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:12.440594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:12.453773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6a01f4d995040c98bba01aa537c9793'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.527090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6a01f4d995040c98bba01aa537c9793'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.528771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6a01f4d995040c98bba01aa537c9793'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.560847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-738fc305-cbda-4bd4-ac86-69d8580be7ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6a01f4d995040c98bba01aa537c9793'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:12.585070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 838/1694] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:12 2022] DELETE /identity/v3/users/f6a01f4d995040c98bba01aa537c9793 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:12.596252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd96c-97ec-476a-97ae-69ab709a5b72 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.598021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd96c-97ec-476a-97ae-69ab709a5b72 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.598827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffd96c-97ec-476a-97ae-69ab709a5b72 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.607481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 839/1695] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:12 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:12.615360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.615787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.621134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.668182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:12.670171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:12.689331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb761720-3fb4-448d-9a9b-ab756fa8b23c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:12.820233 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:12.837353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0da5e0-1030-422e-b62b-918dc38300fd tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55cd36678fa4bfeabdde72c4b9a463b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1554a7044e07480b88de96f9562c1b7a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:12.839002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0da5e0-1030-422e-b62b-918dc38300fd tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.839371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0da5e0-1030-422e-b62b-918dc38300fd tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.839768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0da5e0-1030-422e-b62b-918dc38300fd tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] PATH_INFO: `/v3/projects/f284b55ae58940dda163b1faa2a81971` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.841897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0da5e0-1030-422e-b62b-918dc38300fd tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] RBAC: Authorizing `identity:get_project(project_id=f284b55ae58940dda163b1faa2a81971)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:12.845018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0da5e0-1030-422e-b62b-918dc38300fd tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:12.847766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 857/1696] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:12 2022] GET /identity/v3/projects/f284b55ae58940dda163b1faa2a81971 => generated 377 bytes in 648 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:12.849763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.850148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.850584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.883171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:12.884799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:12.886668 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 840/1697] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:12.889121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:12.892679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:12.909367 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:12.925376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f0c45c-4f80-4def-a115-fbce4fe7111d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:12.939560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:12.942730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:12.943363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:12.943808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] PATH_INFO: `/v3/projects/232ec43724bd48498479b2c45764116f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:12.946049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=232ec43724bd48498479b2c45764116f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:12.950945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:13.003023 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 858/1698] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:08:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:13.004149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:13.006026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.080640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '232ec43724bd48498479b2c45764116f', 'request_id': 'req-4c533e03-5e92-4af1-a540-03c62705ec04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:13.100008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '232ec43724bd48498479b2c45764116f', 'request_id': 'req-4c533e03-5e92-4af1-a540-03c62705ec04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:13.113833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '232ec43724bd48498479b2c45764116f', 'request_id': 'req-4c533e03-5e92-4af1-a540-03c62705ec04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:13.137874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] The token cache is being invalidate because project 232ec43724bd48498479b2c45764116f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:13.138270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:13.139463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:13.144674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 841/1699] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:12 2022] DELETE /identity/v3/projects/232ec43724bd48498479b2c45764116f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:13.146863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:13.149547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.153243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263ea58-8eb6-4106-9d3b-5454bd90a51f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:13.247713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:13.249555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.249972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.250368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.254375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.343393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c533e03-5e92-4af1-a540-03c62705ec04 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:13.361806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:13.363243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.363915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.364594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.367943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.375528 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:13.380108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:13.382292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0b06d7-a166-444e-8dab-a9a2aa51e6e6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:13.398339 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 859/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:13.399943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067165-5be1-464d-a21a-33787445f0d2 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.400327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067165-5be1-464d-a21a-33787445f0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.400711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7067165-5be1-464d-a21a-33787445f0d2 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.411692 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 860/1701] 10.222.0.15 () {54 vars in 961 bytes} [Tue Jul 19 11:08:13 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:13.414240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c402f5-b683-4b32-8301-c374866dfcbd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.415367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c402f5-b683-4b32-8301-c374866dfcbd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.416010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c402f5-b683-4b32-8301-c374866dfcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.445754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a8c402f5-b683-4b32-8301-c374866dfcbd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:13.447534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8c402f5-b683-4b32-8301-c374866dfcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.458716 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 861/1702] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:13.460251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.460651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.460998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.515612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:13.517195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.628371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:13.632729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef9539f-6586-4285-9cb4-092e8dd2054b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:13.663250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 842/1703] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:13.669552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.670562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.671652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.687015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 862/1704] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 11:08:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:13.711065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:13.722379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:13.724929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.738468 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 843/1705] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:13.742180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b54d0-83af-43e8-8db1-348d1494f03d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:13.744778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:13.756773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:13.758786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.760927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.761360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.763298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395973b-52ca-4b08-b6a1-825dc2b54309 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:13.765611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.778104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:13.779215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.779694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.780629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.783214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:13.783847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:13.787422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:13.802773 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:13.811566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:13.817074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:13.831568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 844/1706] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:13.834927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:13.843691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 863/1707] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:13.890484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3b39-5b02-4915-8129-35854a66ee02 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:13.897597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:13.917200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:13.920166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.920479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.920811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.921537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:13.924156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10e89d4-3e59-4adf-8f01-6bbe8b1f167b service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:13.925345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:13.940807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:13.941492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:13.941776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:13.942053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:13.946296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:13.993250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 845/1708] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:13 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:13.999129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.094625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.096890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707e59c-8a4a-4ac2-85c1-1c6fdef8b861 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.108859 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 864/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:14.110199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.110477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.110757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.112383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 865/1710] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:14.117733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:14.120630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:14.142986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd46a6-3f49-4c29-99e7-8a5c833eb464 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:14.149072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:14.150009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.150301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.150581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.151330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.153666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.192414 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 846/1711] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:13 2022] POST /identity/v3/users => generated 295 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:14.199286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.212803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113d15f-56b4-4588-9a3d-c9c2c4305760 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:14.220196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:14.221342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.221859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.222290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.223241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.225624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.244301 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 847/1712] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:14.251187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.252090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.259123 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:14.274298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effe822-ee88-473a-a47d-c21b09a35fee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:14.281032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:14.282069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.282457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.283005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.283892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.286204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.302388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 848/1713] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:14.313142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.338331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e838bc40-263b-4e11-ae81-8cfa349cc475 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:14.345578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:14.346930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.347352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.347887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] PATH_INFO: `/v3/projects/bd93e0e279f04fb4ab15424222d55ccf/users/8d02026ba5b64c5f8e1ee7295aa35c62/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.377308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd93e0e279f04fb4ab15424222d55ccf, user_id=8d02026ba5b64c5f8e1ee7295aa35c62, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.382105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.450355 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 849/1714] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:14 2022] PUT /identity/v3/projects/bd93e0e279f04fb4ab15424222d55ccf/users/8d02026ba5b64c5f8e1ee7295aa35c62/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:14.450355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.453835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:14.465395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5cd2ed-d79d-4ec6-9681-6fa45ff0046d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:14.566461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc776922-f848-4782-8f87-ba72403881f6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:14.573409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:14.574925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.575367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.576277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] PATH_INFO: `/v3/projects/47e4d3b6d5264ec3b6a77fb5832d0e47` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.578944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e4d3b6d5264ec3b6a77fb5832d0e47)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.581346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.606693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab9ec83-042c-44ad-b119-641bb72083bb tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6eba41fd50a48649ec569f2882fc465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc426599e38543e3a00c093be0998dd2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:14.607687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ec83-042c-44ad-b119-641bb72083bb tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.608018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ec83-042c-44ad-b119-641bb72083bb tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.608299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab9ec83-042c-44ad-b119-641bb72083bb tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.610883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9ec83-042c-44ad-b119-641bb72083bb tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorizing `identity:get_project(project_id=5699b6d4baf348dbaac4add1d8545364)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:14.611986 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:14.613815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab9ec83-042c-44ad-b119-641bb72083bb tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:14.616993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 866/1715] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:14 2022] GET /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364 => generated 395 bytes in 500 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:08:14.618420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.618743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.619058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.659582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] MFA Rules not processed for user `8d02026ba5b64c5f8e1ee7295aa35c62`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:14.661246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:14.676836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e4d3b6d5264ec3b6a77fb5832d0e47', 'request_id': 'req-360020d7-2900-491b-8867-5841ffe1ff9c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:14.707220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e4d3b6d5264ec3b6a77fb5832d0e47', 'request_id': 'req-360020d7-2900-491b-8867-5841ffe1ff9c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:14.723862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e4d3b6d5264ec3b6a77fb5832d0e47', 'request_id': 'req-360020d7-2900-491b-8867-5841ffe1ff9c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:14.767159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] The token cache is being invalidate because project 47e4d3b6d5264ec3b6a77fb5832d0e47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:14.768279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:14.769355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-360020d7-2900-491b-8867-5841ffe1ff9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:14.774462 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 850/1716] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:14 2022] DELETE /identity/v3/projects/47e4d3b6d5264ec3b6a77fb5832d0e47 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:14.784079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f278-6c54-46de-90d0-fa9e19decdc9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:14.784079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f278-6c54-46de-90d0-fa9e19decdc9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:14.784791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6624f278-6c54-46de-90d0-fa9e19decdc9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:14.797480 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 851/1717] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:14 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:14.799483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f278-6c54-46de-90d0-fa9e19decdc9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:14.804211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6624f278-6c54-46de-90d0-fa9e19decdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:14.823538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 867/1718] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:14.825328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:14.959144 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:15.025486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.029704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6624f278-6c54-46de-90d0-fa9e19decdc9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:15.030053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:15.045611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:15.046779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.047196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.047647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] PATH_INFO: `/v3/users/8e750646a0444391ad41fac5fefc9df3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.049812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e750646a0444391ad41fac5fefc9df3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:15.053055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:15.158099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e750646a0444391ad41fac5fefc9df3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:15.175118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e750646a0444391ad41fac5fefc9df3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:15.176404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914e3165-c7f0-49d7-b104-1396b4c19e77 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:15.182718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b55cd36678fa4bfeabdde72c4b9a463b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1554a7044e07480b88de96f9562c1b7a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:15.184767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.185382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.185382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] PATH_INFO: `/v3/projects/f284b55ae58940dda163b1faa2a81971` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.186823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] RBAC: Authorizing `identity:get_project(project_id=f284b55ae58940dda163b1faa2a81971)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:15.189455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:15.192146 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 868/1719] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:14 2022] GET /identity/v3/projects/f284b55ae58940dda163b1faa2a81971 => generated 377 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:15.193145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.195177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:15.213684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05dabe1-e078-4fa6-91e6-c09f12e0afe8 tempest-FlavorsAccessTestJSON-1530552674 tempest-FlavorsAccessTestJSON-1530552674-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:15.217366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e750646a0444391ad41fac5fefc9df3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:15.219246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:15.220054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.220445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.220595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e750646a0444391ad41fac5fefc9df3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:15.220729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.221544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:15.224198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:15.240563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-140623ba-95a7-4f02-951e-407d418daac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e750646a0444391ad41fac5fefc9df3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:15.260145 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 852/1720] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:14 2022] DELETE /identity/v3/users/8e750646a0444391ad41fac5fefc9df3 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:15.262663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.263181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.263660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.266904 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 853/1721] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:15.273270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:15.277589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:15.282486 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 869/1722] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:15 2022] POST /identity/v3/projects => generated 391 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:15.288594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.291050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:15.390441 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:15.451583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e276db0-3372-47b2-9579-1908486ef4bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:15.472190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:15.472190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.472190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.472190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.472823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:15.472823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:15.510083 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 870/1723] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:15 2022] POST /identity/v3/users => generated 302 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:15.511810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.544320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ec2cd0-672b-40e9-b917-4f0f9c7dacc6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:15.559532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:15.561359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.563258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.564135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.567150 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Jul 19 11:08:15.567641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.569835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:15.573771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:15.578550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:15.628767 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 871/1724] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:15.633022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.670364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84db2fb-088b-46f0-ab40-ed407bac765a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:15.691719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:15.706255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:15.707307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:15.707990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] PATH_INFO: `/v3/projects/cf30b053d05d40edb6658398bca931eb/users/6ae46b8a08fe4bb7bfb211164f7f53cd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:15.781484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf30b053d05d40edb6658398bca931eb, user_id=6ae46b8a08fe4bb7bfb211164f7f53cd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:15.790451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:15.838085 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 872/1725] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:15 2022] PUT /identity/v3/projects/cf30b053d05d40edb6658398bca931eb/users/6ae46b8a08fe4bb7bfb211164f7f53cd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:15.847849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:15.909070 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:15.909389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dad9be-6961-427b-b1f7-87afad275cf2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:16.069687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6eba41fd50a48649ec569f2882fc465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc426599e38543e3a00c093be0998dd2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:16.070729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.071127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.071573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.073996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorizing `identity:get_project(project_id=5699b6d4baf348dbaac4add1d8545364)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:16.077850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:16.081234 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 854/1726] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:15 2022] GET /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364 => generated 395 bytes in 809 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:08:16.136234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:16.138277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:16.176151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f222a1-5738-44e4-a3fa-4b1461bac36d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:16.203057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:16.203057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.203057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.203057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.207244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:16.207244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:16.268273 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 873/1727] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:15 2022] GET /identity/v3/roles => generated 1420 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:16.268273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:16.276396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:16.316292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75fd122-b26b-48de-aaab-83dcf9a396d1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:16.326646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:16.328633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.329584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.330349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] PATH_INFO: `/v3/projects/5c2a1983f2d641c0a54a81c491508ca9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.333168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c1132-f73c-461b-985f-79547a272fba tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:16.334937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c2a1983f2d641c0a54a81c491508ca9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:16.338091 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:08:16.338091 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:08:16.338091 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:08:16.341543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:16.349355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:16.350139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.350425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.351283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.354080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:16.391198 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:16.532495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:16.537017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:16.560924 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 855/1728] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:16 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:16.589384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c2a1983f2d641c0a54a81c491508ca9', 'request_id': 'req-831b0c8e-f162-4cb0-b235-639eb8ad6b03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:16.590298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:16.612456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c2a1983f2d641c0a54a81c491508ca9', 'request_id': 'req-831b0c8e-f162-4cb0-b235-639eb8ad6b03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:16.621761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cd1582-fb74-4601-bbb7-c9093e3edd9e service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:16.622386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c2a1983f2d641c0a54a81c491508ca9', 'request_id': 'req-831b0c8e-f162-4cb0-b235-639eb8ad6b03'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:16.646177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] The token cache is being invalidate because project 5c2a1983f2d641c0a54a81c491508ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:16.646545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:16.647754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831b0c8e-f162-4cb0-b235-639eb8ad6b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:16.649794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 874/1729] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:16 2022] DELETE /identity/v3/projects/5c2a1983f2d641c0a54a81c491508ca9 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:16.651745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c565-72e5-45e5-995f-93cfc5e9091d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.652037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c565-72e5-45e5-995f-93cfc5e9091d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.652486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0476c565-72e5-45e5-995f-93cfc5e9091d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.654996 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 875/1730] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:16.656745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6cd7-7ffd-41ff-b8ba-515e83d75948 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.657317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6cd7-7ffd-41ff-b8ba-515e83d75948 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.657783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd6cd7-7ffd-41ff-b8ba-515e83d75948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.684899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-12bd6cd7-7ffd-41ff-b8ba-515e83d75948 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:16.686597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12bd6cd7-7ffd-41ff-b8ba-515e83d75948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:16.763385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:16.763385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.763385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.763385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] PATH_INFO: `/v3/projects/cf30b053d05d40edb6658398bca931eb/users/6ae46b8a08fe4bb7bfb211164f7f53cd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.765582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf30b053d05d40edb6658398bca931eb, user_id=6ae46b8a08fe4bb7bfb211164f7f53cd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:16.775484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:16.791960 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 856/1731] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:16 2022] PUT /identity/v3/projects/cf30b053d05d40edb6658398bca931eb/users/6ae46b8a08fe4bb7bfb211164f7f53cd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:16.792911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:16.808842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:16.844394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 876/1732] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:16.845297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe5b1a-44d4-4d86-b144-ffbcc2b31cc0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:16.845297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe5b1a-44d4-4d86-b144-ffbcc2b31cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:16.851293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe5b1a-44d4-4d86-b144-ffbcc2b31cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:16.935143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-61fe5b1a-44d4-4d86-b144-ffbcc2b31cc0 None None] MFA Rules not processed for user `6ae46b8a08fe4bb7bfb211164f7f53cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:16.940049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61fe5b1a-44d4-4d86-b144-ffbcc2b31cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:16.951276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:16.956166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:17.032141 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:17.092119 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:17.168723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c77ee-ed99-457f-a5ac-094a31624b46 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.169192 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 877/1733] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:17.171767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.172276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.172804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.183807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae7532-c615-4ea6-bfc4-d6dcf4d605a5 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6eba41fd50a48649ec569f2882fc465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc426599e38543e3a00c093be0998dd2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.184743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7532-c615-4ea6-bfc4-d6dcf4d605a5 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.185031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7532-c615-4ea6-bfc4-d6dcf4d605a5 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.185309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7532-c615-4ea6-bfc4-d6dcf4d605a5 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.189676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae7532-c615-4ea6-bfc4-d6dcf4d605a5 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorizing `identity:get_project(project_id=5699b6d4baf348dbaac4add1d8545364)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:17.191800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae7532-c615-4ea6-bfc4-d6dcf4d605a5 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:17.198862 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 857/1734] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:16 2022] GET /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364 => generated 395 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:17.201754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.202043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.202313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.229626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:17.237293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:17.251697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] MFA Rules not processed for user `49fd9615857544d783832d148d0720ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:17.255351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:17.376310 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 858/1735] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:17.382431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:17.406306 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 878/1736] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:17.411791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:17.414215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d7f0a-89c1-43b7-9ae7-096aaea68e08 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.440100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788aac5-6773-477f-a0f5-c75145bdc8be None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.442020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.443223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.443694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.444151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.445903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.446619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.446913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.447230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.447963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:17.448286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:17.450055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:17.469860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:17.477374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:17.480767 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 879/1737] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:17.488521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:17.513760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb4de5-9204-4a50-9e1c-56c775d24830 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.528312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.529064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.529378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.529629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.530005 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 859/1738] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:17.530505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:17.533813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:17.619165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:17.623455 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 880/1739] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:17 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:17.625186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:17.626252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:17.683380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3184aff3-128e-4c67-a22e-22c7c6a98448 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.838830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ce5242-0471-4256-9d26-f532ec7389df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.860900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.864110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.864515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.867318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.875826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:17.880389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:17.944022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 881/1740] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:17 2022] POST /identity/v3/users => generated 294 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:08:17.951670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:17.955371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:17.979709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987511e-f499-4f92-b030-13616402e1af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.979709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987511e-f499-4f92-b030-13616402e1af service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.979709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987511e-f499-4f92-b030-13616402e1af service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.979709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4987511e-f499-4f92-b030-13616402e1af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.984484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4987511e-f499-4f92-b030-13616402e1af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:17.984747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb63fa-17b5-4c61-bd52-f1dd9d97e2e6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:17.994790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:17.995636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:17.995922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:17.996197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] PATH_INFO: `/v3/users/784d8e3197b3464d9e2f939adf4551f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:17.998398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=784d8e3197b3464d9e2f939adf4551f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:18.003987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:18.022098 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:18.161619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987511e-f499-4f92-b030-13616402e1af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:18.165675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4987511e-f499-4f92-b030-13616402e1af service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:18.169130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784d8e3197b3464d9e2f939adf4551f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:18.171962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784d8e3197b3464d9e2f939adf4551f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:18.195605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784d8e3197b3464d9e2f939adf4551f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:18.197065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784d8e3197b3464d9e2f939adf4551f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:18.198474 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 860/1741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:18.201584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987511e-f499-4f92-b030-13616402e1af service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:18.224941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4987511e-f499-4f92-b030-13616402e1af service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:18.228957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-03ab54a7-703f-4d0f-bf40-1310c5b20f0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784d8e3197b3464d9e2f939adf4551f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:18.238291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:18.240077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.240646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.241372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.242969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:18.247044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:18.264319 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:18.283583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 861/1742] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:18.290484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:18.294825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:18.319960 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 882/1743] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:17 2022] DELETE /identity/v3/users/784d8e3197b3464d9e2f939adf4551f5 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:18.325558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00f41-5310-40ac-a4f7-840a8dc38e9c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.327887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00f41-5310-40ac-a4f7-840a8dc38e9c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.329244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca00f41-5310-40ac-a4f7-840a8dc38e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.352623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83189e0-115a-4b3d-8e52-59ce8e694d5f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:18.375325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ca00f41-5310-40ac-a4f7-840a8dc38e9c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:18.377963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ca00f41-5310-40ac-a4f7-840a8dc38e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:18.478498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3979f0-2eec-44d8-84ff-51de3496e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:18.479932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3979f0-2eec-44d8-84ff-51de3496e242 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.480840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3979f0-2eec-44d8-84ff-51de3496e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.481449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3979f0-2eec-44d8-84ff-51de3496e242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.482476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3979f0-2eec-44d8-84ff-51de3496e242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:18.484757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3979f0-2eec-44d8-84ff-51de3496e242 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:18.508942 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 862/1744] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:18 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:18.510509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910371b-5dec-4521-96db-8259263cc8ed None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.510921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910371b-5dec-4521-96db-8259263cc8ed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.510921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1910371b-5dec-4521-96db-8259263cc8ed None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.512524 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 863/1745] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:18.513344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910371b-5dec-4521-96db-8259263cc8ed None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:18.531626 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 883/1746] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:18.533550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.533550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.533774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.570419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:18.571675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:18.575096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1910371b-5dec-4521-96db-8259263cc8ed None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:18.583639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:18.586895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.587245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.587858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] PATH_INFO: `/v3/projects/0f764b9ac3934ab09bb175da5ac696d3/users/a5098d2a57b64502be98d9eea5a91cca/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.616071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f764b9ac3934ab09bb175da5ac696d3, user_id=a5098d2a57b64502be98d9eea5a91cca, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:18.621010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:18.652699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 864/1747] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:18 2022] PUT /identity/v3/projects/0f764b9ac3934ab09bb175da5ac696d3/users/a5098d2a57b64502be98d9eea5a91cca/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:18.666390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:18.671641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:18.733425 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 884/1748] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:18.754839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:18.768003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:18.791122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f399d1-1315-4ada-9f6f-b8c1f079059e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:18.814838 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:18.856730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea97bac-7990-4ce8-bb20-8762708ec6a4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:18.863422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b17d1-1b26-4c50-a2e5-49cc4face27e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:18.864639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b17d1-1b26-4c50-a2e5-49cc4face27e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.865123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b17d1-1b26-4c50-a2e5-49cc4face27e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.865600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b17d1-1b26-4c50-a2e5-49cc4face27e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.930710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:18.931643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:18.932013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:18.932249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] PATH_INFO: `/v3/users/8d02026ba5b64c5f8e1ee7295aa35c62` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:18.933682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d02026ba5b64c5f8e1ee7295aa35c62)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:18.935786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:19.011676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b17d1-1b26-4c50-a2e5-49cc4face27e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:19.024594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b17d1-1b26-4c50-a2e5-49cc4face27e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:19.031155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d02026ba5b64c5f8e1ee7295aa35c62'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:19.031912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d02026ba5b64c5f8e1ee7295aa35c62'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:19.049953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d02026ba5b64c5f8e1ee7295aa35c62'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:19.056821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d02026ba5b64c5f8e1ee7295aa35c62'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:19.064672 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 865/1749] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:19.071477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d02026ba5b64c5f8e1ee7295aa35c62'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:19.076105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d785e8-a44f-4567-9983-f001d682edb8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:19.078505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d785e8-a44f-4567-9983-f001d682edb8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:19.080754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d785e8-a44f-4567-9983-f001d682edb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:19.096383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 885/1750] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:18 2022] DELETE /identity/v3/users/8d02026ba5b64c5f8e1ee7295aa35c62 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:19.097434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:19.100040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.150640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e0d785e8-a44f-4567-9983-f001d682edb8 None None] MFA Rules not processed for user `a5098d2a57b64502be98d9eea5a91cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:19.152377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0d785e8-a44f-4567-9983-f001d682edb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.172338 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:19.221370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe5eb20-09ea-4b61-a4c7-322b1ed507ad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:19.233136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:19.234176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:19.234583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:19.234952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:19.238375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.282031 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:19.367381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:19.369308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:19.384432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 886/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:19.385551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:19.387181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.402963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9a7ab-f4e2-496e-93af-bd1cb8bd844a service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:19.409827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:19.411539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:19.411917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:19.412265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:19.414663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.451946 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 866/1752] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 377 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:19.464470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:19.464982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:19.465410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:19.512911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:19.514167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.562400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:19.566354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:19.593497 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 887/1753] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:19.596461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:19.599402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.700004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 867/1754] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:19.799939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:19.802750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:19.909832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b5208-a1cb-438c-9d6d-bff3ef9aed86 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:19.927375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:19.927977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:19.928264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:19.928576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:19.933490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:19.938792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:19.995628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e578-417d-4ab8-81f9-282dbbbb2291 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:20.001292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:20.002649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:20.002649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:20.003146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:20.008389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 888/1755] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:19 2022] POST /identity/v3/projects => generated 389 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:20.009703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:20.018559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:20.020451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:20.042234 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 868/1756] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:20.146719 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:20.180451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb6abd-f09c-4a80-b315-4abf375dfd13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:20.197233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:20.197952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:20.198301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:20.201004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:20.206492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:20.217991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:20.257936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:20.261919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:20.277380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 889/1757] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:20 2022] POST /identity/v3/users => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:20.278541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:20.325791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984f777-7d2b-44ac-b671-6473f1e134f9 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:20.338590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:20.341052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:20.342581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:20.342846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] PATH_INFO: `/v3/projects/f284b55ae58940dda163b1faa2a81971` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:20.347898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f284b55ae58940dda163b1faa2a81971)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:20.352665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:20.473720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f14b5-bc89-4036-a854-2d00fadfd7d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:20.494912 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:20.499660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f284b55ae58940dda163b1faa2a81971', 'request_id': 'req-6d3f594f-d174-4761-86b4-1b359faaa6aa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:20.530090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f284b55ae58940dda163b1faa2a81971', 'request_id': 'req-6d3f594f-d174-4761-86b4-1b359faaa6aa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:20.541375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f284b55ae58940dda163b1faa2a81971', 'request_id': 'req-6d3f594f-d174-4761-86b4-1b359faaa6aa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:20.562692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] The token cache is being invalidate because project f284b55ae58940dda163b1faa2a81971 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:20.562972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:20.580460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:20.588880 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 869/1758] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:20 2022] DELETE /identity/v3/projects/f284b55ae58940dda163b1faa2a81971 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:20.589908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:20.598793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:20.678850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:20.679587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:20.685514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:20.685744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:20.694504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:20.882651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3f594f-d174-4761-86b4-1b359faaa6aa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:20.891847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:20.893078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:20.893574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:20.894063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:20.895595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:20.895950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:20.897394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:20.900868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:20.908425 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 890/1759] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:20.916324 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 870/1760] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:20 2022] GET /identity/v3/roles => generated 1420 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:20.917341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:20.926314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:20.926314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:20.931443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:20.979263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fdaaa-ba5f-4500-882b-f34b103c91c2 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:20.990512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:20.992003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:20.992621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:20.993549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] PATH_INFO: `/v3/users/b55cd36678fa4bfeabdde72c4b9a463b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:20.996483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b55cd36678fa4bfeabdde72c4b9a463b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:21.000815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:21.006260 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:21.112719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6818f5-f89f-4df5-af63-ca651a593529 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:21.136823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:21.137875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:21.138417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:21.139493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:21.145779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:21.156580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b55cd36678fa4bfeabdde72c4b9a463b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.160671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b55cd36678fa4bfeabdde72c4b9a463b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.206489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b55cd36678fa4bfeabdde72c4b9a463b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.208240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b55cd36678fa4bfeabdde72c4b9a463b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.212527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:21.220206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda49882-ccdc-453a-959a-353b5f9daf2f service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:21.229860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b55cd36678fa4bfeabdde72c4b9a463b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.252765 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 871/1761] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:21.254966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:21.257796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:21.258221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:21.331798 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 891/1762] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:20 2022] DELETE /identity/v3/users/b55cd36678fa4bfeabdde72c4b9a463b => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:21.335088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:21.355088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:21.403154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] MFA Rules not processed for user `d5c36018cd5145148fa4e7c6132545bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:21.407925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:21.560847 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:21.650991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddcb47a-24dd-4a9f-b0ea-65d4e7215704 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:21.653108 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 872/1763] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:21.655374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:21.668290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:21.683413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3252130-b48b-42a8-a64f-9a955430edb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:21.685047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252130-b48b-42a8-a64f-9a955430edb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:21.685381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252130-b48b-42a8-a64f-9a955430edb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:21.685613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3252130-b48b-42a8-a64f-9a955430edb0 admin admin] PATH_INFO: `/v3/projects/6b6d440cc9904911bdbb2cf199047ccc/users/c660523d9e8a4ae99ae8c2545a7312d4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:21.709369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252130-b48b-42a8-a64f-9a955430edb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6d440cc9904911bdbb2cf199047ccc, user_id=c660523d9e8a4ae99ae8c2545a7312d4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:21.712131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca405d-e6b6-4aa0-a934-09809cb6f434 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:21.723156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3252130-b48b-42a8-a64f-9a955430edb0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:21.725297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:21.726446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:21.726734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:21.727150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] PATH_INFO: `/v3/projects/bd93e0e279f04fb4ab15424222d55ccf` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:21.733775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd93e0e279f04fb4ab15424222d55ccf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:21.735964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:21.762346 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 892/1764] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:21 2022] PUT /identity/v3/projects/6b6d440cc9904911bdbb2cf199047ccc/users/c660523d9e8a4ae99ae8c2545a7312d4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:21.763893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b687-f095-4bac-be2f-af11af48ff5d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:21.764976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b687-f095-4bac-be2f-af11af48ff5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:21.765265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b687-f095-4bac-be2f-af11af48ff5d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:21.789571 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 893/1765] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:21 2022] GET /identity => generated 270 bytes in 27 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:21.790448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16b687-f095-4bac-be2f-af11af48ff5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:21.799308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e16b687-f095-4bac-be2f-af11af48ff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:21.881136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd93e0e279f04fb4ab15424222d55ccf', 'request_id': 'req-5918575a-5bc9-47c0-b620-836c49a12784'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.902444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd93e0e279f04fb4ab15424222d55ccf', 'request_id': 'req-5918575a-5bc9-47c0-b620-836c49a12784'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.923556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd93e0e279f04fb4ab15424222d55ccf', 'request_id': 'req-5918575a-5bc9-47c0-b620-836c49a12784'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.952826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] The token cache is being invalidate because project bd93e0e279f04fb4ab15424222d55ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:21.953495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.954665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:21.958094 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 873/1766] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:21 2022] DELETE /identity/v3/projects/bd93e0e279f04fb4ab15424222d55ccf => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:21.959323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:21.961152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.079570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16b687-f095-4bac-be2f-af11af48ff5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:22.103939 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:22.184684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5918575a-5bc9-47c0-b620-836c49a12784 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:22.196709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:22.197522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.197831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.198105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.199853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:22.201620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:22.236091 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 874/1767] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:22.237936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:22.241433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.271054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:22.271054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.272914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.273394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.274288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:22.279190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:22.366128 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 894/1768] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:21 2022] POST /identity/v3/projects => generated 401 bytes in 572 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:22.366128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.367462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.387419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.390308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.399430 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:22.483759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598388b-9611-4717-9e7f-a4e87d838d5d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:22.545361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ac15f8-eed6-4d7a-a38a-d66b9073eb1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:22.558816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:22.563441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.564273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.565116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] PATH_INFO: `/v3/users/6ae46b8a08fe4bb7bfb211164f7f53cd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.568593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae46b8a08fe4bb7bfb211164f7f53cd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:22.578898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:22.589552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6eba41fd50a48649ec569f2882fc465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc426599e38543e3a00c093be0998dd2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:22.590484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.591071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.591258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.597436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorizing `identity:get_project(project_id=5699b6d4baf348dbaac4add1d8545364)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:22.600425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:22.602560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 875/1769] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:22 2022] GET /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364 => generated 395 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:22.603435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.605339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.625204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30eadf3-d2d1-4b10-9a2a-c14faaedeab2 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:22.634809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:22.636393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.636945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.637358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] PATH_INFO: `/v3/projects/1554a7044e07480b88de96f9562c1b7a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.639259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=1554a7044e07480b88de96f9562c1b7a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:22.644098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:22.717163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae46b8a08fe4bb7bfb211164f7f53cd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.718097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae46b8a08fe4bb7bfb211164f7f53cd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.735496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae46b8a08fe4bb7bfb211164f7f53cd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.736598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae46b8a08fe4bb7bfb211164f7f53cd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.773430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9296bff6-3438-43a8-ab61-8b5c55469f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae46b8a08fe4bb7bfb211164f7f53cd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.809274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1554a7044e07480b88de96f9562c1b7a', 'request_id': 'req-bc022eff-ae5e-47db-bcec-216f396217fe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.840395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1554a7044e07480b88de96f9562c1b7a', 'request_id': 'req-bc022eff-ae5e-47db-bcec-216f396217fe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.854320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 895/1770] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:22 2022] DELETE /identity/v3/users/6ae46b8a08fe4bb7bfb211164f7f53cd => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:22.857434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c976-7650-4a44-ada4-477021d86732 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:22.857642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1554a7044e07480b88de96f9562c1b7a', 'request_id': 'req-bc022eff-ae5e-47db-bcec-216f396217fe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.858383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c976-7650-4a44-ada4-477021d86732 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:22.859137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279c976-7650-4a44-ada4-477021d86732 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:22.862208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 896/1771] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:22.863890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c976-7650-4a44-ada4-477021d86732 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.866687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e279c976-7650-4a44-ada4-477021d86732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:22.891670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] The token cache is being invalidate because project 1554a7044e07480b88de96f9562c1b7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:22.892141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.895652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:22.905021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 876/1772] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:22 2022] DELETE /identity/v3/projects/1554a7044e07480b88de96f9562c1b7a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:22.907408 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:22.915239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:22.917659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.032338 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:23.091790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc022eff-ae5e-47db-bcec-216f396217fe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.099922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279c976-7650-4a44-ada4-477021d86732 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.134437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364da799-64f8-4bad-bee9-1b3a7d32b0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.135728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfb0168-dbcf-45e7-8bd4-174fba5e1ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.138508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da799-64f8-4bad-bee9-1b3a7d32b0b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.139886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da799-64f8-4bad-bee9-1b3a7d32b0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.139886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364da799-64f8-4bad-bee9-1b3a7d32b0b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.140814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364da799-64f8-4bad-bee9-1b3a7d32b0b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.144418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0168-dbcf-45e7-8bd4-174fba5e1ff8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.145047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0168-dbcf-45e7-8bd4-174fba5e1ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.145438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfb0168-dbcf-45e7-8bd4-174fba5e1ff8 admin admin] PATH_INFO: `/v3/projects/6b6d440cc9904911bdbb2cf199047ccc/users/c660523d9e8a4ae99ae8c2545a7312d4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.149114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364da799-64f8-4bad-bee9-1b3a7d32b0b2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.160131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0168-dbcf-45e7-8bd4-174fba5e1ff8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6d440cc9904911bdbb2cf199047ccc, user_id=c660523d9e8a4ae99ae8c2545a7312d4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.185193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfb0168-dbcf-45e7-8bd4-174fba5e1ff8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.204138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 877/1773] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:22 2022] POST /identity/v3/users => generated 307 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:23.205666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cfe28-af48-46ff-a23b-ae71e69e8d11 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.205954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cfe28-af48-46ff-a23b-ae71e69e8d11 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.206310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669cfe28-af48-46ff-a23b-ae71e69e8d11 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.217353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 878/1774] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:23 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:23.218879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586aa0-3e5a-4dd4-9f72-fdda22bbc43f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.219172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586aa0-3e5a-4dd4-9f72-fdda22bbc43f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.219488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12586aa0-3e5a-4dd4-9f72-fdda22bbc43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.258993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 897/1775] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:22 2022] PUT /identity/v3/projects/6b6d440cc9904911bdbb2cf199047ccc/users/c660523d9e8a4ae99ae8c2545a7312d4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:23.258993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.258993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.259383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.302219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-12586aa0-3e5a-4dd4-9f72-fdda22bbc43f None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:23.303638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:23.305212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.305368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-12586aa0-3e5a-4dd4-9f72-fdda22bbc43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.405292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 898/1776] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:23.405292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.408972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255b992-8fe5-406d-aed2-22abd54f5ccb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.416527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.417571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.417870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.418134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.418886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.420617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.447070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 899/1777] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:23.448399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:23.450700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.558752 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 879/1778] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:23.561364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.562304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.562304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.597188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.598570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.626564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] MFA Rules not processed for user `c660523d9e8a4ae99ae8c2545a7312d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:23.627830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.656592 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:23.723414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1281b72b-bf05-4efc-a9cd-4a7c9b3d46f2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.734309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9f5b8-b83e-4b70-9572-f46945efc32d tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6eba41fd50a48649ec569f2882fc465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc426599e38543e3a00c093be0998dd2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.736471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f5b8-b83e-4b70-9572-f46945efc32d tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.737441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f5b8-b83e-4b70-9572-f46945efc32d tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.738304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9f5b8-b83e-4b70-9572-f46945efc32d tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.741191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9f5b8-b83e-4b70-9572-f46945efc32d tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorizing `identity:get_project(project_id=5699b6d4baf348dbaac4add1d8545364)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.744415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9f5b8-b83e-4b70-9572-f46945efc32d tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.747884 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 900/1779] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:23 2022] GET /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364 => generated 395 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:23.751265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.752220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.752962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.761698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 880/1780] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:23.763215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.783364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a1c2cc-cafd-4b27-8a3c-22b2e3c739f0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:23.791678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:23.793081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:23.793498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:23.793860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] PATH_INFO: `/v3/projects/c98206a6abba4c948eb7c67dba3a4cb3/users/bb8a5288786f48209fdfa67ad057ddbe/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:23.819234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98206a6abba4c948eb7c67dba3a4cb3, user_id=bb8a5288786f48209fdfa67ad057ddbe, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:23.819414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:23.819559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:23.820309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.841101 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 881/1781] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:23 2022] PUT /identity/v3/projects/c98206a6abba4c948eb7c67dba3a4cb3/users/bb8a5288786f48209fdfa67ad057ddbe/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:23.842302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.844299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.855169 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 901/1782] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:23.855169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:23.855169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:23.903698 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:23.969952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7e5cc-bf3b-4b38-b52f-b99c244427cf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.007538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae6cf5-e755-448d-bdfa-1adb42a34896 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.019533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.021265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.021783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.022327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] PATH_INFO: `/v3/projects/cf30b053d05d40edb6658398bca931eb` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.032663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf30b053d05d40edb6658398bca931eb)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.035224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.086327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.087718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.088719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.089225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.177779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf30b053d05d40edb6658398bca931eb', 'request_id': 'req-abebb4a5-bbfa-4937-b48d-99f29e609c1a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.214588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf30b053d05d40edb6658398bca931eb', 'request_id': 'req-abebb4a5-bbfa-4937-b48d-99f29e609c1a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.227471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf30b053d05d40edb6658398bca931eb', 'request_id': 'req-abebb4a5-bbfa-4937-b48d-99f29e609c1a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.249968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] The token cache is being invalidate because project cf30b053d05d40edb6658398bca931eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:24.250866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.252637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abebb4a5-bbfa-4937-b48d-99f29e609c1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:24.255898 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 882/1783] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:23 2022] DELETE /identity/v3/projects/cf30b053d05d40edb6658398bca931eb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:24.258754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.259753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.260339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.287450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.290999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.322369 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 902/1784] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:24.324230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.330492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] MFA Rules not processed for user `a5098d2a57b64502be98d9eea5a91cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:24.336770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.350999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8f151-eae2-41c4-a552-4943c22f7581 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.406200 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:24.494090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d09bb4-7f56-478d-978b-568a84a50720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.497425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09bb4-7f56-478d-978b-568a84a50720 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.497987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09bb4-7f56-478d-978b-568a84a50720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.501724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d09bb4-7f56-478d-978b-568a84a50720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.502329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d09bb4-7f56-478d-978b-568a84a50720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.512614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d09bb4-7f56-478d-978b-568a84a50720 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.513839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 883/1785] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:24.515591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.530153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.538447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 903/1786] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:24.540222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94913-7f9d-472b-b939-362f5e292247 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.540546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94913-7f9d-472b-b939-362f5e292247 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.540916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a94913-7f9d-472b-b939-362f5e292247 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.543244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 904/1787] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:24.545127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.545400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.545995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.571910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:24.576399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.578023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1cf09-eeef-4650-aaac-1ccaa1406e27 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.588372 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 905/1788] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:24.589599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.596552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.604209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.605744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.606318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.606809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.608230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:24.608805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.611201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6da71-87e9-42f7-9ab4-9888f599fbaf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.611993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.616819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.618120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.618511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.618898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] PATH_INFO: `/v3/projects/c98206a6abba4c948eb7c67dba3a4cb3/users/bb8a5288786f48209fdfa67ad057ddbe/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.621679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98206a6abba4c948eb7c67dba3a4cb3, user_id=bb8a5288786f48209fdfa67ad057ddbe, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:24.625058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:24.642598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 906/1789] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:24 2022] PUT /identity/v3/projects/c98206a6abba4c948eb7c67dba3a4cb3/users/bb8a5288786f48209fdfa67ad057ddbe/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:24.643465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:08:24.647685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.654897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 884/1790] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:24.656598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.660449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.821758 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:24.822650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:24.836824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:24.897948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7d589-8270-4d0f-887a-9d6360946167 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:24.932234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:24.935320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:24.935818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:24.938669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:24.950070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.070726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5202174a-3758-427b-a2f2-4d6df208fd68 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.100134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25b4ee-8bc2-47b6-8bbc-49ce478e5b38 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a6eba41fd50a48649ec569f2882fc465', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc426599e38543e3a00c093be0998dd2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.107237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b4ee-8bc2-47b6-8bbc-49ce478e5b38 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.108250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b4ee-8bc2-47b6-8bbc-49ce478e5b38 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.110578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25b4ee-8bc2-47b6-8bbc-49ce478e5b38 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] PATH_INFO: `/v3/projects/55c62fe0535e481989cca3a37b222ddf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.119443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b4ee-8bc2-47b6-8bbc-49ce478e5b38 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorizing `identity:get_project(project_id=55c62fe0535e481989cca3a37b222ddf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.129815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25b4ee-8bc2-47b6-8bbc-49ce478e5b38 tempest-FlavorsAccessNegativeTestJSON-807314109 tempest-FlavorsAccessNegativeTestJSON-807314109-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.143843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 907/1791] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/projects/55c62fe0535e481989cca3a37b222ddf => generated 395 bytes in 495 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:25.148019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cffcee-f8b9-4607-b189-8c65931bcf76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.148971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cffcee-f8b9-4607-b189-8c65931bcf76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.149599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cffcee-f8b9-4607-b189-8c65931bcf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.251319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c8cffcee-f8b9-4607-b189-8c65931bcf76 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:25.251615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.254745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.256327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c8cffcee-f8b9-4607-b189-8c65931bcf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.301143 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 885/1792] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 645 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:25.302989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.430561 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:25.550386 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 908/1793] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:25.554316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.555700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.556440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.572380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa4f9d9-4267-4db8-b8c8-4676bf91963f service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.595477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.596747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.597219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.597492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.598428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.600760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.640868 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 886/1794] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/projects => generated 403 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:25.641981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.719543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:25.724487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.751778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5500df90-c61f-4374-a43d-62e67ff2cf8f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.762613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.764371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.764371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.766051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.769460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:25.769460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.770940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.784428 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:25.802541 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 887/1795] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:25.804139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.833938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a79bfc-734e-4df0-aaff-f1c09d7cb79d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.848179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.851090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.851304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.852589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.855535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.864173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.911272 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 888/1796] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/users => generated 302 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:25.914365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.919523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:25.923555 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 909/1797] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:25.924905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:25.951581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ba0a66-4f43-402a-8a65-398d9e5d2497 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.955272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95feb7-0a1f-4070-b383-4233d726d118 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:25.966585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.968250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.971062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:25.971389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.971830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] PATH_INFO: `/v3/users/5f87308f44ee4edcb8db3cdc5cf0c54d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.972134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:25.973337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:25.973704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:25.976288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f87308f44ee4edcb8db3cdc5cf0c54d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.976715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:25.979178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:25.981662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.031003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 910/1798] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:25 2022] POST /identity/v3/projects => generated 403 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:26.031003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.111328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f87308f44ee4edcb8db3cdc5cf0c54d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:26.125320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f87308f44ee4edcb8db3cdc5cf0c54d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:26.156677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840cff42-5882-4f22-b376-7db226f1fabc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.163318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.165031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.165191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f87308f44ee4edcb8db3cdc5cf0c54d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:26.165299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.165632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.166416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.166791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f87308f44ee4edcb8db3cdc5cf0c54d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:26.168510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.183635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f87308f44ee4edcb8db3cdc5cf0c54d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:26.189725 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 911/1799] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:26.189725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.191321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.199237 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 889/1800] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:25 2022] DELETE /identity/v3/users/5f87308f44ee4edcb8db3cdc5cf0c54d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:26.201271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.204672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.209451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc83746-e271-44f3-abb6-97eccd9dfbaa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.256128 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:26.421111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.422011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.422519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.422866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.423931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.429564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.488020 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 912/1801] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:26 2022] POST /identity/v3/users => generated 302 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:26.492870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.495662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.532897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32901fc1-b773-4f18-ba5a-31914f97f0a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.545422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485f6ee-7f5f-4f47-aa4c-d25d6f40c1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.547586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f6ee-7f5f-4f47-aa4c-d25d6f40c1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.548531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f6ee-7f5f-4f47-aa4c-d25d6f40c1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.549457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485f6ee-7f5f-4f47-aa4c-d25d6f40c1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.551480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f6ee-7f5f-4f47-aa4c-d25d6f40c1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.556836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485f6ee-7f5f-4f47-aa4c-d25d6f40c1e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.607074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 913/1802] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:26.610511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.610867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.611487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.645420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93db0c-7553-4614-ad07-8210d4772a8e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.661227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:26.661227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.697602 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 914/1803] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:26.713519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.717891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.718959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.719490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.719930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.737016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:26.743395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f8e819-fdbf-4f6c-825c-c94ce7dbc6b5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.755552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.757140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.757944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.758543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.762884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.769487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.803233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 915/1804] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:26.803233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.827888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c944bfe-bb31-4add-a2c6-920dd1cad81e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:26.843015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:26.845028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:26.845323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:26.846789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] PATH_INFO: `/v3/projects/56ac90fe8e4e4769869b81415bb279cf/users/5ba793aef6f04b61a2d2818baf3658f6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:26.894025 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:26.907991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ac90fe8e4e4769869b81415bb279cf, user_id=5ba793aef6f04b61a2d2818baf3658f6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:26.910879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:26.958597 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 916/1805] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:26 2022] PUT /identity/v3/projects/56ac90fe8e4e4769869b81415bb279cf/users/5ba793aef6f04b61a2d2818baf3658f6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:26.959608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:26.970084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:27.026245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.035942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:27.089667 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 890/1806] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 890 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:08:27.099082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:27.205640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626452a-56b0-4dc8-96b3-b39e6a92ec6d service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:27.375896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b74311-7a8c-4421-ae08-55a25c3426a0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:27.403944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80f239-d0fc-4ea5-9bff-d8161f28143b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:27.405283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f239-d0fc-4ea5-9bff-d8161f28143b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.405684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f239-d0fc-4ea5-9bff-d8161f28143b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.406190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80f239-d0fc-4ea5-9bff-d8161f28143b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.682486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f239-d0fc-4ea5-9bff-d8161f28143b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.684028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80f239-d0fc-4ea5-9bff-d8161f28143b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:27.692525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:27.694900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.707093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.715508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.719010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.726426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 917/1807] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 767 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:27.728021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.728786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.732554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:27.735893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.797126 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:27.806532 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 891/1808] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:27 2022] GET /identity/v3/roles => generated 1420 bytes in 716 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:27.817712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:27.821794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:27.836845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] MFA Rules not processed for user `5ba793aef6f04b61a2d2818baf3658f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:27.836845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:27.889748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce766e69-6521-4974-84e4-e865c0a74e23 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:27.921569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:27.922607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:27.932018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:27.932494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] PATH_INFO: `/v3/users/285bcd7f1a884301986daa4bbd3ab9fd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:27.943174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=285bcd7f1a884301986daa4bbd3ab9fd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:27.945327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:28.103511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '285bcd7f1a884301986daa4bbd3ab9fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.119585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '285bcd7f1a884301986daa4bbd3ab9fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.160425 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 918/1809] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:28.161736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:28.165388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '285bcd7f1a884301986daa4bbd3ab9fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.168068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '285bcd7f1a884301986daa4bbd3ab9fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.210575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '285bcd7f1a884301986daa4bbd3ab9fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:28.216140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013d9ca4-58ef-40e7-8b3e-2a8ccece3b0d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:28.245402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 892/1810] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:27 2022] DELETE /identity/v3/users/285bcd7f1a884301986daa4bbd3ab9fd => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:28.246770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:28.251743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:28.257554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6e546-9496-4103-8373-5d8c1443e0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:28.263989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e546-9496-4103-8373-5d8c1443e0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.266380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e546-9496-4103-8373-5d8c1443e0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.267199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6e546-9496-4103-8373-5d8c1443e0a0 admin admin] PATH_INFO: `/v3/projects/50fafdf084754fb682a8bf5407f37c84/users/d6e042fb81da4e03bdb3a2d8caecea29/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.376210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6e546-9496-4103-8373-5d8c1443e0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fafdf084754fb682a8bf5407f37c84, user_id=d6e042fb81da4e03bdb3a2d8caecea29, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:28.379374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6e546-9496-4103-8373-5d8c1443e0a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:28.447554 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 919/1811] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:28 2022] PUT /identity/v3/projects/50fafdf084754fb682a8bf5407f37c84/users/d6e042fb81da4e03bdb3a2d8caecea29/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:28.449246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90e27-c3c3-448b-9100-117f03fd574e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.449560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90e27-c3c3-448b-9100-117f03fd574e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.449817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f90e27-c3c3-448b-9100-117f03fd574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.453593 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:28.559662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-87f90e27-c3c3-448b-9100-117f03fd574e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:28.573083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87f90e27-c3c3-448b-9100-117f03fd574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:28.591517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed5174-d767-477f-9cf5-e725a3750bc7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:28.796152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa6c62-1bfd-44d6-9006-ef2c63500ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:28.826395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6c62-1bfd-44d6-9006-ef2c63500ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.826395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6c62-1bfd-44d6-9006-ef2c63500ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.826743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa6c62-1bfd-44d6-9006-ef2c63500ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.829337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6c62-1bfd-44d6-9006-ef2c63500ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:28.840575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa6c62-1bfd-44d6-9006-ef2c63500ea8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:28.967298 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 920/1812] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:28.969356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.969356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.971686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:28.976325 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 893/1813] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/projects => generated 401 bytes in 730 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:28.983782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:28.986952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:28.989539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.051293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:29.065918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.273420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:29.274691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.287875 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 921/1814] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:29.288977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.326543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca5dcdd-6622-43ac-9a75-2c9107acdd48 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.353830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.354896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.355339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.355761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.356798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.359124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.415039 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:29.447088 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 922/1815] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:29 2022] POST /identity/v3/users => generated 307 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:29.448632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.458198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.486591 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 894/1816] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 19 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 509 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:29.488468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.493985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:29.538217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bd7a55-e038-4803-a6f7-3473981e2cdb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.561045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.562621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.563401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.565488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] PATH_INFO: `/v3/projects/5699b6d4baf348dbaac4add1d8545364` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.568036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5699b6d4baf348dbaac4add1d8545364)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.583901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.677713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e9e081-0993-407b-84b4-c75eff1f5833 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.688266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:29.694414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:29.695272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:29.695911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:29.726773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:29.731311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:29.758079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5699b6d4baf348dbaac4add1d8545364', 'request_id': 'req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.783831 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 923/1817] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:29.784925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5699b6d4baf348dbaac4add1d8545364', 'request_id': 'req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.786448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.815964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5699b6d4baf348dbaac4add1d8545364', 'request_id': 'req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.826842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319961a3-59c1-4095-bf54-688dda3d4ed7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:29.841365 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:29.908721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] The token cache is being invalidate because project 5699b6d4baf348dbaac4add1d8545364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:29.913115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.918591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:29.939472 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 895/1818] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:29 2022] DELETE /identity/v3/projects/5699b6d4baf348dbaac4add1d8545364 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:29.951963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:29.954080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:30.087964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:30.089136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:30.089707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:30.090252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:30.094898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:30.440695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f01e8-8a6c-400a-b984-2b9d0e3be843 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:30.454976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:30.457656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:30.459639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:30.459639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:30.461703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:30.467176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:30.507888 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 896/1819] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:29 2022] GET /identity/v3/roles => generated 1420 bytes in 568 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:30.507888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:30.513489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:30.552567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad266a-9c78-4913-916a-09537e94c2a9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:30.561100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:30.563484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:30.564189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:30.565997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:30.571311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:30.581478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:30.588707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:30.654146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:30.681507 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 924/1820] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 895 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:30.683471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:30.683966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:30.690154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:30.763565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3ddc-6a7d-4fcf-b0bc-1f4bcdf9daac service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:30.765519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 897/1821] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:30.775099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:30.830010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59755ffd-389f-4845-a727-78019061630f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:30.832103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59755ffd-389f-4845-a727-78019061630f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:30.848782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59755ffd-389f-4845-a727-78019061630f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:30.849601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59755ffd-389f-4845-a727-78019061630f admin admin] PATH_INFO: `/v3/users/a6eba41fd50a48649ec569f2882fc465` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:30.860984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59755ffd-389f-4845-a727-78019061630f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6eba41fd50a48649ec569f2882fc465)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:30.873178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59755ffd-389f-4845-a727-78019061630f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:30.884194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3f0de3-0a19-4177-9103-6a20f9755b55 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:30.939495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:30.943476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:30.949917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:30.951156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] PATH_INFO: `/v3/projects/ffc7b2b3d6aa43d5a42c898a3381730e/users/3adce20a2fca43808de43f940433755b/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:31.032288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc7b2b3d6aa43d5a42c898a3381730e, user_id=3adce20a2fca43808de43f940433755b, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:31.046244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:31.095049 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 898/1822] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:30 2022] PUT /identity/v3/projects/ffc7b2b3d6aa43d5a42c898a3381730e/users/3adce20a2fca43808de43f940433755b/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:31.101606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:31.125243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6eba41fd50a48649ec569f2882fc465'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:31.126805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6eba41fd50a48649ec569f2882fc465'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:31.129716 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:31.146212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6eba41fd50a48649ec569f2882fc465'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:31.147573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6eba41fd50a48649ec569f2882fc465'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:31.162838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6eba41fd50a48649ec569f2882fc465'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:31.229607 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 925/1823] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:30 2022] DELETE /identity/v3/users/a6eba41fd50a48649ec569f2882fc465 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:31.378927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba570ff-a0fe-4bad-9131-5ac7f8739a0d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:31.616657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33995d3d-e5f0-4b38-a881-925328689c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:31.618110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995d3d-e5f0-4b38-a881-925328689c00 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:31.618605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995d3d-e5f0-4b38-a881-925328689c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:31.619172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33995d3d-e5f0-4b38-a881-925328689c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:31.620286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33995d3d-e5f0-4b38-a881-925328689c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:31.624229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33995d3d-e5f0-4b38-a881-925328689c00 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:31.627491 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:31.667702 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 899/1824] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:31 2022] GET /identity/v3/roles => generated 1420 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:31.675036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:31.689827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:31.736004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59755ffd-389f-4845-a727-78019061630f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:31.749951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3406a330-826c-4839-83f4-118ed3dd4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:31.753077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406a330-826c-4839-83f4-118ed3dd4f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:31.760103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406a330-826c-4839-83f4-118ed3dd4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:31.762854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3406a330-826c-4839-83f4-118ed3dd4f1a admin admin] PATH_INFO: `/v3/projects/ffc7b2b3d6aa43d5a42c898a3381730e/users/3adce20a2fca43808de43f940433755b/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:31.770435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406a330-826c-4839-83f4-118ed3dd4f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffc7b2b3d6aa43d5a42c898a3381730e, user_id=3adce20a2fca43808de43f940433755b, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:31.787828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3406a330-826c-4839-83f4-118ed3dd4f1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:31.850108 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 926/1825] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:31 2022] PUT /identity/v3/projects/ffc7b2b3d6aa43d5a42c898a3381730e/users/3adce20a2fca43808de43f940433755b/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:31.871906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:31.873189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:31.873777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:32.027001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] MFA Rules not processed for user `3adce20a2fca43808de43f940433755b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:32.058227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:32.277773 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 900/1826] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:31 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:32.289766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:32.292282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:32.293125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:32.369389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:32.372107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:32.668331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 927/1827] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:08:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:32.736247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:32.738516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:32.756432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:32.758421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:32.962170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdbd22-5a71-4608-84e6-17275a12759a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:32.968585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d55d74-24c7-4bfc-a29d-5393f2ac1874 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:32.975413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:32.976574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:32.977235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:32.977722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:32.982996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:32.984687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:32.985017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:32.985508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:32.993364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:32.996439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:33.009808 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 928/1828] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:08:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:08:33.022101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:33.023867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:33.102961 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 901/1829] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:32 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:33.179794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:33.182730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:33.219131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8ef2ad-4d0b-46bb-8473-6fbf7ecdea55 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:33.232843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:33.234397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:33.234915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:33.235410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:33.238949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:33.430708 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:33.505387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:33.515674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:33.580899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 929/1830] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:33.610784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:33.613144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:33.912758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90023adf-c04d-43db-b182-5b73871e9d14 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:33.942756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:33.946195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:33.951995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:33.952830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] PATH_INFO: `/v3/projects/afa33f27a7db4720954fe8cbaf17668a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:33.956937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afa33f27a7db4720954fe8cbaf17668a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:33.965996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:34.015697 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:34.160395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afa33f27a7db4720954fe8cbaf17668a', 'request_id': 'req-723e461c-c2c4-46ae-a316-9387091bbdf1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.181254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afa33f27a7db4720954fe8cbaf17668a', 'request_id': 'req-723e461c-c2c4-46ae-a316-9387091bbdf1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.191885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afa33f27a7db4720954fe8cbaf17668a', 'request_id': 'req-723e461c-c2c4-46ae-a316-9387091bbdf1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.288647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] The token cache is being invalidate because project afa33f27a7db4720954fe8cbaf17668a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:34.302422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.306394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.326740 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 902/1831] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:33 2022] DELETE /identity/v3/projects/afa33f27a7db4720954fe8cbaf17668a => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:34.327619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:34.354458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776b1ff8-d6b1-4f32-8c33-b213524e476e service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:34.549280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:34.550292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:34.550579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:34.550870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] PATH_INFO: `/v3/users/4138966312ad41d7a69fea8036fe7695` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:34.553222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4138966312ad41d7a69fea8036fe7695)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:34.555563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:34.702023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4138966312ad41d7a69fea8036fe7695'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.705915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4138966312ad41d7a69fea8036fe7695'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.727083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4138966312ad41d7a69fea8036fe7695'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.728016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4138966312ad41d7a69fea8036fe7695'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.747982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4138966312ad41d7a69fea8036fe7695'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:34.810126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 930/1832] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:34 2022] DELETE /identity/v3/users/4138966312ad41d7a69fea8036fe7695 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:34.838759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:34.840840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:34.881026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723e461c-c2c4-46ae-a316-9387091bbdf1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:35.046879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:35.049092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:35.171342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:35.174469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:35.175310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:35.180909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] PATH_INFO: `/v3/projects/dc426599e38543e3a00c093be0998dd2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:35.184245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc426599e38543e3a00c093be0998dd2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:35.188875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:35.264868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7db50f-bd2d-4194-ba3f-d5af20c7db6f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:35.284907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:35.286076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:35.286294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:35.286655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] PATH_INFO: `/v3/users/5ba793aef6f04b61a2d2818baf3658f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:35.294805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ba793aef6f04b61a2d2818baf3658f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:35.298925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:35.336488 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:35.436695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc426599e38543e3a00c093be0998dd2', 'request_id': 'req-a6f4d194-d15a-40e1-aa77-815ba636c197'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.454914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc426599e38543e3a00c093be0998dd2', 'request_id': 'req-a6f4d194-d15a-40e1-aa77-815ba636c197'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.490112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc426599e38543e3a00c093be0998dd2', 'request_id': 'req-a6f4d194-d15a-40e1-aa77-815ba636c197'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.530898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ba793aef6f04b61a2d2818baf3658f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.534685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ba793aef6f04b61a2d2818baf3658f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.547387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] The token cache is being invalidate because project dc426599e38543e3a00c093be0998dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:35.548986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.551174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.562985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ba793aef6f04b61a2d2818baf3658f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.563890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ba793aef6f04b61a2d2818baf3658f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.568928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 903/1833] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:34 2022] DELETE /identity/v3/projects/dc426599e38543e3a00c093be0998dd2 => generated 0 bytes in 720 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:35.571738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:35.579733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:35.597930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5652347e-764b-466e-b5ed-6c699f616337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ba793aef6f04b61a2d2818baf3658f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:35.694369 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 931/1834] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:35 2022] DELETE /identity/v3/users/5ba793aef6f04b61a2d2818baf3658f6 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:35.700237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:35.700649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:35.700978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:35.726441 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:35.785998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:35.787528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:35.889388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f4d194-d15a-40e1-aa77-815ba636c197 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:36.116230 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 932/1835] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:36.230727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:36.234555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:36.283235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:36.287029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:36.295143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:36.296959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] PATH_INFO: `/v3/users/6c607a1d8a40406db8520b166d778500` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:36.305423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c607a1d8a40406db8520b166d778500)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:36.328559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:36.570120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c607a1d8a40406db8520b166d778500'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:36.592466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c607a1d8a40406db8520b166d778500'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:36.629407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c607a1d8a40406db8520b166d778500'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:36.630608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c607a1d8a40406db8520b166d778500'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:36.666355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c607a1d8a40406db8520b166d778500'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:36.690787 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 904/1836] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:35 2022] DELETE /identity/v3/users/6c607a1d8a40406db8520b166d778500 => generated 0 bytes in 1120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:36.691645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f76c9db-3caf-49a7-acfc-0361ca8173d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:36.989971 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:37.068738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:37.069409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:37.069600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:37.069849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:37.081316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:37.469026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:37.472612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f664823-96ab-4748-a0e5-abccb63decdf service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:37.500803 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 933/1837] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 1272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:38.648042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:38.649635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:38.702037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b0c9e-5f04-436c-ae34-d5418a88ec30 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:38.753968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:38.755526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:38.756157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:38.756537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] PATH_INFO: `/v3/projects/b58243a8bec844608c599a6c01e5e792` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:38.781300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b58243a8bec844608c599a6c01e5e792)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:38.785499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:38.997753 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:39.026869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b58243a8bec844608c599a6c01e5e792', 'request_id': 'req-8f382172-872e-493a-a369-11d508703f05'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:39.067964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b58243a8bec844608c599a6c01e5e792', 'request_id': 'req-8f382172-872e-493a-a369-11d508703f05'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:39.112523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b58243a8bec844608c599a6c01e5e792', 'request_id': 'req-8f382172-872e-493a-a369-11d508703f05'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:39.187546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] The token cache is being invalidate because project b58243a8bec844608c599a6c01e5e792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:39.187546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:39.187546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8f382172-872e-493a-a369-11d508703f05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:39.198904 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 905/1838] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:38 2022] DELETE /identity/v3/projects/b58243a8bec844608c599a6c01e5e792 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:39.200591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:39.201461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:39.201461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:39.239762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:39.242659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:39.627647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 934/1839] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:39.641036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa665-50eb-489e-a891-d7a4c15cabb3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:39.641282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa665-50eb-489e-a891-d7a4c15cabb3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:39.641806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55efa665-50eb-489e-a891-d7a4c15cabb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:39.764098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-55efa665-50eb-489e-a891-d7a4c15cabb3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:39.772538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55efa665-50eb-489e-a891-d7a4c15cabb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:39.842054 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 906/1840] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:39.851039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:39.893530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d3e58-0d3f-4ba8-9e51-0eee1acbdf23 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:39.912176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:39.925480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb072162-5e2e-40f3-ad63-4a5a3e9d5d43 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:39.926663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb072162-5e2e-40f3-ad63-4a5a3e9d5d43 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:39.927402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb072162-5e2e-40f3-ad63-4a5a3e9d5d43 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:39.931034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 907/1841] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:08:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:08:39.933821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:39.938397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:39.941193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:39.949721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:39.958499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:39.969917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26a6330-06ec-48ac-95e0-acddb0d4a259 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:40.066788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 935/1842] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:40.071423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb072162-5e2e-40f3-ad63-4a5a3e9d5d43 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:40.146333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:40.146778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:40.147272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:40.210642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb072162-5e2e-40f3-ad63-4a5a3e9d5d43 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:40.280893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:40.282161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:40.282668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:40.283178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:40.284621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:40.321092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:40.323349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:40.327485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:40.443455 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 908/1843] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:40 2022] POST /identity/v3/projects => generated 411 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:40.448292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:40.649399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cf1e68-5aaa-480c-afaf-76095d9aa235 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:40.662524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:40.663766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:40.668336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:40.669216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:40.670492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:40.680185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:40.715274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 909/1844] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:40 2022] POST /identity/v3/users => generated 306 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:08:40.720912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:40.737928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bad62-b800-4ae9-8681-1d6b51dce03a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:40.751293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:40.755645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:40.756378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:40.762742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:40.766855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:40.775020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:40.826991 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 910/1845] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:40.838244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 936/1846] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:08:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 694 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:40.844217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:40.886071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e904b0-3d45-40eb-b97c-bd68bb8a3cc9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:40.912925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28e1d1-6c3e-4b95-8466-b85542bf38de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:40.914666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e1d1-6c3e-4b95-8466-b85542bf38de admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:40.915183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e1d1-6c3e-4b95-8466-b85542bf38de admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:40.915692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28e1d1-6c3e-4b95-8466-b85542bf38de admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:40.917532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e1d1-6c3e-4b95-8466-b85542bf38de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:40.930541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28e1d1-6c3e-4b95-8466-b85542bf38de admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:40.968792 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 911/1847] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:40.974306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:41.016867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ac49a-538c-40cb-a0cc-987627f6dae5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:41.032906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:41.034955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:41.037704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:41.038704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] PATH_INFO: `/v3/projects/d3a20f1003a9486e80035bfe173e20b4/users/442516ecaf024e9180248220f224ee9b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:41.055289 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:41.104753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a20f1003a9486e80035bfe173e20b4, user_id=442516ecaf024e9180248220f224ee9b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:41.110345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:41.155819 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 937/1848] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:40 2022] PUT /identity/v3/projects/d3a20f1003a9486e80035bfe173e20b4/users/442516ecaf024e9180248220f224ee9b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:41.176957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:41.177690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:41.177690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:41.184267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:41.186501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:41.279777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] MFA Rules not processed for user `442516ecaf024e9180248220f224ee9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:41.281858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:41.496931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e717b4e-8fd1-48b7-9af5-6ec55ea59eff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:41.524622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:41.526965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:41.527267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:41.527686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:41.571332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:41.576584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:41.612442 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 938/1849] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:41.613561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:41.622636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:41.636307 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 912/1850] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:41 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:41.639387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:41.661998 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:41.970931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e783c53-669c-4607-b3ef-ec1d9c2a85bb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:41.990040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:41.991081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:41.992930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:41.993427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:41.994375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:42.009855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:42.044997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bacbb6-8a51-4d92-9647-341ed43c9409 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:42.080288 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 913/1851] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:41 2022] POST /identity/v3/projects => generated 411 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:42.087686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:42.113530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:42.130286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:42.132594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:42.132873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] PATH_INFO: `/v3/projects/55c62fe0535e481989cca3a37b222ddf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:42.170228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55c62fe0535e481989cca3a37b222ddf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:42.174054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:42.589169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55c62fe0535e481989cca3a37b222ddf', 'request_id': 'req-a266be28-0a73-4bd1-b49e-7529c4063be5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:42.606665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaedf33-97a4-4411-813d-027f981e15b9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:42.632862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55c62fe0535e481989cca3a37b222ddf', 'request_id': 'req-a266be28-0a73-4bd1-b49e-7529c4063be5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:42.687220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55c62fe0535e481989cca3a37b222ddf', 'request_id': 'req-a266be28-0a73-4bd1-b49e-7529c4063be5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:42.745761 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:42.786627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] The token cache is being invalidate because project 55c62fe0535e481989cca3a37b222ddf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:42.794890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:42.799852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:42.823019 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 939/1852] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:41 2022] DELETE /identity/v3/projects/55c62fe0535e481989cca3a37b222ddf => generated 0 bytes in 1210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:42.835558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:42.851180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:42.925086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808356-7be4-4956-ab5a-ab5584592b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:42.926132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808356-7be4-4956-ab5a-ab5584592b58 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:42.926582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808356-7be4-4956-ab5a-ab5584592b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:42.927033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808356-7be4-4956-ab5a-ab5584592b58 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:42.929276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808356-7be4-4956-ab5a-ab5584592b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:42.942751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808356-7be4-4956-ab5a-ab5584592b58 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:43.047116 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 914/1853] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:42 2022] POST /identity/v3/users => generated 312 bytes in 957 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:43.062817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441de020-4f06-436b-9871-03ea00292f9a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:43.070689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441de020-4f06-436b-9871-03ea00292f9a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:43.074252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441de020-4f06-436b-9871-03ea00292f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:43.174233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-441de020-4f06-436b-9871-03ea00292f9a None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:43.175567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-441de020-4f06-436b-9871-03ea00292f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:43.304638 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:43.402544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266be28-0a73-4bd1-b49e-7529c4063be5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:43.433935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:43.451438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:43.458124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:43.458930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] PATH_INFO: `/v3/projects/56ac90fe8e4e4769869b81415bb279cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:43.466518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ac90fe8e4e4769869b81415bb279cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:43.469233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:43.606492 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 915/1854] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jul 19 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:43.614005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:43.623279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:43.625331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:43.707209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ac90fe8e4e4769869b81415bb279cf', 'request_id': 'req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:43.747914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ac90fe8e4e4769869b81415bb279cf', 'request_id': 'req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:43.772425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ac90fe8e4e4769869b81415bb279cf', 'request_id': 'req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:43.808281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:43.814294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] The token cache is being invalidate because project 56ac90fe8e4e4769869b81415bb279cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:43.815180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:43.817481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:43.818217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:43.834911 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 940/1855] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:42 2022] DELETE /identity/v3/projects/56ac90fe8e4e4769869b81415bb279cf => generated 0 bytes in 1005 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:43.834911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:43.837068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.122684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc920a42-16fb-41d1-a12a-2c1b3b21e2a9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:44.124385 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 916/1856] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:44.127951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:44.137020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:44.137631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:44.137981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:44.138269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:44.139204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:44.143764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:44.144076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.175015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 941/1857] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:43 2022] GET /identity/v3/roles => generated 1420 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:44.176324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:44.181432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.204519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252824f-1560-438c-8f37-5dd4362ef2ad None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:44.234057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:44.235600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:44.236420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:44.236909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] PATH_INFO: `/v3/users/3adce20a2fca43808de43f940433755b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:44.244364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adce20a2fca43808de43f940433755b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:44.249337 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:44.258197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:44.299675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eab846-1e66-45de-b689-d6a9fefe9ebb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:44.312177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:44.313565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:44.314270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:44.314785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:44.322867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.339178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:44.349934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17840c17-bab3-453a-aa9a-d523a845be89 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:44.364959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 942/1858] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:44.366864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:44.367467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:44.368230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:44.398499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:44.400457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.417143 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 943/1859] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:44.419348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:44.447946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ba2c3-ae7e-49f4-9f1b-55855db9cf13 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:44.464109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:44.467367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:44.470415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:44.471181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] PATH_INFO: `/v3/projects/616fd3aa5fe3490180c2a3373edbfa75/users/680c54e6771e44308e050d39ad3a6378/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:44.486382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adce20a2fca43808de43f940433755b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:44.522444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adce20a2fca43808de43f940433755b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:44.528795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616fd3aa5fe3490180c2a3373edbfa75, user_id=680c54e6771e44308e050d39ad3a6378, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:44.540798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:44.584950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adce20a2fca43808de43f940433755b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:44.589633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adce20a2fca43808de43f940433755b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:44.599970 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 944/1860] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:44 2022] PUT /identity/v3/projects/616fd3aa5fe3490180c2a3373edbfa75/users/680c54e6771e44308e050d39ad3a6378/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:44.609505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:44.615697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.643264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adce20a2fca43808de43f940433755b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:44.674933 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 917/1861] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:44 2022] DELETE /identity/v3/users/3adce20a2fca43808de43f940433755b => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:44.678373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:44.684900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:44.872302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f77d1f6-78f7-4746-8927-6f361bc26ac3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:44.927784 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:45.028453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a04b3a-01c4-4137-a5cd-e596df9235aa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:45.069583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:45.070410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:45.070707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:45.071148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:45.071783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:45.073622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:45.131147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:45.131147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:45.131147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:45.131147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:45.131934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:45.131934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:45.131934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:45.195799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 945/1862] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 596 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:45.203273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:45.278458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f8f121-eda0-4d53-ab85-6f20e3033605 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:45.295525 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 918/1863] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 618 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:45.301207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:45.301510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:45.302386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:45.302386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:45.302778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:45.303434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:45.305674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:45.374332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d86be08-a0f3-4f7e-aecc-89c60f368bf5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:45.380124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 946/1864] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:45 2022] POST /identity/v3/projects => generated 387 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:45.383723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:45.449879 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:45.709511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1115a280-6dd4-476d-95e0-116a819537f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:45.711254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115a280-6dd4-476d-95e0-116a819537f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:45.711254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115a280-6dd4-476d-95e0-116a819537f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:45.711254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1115a280-6dd4-476d-95e0-116a819537f2 admin admin] PATH_INFO: `/v3/projects/616fd3aa5fe3490180c2a3373edbfa75/users/680c54e6771e44308e050d39ad3a6378/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:45.745452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115a280-6dd4-476d-95e0-116a819537f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616fd3aa5fe3490180c2a3373edbfa75, user_id=680c54e6771e44308e050d39ad3a6378, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:45.747876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861ba6d8-a067-45f4-bb97-55a02cd84b25 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:45.761815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1115a280-6dd4-476d-95e0-116a819537f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:45.783765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:45.786853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:45.789150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:45.790241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:45.798503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:45.801386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:45.825508 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 919/1865] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:45 2022] PUT /identity/v3/projects/616fd3aa5fe3490180c2a3373edbfa75/users/680c54e6771e44308e050d39ad3a6378/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:45.857371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:45.857930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:45.857930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:45.880219 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 947/1866] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:45 2022] POST /identity/v3/users => generated 294 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:45.887651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:45.907598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529744a-016c-477b-be70-e570e31ea4a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:46.022032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] MFA Rules not processed for user `680c54e6771e44308e050d39ad3a6378`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:46.028544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:46.204257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:46.205923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:46.206406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:46.206993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:46.208181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:46.222466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:46.268385 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 920/1867] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:46.300771 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 948/1868] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:08:46.306134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:46.324927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e389971-e0e9-4eb4-b561-6f572b7eafa7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:46.343637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6115fd6-eb5a-47ea-b953-0a9b8a546745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:46.344429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6115fd6-eb5a-47ea-b953-0a9b8a546745 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:46.344715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6115fd6-eb5a-47ea-b953-0a9b8a546745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:46.344990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6115fd6-eb5a-47ea-b953-0a9b8a546745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:46.345791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6115fd6-eb5a-47ea-b953-0a9b8a546745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:46.347547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6115fd6-eb5a-47ea-b953-0a9b8a546745 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:46.380729 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 921/1869] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:46.383366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:46.429973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ee064-33e2-4df4-a491-d0c4aacc926b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:46.475192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:46.477606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:46.478132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:46.478662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] PATH_INFO: `/v3/projects/03199c48900d44baa03830987b701343/users/068e5be69561439ca64737738fcd53d6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:46.598626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03199c48900d44baa03830987b701343, user_id=068e5be69561439ca64737738fcd53d6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:46.608731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:46.668088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:46.668324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:46.668674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:46.668954 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 949/1870] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:46 2022] PUT /identity/v3/projects/03199c48900d44baa03830987b701343/users/068e5be69561439ca64737738fcd53d6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:46.764375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] MFA Rules not processed for user `068e5be69561439ca64737738fcd53d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:46.765712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:46.951811 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:47.044717 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 922/1871] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:47.047703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:47.272623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a0620-d522-442d-a167-6a3cf175ab11 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:47.288636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:47.291104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:47.292383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:47.293842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:47.295174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:47.299657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:47.376985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 950/1872] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:47 2022] POST /identity/v3/projects => generated 385 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:47.382264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:47.494727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca00a342-9799-42bd-9b53-043e925ce0a0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:47.745811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:47.746586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:47.746976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:47.747207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:47.748070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:47.762175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:47.836299 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 923/1873] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:47 2022] POST /identity/v3/users => generated 299 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:47.838978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:47.871611 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:47.880218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:47.885165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:47.904641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c521a51-aecc-4d36-b106-24c7508a6e26 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:47.937325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:47.941946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:47.948439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:47.953073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:47.957384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:47.966155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.043153 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 951/1874] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:48.049424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.091089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3323bbb-1d92-477c-ac0f-16163fedd1f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.103913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.105398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.105973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.106480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] PATH_INFO: `/v3/projects/94ac3c7068c94f96b3dff4256da6df1f/users/36525c71fdeb4966ac18198d2ed5e8f2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.144564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ac3c7068c94f96b3dff4256da6df1f, user_id=36525c71fdeb4966ac18198d2ed5e8f2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.147883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.177336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 952/1875] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:48 2022] PUT /identity/v3/projects/94ac3c7068c94f96b3dff4256da6df1f/users/36525c71fdeb4966ac18198d2ed5e8f2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:48.181596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.296102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59576273-6bc4-427f-9346-c8374a0fcae1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.340018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8497e8-a80b-47b1-b1da-c2e5b2ba4df6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.369415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.370375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.370776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.371205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.372135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.374246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.447095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 953/1876] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:08:48.451805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.483169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75687c3-c093-445e-85e0-b4678d426f63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:48.513343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fabf8d-b5f1-4859-a937-43b88f381471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.514625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabf8d-b5f1-4859-a937-43b88f381471 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.515057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabf8d-b5f1-4859-a937-43b88f381471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.515652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fabf8d-b5f1-4859-a937-43b88f381471 admin admin] PATH_INFO: `/v3/projects/94ac3c7068c94f96b3dff4256da6df1f/users/36525c71fdeb4966ac18198d2ed5e8f2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.526284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabf8d-b5f1-4859-a937-43b88f381471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94ac3c7068c94f96b3dff4256da6df1f, user_id=36525c71fdeb4966ac18198d2ed5e8f2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:48.537802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fabf8d-b5f1-4859-a937-43b88f381471 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:48.568295 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 954/1877] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:48 2022] PUT /identity/v3/projects/94ac3c7068c94f96b3dff4256da6df1f/users/36525c71fdeb4966ac18198d2ed5e8f2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:48.609070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.610752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.611160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.699513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] MFA Rules not processed for user `36525c71fdeb4966ac18198d2ed5e8f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:48.701166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:48.784883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0672320-861a-45b6-9e34-38f8db4eda1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:48.786340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672320-861a-45b6-9e34-38f8db4eda1f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:48.786855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672320-861a-45b6-9e34-38f8db4eda1f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:48.787329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0672320-861a-45b6-9e34-38f8db4eda1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:48.816248 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:48.965791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 955/1878] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:48.973757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:48.976160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:49.069927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672320-861a-45b6-9e34-38f8db4eda1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:49.070640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0672320-861a-45b6-9e34-38f8db4eda1f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:49.124829 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 924/1879] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 1246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:49.126455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0662c-88a8-4b8d-b015-b013ae53878b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:49.127078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0662c-88a8-4b8d-b015-b013ae53878b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:49.127158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0662c-88a8-4b8d-b015-b013ae53878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:49.186882 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:49.272044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4bf0662c-88a8-4b8d-b015-b013ae53878b None None] MFA Rules not processed for user `bb8a5288786f48209fdfa67ad057ddbe`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:49.274665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4bf0662c-88a8-4b8d-b015-b013ae53878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:49.293416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a72b01-7a35-4b8c-9ad7-6cc485c38cdc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:49.300881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:49.302292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:49.302751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:49.303165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] PATH_INFO: `/v3/projects/ffc7b2b3d6aa43d5a42c898a3381730e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:49.305493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffc7b2b3d6aa43d5a42c898a3381730e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:49.308537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:49.441099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffc7b2b3d6aa43d5a42c898a3381730e', 'request_id': 'req-d90b00a0-f09d-467e-8d15-de687b1e3e63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:49.451874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffc7b2b3d6aa43d5a42c898a3381730e', 'request_id': 'req-d90b00a0-f09d-467e-8d15-de687b1e3e63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:49.461917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffc7b2b3d6aa43d5a42c898a3381730e', 'request_id': 'req-d90b00a0-f09d-467e-8d15-de687b1e3e63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:49.486841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] The token cache is being invalidate because project ffc7b2b3d6aa43d5a42c898a3381730e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:49.487870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:49.489018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:49.491957 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 956/1880] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:48 2022] DELETE /identity/v3/projects/ffc7b2b3d6aa43d5a42c898a3381730e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:49.496854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:49.498957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:49.501230 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 925/1881] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:49.502685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf5a7-24ad-48da-9bfc-2b053e654853 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:49.502982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf5a7-24ad-48da-9bfc-2b053e654853 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:49.503264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bf5a7-24ad-48da-9bfc-2b053e654853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:49.553731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-891bf5a7-24ad-48da-9bfc-2b053e654853 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:49.555160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-891bf5a7-24ad-48da-9bfc-2b053e654853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:49.776725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 926/1882] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:49.790806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:49.791951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:49.792445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:49.812115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b00a0-f09d-467e-8d15-de687b1e3e63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:49.835504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:49.836392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:49.837430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:49.837832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:49.838549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:49.840391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:49.842070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:49.878229 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 927/1883] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:49.885850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:49.920659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea766f-bb3c-4a15-ad2e-7835eadb1379 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:49.977628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:49.979269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:49.979786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:49.981199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:49.981687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:49.982250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:49.999217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:50.112071 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 928/1884] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:50.114222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:50.122540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:50.213040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7ab127-9ed2-4090-9124-bc2acd2feef1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:50.240081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:50.240955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:50.241328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:50.241611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:50.247410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:50.262733 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:50.294575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:50.299118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:50.325695 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:50.385172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 957/1885] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 892 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:50.397127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:50.479742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb44f77a-37ae-4959-ac42-35bd1ba3d376 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:50.526111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:50.530692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:50.536462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:50.537548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:50.539687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:50.554544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:50.630120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:50.636940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:50.692773 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 958/1886] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:50 2022] POST /identity/v3/projects => generated 389 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:50.695093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:50.703669 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 929/1887] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:50.705000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:50.760057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491e70e-8ff6-4e29-aa48-14319bae667c service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:50.987702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:50.988580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:50.989046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:50.989421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:50.990291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:50.992695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:51.055739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 930/1888] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:50 2022] POST /identity/v3/users => generated 295 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:51.062558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:51.084189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb9471-b0af-452d-b600-7d1b98a46e91 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:51.105759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:51.106574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:51.106934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:51.107310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:51.108199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:51.110024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:51.147528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 931/1889] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:08:51.151269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:51.182838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88ced85-124f-4653-819a-a261458462f5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:51.215383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:51.216163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:51.216523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:51.216780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:51.217696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:51.219740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:51.251414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a240a79-dcd4-427d-b920-dbb5928a4932 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:51.272326 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 932/1890] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:51.273365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:51.299272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c2b861-7e1c-47d0-8bfc-86efe41419da admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:51.302610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:51.304147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:51.304712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:51.305490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:51.313221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:51.314204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:51.314486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:51.314761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] PATH_INFO: `/v3/projects/168b6a3bf89248acac3b1aec0a9a5a4d/users/67fda77d52cc4034a419314d291c17b7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:51.315657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:51.364211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=168b6a3bf89248acac3b1aec0a9a5a4d, user_id=67fda77d52cc4034a419314d291c17b7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:51.367736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:51.391353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 933/1891] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:51 2022] PUT /identity/v3/projects/168b6a3bf89248acac3b1aec0a9a5a4d/users/67fda77d52cc4034a419314d291c17b7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:51.392492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:51.397620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:51.553463 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:51.576186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a998c-d9fe-4e15-829d-3b48ef5af6b3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:51.584127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:51.585295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:51.585668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:51.586165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] PATH_INFO: `/v3/users/442516ecaf024e9180248220f224ee9b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:51.589029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] RBAC: Authorizing `identity:delete_user(user_id=442516ecaf024e9180248220f224ee9b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:51.591275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:51.602540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:51.606012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41601741-d0ad-417b-8c10-1609c9cfb17a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:51.649040 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 959/1892] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 956 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:51.654255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31868269-801b-4635-a34e-e2a905d16165 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:51.654970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31868269-801b-4635-a34e-e2a905d16165 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:51.655584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31868269-801b-4635-a34e-e2a905d16165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:51.684749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442516ecaf024e9180248220f224ee9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:51.707334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442516ecaf024e9180248220f224ee9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:51.743727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442516ecaf024e9180248220f224ee9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:51.745041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442516ecaf024e9180248220f224ee9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:51.754166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-31868269-801b-4635-a34e-e2a905d16165 None None] MFA Rules not processed for user `67fda77d52cc4034a419314d291c17b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:51.758417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-31868269-801b-4635-a34e-e2a905d16165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:51.759700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442516ecaf024e9180248220f224ee9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:51.774810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 934/1893] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:51 2022] DELETE /identity/v3/users/442516ecaf024e9180248220f224ee9b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:51.776208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:51.777960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:51.910560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 960/1894] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:51.910560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31868269-801b-4635-a34e-e2a905d16165 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:51.910560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-31868269-801b-4635-a34e-e2a905d16165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:51.916517 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:52.004858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0962aabe-6fb3-46bf-8e3b-f8e90c6c039e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.008860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31868269-801b-4635-a34e-e2a905d16165 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.021934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.023772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.024011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.024676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.025004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.025290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.026076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.026826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.033237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:52.034364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:52.157489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.161206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3d4b5-f81a-4f55-9363-85496d2d7178 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.185573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.187310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.192380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 961/1895] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:51 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:52.201497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.202039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.202503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.213343 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 935/1896] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:52.215139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:52.217584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:52.246076 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:52.249782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:52.254834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:52.421072 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 962/1897] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:52.431385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4fc24-80ef-48e6-a734-dc500da08776 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.450592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.451340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.451714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.452000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.452882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.459268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.529975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 936/1898] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:52 2022] POST /identity/v3/projects => generated 387 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:52.536887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:52.570070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039cce62-9ae9-47d6-9917-f8cee3acc792 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.574446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:52.577324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:52.663522 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:52.716454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.717199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.719896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.720191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.722809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.733783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.780999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 963/1899] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:52 2022] POST /identity/v3/users => generated 300 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:52.787080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:52.819014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02a959a-5007-469b-82d1-f30e49a91eab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.833653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.834856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.837018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.837879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.840861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.844892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.863796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a1411-45ec-4979-b027-69bcd7d0e503 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.874748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.876412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.877342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.878022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.879864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 964/1900] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:52.884410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:52.906823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15fbfb-2a68-4a71-927a-baa51d081a0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:52.909923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.914234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.914406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:52.915385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:52.915674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:52.915959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] PATH_INFO: `/v3/projects/5bcb0960c9e14dc9aaabf1377ff7fa8a/users/1686189afc5949c2a3f3647fc793e568/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:52.960013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcb0960c9e14dc9aaabf1377ff7fa8a, user_id=1686189afc5949c2a3f3647fc793e568, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:52.962763 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 937/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:52.965299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:52.990159 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 965/1902] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:52 2022] PUT /identity/v3/projects/5bcb0960c9e14dc9aaabf1377ff7fa8a/users/1686189afc5949c2a3f3647fc793e568/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:52.994284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:53.019780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011d39ec-4ff6-4234-b20a-c0ea47013d6d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:53.065847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:53.068315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:53.304571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d10bf-e326-4814-8756-49ee0ad60b97 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:53.315665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:53.318399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:53.318798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:53.320845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] PATH_INFO: `/v3/users/068e5be69561439ca64737738fcd53d6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:53.324315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] RBAC: Authorizing `identity:delete_user(user_id=068e5be69561439ca64737738fcd53d6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:53.325004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:53.328881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:53.329706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:53.334436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:53.339971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:53.347091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:53.362030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:53.411240 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 938/1903] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:53.413076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:53.450669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bcad3-57c7-4bb1-b59b-eba84137d650 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:53.475921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '068e5be69561439ca64737738fcd53d6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:53.477275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '068e5be69561439ca64737738fcd53d6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:53.488831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f0438-3841-48fb-9554-4ddaea576cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:53.490251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0438-3841-48fb-9554-4ddaea576cbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:53.490700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0438-3841-48fb-9554-4ddaea576cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:53.491164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f0438-3841-48fb-9554-4ddaea576cbc admin admin] PATH_INFO: `/v3/projects/5bcb0960c9e14dc9aaabf1377ff7fa8a/users/1686189afc5949c2a3f3647fc793e568/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:53.497662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '068e5be69561439ca64737738fcd53d6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:53.499514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '068e5be69561439ca64737738fcd53d6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:53.509819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ecff9104-da85-4c97-9665-411ad44ba253 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '068e5be69561439ca64737738fcd53d6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:53.518463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f0438-3841-48fb-9554-4ddaea576cbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bcb0960c9e14dc9aaabf1377ff7fa8a, user_id=1686189afc5949c2a3f3647fc793e568, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:53.529976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f0438-3841-48fb-9554-4ddaea576cbc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:53.535462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 966/1904] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:53 2022] DELETE /identity/v3/users/068e5be69561439ca64737738fcd53d6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:53.545953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:53.548693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:53.550101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:53.576688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 939/1905] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:53 2022] PUT /identity/v3/projects/5bcb0960c9e14dc9aaabf1377ff7fa8a/users/1686189afc5949c2a3f3647fc793e568/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:53.596147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:53.596525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:53.596888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:53.597890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:53.600536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:53.610740 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:53.693456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] MFA Rules not processed for user `1686189afc5949c2a3f3647fc793e568`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:53.695200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:53.719132 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:53.758033 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 967/1906] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:53.814734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:53.816940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:53.965930 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 940/1907] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:53.975474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:53.977790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:53.995660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac7a8e-a8a6-4316-aa06-e6005b6c3286 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:54.012179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:54.013266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:54.013627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:54.013961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] PATH_INFO: `/v3/projects/d3a20f1003a9486e80035bfe173e20b4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:54.015580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a20f1003a9486e80035bfe173e20b4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:54.017731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:54.025498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9de96f-f61a-43f9-8e1e-6faca9ddb882 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:54.038987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:54.044452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:54.044452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:54.044452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:54.067221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:54.072560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:54.091961 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 968/1908] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:54.094277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:54.104221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:54.133279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a20f1003a9486e80035bfe173e20b4', 'request_id': 'req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.158506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a20f1003a9486e80035bfe173e20b4', 'request_id': 'req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.173770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a20f1003a9486e80035bfe173e20b4', 'request_id': 'req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.200890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] The token cache is being invalidate because project d3a20f1003a9486e80035bfe173e20b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:54.201562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.202392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.210236 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 941/1909] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:53 2022] DELETE /identity/v3/projects/d3a20f1003a9486e80035bfe173e20b4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:54.212324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:54.215850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:54.310606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21827c39-d50f-455a-bc6c-8fb0db6a18f5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:54.408868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dfd06f-3ed5-44d9-8473-ce645ecbbcde admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:54.421345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:54.423389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:54.425158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:54.425561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] PATH_INFO: `/v3/users/680c54e6771e44308e050d39ad3a6378` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:54.432861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=680c54e6771e44308e050d39ad3a6378)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:54.435566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:54.461871 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:54.503808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:54.505091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:54.505376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:54.505846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:54.508948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:54.515323 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:54.557931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680c54e6771e44308e050d39ad3a6378'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.578479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680c54e6771e44308e050d39ad3a6378'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.611704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680c54e6771e44308e050d39ad3a6378'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.611704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680c54e6771e44308e050d39ad3a6378'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.636610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680c54e6771e44308e050d39ad3a6378'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:54.654181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 942/1910] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:54 2022] DELETE /identity/v3/users/680c54e6771e44308e050d39ad3a6378 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:54.698611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:54.702065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:54.722795 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 969/1911] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:54.831474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:54.835337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:55.067857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff4fd7-b275-4615-9f9f-25f8af554c1d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:55.078248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:55.079104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:55.079710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:55.080096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:55.083099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:55.269455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:55.273966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:55.294259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 943/1912] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:56.001422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:56.004375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:56.018529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:56.020111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:56.038133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b4db0-d1a3-4a3c-b86d-07abb7bec694 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:56.167307 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:56.239363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8210f578-e2b7-440b-9994-e391eb0298ff service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:56.248212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:56.251913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:56.252636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:56.253487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:56.254624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:56.255163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] PATH_INFO: `/v3/projects/03199c48900d44baa03830987b701343` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:56.256387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:56.257490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03199c48900d44baa03830987b701343)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:56.258019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] PATH_INFO: `/v3/users/67fda77d52cc4034a419314d291c17b7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:56.272883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=67fda77d52cc4034a419314d291c17b7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:56.274907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:56.277393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:56.431071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67fda77d52cc4034a419314d291c17b7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.435408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03199c48900d44baa03830987b701343', 'request_id': 'req-f8a583b1-5378-4a2b-81f0-dabeafd60753'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.456185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67fda77d52cc4034a419314d291c17b7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.465991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03199c48900d44baa03830987b701343', 'request_id': 'req-f8a583b1-5378-4a2b-81f0-dabeafd60753'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.490590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03199c48900d44baa03830987b701343', 'request_id': 'req-f8a583b1-5378-4a2b-81f0-dabeafd60753'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.500822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67fda77d52cc4034a419314d291c17b7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.502030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67fda77d52cc4034a419314d291c17b7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.518078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] The token cache is being invalidate because project 03199c48900d44baa03830987b701343 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:56.518423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.523335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.525369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121051e6-3df0-4888-a1d5-6ec137c9b8ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67fda77d52cc4034a419314d291c17b7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.528047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 970/1913] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:55 2022] DELETE /identity/v3/projects/03199c48900d44baa03830987b701343 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:56.533858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:56.535826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:56.545585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 944/1914] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:56 2022] DELETE /identity/v3/users/67fda77d52cc4034a419314d291c17b7 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:56.551180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:56.552693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:56.553021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:56.579995 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:56.651802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:56.658915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:56.746645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a583b1-5378-4a2b-81f0-dabeafd60753 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:56.869408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:56.870348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:56.870631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:56.870903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] PATH_INFO: `/v3/users/36525c71fdeb4966ac18198d2ed5e8f2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:56.872614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=36525c71fdeb4966ac18198d2ed5e8f2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:56.877916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:56.888845 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 945/1915] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:56.889838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:56.893722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:56.927018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de900641-fad4-4648-be4a-a2ad194b1bc1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:56.960673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:56.966232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:56.967343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:56.969253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] PATH_INFO: `/v3/projects/616fd3aa5fe3490180c2a3373edbfa75` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:56.981829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=616fd3aa5fe3490180c2a3373edbfa75)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:56.986948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:56.995567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36525c71fdeb4966ac18198d2ed5e8f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:56.997313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36525c71fdeb4966ac18198d2ed5e8f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.017010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36525c71fdeb4966ac18198d2ed5e8f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.018552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36525c71fdeb4966ac18198d2ed5e8f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.031530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36525c71fdeb4966ac18198d2ed5e8f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.098869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 971/1916] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:08:56 2022] DELETE /identity/v3/users/36525c71fdeb4966ac18198d2ed5e8f2 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:57.102295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:57.103860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:57.180704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616fd3aa5fe3490180c2a3373edbfa75', 'request_id': 'req-292d8b08-2c36-4562-a196-1034d6e05c08'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.206588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616fd3aa5fe3490180c2a3373edbfa75', 'request_id': 'req-292d8b08-2c36-4562-a196-1034d6e05c08'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.209072 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:57.234777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616fd3aa5fe3490180c2a3373edbfa75', 'request_id': 'req-292d8b08-2c36-4562-a196-1034d6e05c08'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.249318 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:57.271221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a589b7d-6af7-4bf9-aedd-d67a72afa5ff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:57.279903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] The token cache is being invalidate because project 616fd3aa5fe3490180c2a3373edbfa75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:57.280394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.281128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-292d8b08-2c36-4562-a196-1034d6e05c08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:57.284927 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 946/1917] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:56 2022] DELETE /identity/v3/projects/616fd3aa5fe3490180c2a3373edbfa75 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:57.291839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71dae-978b-4c6e-a7d3-f0957151fec0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.292165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71dae-978b-4c6e-a7d3-f0957151fec0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.292568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e71dae-978b-4c6e-a7d3-f0957151fec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.344844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-38e71dae-978b-4c6e-a7d3-f0957151fec0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:57.373168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38e71dae-978b-4c6e-a7d3-f0957151fec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:57.396414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:57.397962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.398159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.398624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.404317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:57.537659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:57.540094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91c45-834e-42cc-b467-4128c41313b4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:57.558561 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 972/1918] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:57.560764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0df4-2cda-4f4b-aaa5-b9bc6d63b168 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.561298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0df4-2cda-4f4b-aaa5-b9bc6d63b168 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.561806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0df4-2cda-4f4b-aaa5-b9bc6d63b168 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.563560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 973/1919] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:08:57.580041 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 947/1920] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:57.591349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.592463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.594829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.618905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.619242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.619495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.654839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:57.659587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:57.666095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:57.667584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:57.700273 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 974/1921] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:57.702280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:57.740579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3280450-ef0d-474f-9a9a-8b0d82369606 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:57.749549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:57.750726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.751138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.751848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.753543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:08:57.754450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:57.760247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:57.809971 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 975/1922] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:08:57.811812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:57.868889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec8003-bcaa-4a57-90d2-7172347bd628 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:57.892472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:57.893169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:57.893457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:57.893738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:57.894718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:57.896793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:57.937959 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 948/1923] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:08:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:57.974024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:57.983700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:57.986529 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 976/1924] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:08:57 2022] POST /identity/v3/projects => generated 395 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:57.992983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:58.082774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88369dbd-ec86-4ee7-bb93-8f9f15b62ee4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:58.134578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4357926-b4aa-4c13-bc22-80aeda494850 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:58.162276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:58.163307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:58.163603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:58.163889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:58.164717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:58.167025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:58.196267 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:58.230613 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 977/1925] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:08:57 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:08:58.232121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:58.268895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a1cd1-340c-4ba9-93dc-3b17322666bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:58.286279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:58.287011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:58.287297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:58.287577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:58.288701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:58.295618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:58.329961 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 978/1926] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:58.331189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:58.353688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a1551-1b59-458f-a805-0e6d66a572ad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:58.370546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:58.371431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:58.371726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:58.372015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:58.372926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:58.378046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:58.411016 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 979/1927] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:08:58.415541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:58.427577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a2aed-d821-43f1-8d97-fb5431ba094c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:58.433498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f472b1-f294-42dd-ba1e-168cde214107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:58.434452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f472b1-f294-42dd-ba1e-168cde214107 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:58.434890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f472b1-f294-42dd-ba1e-168cde214107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:58.435180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f472b1-f294-42dd-ba1e-168cde214107 admin admin] PATH_INFO: `/v3/projects/6edf36048bec47f7a94a089b0f1e63ca/users/6f034d6e3a874e9892df5c3188235e7e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:58.459951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f472b1-f294-42dd-ba1e-168cde214107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6edf36048bec47f7a94a089b0f1e63ca, user_id=6f034d6e3a874e9892df5c3188235e7e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:58.465450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f472b1-f294-42dd-ba1e-168cde214107 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:58.515296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:58.516731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:58.517461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:58.518346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:58.527361 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 980/1928] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:08:58 2022] PUT /identity/v3/projects/6edf36048bec47f7a94a089b0f1e63ca/users/6f034d6e3a874e9892df5c3188235e7e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:08:58.529333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:58.529689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:58.529994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:58.553989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:58.560948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:58.562328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:58.565467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:58.613884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 949/1929] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 641 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:08:58.716136 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 981/1930] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:08:58.813632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:58.819964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:58.842099 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:08:59.103352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dab618-9587-469a-abac-d87306fbaba5 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:59.293403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfc26f0-2941-47c3-a870-6ac500c54500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:59.294107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc26f0-2941-47c3-a870-6ac500c54500 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:59.294390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc26f0-2941-47c3-a870-6ac500c54500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:59.295114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfc26f0-2941-47c3-a870-6ac500c54500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:59.317843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc26f0-2941-47c3-a870-6ac500c54500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:59.319512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfc26f0-2941-47c3-a870-6ac500c54500 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:59.346380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 950/1931] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:08:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:08:59.496860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:08:59.499466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:59.527555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb50978-216a-48ca-a658-ad63db84eec7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:08:59.538634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:08:59.542409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:59.543697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:59.544209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] PATH_INFO: `/v3/projects/94ac3c7068c94f96b3dff4256da6df1f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:59.547302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] RBAC: Authorizing `identity:delete_project(project_id=94ac3c7068c94f96b3dff4256da6df1f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:08:59.551763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:08:59.680236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94ac3c7068c94f96b3dff4256da6df1f', 'request_id': 'req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:59.697669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94ac3c7068c94f96b3dff4256da6df1f', 'request_id': 'req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:59.715182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94ac3c7068c94f96b3dff4256da6df1f', 'request_id': 'req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:59.751769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] The token cache is being invalidate because project 94ac3c7068c94f96b3dff4256da6df1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:08:59.752291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:59.753657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3371bdce-33ff-477e-a2f8-ff24a6ecbcae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:08:59.768553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 982/1932] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:08:59 2022] DELETE /identity/v3/projects/94ac3c7068c94f96b3dff4256da6df1f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:08:59.769465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:59.770186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:59.770186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:08:59.797152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:08:59.798868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:08:59.997033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:08:59.997353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 951/1933] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:08:59.997918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:08:59.998384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.065566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:00.068428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:00.094423 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 983/1934] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:08:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:00.109037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.129354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.131956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:00.148068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43bb27e-7b30-438b-b512-488541aa9d96 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:00.174032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:00.177863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:00.181169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28e7569-0451-4e1c-81b0-4a253999f1f5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:00.186404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:00.187081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.190410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:00.192306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:00.194031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:00.195435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:00.195763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:00.196260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:00.196826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] PATH_INFO: `/v3/projects/168b6a3bf89248acac3b1aec0a9a5a4d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.200118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=168b6a3bf89248acac3b1aec0a9a5a4d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:00.204324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:00.228394 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 952/1935] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:00.235236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.258093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17ec870-b1a2-4905-baba-a8246d857ba0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:00.271900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:00.272842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:00.273520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:00.273911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.274899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:00.277159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:00.297067 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:00.389950 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 953/1936] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:00 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:00.400446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.433164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '168b6a3bf89248acac3b1aec0a9a5a4d', 'request_id': 'req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:00.472119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '168b6a3bf89248acac3b1aec0a9a5a4d', 'request_id': 'req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:00.503078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '168b6a3bf89248acac3b1aec0a9a5a4d', 'request_id': 'req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:00.561687 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:00.564326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] The token cache is being invalidate because project 168b6a3bf89248acac3b1aec0a9a5a4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:00.564565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:00.565899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:00.569161 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 984/1937] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:00 2022] DELETE /identity/v3/projects/168b6a3bf89248acac3b1aec0a9a5a4d => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:00.577025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.583850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:00.660456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f9cd00-060a-4110-ac5e-bb223eee0a29 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:00.677712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:00.681900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:00.683360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:00.683708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.689588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:00.696999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:00.787970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 954/1938] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:00 2022] POST /identity/v3/users => generated 288 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:00.789953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.799072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:00.851704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381ebfa-b2cf-4e0f-be03-4990345ddeb2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:00.866752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d75e9-b25a-4c21-9aa7-10f7036417f0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:00.875437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:00.876838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:00.879008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:00.879627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.881340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:00.886909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:00.901006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:00.902790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:00.903399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:00.904030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] PATH_INFO: `/v3/users/1686189afc5949c2a3f3647fc793e568` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:00.910911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1686189afc5949c2a3f3647fc793e568)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:00.923964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:00.957012 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 955/1939] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:00.958748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:00.997548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0dcdb-6163-4819-8dd4-19b6989db535 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:01.029275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:01.030932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:01.031688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:01.032845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:01.035317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:01.045446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:01.092953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1686189afc5949c2a3f3647fc793e568'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:01.095487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1686189afc5949c2a3f3647fc793e568'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:01.097719 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 956/1940] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:00 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:01.110195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:01.113949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1686189afc5949c2a3f3647fc793e568'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:01.115588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:01.115991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1686189afc5949c2a3f3647fc793e568'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:01.127071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3040bbc-8d1a-4539-bc4c-a4d78632761a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1686189afc5949c2a3f3647fc793e568'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:01.158246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d475266-61af-4fe5-8587-72cd288193ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:01.178864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 985/1941] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:00 2022] DELETE /identity/v3/users/1686189afc5949c2a3f3647fc793e568 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:01.179351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:01.179351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:01.181033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:01.181687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] PATH_INFO: `/v3/projects/a7947935ebfa4962aefb1f503efdb06c/users/e3ccd6eb128543ecb4dafbb7c9c48561/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:01.237027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7947935ebfa4962aefb1f503efdb06c, user_id=e3ccd6eb128543ecb4dafbb7c9c48561, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:01.243693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:01.287297 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 957/1942] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:01 2022] PUT /identity/v3/projects/a7947935ebfa4962aefb1f503efdb06c/users/e3ccd6eb128543ecb4dafbb7c9c48561/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:01.305284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed212-3d38-4a51-bbc2-0ccb66985e3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:01.305858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed212-3d38-4a51-bbc2-0ccb66985e3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:01.306403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aed212-3d38-4a51-bbc2-0ccb66985e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:01.361773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-55aed212-3d38-4a51-bbc2-0ccb66985e3c None None] MFA Rules not processed for user `e3ccd6eb128543ecb4dafbb7c9c48561`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:01.378951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55aed212-3d38-4a51-bbc2-0ccb66985e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:01.431892 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:01.591006 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 986/1943] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:01.593648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:01.779877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409523a1-5692-460d-9ae7-626f701971e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:01.805037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81446a09-217a-4ced-97cf-bd9e3aa5f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:01.806655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446a09-217a-4ced-97cf-bd9e3aa5f0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:01.807341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446a09-217a-4ced-97cf-bd9e3aa5f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:01.807935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81446a09-217a-4ced-97cf-bd9e3aa5f0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:01.809712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446a09-217a-4ced-97cf-bd9e3aa5f0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:01.814062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81446a09-217a-4ced-97cf-bd9e3aa5f0c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:01.822592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:01.822937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:01.823559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:01.904694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] MFA Rules not processed for user `d5c36018cd5145148fa4e7c6132545bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:01.906706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:01.919128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 958/1944] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:01 2022] POST /identity/v3/projects => generated 373 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:01.919474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:01.920067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:01.921749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:01.981768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] MFA Rules not processed for user `d6e042fb81da4e03bdb3a2d8caecea29`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:01.984388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:02.024556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 987/1945] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:02.024556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.053102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9afc7ca-3bc8-4b14-8ca4-b982bdb0f4a5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.118606 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:02.156147 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 959/1946] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:02.162956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.165363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:02.220766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.222189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.222847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.224420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.226878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.231631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.297156 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 988/1947] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:02 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:02.302203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.320220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0ab56-63b9-444b-b202-29ce28f7d0ce None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.326622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef2f364-9ad7-41c2-9d69-dfc4f11ddad2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.332971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.334261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.335275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.337033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.338549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.341582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.343396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.349297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.351864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.352788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.356247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.366012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.390756 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 960/1948] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:02 2022] POST /identity/v3/projects => generated 403 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:02.392062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.400780 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 989/1949] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:02.407938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.438112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dda51e-6918-4e28-9cd9-1b6db9c5a946 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.524452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716b441-d3be-456a-8d68-bd3b836e843f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.549595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.550345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.550691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.551037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.551842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.554064 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:02.556900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.589616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.592977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.594048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.594352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] PATH_INFO: `/v3/projects/dcefe07e65054935b06827de70d61800/users/c88e5646f30e416ba078896ea553cdb4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.603818 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 961/1950] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:02 2022] POST /identity/v3/users => generated 308 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:02.620591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.651018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcefe07e65054935b06827de70d61800, user_id=c88e5646f30e416ba078896ea553cdb4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.657064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.671260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ef3e6f-8583-4f38-b143-9a52dec28649 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.684203 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 990/1951] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:02 2022] PUT /identity/v3/projects/dcefe07e65054935b06827de70d61800/users/c88e5646f30e416ba078896ea553cdb4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:02.688198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.864781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.865740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.865740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.865998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.866767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.868656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.870288 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:02.880394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6c126-80e5-4ddc-bdca-7e521ac838d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.890558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.904270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 962/1952] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:02.905301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.905963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.906542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.909727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.916778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.920433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.931143 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 991/1953] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:02.944689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:02.950297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9789d9-ceb8-4a2d-ac7c-20283a25106b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.956945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac1459-ec1d-4cd8-a521-9d5fa1d90da5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:02.963056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2330-d8e5-4325-b3ff-13cb509cdf6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.964061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2330-d8e5-4325-b3ff-13cb509cdf6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.964436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2330-d8e5-4325-b3ff-13cb509cdf6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.964685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2330-d8e5-4325-b3ff-13cb509cdf6f admin admin] PATH_INFO: `/v3/projects/dcefe07e65054935b06827de70d61800/users/c88e5646f30e416ba078896ea553cdb4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:02.966984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec2330-d8e5-4325-b3ff-13cb509cdf6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcefe07e65054935b06827de70d61800, user_id=c88e5646f30e416ba078896ea553cdb4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:02.967302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:02.969306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:02.969881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:02.970059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec2330-d8e5-4325-b3ff-13cb509cdf6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:02.970612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] PATH_INFO: `/v3/projects/e796aa50ed284a069202647d1bd1cb31/users/157d394363444db8a72d3119f9d01226/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.000253 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 992/1954] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:02 2022] PUT /identity/v3/projects/dcefe07e65054935b06827de70d61800/users/c88e5646f30e416ba078896ea553cdb4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:03.002068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.002447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.002799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.037587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e796aa50ed284a069202647d1bd1cb31, user_id=157d394363444db8a72d3119f9d01226, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:03.042762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:03.059573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] MFA Rules not processed for user `c88e5646f30e416ba078896ea553cdb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:03.061765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:03.081056 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 963/1955] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:02 2022] PUT /identity/v3/projects/e796aa50ed284a069202647d1bd1cb31/users/157d394363444db8a72d3119f9d01226/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:03.088428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:03.201815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d9b81-dfce-4a6a-9af1-e573a5b548cb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:03.210387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:03.210387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.210387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.210387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.211754 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 993/1956] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:03.211923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:03.214102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:03.227434 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 964/1957] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:09:03.233446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:03.283231 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:03.295963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:03.297591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:03.316496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ecd821-1dea-4081-8be8-245c66245b8d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:03.336106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:03.337518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.338041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.338778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] PATH_INFO: `/v3/projects/5bcb0960c9e14dc9aaabf1377ff7fa8a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.343435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bcb0960c9e14dc9aaabf1377ff7fa8a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:03.346656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:03.405538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cc9064-6774-416a-a04c-0f2940063bb3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:03.467549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bcb0960c9e14dc9aaabf1377ff7fa8a', 'request_id': 'req-309cb776-861f-4ff1-a78f-3fe5d5de09b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:03.490632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bcb0960c9e14dc9aaabf1377ff7fa8a', 'request_id': 'req-309cb776-861f-4ff1-a78f-3fe5d5de09b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:03.509717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bcb0960c9e14dc9aaabf1377ff7fa8a', 'request_id': 'req-309cb776-861f-4ff1-a78f-3fe5d5de09b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:03.536019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de6b07f-01c8-482e-a4c2-12a5ac16864c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:03.537223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b07f-01c8-482e-a4c2-12a5ac16864c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.538309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] The token cache is being invalidate because project 5bcb0960c9e14dc9aaabf1377ff7fa8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:03.538458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b07f-01c8-482e-a4c2-12a5ac16864c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.538878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de6b07f-01c8-482e-a4c2-12a5ac16864c admin admin] PATH_INFO: `/v3/projects/e796aa50ed284a069202647d1bd1cb31/users/157d394363444db8a72d3119f9d01226/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.539020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:03.540316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:03.544323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6b07f-01c8-482e-a4c2-12a5ac16864c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e796aa50ed284a069202647d1bd1cb31, user_id=157d394363444db8a72d3119f9d01226, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:03.544699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 965/1958] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:03 2022] DELETE /identity/v3/projects/5bcb0960c9e14dc9aaabf1377ff7fa8a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:03.546986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:03.550397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:03.551230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de6b07f-01c8-482e-a4c2-12a5ac16864c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:03.600822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 994/1959] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:03 2022] PUT /identity/v3/projects/e796aa50ed284a069202647d1bd1cb31/users/157d394363444db8a72d3119f9d01226/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:03.603907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e67f6-fcb8-4227-a8de-05b18b4b2b72 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.604436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e67f6-fcb8-4227-a8de-05b18b4b2b72 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.604817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e67f6-fcb8-4227-a8de-05b18b4b2b72 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.606859 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 995/1960] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:09:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:09:03.608432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769a732-fa24-4044-8c25-fcdb1003a33b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.608831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769a732-fa24-4044-8c25-fcdb1003a33b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.610950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4769a732-fa24-4044-8c25-fcdb1003a33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.645442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4769a732-fa24-4044-8c25-fcdb1003a33b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:03.647639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4769a732-fa24-4044-8c25-fcdb1003a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:03.727102 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:03.791032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309cb776-861f-4ff1-a78f-3fe5d5de09b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:03.827723 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 996/1961] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:03.829664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a494-f7f6-4858-a091-82c1c4d4547c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:03.832500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a494-f7f6-4858-a091-82c1c4d4547c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:03.834662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278a494-f7f6-4858-a091-82c1c4d4547c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:03.879313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e278a494-f7f6-4858-a091-82c1c4d4547c None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:03.881141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e278a494-f7f6-4858-a091-82c1c4d4547c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:04.005902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.007851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.008654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.009147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.011505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:04.020931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 997/1962] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:09:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:04.022353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.022647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.022928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.092179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:04.093500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:04.115419 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 998/1963] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:04.116424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.119781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:04.161711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4948b-b4b7-4286-ae30-27a3e2c883cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.168915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.171337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.176244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.176985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.177334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.177613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.191946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.193609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.197561 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 966/1964] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:04.199356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.217471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 999/1965] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:04.240687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2509ad-467e-442f-9401-c1b9df1e376c service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.246841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.249883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.250840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.251696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.256314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:04.257475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.259331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.351363 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 967/1966] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:04.356069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.367543 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:04.408111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94025c1a-e1a7-4048-af31-eeb4010185e2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.422602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.427238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.427575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.427831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.428652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.445131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.524390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1000/1967] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:04 2022] POST /identity/v3/projects => generated 399 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:04.525489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.555239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf641856-6291-4242-b134-59338ee6e9e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.666732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.667458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.667786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.668148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.669782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.672614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.699810 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:04.709767 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 968/1968] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:04 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:04.716719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.729736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b77c8d7-2ad5-4eae-a7fc-e37e5886b7a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.737132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.737849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.738168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.738441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.739322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.741552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.762052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.770601 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1001/1969] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:04.775912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cc8bb1-d663-47c1-89fe-d6d37226da2b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.782817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58e36f-92aa-4abb-b854-0324d6852d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.783414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58e36f-92aa-4abb-b854-0324d6852d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.783699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58e36f-92aa-4abb-b854-0324d6852d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.784211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58e36f-92aa-4abb-b854-0324d6852d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.785082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58e36f-92aa-4abb-b854-0324d6852d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.786875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58e36f-92aa-4abb-b854-0324d6852d34 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.805715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:04.806971 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 969/1970] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:09:04.819523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bcbaca-4ba9-4d18-948d-ebd1b048bbe8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:04.828039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:04.829325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.829627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.829913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] PATH_INFO: `/v3/projects/59ea266969164022b32e1598f39958cd/users/d44863518a614896a5d7b2dacbcfde36/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.851051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ea266969164022b32e1598f39958cd, user_id=d44863518a614896a5d7b2dacbcfde36, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:04.854180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:04.896729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:04.897022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:04.897303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:04.917008 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1002/1971] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:04 2022] PUT /identity/v3/projects/59ea266969164022b32e1598f39958cd/users/d44863518a614896a5d7b2dacbcfde36/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:04.948484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] MFA Rules not processed for user `d44863518a614896a5d7b2dacbcfde36`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:04.950690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:05.111845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:05.117747 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 970/1972] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:05.300474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79b981-5428-4be0-afc2-776cf2bf8854 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:05.323107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:05.327397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:05.327966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:05.328523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:05.329780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:05.332057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:05.405572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1003/1973] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:05 2022] POST /identity/v3/projects => generated 397 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:05.415181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:05.433546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b25493-0674-4755-b08d-b8c2f742d0ff None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:05.634132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:05.635368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:05.635854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:05.636332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:05.637700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:05.641580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:05.683391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 971/1974] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:05 2022] POST /identity/v3/users => generated 305 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:05.688006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:05.703971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c82838-ad81-4921-831b-75601dca7628 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:05.712244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:05.715882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:05.716850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:05.717820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:05.719352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:05.721386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:05.743764 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1004/1975] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:05.748374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:05.761212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0aa965-0e1b-48b8-b17d-a17ea39ad790 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:05.767789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:05.768079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:05.768232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:05.768562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] PATH_INFO: `/v3/projects/a3fc3985ba4c4950bbce48a91104ee2d/users/a2916c0e6f234256987bf4c8c5d829ed/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:05.812074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fc3985ba4c4950bbce48a91104ee2d, user_id=a2916c0e6f234256987bf4c8c5d829ed, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:05.820023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:05.854166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:05.869109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 972/1976] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:05 2022] PUT /identity/v3/projects/a3fc3985ba4c4950bbce48a91104ee2d/users/a2916c0e6f234256987bf4c8c5d829ed/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:05.888566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f015dd6b-b1f2-4269-bab6-2f8fb2bf0d4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:05.976217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:05.979879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:06.073731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:06.074510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:06.074979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:06.075259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:06.076103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:06.077840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:06.111017 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1005/1977] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:06.119658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:06.136392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2db943-7685-4bc4-a06c-58a6623f890f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:06.144498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04735aa0-d95e-488c-ad8a-01d7a1975321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:06.145945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735aa0-d95e-488c-ad8a-01d7a1975321 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:06.146233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735aa0-d95e-488c-ad8a-01d7a1975321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:06.146510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04735aa0-d95e-488c-ad8a-01d7a1975321 admin admin] PATH_INFO: `/v3/projects/a3fc3985ba4c4950bbce48a91104ee2d/users/a2916c0e6f234256987bf4c8c5d829ed/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:06.152119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04735aa0-d95e-488c-ad8a-01d7a1975321 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3fc3985ba4c4950bbce48a91104ee2d, user_id=a2916c0e6f234256987bf4c8c5d829ed, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:06.156073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04735aa0-d95e-488c-ad8a-01d7a1975321 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:06.175438 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1006/1978] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:06 2022] PUT /identity/v3/projects/a3fc3985ba4c4950bbce48a91104ee2d/users/a2916c0e6f234256987bf4c8c5d829ed/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:06.194229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:06.195783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:06.196360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:06.200380 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:06.220087 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:06.280801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] MFA Rules not processed for user `a2916c0e6f234256987bf4c8c5d829ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:06.283854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:06.291533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0648d875-e09d-4a20-a041-b9feaed7daff admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:06.475446 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1007/1979] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:06 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:06.524858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:06.526046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:06.527047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:06.527047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:06.535240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:06.846546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:06.850145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:06.889655 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 973/1980] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:06.926742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:06.946503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12116980-194a-4d9b-b9d9-b164b6badcdb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:06.956933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:06.957718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:06.958150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:06.960156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:07.107015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:07.110782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:07.130940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:07.151674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88704946-e754-44aa-ac97-126dac819cf3 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:07.158137 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1008/1981] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:07.170955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:07.172000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:07.172575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:07.173090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:07.178024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:07.427850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:07.435667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:07.485563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 974/1982] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:08.848451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:08.877112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86304058-c028-4715-9b7f-8a5c91afed47 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:08.896728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:08.903958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:08.905229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:08.905617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:08.935055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:08.938255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:08.992043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1009/1983] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:08 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:09.516070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:09.518449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:09.554202 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:09.588618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:09.716614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d52590-da86-4a82-93e7-785f7b6dfa03 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:09.723968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:09.725258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:09.725842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:09.726302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] PATH_INFO: `/v3/users/e3ccd6eb128543ecb4dafbb7c9c48561` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:09.728090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3ccd6eb128543ecb4dafbb7c9c48561)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:09.749686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:09.771084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d8ef8-26ca-480b-91b8-c9be28ffab5a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:09.788330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:09.789562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:09.790040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:09.790467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] PATH_INFO: `/v3/users/d44863518a614896a5d7b2dacbcfde36` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:09.792990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] RBAC: Authorizing `identity:delete_user(user_id=d44863518a614896a5d7b2dacbcfde36)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:09.796239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:09.841828 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:09.874016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3ccd6eb128543ecb4dafbb7c9c48561'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.905357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3ccd6eb128543ecb4dafbb7c9c48561'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.921516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd44863518a614896a5d7b2dacbcfde36'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.922629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd44863518a614896a5d7b2dacbcfde36'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.938393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3ccd6eb128543ecb4dafbb7c9c48561'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.938571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3ccd6eb128543ecb4dafbb7c9c48561'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.944034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd44863518a614896a5d7b2dacbcfde36'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.945489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd44863518a614896a5d7b2dacbcfde36'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.965116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef0e3c2c-b807-4a7b-a552-2343d7ce87df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd44863518a614896a5d7b2dacbcfde36'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.971833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a89adfa-8c8d-40c2-a8c6-5ed5b18302c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3ccd6eb128543ecb4dafbb7c9c48561'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:09.989439 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 975/1984] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:09 2022] DELETE /identity/v3/users/e3ccd6eb128543ecb4dafbb7c9c48561 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:09.995150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:09.995372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:09.995610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:10.020946 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1010/1985] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:09 2022] DELETE /identity/v3/users/d44863518a614896a5d7b2dacbcfde36 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:10.028255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:10.029379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:10.029684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:10.045113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:10.046412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:10.083997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:10.091132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:10.260270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 976/1986] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:10.282413 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1011/1987] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:10.333658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:10.336413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:10.398560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:10.400905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:10.475633 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:10.549841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9012e8e-07c9-4488-ab4b-00b3fcb01e72 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:10.561163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:10.561876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:10.563781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:10.564083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:10.581323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a8d61-f235-461e-99be-a7486a645016 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:10.590346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:10.592064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:10.595002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:10.595711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:10.596008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:10.596285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:10.622962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 977/1988] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:10.623679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:10.632153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:10.643860 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1012/1989] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:12.142631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:12.144789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:12.169488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fe5563-d850-41b0-8d78-0b5a314f0f1b service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:12.182846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:12.183790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:12.184074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:12.184434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] PATH_INFO: `/v3/projects/a7947935ebfa4962aefb1f503efdb06c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:12.192423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7947935ebfa4962aefb1f503efdb06c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:12.201688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:12.281182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7947935ebfa4962aefb1f503efdb06c', 'request_id': 'req-fa639ec1-d328-49d2-97c8-9881ef1968f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.293033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7947935ebfa4962aefb1f503efdb06c', 'request_id': 'req-fa639ec1-d328-49d2-97c8-9881ef1968f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.303631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7947935ebfa4962aefb1f503efdb06c', 'request_id': 'req-fa639ec1-d328-49d2-97c8-9881ef1968f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.328022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] The token cache is being invalidate because project a7947935ebfa4962aefb1f503efdb06c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:12.328317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.329302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.334637 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 978/1990] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:12 2022] DELETE /identity/v3/projects/a7947935ebfa4962aefb1f503efdb06c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:12.336787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:12.348284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597dccd6-029e-4961-811a-4b8c607413cc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:12.389858 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:12.422401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:12.423338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:12.423626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:12.423911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] PATH_INFO: `/v3/users/c88e5646f30e416ba078896ea553cdb4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:12.425349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c88e5646f30e416ba078896ea553cdb4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:12.427392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:12.532258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c88e5646f30e416ba078896ea553cdb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.533532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c88e5646f30e416ba078896ea553cdb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.550147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c88e5646f30e416ba078896ea553cdb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.551420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c88e5646f30e416ba078896ea553cdb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.591021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cb6b73f-7dd2-4bbf-b208-89a911f49e4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c88e5646f30e416ba078896ea553cdb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:12.633484 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1013/1991] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:12 2022] DELETE /identity/v3/users/c88e5646f30e416ba078896ea553cdb4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:13.297362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:13.301914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:13.353128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa639ec1-d328-49d2-97c8-9881ef1968f9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:13.534451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:13.538713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:13.542998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:13.550291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] PATH_INFO: `/v3/projects/59ea266969164022b32e1598f39958cd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:13.558815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ea266969164022b32e1598f39958cd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:13.575924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:13.755756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1798ad7-e682-4385-8385-657b5fb43741 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:13.756715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1798ad7-e682-4385-8385-657b5fb43741 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:13.756861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1798ad7-e682-4385-8385-657b5fb43741 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:13.760676 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1014/1992] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:09:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:09:13.798853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ea266969164022b32e1598f39958cd', 'request_id': 'req-323f4dff-0cc5-4255-98e5-b5950bdef5d4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:13.829643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ea266969164022b32e1598f39958cd', 'request_id': 'req-323f4dff-0cc5-4255-98e5-b5950bdef5d4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:13.835814 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:13.870660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ea266969164022b32e1598f39958cd', 'request_id': 'req-323f4dff-0cc5-4255-98e5-b5950bdef5d4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:13.878340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:13.879278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:13.880066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:13.932257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] The token cache is being invalidate because project 59ea266969164022b32e1598f39958cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:13.932934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:13.936306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:13.942657 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 979/1993] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:13 2022] DELETE /identity/v3/projects/59ea266969164022b32e1598f39958cd => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:13.948050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:13.952980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:13.966442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:13.971998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:14.164214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f4dff-0cc5-4255-98e5-b5950bdef5d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:14.179008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:14.193017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:14.193230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:14.193517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] PATH_INFO: `/v3/users/a2916c0e6f234256987bf4c8c5d829ed` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:14.194999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2916c0e6f234256987bf4c8c5d829ed)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:14.200088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:14.256490 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1015/1994] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:09:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:14.315452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2916c0e6f234256987bf4c8c5d829ed'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:14.331068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2916c0e6f234256987bf4c8c5d829ed'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:14.353505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2916c0e6f234256987bf4c8c5d829ed'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:14.355274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2916c0e6f234256987bf4c8c5d829ed'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:14.365125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2916c0e6f234256987bf4c8c5d829ed'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:14.373250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 980/1995] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:13 2022] DELETE /identity/v3/users/a2916c0e6f234256987bf4c8c5d829ed => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:14.695016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:14.697173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:14.721563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d65e9e-a4c9-4e81-8660-c05bd6a10764 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:14.844587 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:14.953581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:14.958712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:14.959577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:14.960624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:14.964585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:14.986372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:14.988537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d66ee2-5bd3-4c73-8493-710e42826456 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:15.006133 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1016/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:15.100108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:15.101788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:15.325318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d20977-f40c-4305-a7a2-9366ac1f2e28 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:15.346220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:15.348313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:15.348626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:15.351041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] PATH_INFO: `/v3/projects/dcefe07e65054935b06827de70d61800` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:15.361470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcefe07e65054935b06827de70d61800)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:15.369282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:15.389380 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:15.512448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcefe07e65054935b06827de70d61800', 'request_id': 'req-04dc689c-424f-4be7-a432-ee97c61d41ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:15.524073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcefe07e65054935b06827de70d61800', 'request_id': 'req-04dc689c-424f-4be7-a432-ee97c61d41ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:15.535442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcefe07e65054935b06827de70d61800', 'request_id': 'req-04dc689c-424f-4be7-a432-ee97c61d41ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:15.557310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] The token cache is being invalidate because project dcefe07e65054935b06827de70d61800 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:15.558499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:15.561074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04dc689c-424f-4be7-a432-ee97c61d41ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:15.564381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 981/1997] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:15 2022] DELETE /identity/v3/projects/dcefe07e65054935b06827de70d61800 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:15.569607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:15.569986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:15.570196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:15.604696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:15.606083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:15.722454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1017/1998] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:15.727072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:15.727662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:15.728088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:15.760075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:15.772869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:15.811018 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 982/1999] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:15.816865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:15.829751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc275ae-f4f9-45b0-84b9-a4030ff29600 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:15.837654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:15.838917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:15.840081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:15.841022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:15.842150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:15.843283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:15.845735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:15.875555 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1018/2000] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:15.876632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:15.905460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb51a35-67cd-4120-bb6e-69b2d0944d96 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:15.915709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf0457-af56-4d54-944c-488818101f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:15.917367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0457-af56-4d54-944c-488818101f4d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:15.918123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0457-af56-4d54-944c-488818101f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:15.918924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf0457-af56-4d54-944c-488818101f4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:15.920629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf0457-af56-4d54-944c-488818101f4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:15.925186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf0457-af56-4d54-944c-488818101f4d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:15.993843 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 983/2001] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:15 2022] POST /identity/v3/projects => generated 391 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:15.997952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:16.037082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f534cd-62b2-453a-8cf7-e0978ee76c8e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:16.046615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a84b9-7143-42ee-9e99-7a228fe01de0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.047189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a84b9-7143-42ee-9e99-7a228fe01de0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.047618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a84b9-7143-42ee-9e99-7a228fe01de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.132408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ad5a84b9-7143-42ee-9e99-7a228fe01de0 None None] MFA Rules not processed for user `6f034d6e3a874e9892df5c3188235e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:16.133702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad5a84b9-7143-42ee-9e99-7a228fe01de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:16.339610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:16.346834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.347330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.347831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.349261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:16.357468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:16.399920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 984/2002] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:16.401384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.401674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.401949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.446138 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1019/2003] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:15 2022] POST /identity/v3/users => generated 296 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:16.446664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] MFA Rules not processed for user `a5098d2a57b64502be98d9eea5a91cca`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:16.448143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:16.452213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:16.461074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:16.501671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ce584a-99a3-4a31-b925-083834066558 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:16.510391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:16.512637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.514131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.515090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] PATH_INFO: `/v3/projects/a3fc3985ba4c4950bbce48a91104ee2d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.518142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3fc3985ba4c4950bbce48a91104ee2d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:16.520792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:16.662044 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 985/2004] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:16.663206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:16.666081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:16.678330 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:16.687713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a50b57d-1ab6-4548-8938-f0a0373f0a3c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:16.697490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:16.698768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.711858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.713529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.716786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:16.724409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:16.773007 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 986/2005] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:16 2022] POST /identity/v3/projects => generated 397 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:16.774246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:16.792899 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:16.822075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3fc3985ba4c4950bbce48a91104ee2d', 'request_id': 'req-523a0579-edc7-44e8-9a68-e26f557cf1cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:16.852229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3fc3985ba4c4950bbce48a91104ee2d', 'request_id': 'req-523a0579-edc7-44e8-9a68-e26f557cf1cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:16.881758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3fc3985ba4c4950bbce48a91104ee2d', 'request_id': 'req-523a0579-edc7-44e8-9a68-e26f557cf1cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:16.902055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43ca4-18a7-43df-972b-71268500a65a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:16.910438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:16.911467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.912300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.913014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.914314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:16.917850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:16.923067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] The token cache is being invalidate because project a3fc3985ba4c4950bbce48a91104ee2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:16.923585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:16.930857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:16.936648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 987/2006] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:16.937990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:16.938708 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1020/2007] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:16 2022] DELETE /identity/v3/projects/a3fc3985ba4c4950bbce48a91104ee2d => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:16.940710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:16.948576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:16.959591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:16.962037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505f7307-64ed-493f-bddf-e635ce386aab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:16.970470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5023c6-9a5d-4df9-94f3-8a5a551839d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:16.972187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5023c6-9a5d-4df9-94f3-8a5a551839d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:16.973259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5023c6-9a5d-4df9-94f3-8a5a551839d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:16.973926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5023c6-9a5d-4df9-94f3-8a5a551839d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:16.975322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5023c6-9a5d-4df9-94f3-8a5a551839d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:16.979360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5023c6-9a5d-4df9-94f3-8a5a551839d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:17.022180 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 988/2008] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:16 2022] POST /identity/v3/users => generated 305 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:17.023705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.024060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.024426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.060198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:17.060198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:17.094483 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 989/2009] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:17.096578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.128316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899ade9-465d-4465-9b41-fef80ba35026 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:17.137664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aba39e-3ef1-4cac-8d70-5e2a9080fdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:17.139342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aba39e-3ef1-4cac-8d70-5e2a9080fdb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.139613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aba39e-3ef1-4cac-8d70-5e2a9080fdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.140382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aba39e-3ef1-4cac-8d70-5e2a9080fdb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.142066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aba39e-3ef1-4cac-8d70-5e2a9080fdb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:17.145640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aba39e-3ef1-4cac-8d70-5e2a9080fdb2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:17.178488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 990/2010] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:17.182300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.182824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.183295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.207800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a0579-edc7-44e8-9a68-e26f557cf1cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:17.217514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:17.218915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.219419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.219991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.223948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:17.239114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:17.280701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:17.282894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:17.307322 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1021/2011] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:17.316827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.345393 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 991/2012] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:17.346776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.354115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d3ace-35d8-4a6f-a042-696d628d014e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:17.373916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094d067-4af7-488d-967d-123e53a35e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:17.374941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb30a28-a421-4684-9d4b-9636366074fc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:17.375271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094d067-4af7-488d-967d-123e53a35e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.375706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094d067-4af7-488d-967d-123e53a35e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.376239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094d067-4af7-488d-967d-123e53a35e3e admin admin] PATH_INFO: `/v3/projects/a83fb3943f4c4189a2a4df88e0850f12/users/871b812913b44c129b7d09272a42a278/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.389315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:17.390417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.393197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.393604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] PATH_INFO: `/v3/projects/3a013e3bdc054958885eb3e4056389ff/users/60df79c3ae414171adf9e533bb56a23a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.444287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a013e3bdc054958885eb3e4056389ff, user_id=60df79c3ae414171adf9e533bb56a23a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:17.450444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:17.496909 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 992/2013] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:17 2022] PUT /identity/v3/projects/3a013e3bdc054958885eb3e4056389ff/users/60df79c3ae414171adf9e533bb56a23a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:17.498971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094d067-4af7-488d-967d-123e53a35e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83fb3943f4c4189a2a4df88e0850f12, user_id=871b812913b44c129b7d09272a42a278, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:17.502157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094d067-4af7-488d-967d-123e53a35e3e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:17.512574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.535937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1022/2014] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:17 2022] PUT /identity/v3/projects/a83fb3943f4c4189a2a4df88e0850f12/users/871b812913b44c129b7d09272a42a278/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:17.539007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.539332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.539612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.630306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] MFA Rules not processed for user `60df79c3ae414171adf9e533bb56a23a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:17.631644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:17.738289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467dd34e-9a10-4691-b96d-01f10b648f2a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:17.773173 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:17.883487 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1023/2015] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:17.884618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.907155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:17.908026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.908314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.908804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.909579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:17.909895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:17.911725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:17.946650 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 993/2016] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:17.948296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:17.962760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb20cf-74cf-400a-a519-39ee717ce270 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:17.974610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:17.976281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:17.976872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:17.977340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:17.978641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:17.981801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.036933 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:18.069245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 994/2017] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:17 2022] POST /identity/v3/projects => generated 391 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:18.080945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.134368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b8f19-befc-4353-80ee-754d2afe94ca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.289008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e944ec-850f-489d-bce2-9d6720f51500 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.309652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.310930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.311416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.312065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.313315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.317274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.394298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.395534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.396038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.396566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.398074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.408387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.421636 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1024/2018] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:17 2022] GET /identity/v3/roles => generated 1420 bytes in 538 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:18.422624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.429604 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 995/2019] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:18 2022] POST /identity/v3/projects => generated 391 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:18.433147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.438531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793a6a6-7c70-4ba3-ae5d-3ebd2d9a3d0d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.569519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.571132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.571838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.572597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.574691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.579639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.658297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad730a63-26e4-46e3-b331-2d7e41f0359d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.672553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1025/2020] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:18 2022] POST /identity/v3/users => generated 302 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:18.673901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.680777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.682151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.682447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.682728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] PATH_INFO: `/v3/projects/a83fb3943f4c4189a2a4df88e0850f12/users/871b812913b44c129b7d09272a42a278/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.685401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a83fb3943f4c4189a2a4df88e0850f12, user_id=871b812913b44c129b7d09272a42a278, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.697584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.717955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a478ec0e-9400-4ea7-8140-8fa2f359adf1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.730651 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 996/2021] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:18 2022] PUT /identity/v3/projects/a83fb3943f4c4189a2a4df88e0850f12/users/871b812913b44c129b7d09272a42a278/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:18.731998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.758301 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:18.920214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a301c6-62bc-45b7-91c2-b58317c87d74 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:18.934634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.935361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.935644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.935923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.940418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:18.942660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:18.975656 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 997/2022] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:18.977505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:18.990321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:18.993131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:18.994215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:18.995221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:18.997661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:19.005981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:19.007476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd47d6-0d60-437d-9ec6-2a7035bb7239 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:19.019079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:19.021282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:19.021570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:19.021848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] PATH_INFO: `/v3/projects/928d6f120e174067a8b9d47a874bb9fa/users/c7c20e02149d4d259a1e3191e4b3b68a/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:19.063028 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:19.100199 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1026/2023] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:18 2022] POST /identity/v3/users => generated 296 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:19.100943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928d6f120e174067a8b9d47a874bb9fa, user_id=c7c20e02149d4d259a1e3191e4b3b68a, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:19.104836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:19.110780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:19.143167 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 998/2024] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:18 2022] PUT /identity/v3/projects/928d6f120e174067a8b9d47a874bb9fa/users/c7c20e02149d4d259a1e3191e4b3b68a/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:19.144325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:19.154631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd749cda-1e42-4fa0-9555-23ef7054cd76 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:19.329374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178e18e-ade7-4ca0-bc57-b79bda4674b2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:19.345179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:19.345929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:19.346497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:19.346788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:19.350119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:19.352804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:19.384696 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 999/2025] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:19.389539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:19.420628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7168189-6b38-4422-9d14-40b049879028 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:19.432153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e30486-e1cb-43f1-998a-5fcfb0cda034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:19.434374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30486-e1cb-43f1-998a-5fcfb0cda034 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:19.435839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30486-e1cb-43f1-998a-5fcfb0cda034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:19.436338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e30486-e1cb-43f1-998a-5fcfb0cda034 admin admin] PATH_INFO: `/v3/projects/928d6f120e174067a8b9d47a874bb9fa/users/c7c20e02149d4d259a1e3191e4b3b68a/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:19.443775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e30486-e1cb-43f1-998a-5fcfb0cda034 admin admin] RBAC: Authorizing `identity:create_grant(project_id=928d6f120e174067a8b9d47a874bb9fa, user_id=c7c20e02149d4d259a1e3191e4b3b68a, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:19.450701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e30486-e1cb-43f1-998a-5fcfb0cda034 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:19.493447 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1000/2026] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:19 2022] PUT /identity/v3/projects/928d6f120e174067a8b9d47a874bb9fa/users/c7c20e02149d4d259a1e3191e4b3b68a/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:19.498312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:19.498637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:19.498921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:19.583543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] MFA Rules not processed for user `c7c20e02149d4d259a1e3191e4b3b68a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:19.600475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:19.665548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:19.665548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:19.665548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:19.665548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:19.666793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:19.666793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:19.693804 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1027/2027] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 593 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:19.698692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:19.724767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60566f0-0488-4361-b2bf-93b1d09fe55d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:19.760877 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:19.794649 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1001/2028] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:19.803045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:19.804873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:19.979664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:19.981688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:19.982177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:19.982686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:19.984664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:19.989385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:20.014926 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1028/2029] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:20.021583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:20.069626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9a9c0-f31a-4dee-9ca9-b8b8eaae929c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:20.100183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c97b248-2867-4518-9e0f-7a92409b58cb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:20.104741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:20.110805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.112861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.114944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] PATH_INFO: `/v3/projects/e40d649560e141eb8ce5b4d08ac7b873/users/49c89df2d42e47e4acdf8ba55b03eee9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.120533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cfc128-64f7-4cb6-a4cc-ce02f8dd9479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:20.123344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc128-64f7-4cb6-a4cc-ce02f8dd9479 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.123708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc128-64f7-4cb6-a4cc-ce02f8dd9479 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.124059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cfc128-64f7-4cb6-a4cc-ce02f8dd9479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.153181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfc128-64f7-4cb6-a4cc-ce02f8dd9479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:20.156716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cfc128-64f7-4cb6-a4cc-ce02f8dd9479 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:20.182110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40d649560e141eb8ce5b4d08ac7b873, user_id=49c89df2d42e47e4acdf8ba55b03eee9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:20.207770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:20.217203 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1002/2030] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:20.253289 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1029/2031] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:20 2022] PUT /identity/v3/projects/e40d649560e141eb8ce5b4d08ac7b873/users/49c89df2d42e47e4acdf8ba55b03eee9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:20.272222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:20.294711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:20.295247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:20.491932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] MFA Rules not processed for user `49c89df2d42e47e4acdf8ba55b03eee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:20.503524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:20.803080 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1003/2032] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 534 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:20.808016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.096680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4a495-a1b1-4eb0-b83c-f3187cafb2a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.103683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.104471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.104757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.105167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.106286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.109168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.127595 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:21.163857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1030/2033] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:20 2022] POST /identity/v3/projects => generated 393 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:21.165580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.206156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ebcb2-71e8-4406-ae05-458d1966e79f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.426855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.427717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.428067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.428377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.429137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.431833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.448446 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:21.496577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1004/2034] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:21 2022] POST /identity/v3/users => generated 303 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:21.503134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.560051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243d7c2-5589-4fe9-b522-b190c650e1ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.615136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.616257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.616732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.618685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.620967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.627052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.672852 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1031/2035] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:21.675989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.717186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6def0d-64f4-455a-b3d7-8da38108a458 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.756767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:21.758289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:21.758289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:21.759112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] PATH_INFO: `/v3/projects/372ee15bcc374731a637143330b31848/users/b4172ef3253f425dbe32381a246ddd75/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:21.846350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=372ee15bcc374731a637143330b31848, user_id=b4172ef3253f425dbe32381a246ddd75, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:21.855081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:21.867212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:21.888280 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1005/2036] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:21 2022] PUT /identity/v3/projects/372ee15bcc374731a637143330b31848/users/b4172ef3253f425dbe32381a246ddd75/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:21.888635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7233de-bda8-4c53-b99c-d8c146a7b02f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:21.892234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:22.155672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:22.156654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.156935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.157235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] PATH_INFO: `/v3/users/60df79c3ae414171adf9e533bb56a23a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.166739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60df79c3ae414171adf9e533bb56a23a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:22.175106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:22.281085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195f8e9-6368-4308-9495-62e6b400cb3e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:22.313152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf4c65-52d7-4392-b1ce-31f68a54a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:22.316761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf4c65-52d7-4392-b1ce-31f68a54a283 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.318302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf4c65-52d7-4392-b1ce-31f68a54a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.318868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf4c65-52d7-4392-b1ce-31f68a54a283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.323238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf4c65-52d7-4392-b1ce-31f68a54a283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:22.328805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60df79c3ae414171adf9e533bb56a23a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:22.332412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60df79c3ae414171adf9e533bb56a23a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:22.332580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbf4c65-52d7-4392-b1ce-31f68a54a283 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:22.361252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60df79c3ae414171adf9e533bb56a23a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:22.362254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60df79c3ae414171adf9e533bb56a23a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:22.367796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1006/2037] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:21 2022] GET /identity/v3/roles => generated 1420 bytes in 478 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:22.379190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60df79c3ae414171adf9e533bb56a23a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:22.383014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164be1-2dc6-43ec-81db-e965e7b96b02 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.384634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164be1-2dc6-43ec-81db-e965e7b96b02 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.386754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0164be1-2dc6-43ec-81db-e965e7b96b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.456412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1032/2038] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:21 2022] DELETE /identity/v3/users/60df79c3ae414171adf9e533bb56a23a => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:22.458002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:22.463314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:22.496943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b0164be1-2dc6-43ec-81db-e965e7b96b02 None None] MFA Rules not processed for user `157d394363444db8a72d3119f9d01226`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:22.501671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0164be1-2dc6-43ec-81db-e965e7b96b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:22.649195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c868d6-49d0-4c7f-beb5-8fb4e1b84706 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:22.667635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321ccfc0-b856-46b3-9c55-4a41f0a42db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:22.669219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ccfc0-b856-46b3-9c55-4a41f0a42db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.669697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ccfc0-b856-46b3-9c55-4a41f0a42db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.669978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321ccfc0-b856-46b3-9c55-4a41f0a42db0 admin admin] PATH_INFO: `/v3/projects/372ee15bcc374731a637143330b31848/users/b4172ef3253f425dbe32381a246ddd75/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.674041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ccfc0-b856-46b3-9c55-4a41f0a42db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372ee15bcc374731a637143330b31848, user_id=b4172ef3253f425dbe32381a246ddd75, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:22.677703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321ccfc0-b856-46b3-9c55-4a41f0a42db0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:22.681649 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:22.698928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1033/2039] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:22 2022] PUT /identity/v3/projects/372ee15bcc374731a637143330b31848/users/b4172ef3253f425dbe32381a246ddd75/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:22.700886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.701400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.701826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.726556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:22.728386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:22.728549 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1007/2040] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:22.745871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:22.746627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:22.747138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:22.850442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] MFA Rules not processed for user `b4172ef3253f425dbe32381a246ddd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:22.851884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:22.975839 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:22.996488 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1034/2041] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:22.998602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:23.003409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.032561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22729624-2d54-4d1e-8605-360442bde5ae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:23.063252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:23.064538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:23.064746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1008/2042] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:23.065710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:23.069234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:23.069533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] PATH_INFO: `/v3/users/c7d660c8cdfb4d7e94fb4f137f4c540b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:23.072440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7d660c8cdfb4d7e94fb4f137f4c540b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:23.073645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.079879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:23.208260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7d660c8cdfb4d7e94fb4f137f4c540b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:23.210185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7d660c8cdfb4d7e94fb4f137f4c540b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:23.233251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7d660c8cdfb4d7e94fb4f137f4c540b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:23.234202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7d660c8cdfb4d7e94fb4f137f4c540b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:23.252474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7d660c8cdfb4d7e94fb4f137f4c540b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:23.293605 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1035/2043] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:22 2022] DELETE /identity/v3/users/c7d660c8cdfb4d7e94fb4f137f4c540b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:23.294807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:23.296496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.375233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d34859-246b-43b8-ab96-45f2285d3786 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:23.485232 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:23.502258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e5b9fe-887e-4a1e-8dfd-84c554f99268 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:23.521894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:23.522880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:23.523348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:23.523773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:23.526397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.541079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:23.542539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:23.543197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:23.543687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:23.547000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.652556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:23.656422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9348b38a-e885-41ce-aa47-388675fe694a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:23.678670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1036/2044] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:23.698344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:23.698867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:23.704655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:23.739941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:23.744705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:23.782016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:23.783533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.807794 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1009/2045] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:23.809723 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1037/2046] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:23.811633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:23.876404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718ffb84-a679-4b9f-81b0-497f8fe51a72 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:23.878898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:23.881442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.904183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60520087-5095-4838-a7d0-ddb05119d714 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:23.914837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:23.915609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:23.916061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:23.916530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:23.940965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:23.942031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:23.943900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:23.945706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:23.946210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:23.949090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:23.960851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:23.970519 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1038/2047] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:24.158592 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:24.227902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:24.231639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cc858c-f427-4e1a-a007-95257a87e2c9 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:24.260056 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1010/2048] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:24.308837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:24.313419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:24.360635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824fbd9-1798-49a0-b693-71bf252264aa service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:24.370443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:24.373040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:24.373996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:24.374758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] PATH_INFO: `/v3/users/49c89df2d42e47e4acdf8ba55b03eee9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:24.377465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49c89df2d42e47e4acdf8ba55b03eee9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:24.382465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:24.506313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49c89df2d42e47e4acdf8ba55b03eee9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:24.509187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49c89df2d42e47e4acdf8ba55b03eee9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:24.528755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49c89df2d42e47e4acdf8ba55b03eee9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:24.530377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49c89df2d42e47e4acdf8ba55b03eee9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:24.552380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49c89df2d42e47e4acdf8ba55b03eee9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:24.621229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1039/2049] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:24 2022] DELETE /identity/v3/users/49c89df2d42e47e4acdf8ba55b03eee9 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:24.626759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:24.627278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:24.627778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:24.698454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:24.701855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:24.733089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:24.735540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:24.882306 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1011/2050] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:24.930290 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:24.953736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c5287e-5292-4a8f-93e6-8669941f5da8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:24.964640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:24.965942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:24.966537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:24.966967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] PATH_INFO: `/v3/users/49fd9615857544d783832d148d0720ce` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:24.969691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=49fd9615857544d783832d148d0720ce)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:24.972656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:24.976080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:24.978346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.076802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49fd9615857544d783832d148d0720ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.077427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49fd9615857544d783832d148d0720ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.093134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49fd9615857544d783832d148d0720ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.094708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49fd9615857544d783832d148d0720ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.108061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3d1a0795-a281-4a06-a7e2-0af28d69f3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49fd9615857544d783832d148d0720ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.118272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d006f84-963d-4fd7-ae52-d325a3541c4b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:25.127802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:25.129786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:25.130099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:25.130515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:25.134230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.141479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1040/2051] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:24 2022] DELETE /identity/v3/users/49fd9615857544d783832d148d0720ce => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:25.143295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:25.145385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:25.146563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:25.163342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:25.168149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:25.185398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:25.186655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.192724 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1012/2052] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:25.193843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:25.195909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.223532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2618ac8-96ca-4282-b743-c9e318e83525 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:25.343707 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1041/2053] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:25.352087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:25.356605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.358270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:25.359205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:25.359469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:25.359749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] PATH_INFO: `/v3/projects/b3604802d3684957b78e2f9a649e8211` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:25.361116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3604802d3684957b78e2f9a649e8211)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:25.363072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:25.422140 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:25.450943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3604802d3684957b78e2f9a649e8211', 'request_id': 'req-631e8624-d2b8-4cf2-a24b-392282cf053d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.467374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3604802d3684957b78e2f9a649e8211', 'request_id': 'req-631e8624-d2b8-4cf2-a24b-392282cf053d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.480074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3604802d3684957b78e2f9a649e8211', 'request_id': 'req-631e8624-d2b8-4cf2-a24b-392282cf053d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.489349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fb98b5-14ec-4d12-be9b-777db1f7e8a1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:25.515941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] The token cache is being invalidate because project b3604802d3684957b78e2f9a649e8211 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:25.516551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.518226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.521850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1013/2054] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:25 2022] DELETE /identity/v3/projects/b3604802d3684957b78e2f9a649e8211 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:25.527665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:25.530766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.540905 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:25.630824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:25.631977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:25.632510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:25.632995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:25.637625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:25.703504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e8624-d2b8-4cf2-a24b-392282cf053d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:25.710110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:25.711044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:25.711320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:25.711593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] PATH_INFO: `/v3/users/46e0b8e0c22a4cf28cb444c0dec3e731` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:25.714197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e0b8e0c22a4cf28cb444c0dec3e731)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:25.717195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:25.809308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e0b8e0c22a4cf28cb444c0dec3e731'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.816644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:25.819707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:25.826295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e0b8e0c22a4cf28cb444c0dec3e731'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.846789 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1042/2055] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:25.866355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e0b8e0c22a4cf28cb444c0dec3e731'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.867330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e0b8e0c22a4cf28cb444c0dec3e731'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.885931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a638827-deca-4bda-8d52-557880d9c949 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e0b8e0c22a4cf28cb444c0dec3e731'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:25.909249 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1014/2056] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:25 2022] DELETE /identity/v3/users/46e0b8e0c22a4cf28cb444c0dec3e731 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:26.400721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:26.415690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132a5682-2f24-4256-a039-616c438c8444 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:26.613225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:26.617596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:26.617997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:26.626338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] PATH_INFO: `/v3/projects/f8ab28a7c92b4dc18bfc788449a6c316` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:26.630744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ab28a7c92b4dc18bfc788449a6c316)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:26.642980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:26.869686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ab28a7c92b4dc18bfc788449a6c316', 'request_id': 'req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:26.903733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ab28a7c92b4dc18bfc788449a6c316', 'request_id': 'req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:26.925255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ab28a7c92b4dc18bfc788449a6c316', 'request_id': 'req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:26.986844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] The token cache is being invalidate because project f8ab28a7c92b4dc18bfc788449a6c316 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:26.991181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:26.998356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.019647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1043/2057] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:26 2022] DELETE /identity/v3/projects/f8ab28a7c92b4dc18bfc788449a6c316 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:27.029944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:27.030761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:27.030880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:27.090784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:27.093837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:27.099147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:27.112214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:27.135954 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:27.221721 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:27.322079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1015/2058] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:27.322079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:27.322079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:27.329524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5497171-5e48-4d4f-b9c1-2799b1bd34ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:27.341703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e5b6a8-732e-43a2-9389-b030d8856d87 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:27.348957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:27.349197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:27.349881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:27.350078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:27.350235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:27.350379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:27.350566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] PATH_INFO: `/v3/projects/e40d649560e141eb8ce5b4d08ac7b873` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:27.350721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] PATH_INFO: `/v3/projects/3a013e3bdc054958885eb3e4056389ff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:27.352036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a013e3bdc054958885eb3e4056389ff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:27.352208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40d649560e141eb8ce5b4d08ac7b873)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:27.354088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:27.354387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:27.443007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40d649560e141eb8ce5b4d08ac7b873', 'request_id': 'req-3aa669f5-fe8e-414b-a973-77ae27d85892'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.471435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40d649560e141eb8ce5b4d08ac7b873', 'request_id': 'req-3aa669f5-fe8e-414b-a973-77ae27d85892'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.496843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40d649560e141eb8ce5b4d08ac7b873', 'request_id': 'req-3aa669f5-fe8e-414b-a973-77ae27d85892'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.521113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a013e3bdc054958885eb3e4056389ff', 'request_id': 'req-428ba668-6e09-49ef-a52c-a784458828f8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.544898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a013e3bdc054958885eb3e4056389ff', 'request_id': 'req-428ba668-6e09-49ef-a52c-a784458828f8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.551502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] The token cache is being invalidate because project e40d649560e141eb8ce5b4d08ac7b873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:27.552745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.555863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3aa669f5-fe8e-414b-a973-77ae27d85892 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.559333 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1016/2059] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:27 2022] DELETE /identity/v3/projects/e40d649560e141eb8ce5b4d08ac7b873 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:27.566332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:27.567422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:27.567990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:27.573169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a013e3bdc054958885eb3e4056389ff', 'request_id': 'req-428ba668-6e09-49ef-a52c-a784458828f8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.614324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] The token cache is being invalidate because project 3a013e3bdc054958885eb3e4056389ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:27.614852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.616782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:27.623647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1044/2060] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:27 2022] DELETE /identity/v3/projects/3a013e3bdc054958885eb3e4056389ff => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:27.625694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:27.632839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:27.643285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:27.647041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:27.941687 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1017/2061] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:27.943183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:27.945520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:27.963272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ba668-6e09-49ef-a52c-a784458828f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:27.972109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:27.973961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:27.974473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:27.975589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] PATH_INFO: `/v3/users/b4172ef3253f425dbe32381a246ddd75` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:27.981536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4172ef3253f425dbe32381a246ddd75)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:27.983109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b8a6bb-7c70-46bd-8afd-466ee69452b5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:27.984732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:27.996677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:27.998162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:27.998526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:27.998797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] PATH_INFO: `/v3/users/c7c20e02149d4d259a1e3191e4b3b68a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:28.001297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7c20e02149d4d259a1e3191e4b3b68a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:28.003561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:28.127001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7c20e02149d4d259a1e3191e4b3b68a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.137671 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:28.147261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7c20e02149d4d259a1e3191e4b3b68a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.159124 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:28.185501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7c20e02149d4d259a1e3191e4b3b68a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.189029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7c20e02149d4d259a1e3191e4b3b68a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.208705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4172ef3253f425dbe32381a246ddd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.209840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4172ef3253f425dbe32381a246ddd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.211603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7c20e02149d4d259a1e3191e4b3b68a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.234062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4172ef3253f425dbe32381a246ddd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.234857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4172ef3253f425dbe32381a246ddd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.237530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1018/2062] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:27 2022] DELETE /identity/v3/users/c7c20e02149d4d259a1e3191e4b3b68a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:28.241898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:28.245016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:28.256493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4172ef3253f425dbe32381a246ddd75'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.314368 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1045/2063] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:27 2022] DELETE /identity/v3/users/b4172ef3253f425dbe32381a246ddd75 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:28.315708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:28.320706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:28.416385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0967a-cac6-4db5-9fd8-cbb513ba1c18 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:28.557410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319c63c-c6d7-41a8-b2b4-e28c6b581ae7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:28.577207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:28.577392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:28.578201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:28.578405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:28.578527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:28.578761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] PATH_INFO: `/v3/projects/8ce810d95b994f41ba75267cbeaa9377` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:28.578860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:28.587702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:28.588930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ce810d95b994f41ba75267cbeaa9377)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:28.589644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:28.590217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:28.593383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:28.594303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:28.669903 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1046/2064] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:28.671333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:28.712130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12371d84-308c-424c-8251-e1c7ce2780d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:28.766631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ce810d95b994f41ba75267cbeaa9377', 'request_id': 'req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.803904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ce810d95b994f41ba75267cbeaa9377', 'request_id': 'req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.844228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ce810d95b994f41ba75267cbeaa9377', 'request_id': 'req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.856020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:28.856786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:28.857071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:28.857344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:28.858080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:28.860184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:28.888390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] The token cache is being invalidate because project 8ce810d95b994f41ba75267cbeaa9377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:28.889187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.892780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:28.896680 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1019/2065] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:28 2022] DELETE /identity/v3/projects/8ce810d95b994f41ba75267cbeaa9377 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:28.901247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:28.903345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:28.929894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e1ec7-030a-4666-bf30-81e75e4e8a90 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:28.939738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:28.942471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:28.943351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:28.944203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] PATH_INFO: `/v3/users/7f1c961d89084d03aa7a7f8c963ee7b5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:28.946113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1047/2066] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:28 2022] POST /identity/v3/projects => generated 369 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:28.947761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:28.949163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1c961d89084d03aa7a7f8c963ee7b5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:28.951205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:28.952938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:28.957228 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:29.139941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1c961d89084d03aa7a7f8c963ee7b5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:29.143014 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:29.175104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1c961d89084d03aa7a7f8c963ee7b5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:29.209744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1c961d89084d03aa7a7f8c963ee7b5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:29.210994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1c961d89084d03aa7a7f8c963ee7b5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:29.237372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1c961d89084d03aa7a7f8c963ee7b5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:29.244556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f64ba10-38ec-44b0-83fb-b5740d75366b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:29.259264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:29.259980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:29.260263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:29.260568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:29.261369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:29.267790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:29.269421 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1020/2067] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:28 2022] DELETE /identity/v3/users/7f1c961d89084d03aa7a7f8c963ee7b5 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:29.322149 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1048/2068] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:28 2022] POST /identity/v3/users => generated 285 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:29.327245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:29.329524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:29.501079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef61311-f502-49af-89e5-0c86a9bac9ba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:29.529293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:29.530122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:29.530512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:29.530698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:29.531947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:29.536228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:29.585114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1021/2069] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:29.586499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:29.602895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d9733-dfbe-47d5-a653-ed98793c9795 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:29.617473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:29.618121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:29.618411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:29.618695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:29.619530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:29.621550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:29.645329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:29.648222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:29.718094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfecbfd7-d4b3-403a-9e33-e028ab95818a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:29.720439 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1049/2070] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:29.727247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:29.744826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:29.746679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:29.751186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:29.752879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] PATH_INFO: `/v3/projects/928d6f120e174067a8b9d47a874bb9fa` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:29.757686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=928d6f120e174067a8b9d47a874bb9fa)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:29.761586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:29.806935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b37db9-829d-42a1-a6f3-124a1ddd1dee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:29.853002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ffdd9-3c2c-4e14-be33-00814da12765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:29.863612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffdd9-3c2c-4e14-be33-00814da12765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:29.870362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffdd9-3c2c-4e14-be33-00814da12765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:29.871047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ffdd9-3c2c-4e14-be33-00814da12765 admin admin] PATH_INFO: `/v3/projects/94d27913ebb646d7b8008a298fc50a10/users/3bb73407f24042d8a9f9bf898401cafb/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:30.021380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ffdd9-3c2c-4e14-be33-00814da12765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d27913ebb646d7b8008a298fc50a10, user_id=3bb73407f24042d8a9f9bf898401cafb, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:30.036621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ffdd9-3c2c-4e14-be33-00814da12765 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:30.120458 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1050/2071] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:29 2022] PUT /identity/v3/projects/94d27913ebb646d7b8008a298fc50a10/users/3bb73407f24042d8a9f9bf898401cafb/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:30.143919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:30.144386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:30.144792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:30.172168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '928d6f120e174067a8b9d47a874bb9fa', 'request_id': 'req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.211890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '928d6f120e174067a8b9d47a874bb9fa', 'request_id': 'req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.235375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '928d6f120e174067a8b9d47a874bb9fa', 'request_id': 'req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.256431 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:30.286705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] The token cache is being invalidate because project 928d6f120e174067a8b9d47a874bb9fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:30.288556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.293048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-320fd0d6-aee7-46b4-a0df-fb69f0aa1fb3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.306894 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1022/2072] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:29 2022] DELETE /identity/v3/projects/928d6f120e174067a8b9d47a874bb9fa => generated 0 bytes in 659 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:30.307125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] MFA Rules not processed for user `3bb73407f24042d8a9f9bf898401cafb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:30.308645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:30.317295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:30.317903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:30.322681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:30.379303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:30.386766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:30.480309 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1051/2073] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:30.487942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:30.489983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:30.631549 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1023/2074] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:30.632112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d41959-25b0-4de3-8ba1-35619e720776 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:30.633321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:30.639667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:30.643415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4157b681-4e4a-4889-9325-4433d2204f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:30.644955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157b681-4e4a-4889-9325-4433d2204f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:30.646287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157b681-4e4a-4889-9325-4433d2204f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:30.646954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4157b681-4e4a-4889-9325-4433d2204f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:30.648766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157b681-4e4a-4889-9325-4433d2204f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:30.654764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4157b681-4e4a-4889-9325-4433d2204f24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:30.669100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c783e6-993e-444d-88d0-e71eed0b740a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:30.696482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:30.698073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:30.698423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:30.698982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] PATH_INFO: `/v3/projects/372ee15bcc374731a637143330b31848` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:30.712461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=372ee15bcc374731a637143330b31848)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:30.716829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:30.762752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1052/2075] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:30 2022] POST /identity/v3/projects => generated 369 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:30.774025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:30.774538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:30.775043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:30.848672 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:30.857865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372ee15bcc374731a637143330b31848', 'request_id': 'req-99a85f32-54cd-4880-8dd1-75ee679ffa44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.878361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372ee15bcc374731a637143330b31848', 'request_id': 'req-99a85f32-54cd-4880-8dd1-75ee679ffa44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.880708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:30.884076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:30.889203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372ee15bcc374731a637143330b31848', 'request_id': 'req-99a85f32-54cd-4880-8dd1-75ee679ffa44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.918879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] The token cache is being invalidate because project 372ee15bcc374731a637143330b31848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:30.919297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.920029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:30.922639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1024/2076] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:30 2022] DELETE /identity/v3/projects/372ee15bcc374731a637143330b31848 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:30.926149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:30.937641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.127678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1053/2077] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:31.129028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:31.131271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.163243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5d9089-e222-44cd-ad5c-52f775a68118 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:31.172694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d244c219-d8c9-43b8-9858-6f67fd49b902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:31.173687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244c219-d8c9-43b8-9858-6f67fd49b902 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.174296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244c219-d8c9-43b8-9858-6f67fd49b902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.174805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d244c219-d8c9-43b8-9858-6f67fd49b902 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.175768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244c219-d8c9-43b8-9858-6f67fd49b902 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:31.179080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d244c219-d8c9-43b8-9858-6f67fd49b902 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:31.219836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a85f32-54cd-4880-8dd1-75ee679ffa44 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:31.243762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:31.245142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.245600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.245982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] PATH_INFO: `/v3/projects/1e2ea7b2794f47198a18f33c4216850e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.249008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2ea7b2794f47198a18f33c4216850e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:31.254018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:31.269158 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1054/2078] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:31 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:31.274808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.281275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.281796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.336690 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:31.349649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:31.357444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.397938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2ea7b2794f47198a18f33c4216850e', 'request_id': 'req-d99d6699-3312-4f06-96bc-2631b9b6805f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:31.413667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2ea7b2794f47198a18f33c4216850e', 'request_id': 'req-d99d6699-3312-4f06-96bc-2631b9b6805f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:31.429345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2ea7b2794f47198a18f33c4216850e', 'request_id': 'req-d99d6699-3312-4f06-96bc-2631b9b6805f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:31.468168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] The token cache is being invalidate because project 1e2ea7b2794f47198a18f33c4216850e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:31.468935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:31.470108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:31.472928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1025/2079] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:30 2022] DELETE /identity/v3/projects/1e2ea7b2794f47198a18f33c4216850e => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:31.474638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:31.477003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.520340 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1055/2080] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:31.520340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:31.521912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.556443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c9ec3-b7c6-4b64-b1c7-9cb3e63f7314 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:31.575415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cbf6a7-a530-4332-882b-df70e5baa47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:31.576493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf6a7-a530-4332-882b-df70e5baa47b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.578038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf6a7-a530-4332-882b-df70e5baa47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.578493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbf6a7-a530-4332-882b-df70e5baa47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.585097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbf6a7-a530-4332-882b-df70e5baa47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:31.587329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cbf6a7-a530-4332-882b-df70e5baa47b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:31.629785 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1056/2081] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:31 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:31.638720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91523-5e69-46e4-88da-be81cac16791 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.645316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91523-5e69-46e4-88da-be81cac16791 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.648466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc91523-5e69-46e4-88da-be81cac16791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.708559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6cc91523-5e69-46e4-88da-be81cac16791 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:31.710516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cc91523-5e69-46e4-88da-be81cac16791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.734814 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1057/2082] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:31.736619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc05e68-630a-4ded-958b-dbc94a854227 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.737101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc05e68-630a-4ded-958b-dbc94a854227 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.737640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc05e68-630a-4ded-958b-dbc94a854227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.756646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d6699-3312-4f06-96bc-2631b9b6805f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:31.763814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:31.764701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.765090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.765494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.766395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:31.766815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:31.768869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:31.800151 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1026/2083] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:31.801141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:31.815053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4dc05e68-630a-4ded-958b-dbc94a854227 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:31.816364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dc05e68-630a-4ded-958b-dbc94a854227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.846718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba827316-a072-4380-a490-de7d46f81932 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:31.847717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1058/2084] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:31.849349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.849635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.849915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.889702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:31.891037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:31.891485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:31.891867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] PATH_INFO: `/v3/projects/7aad9d360a7f4d0cbe4b8eb8c8290b26/users/7a0cc22a1a0a46fa8304a856a19d5dd3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:31.897667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:31.898947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:31.933658 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1059/2085] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:31.941169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:31.954203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aad9d360a7f4d0cbe4b8eb8c8290b26, user_id=7a0cc22a1a0a46fa8304a856a19d5dd3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:31.957222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:31.973159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8afbfbb-83fd-4ccb-9d19-419139bd6464 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:31.996505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1027/2086] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:31 2022] PUT /identity/v3/projects/7aad9d360a7f4d0cbe4b8eb8c8290b26/users/7a0cc22a1a0a46fa8304a856a19d5dd3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:31.998005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:31.999122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.000644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.001370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.002299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.003905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.008281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.121740 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1060/2087] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:31 2022] POST /identity/v3/projects => generated 409 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:32.126038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.187772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b47ba8-4ae9-4fcb-96d8-fcd61d21273b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.220548 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:32.278673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a28613-3d30-4c8f-b20d-24b64186a027 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.282761 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:32.286239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.287468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.288072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.288614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.290274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:32.290776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.294436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.353491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.354480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.354926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.355309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.356767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:32.356767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.358908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.368114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1061/2088] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:32.372468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.403233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e8547-5658-427c-965f-4d8e61805627 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.413186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.414307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.414603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1028/2089] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:32.415861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.422195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.422770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.424272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.427581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.432952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89949f42-1c57-4b27-9c80-4f76183b60e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.447420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.448125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.448489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.448776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.449508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.451587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.453399 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1062/2090] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:32.455144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.484900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815d0f-db9e-49cc-bd70-b6e49aeef718 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.499205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1029/2091] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:32 2022] POST /identity/v3/users => generated 305 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:32.500027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.503596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.504786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.505409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.506690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.511181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.525721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01df738-e351-4432-bdad-edc1a9fa2760 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.526357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.547548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.548166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.548565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.548848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.549587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.551615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.614783 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1030/2092] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:32 2022] POST /identity/v3/projects => generated 397 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:32.616176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.645653 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1063/2093] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:32 2022] POST /identity/v3/projects => generated 393 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:32.648059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:32.785668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93241eb2-314e-40bb-8a26-db2ff10faa2b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.933815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:32.936075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:32.937986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:32.937986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] PATH_INFO: `/v3/projects/7aad9d360a7f4d0cbe4b8eb8c8290b26/users/7a0cc22a1a0a46fa8304a856a19d5dd3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:32.942906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aad9d360a7f4d0cbe4b8eb8c8290b26, user_id=7a0cc22a1a0a46fa8304a856a19d5dd3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:32.949390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:32.977728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aad3d92-9b78-4cea-8761-29786bdc50b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:32.978025 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1031/2094] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:32 2022] PUT /identity/v3/projects/7aad9d360a7f4d0cbe4b8eb8c8290b26/users/7a0cc22a1a0a46fa8304a856a19d5dd3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:32.979014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.060652 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:33.154364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f02d7a-976b-4daf-8379-2ddaca1790b1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.172076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.173336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.173622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.173903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.174892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.176920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.198393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e278bc-d7c3-4275-a640-f56f37506c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.199460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e278bc-d7c3-4275-a640-f56f37506c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.199910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e278bc-d7c3-4275-a640-f56f37506c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.200423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e278bc-d7c3-4275-a640-f56f37506c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.201551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e278bc-d7c3-4275-a640-f56f37506c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.205008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e278bc-d7c3-4275-a640-f56f37506c0f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.239915 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1032/2095] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:32 2022] POST /identity/v3/users => generated 299 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:33.243223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.257149 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1064/2096] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:32 2022] GET /identity/v3/roles => generated 1420 bytes in 611 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:33.278528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.278772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.279267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.285453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd393ed-4789-4bc4-976e-e6d30a8d8dbb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.305126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.305877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.306170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.306450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.307187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.316388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.381520 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1033/2097] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:33 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:33.382573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.389873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] MFA Rules not processed for user `7a0cc22a1a0a46fa8304a856a19d5dd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:33.395570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:33.402874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc358e0f-2828-4795-a0b2-a1dc0ffac766 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.419845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.420732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.421027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.421294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.422073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.426949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.459416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1034/2098] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:33.462389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.482455 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:33.510006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b252d71-1567-4834-9a38-9dc6d2be1659 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.520430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.521255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.521441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.521865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.522843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.524555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.556245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1035/2099] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:33.564581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.585135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daefa21-f341-4eae-85c4-e683d7941a38 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.599957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.601053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.601507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.601933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.603004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.606973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.607177 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1065/2100] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:33.608147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.635652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1470d4-4ced-414f-a995-444119e2ff86 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.648339 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1036/2101] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:33.650879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.666024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.670620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.671226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.671790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.673280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.675526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a46140-fe61-43a9-9a51-93392371f01d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.677103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.691460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.693424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.693905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.694346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] PATH_INFO: `/v3/projects/b47e6c73c97c48159ac489d5f93a0b02/users/9fa5fdd35f3d489dbfb7c894ff95f66d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.697941 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1066/2102] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:33.699652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.702432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:33.716944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b47e6c73c97c48159ac489d5f93a0b02, user_id=9fa5fdd35f3d489dbfb7c894ff95f66d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.720976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.763082 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1037/2103] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:33 2022] PUT /identity/v3/projects/b47e6c73c97c48159ac489d5f93a0b02/users/9fa5fdd35f3d489dbfb7c894ff95f66d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:33.765141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:33.870197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e6690-5c03-497e-9cb2-92e09072276c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.961078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7e30b-e474-4c59-b3af-dc3443b1ec8d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:33.967393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:33.968579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:33.969113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:33.969608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:33.970831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:33.973159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:33.999455 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1038/2104] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:34.001114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:34.010202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.011508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.011508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.011724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.019338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e9c9e-9720-45fb-a4ce-4efd0d4c478d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:34.025569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79d774-6ac9-4b86-897d-18a6055b378f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.026972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d774-6ac9-4b86-897d-18a6055b378f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.027456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d774-6ac9-4b86-897d-18a6055b378f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.027915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79d774-6ac9-4b86-897d-18a6055b378f admin admin] PATH_INFO: `/v3/projects/3b7797d2a66144f880e517268ca01088/users/b20b9d3a9539420fa8cfe87da29ca1e4/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.058636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79d774-6ac9-4b86-897d-18a6055b378f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b7797d2a66144f880e517268ca01088, user_id=b20b9d3a9539420fa8cfe87da29ca1e4, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.064540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79d774-6ac9-4b86-897d-18a6055b378f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.098772 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1039/2105] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:33 2022] PUT /identity/v3/projects/3b7797d2a66144f880e517268ca01088/users/b20b9d3a9539420fa8cfe87da29ca1e4/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:34.102905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57b31-4b5b-4d53-b1da-714b5638b2be None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.104964 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:34.105734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57b31-4b5b-4d53-b1da-714b5638b2be None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.106299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d57b31-4b5b-4d53-b1da-714b5638b2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.122403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.124043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.144035 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1067/2106] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:33 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:34.145232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:34.158374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3fce0-d8bc-46f5-bb7a-3f19e0454111 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:34.178762 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:34.226574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-24d57b31-4b5b-4d53-b1da-714b5638b2be None None] MFA Rules not processed for user `9fa5fdd35f3d489dbfb7c894ff95f66d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:34.227919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-24d57b31-4b5b-4d53-b1da-714b5638b2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:34.277186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8463a-9de9-4e78-a895-c3c559933cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.278148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8463a-9de9-4e78-a895-c3c559933cb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.278436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8463a-9de9-4e78-a895-c3c559933cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.278713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8463a-9de9-4e78-a895-c3c559933cb9 admin admin] PATH_INFO: `/v3/projects/af366066ae55400fb4d26141e678091e/users/b04833772a374794a55b787d0317cff6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.302247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8463a-9de9-4e78-a895-c3c559933cb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af366066ae55400fb4d26141e678091e, user_id=b04833772a374794a55b787d0317cff6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.305817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8463a-9de9-4e78-a895-c3c559933cb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.348505 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1068/2107] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:34 2022] PUT /identity/v3/projects/af366066ae55400fb4d26141e678091e/users/b04833772a374794a55b787d0317cff6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:34.352080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.352474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.352762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.426587 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1040/2108] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:34.426587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ab51-b965-4085-9224-42c55da12806 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.426587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ab51-b965-4085-9224-42c55da12806 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.426587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037ab51-b965-4085-9224-42c55da12806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.435498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:34.438747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:34.523978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9037ab51-b965-4085-9224-42c55da12806 None None] MFA Rules not processed for user `b04833772a374794a55b787d0317cff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:34.529491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9037ab51-b965-4085-9224-42c55da12806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:34.613786 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1069/2109] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:34.615736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:34.655230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103f739-70f2-4cfe-abbc-514ea658e4cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:34.660777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.661562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.661917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.662263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.663060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.666734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.708790 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1070/2110] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:34 2022] POST /identity/v3/projects => generated 409 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:34.710521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:34.763213 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1041/2111] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:34.764594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037ab51-b965-4085-9224-42c55da12806 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:34.780980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037ab51-b965-4085-9224-42c55da12806 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:34.833419 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:34.879104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcb2c8-9e8f-4568-b4c0-06f93c827dba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:34.890684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.892259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.892800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.893277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] PATH_INFO: `/v3/users/3bb73407f24042d8a9f9bf898401cafb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.900990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bb73407f24042d8a9f9bf898401cafb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.917621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:34.918581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:34.918914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:34.919143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:34.920308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.920920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:34.923856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:34.997391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1042/2112] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:34 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:34.999954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.005615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.087160 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:35.100174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bb73407f24042d8a9f9bf898401cafb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:35.101459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bb73407f24042d8a9f9bf898401cafb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:35.126451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bb73407f24042d8a9f9bf898401cafb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:35.128121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bb73407f24042d8a9f9bf898401cafb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:35.160504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bb73407f24042d8a9f9bf898401cafb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:35.199689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a652619f-d2ae-4776-8b31-5baec807aa83 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:35.211516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:35.212468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.213127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.213472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.217267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.221869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1071/2113] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:34 2022] DELETE /identity/v3/users/3bb73407f24042d8a9f9bf898401cafb => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:35.232256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.233915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.268042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:35.279699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:35.313444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1043/2114] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:35.327779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.339974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.368462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c4922e-1b62-453d-9c29-fd7d740c4c84 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:35.408111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc706337-3817-4d7a-8b3f-14eecdeafa4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:35.425108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f582e-cb45-42dc-89ee-53a917f910e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:35.428040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f582e-cb45-42dc-89ee-53a917f910e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.428515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f582e-cb45-42dc-89ee-53a917f910e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.429017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f582e-cb45-42dc-89ee-53a917f910e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.431047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f582e-cb45-42dc-89ee-53a917f910e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:35.438294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f582e-cb45-42dc-89ee-53a917f910e5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:35.505439 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1072/2115] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:35 2022] POST /identity/v3/projects => generated 393 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:35.507959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.509775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.513325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.541815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:35.542645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.542645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.542645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.543573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:35.547411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:35.561198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:35.564261 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1044/2116] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:35 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:35.565367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.566115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.577951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f3e46-aa4c-483e-b277-66ce56d01df3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:35.729320 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:35.795438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdc3a8-24d2-44ef-a3b1-e551c78d01e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:35.798739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc3a8-24d2-44ef-a3b1-e551c78d01e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.799806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc3a8-24d2-44ef-a3b1-e551c78d01e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.800741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdc3a8-24d2-44ef-a3b1-e551c78d01e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.802025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc3a8-24d2-44ef-a3b1-e551c78d01e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:35.819516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdc3a8-24d2-44ef-a3b1-e551c78d01e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:35.828943 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1073/2117] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:35.832323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.866902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10580261-b6cc-41ce-8b59-3e60415a2736 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:35.882988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:35.884743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.885247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.885812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] PATH_INFO: `/v3/projects/7f6ed214091a4a93b8b6b56fba308570/users/fdc23e15360f403889e23c2b72144e7c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.904099 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1045/2118] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:35 2022] POST /identity/v3/users => generated 303 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:35.906370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:35.906849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:35.907326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:35.922808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6ed214091a4a93b8b6b56fba308570, user_id=fdc23e15360f403889e23c2b72144e7c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:35.928827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:35.964039 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1074/2119] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:35 2022] PUT /identity/v3/projects/7f6ed214091a4a93b8b6b56fba308570/users/fdc23e15360f403889e23c2b72144e7c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:35.966103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:35.974379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:35.995342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] MFA Rules not processed for user `871b812913b44c129b7d09272a42a278`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:35.998236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.113362 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:36.219470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1046/2120] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:35 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:36.221516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.238944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749d001-3a3a-4a48-af02-260de85665ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.243972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.244962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.245528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.245887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.429520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.434059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.475458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d0578b-0d81-4dc6-97b3-47ec3fb858e9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.475742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1075/2121] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:36.477605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.487407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f5504-891a-4f47-b955-68c98781f37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.489095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f5504-891a-4f47-b955-68c98781f37c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.489742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f5504-891a-4f47-b955-68c98781f37c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.490550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f5504-891a-4f47-b955-68c98781f37c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.491796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f5504-891a-4f47-b955-68c98781f37c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.499667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f5504-891a-4f47-b955-68c98781f37c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.502814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7abc45-e938-4dee-957a-5ddd21389000 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.528843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.529973 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1047/2122] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:36.533812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.534391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.534940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.543379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.543872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.544594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.545600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.547706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.566219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] MFA Rules not processed for user `6f034d6e3a874e9892df5c3188235e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:36.568580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:36.604667 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1076/2123] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:36.606735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.642303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee11fde-2c3a-47fe-a966-4dc73b3370f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.655902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.656907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.657192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.657478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] PATH_INFO: `/v3/projects/83419f33442b45329fcda43e8d8406a0/users/3d7ec0edb22b4434ada05f73a4ee4527/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.685145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83419f33442b45329fcda43e8d8406a0, user_id=3d7ec0edb22b4434ada05f73a4ee4527, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.688708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.731452 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1077/2124] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:36 2022] PUT /identity/v3/projects/83419f33442b45329fcda43e8d8406a0/users/3d7ec0edb22b4434ada05f73a4ee4527/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:36.733826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.792171 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1048/2125] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:36.795746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.842105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ece56-2076-4cfb-aa35-ee39c43fb367 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.898491 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:36.926033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391ef44-8186-4d60-ba6d-e195ce880995 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:36.932709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:36.941249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:36.941884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:36.942322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] PATH_INFO: `/v3/projects/7f6ed214091a4a93b8b6b56fba308570/users/fdc23e15360f403889e23c2b72144e7c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:36.945118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f6ed214091a4a93b8b6b56fba308570, user_id=fdc23e15360f403889e23c2b72144e7c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:36.948289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:36.973473 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1078/2126] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:36 2022] PUT /identity/v3/projects/7f6ed214091a4a93b8b6b56fba308570/users/fdc23e15360f403889e23c2b72144e7c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:36.974869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:36.981879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.014213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5cfff8-39d0-47e6-a569-7d3577b54246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.015369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cfff8-39d0-47e6-a569-7d3577b54246 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.015746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cfff8-39d0-47e6-a569-7d3577b54246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.016091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5cfff8-39d0-47e6-a569-7d3577b54246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.016977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cfff8-39d0-47e6-a569-7d3577b54246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.018979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5cfff8-39d0-47e6-a569-7d3577b54246 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.044677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1049/2127] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:36 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:37.046367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.050421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.050973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.099949 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:37.125161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] MFA Rules not processed for user `fdc23e15360f403889e23c2b72144e7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:37.131069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.251857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca036998-ad8e-4150-a3ed-666b8f7e68cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.280150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.281360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.281890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.284696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.288505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.324268 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1050/2128] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:37.333112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.437847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf23c91-2e8c-4d13-9b87-f17b81eb158a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.446563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.449381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.449680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.450002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] PATH_INFO: `/v3/projects/83419f33442b45329fcda43e8d8406a0/users/3d7ec0edb22b4434ada05f73a4ee4527/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.452666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83419f33442b45329fcda43e8d8406a0, user_id=3d7ec0edb22b4434ada05f73a4ee4527, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.456334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.483762 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1051/2129] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:37 2022] PUT /identity/v3/projects/83419f33442b45329fcda43e8d8406a0/users/3d7ec0edb22b4434ada05f73a4ee4527/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:37.485287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.487327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.507499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.509759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b531f-8c7d-44d4-a8c0-c5855734a47d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.529056 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1079/2130] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:37.530837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.531322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.531919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.612879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] MFA Rules not processed for user `3d7ec0edb22b4434ada05f73a4ee4527`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:37.615651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1343786-27a9-4b63-a212-64b50f6bc967 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.629965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:37.633792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.639489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.639848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.640135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.709689 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:37.803925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:37.806639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:37.841583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1052/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:37.847278 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:37.849892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1080/2132] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:37 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:37.910995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.913314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:37.929096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87423490-87f3-4b32-9fc6-8a214a363583 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:37.937783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:37.938772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:37.939244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:37.939690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:37.941934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.046100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:38.047828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0171ee0-92dd-43e4-af28-78f3a08003c7 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:38.069435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22b5cf3-eb2e-4669-bb43-89caf59ad487 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:38.095236 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1081/2133] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:37 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:09:38.097491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:38.098606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.099045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.099451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] PATH_INFO: `/v3/users/b04833772a374794a55b787d0317cff6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.106831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04833772a374794a55b787d0317cff6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:38.112529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:38.211308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04833772a374794a55b787d0317cff6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.225254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04833772a374794a55b787d0317cff6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.261356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04833772a374794a55b787d0317cff6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.262465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04833772a374794a55b787d0317cff6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.285582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65c86fbd-52f7-4a02-8ea0-70c511b3a17d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04833772a374794a55b787d0317cff6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:38.293726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1053/2134] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:37 2022] DELETE /identity/v3/users/b04833772a374794a55b787d0317cff6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:38.298542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581552b-945a-43f0-bb8a-75bc69c39d66 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.298932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581552b-945a-43f0-bb8a-75bc69c39d66 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.299379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581552b-945a-43f0-bb8a-75bc69c39d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.341610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4581552b-945a-43f0-bb8a-75bc69c39d66 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:38.346212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4581552b-945a-43f0-bb8a-75bc69c39d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.431722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa6d1-6ab1-4d9d-aa29-89aaa2bab6f4 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.432087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa6d1-6ab1-4d9d-aa29-89aaa2bab6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.433185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18fa6d1-6ab1-4d9d-aa29-89aaa2bab6f4 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.435269 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1054/2135] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:09:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:09:38.474036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.475245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.475767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.521516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:38.524878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.545155 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1082/2136] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:38.550672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.551324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.552179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.588056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:38.590161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.654642 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:38.691173 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1055/2137] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:38.692894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:38.697799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.723872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52b20e-4b84-4e90-971b-b5227e2a9fe6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:38.729028 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1083/2138] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:38.737412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:38.738728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:38.739377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:38.739867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:38.765137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:38.769432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:38.798193 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1056/2139] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:38.972127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:38.974526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.991720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:38.995386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:38.995667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77f5b0-8e52-4968-a94b-46fea0d85c9c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.003063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.004128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.004568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.004953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.018852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d558425-ffb0-45b2-8e04-02ed45cf705e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.023936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.033664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.034426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.034705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.034987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.039102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.059225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.061747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.073397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1084/2140] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:39.075865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.086239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:39.086455 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1057/2141] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:39.087834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.109494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:39.166532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c27f2e-1902-4a8a-9d1a-cdd7191b158e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.175971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20456053-7726-405d-b9b4-03afab580e79 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.187584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.190655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.193930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.195165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.196016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.196393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.196552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] PATH_INFO: `/v3/projects/94d27913ebb646d7b8008a298fc50a10` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.197301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] PATH_INFO: `/v3/users/9fa5fdd35f3d489dbfb7c894ff95f66d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.198544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d27913ebb646d7b8008a298fc50a10)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.202483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.204223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa5fdd35f3d489dbfb7c894ff95f66d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.209876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:39.228575 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:39.328836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d27913ebb646d7b8008a298fc50a10', 'request_id': 'req-b79a7090-1d7f-4265-bbeb-b9590527f3b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.336491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa5fdd35f3d489dbfb7c894ff95f66d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.349350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d27913ebb646d7b8008a298fc50a10', 'request_id': 'req-b79a7090-1d7f-4265-bbeb-b9590527f3b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.356270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa5fdd35f3d489dbfb7c894ff95f66d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.378960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d27913ebb646d7b8008a298fc50a10', 'request_id': 'req-b79a7090-1d7f-4265-bbeb-b9590527f3b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.400316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa5fdd35f3d489dbfb7c894ff95f66d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.405228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa5fdd35f3d489dbfb7c894ff95f66d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.414790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] The token cache is being invalidate because project 94d27913ebb646d7b8008a298fc50a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:39.421051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.429019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.434839 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1085/2142] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:39 2022] DELETE /identity/v3/projects/94d27913ebb646d7b8008a298fc50a10 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:39.441094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:39.442705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42f88fab-8dec-487a-9fb6-16516ff9b7ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa5fdd35f3d489dbfb7c894ff95f66d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:39.444526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:39.470114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1058/2143] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:39 2022] DELETE /identity/v3/users/9fa5fdd35f3d489dbfb7c894ff95f66d => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:39.476764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.477946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.480655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.566032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:39.568894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:39.731035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a7090-1d7f-4265-bbeb-b9590527f3b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:39.790589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1059/2144] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:39.909589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:39.910537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:39.910816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:39.911094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] PATH_INFO: `/v3/users/7a0cc22a1a0a46fa8304a856a19d5dd3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:39.917999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0cc22a1a0a46fa8304a856a19d5dd3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:39.921317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:40.119973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0cc22a1a0a46fa8304a856a19d5dd3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.125470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0cc22a1a0a46fa8304a856a19d5dd3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.131980 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:40.142859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0cc22a1a0a46fa8304a856a19d5dd3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.144238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0cc22a1a0a46fa8304a856a19d5dd3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.165641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0cc22a1a0a46fa8304a856a19d5dd3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:40.205976 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1086/2145] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:39 2022] DELETE /identity/v3/users/7a0cc22a1a0a46fa8304a856a19d5dd3 => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:40.249965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:40.255490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:40.423469 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:40.526140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9791c-3ccf-4704-8059-e0fef21dffb6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:40.749223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:40.760413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:40.763279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:40.770639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:40.775740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:41.123972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:41.132948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:41.235385 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1060/2146] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 987 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:41.688338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:41.689706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:41.727547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b515-5dcb-4e54-8e51-0352ac302542 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:41.748120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:41.752183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:41.752902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:41.755667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] PATH_INFO: `/v3/projects/af366066ae55400fb4d26141e678091e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:41.762158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=af366066ae55400fb4d26141e678091e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:41.776925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:41.923413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af366066ae55400fb4d26141e678091e', 'request_id': 'req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:41.949219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af366066ae55400fb4d26141e678091e', 'request_id': 'req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:41.968138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af366066ae55400fb4d26141e678091e', 'request_id': 'req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.017553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] The token cache is being invalidate because project af366066ae55400fb4d26141e678091e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:42.019748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.022370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.033855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:42.034615 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1087/2147] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:41 2022] DELETE /identity/v3/projects/af366066ae55400fb4d26141e678091e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:42.060377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a39305-cd6e-479d-b392-9d2f48987e78 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:42.216056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:42.218122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:42.218595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:42.218963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] PATH_INFO: `/v3/users/3d7ec0edb22b4434ada05f73a4ee4527` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:42.221141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d7ec0edb22b4434ada05f73a4ee4527)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:42.223926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:42.333029 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:42.336249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d7ec0edb22b4434ada05f73a4ee4527'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.352765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d7ec0edb22b4434ada05f73a4ee4527'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.391535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d7ec0edb22b4434ada05f73a4ee4527'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.393063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d7ec0edb22b4434ada05f73a4ee4527'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.416181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a89067fe-d32b-4d09-8174-78f05fcfb863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d7ec0edb22b4434ada05f73a4ee4527'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:42.439790 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1061/2148] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:42 2022] DELETE /identity/v3/users/3d7ec0edb22b4434ada05f73a4ee4527 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:42.779495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:42.787536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:42.871631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f21bb43-6ebd-4f4b-b289-83044b8d0b2b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:43.093124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:43.094228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.100608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.101106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] PATH_INFO: `/v3/projects/7aad9d360a7f4d0cbe4b8eb8c8290b26` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.104011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aad9d360a7f4d0cbe4b8eb8c8290b26)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:43.106542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:43.231589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aad9d360a7f4d0cbe4b8eb8c8290b26', 'request_id': 'req-591b12db-ddaa-46a9-8631-6d700e2c5024'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:43.247173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aad9d360a7f4d0cbe4b8eb8c8290b26', 'request_id': 'req-591b12db-ddaa-46a9-8631-6d700e2c5024'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:43.250618 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:43.285862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aad9d360a7f4d0cbe4b8eb8c8290b26', 'request_id': 'req-591b12db-ddaa-46a9-8631-6d700e2c5024'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:43.322067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] The token cache is being invalidate because project 7aad9d360a7f4d0cbe4b8eb8c8290b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:43.322348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:43.326906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-591b12db-ddaa-46a9-8631-6d700e2c5024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:43.335933 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1088/2149] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:42 2022] DELETE /identity/v3/projects/7aad9d360a7f4d0cbe4b8eb8c8290b26 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:43.337998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.340061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.340712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.373015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:43.374749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:43.490352 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1062/2150] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:43.501634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.502586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.504797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.542480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:43.544903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:43.560337 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1089/2151] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:43.561655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:43.578270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20647e0-1e6c-4465-a0a0-4dd92c591b0f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:43.594868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:43.595800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.596187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.596541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.597280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:43.597597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:43.600742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:43.658400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1063/2152] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:43.660550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:43.672257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a4863-dd32-4277-850d-3422735a32e9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:43.677973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:43.678684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.679017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.679292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.680023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:43.682612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:43.740494 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1090/2153] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:43 2022] POST /identity/v3/projects => generated 383 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:43.746237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:43.768320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e68992c-97dc-4acc-b080-99816f06e419 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:43.882172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:43.882879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.883183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.883437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.884170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:43.886295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:43.914743 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1064/2154] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:43 2022] POST /identity/v3/users => generated 292 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:43.921219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:43.940325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c635-ee7b-4b8e-96b2-76f010910029 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:43.952449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:43.953643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:43.955830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:43.956468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:43.958980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:43.961390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:43.981237 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1091/2155] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:43.986502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:43.999736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b97332-0e87-4624-a095-65bdfb540d14 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:44.018782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbde774-3f55-4925-a469-f5212bdfe4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:44.019507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde774-3f55-4925-a469-f5212bdfe4db admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:44.019795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde774-3f55-4925-a469-f5212bdfe4db admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:44.020237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbde774-3f55-4925-a469-f5212bdfe4db admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:44.021815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbde774-3f55-4925-a469-f5212bdfe4db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:44.023890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbde774-3f55-4925-a469-f5212bdfe4db admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:44.057888 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1065/2156] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:09:44.060064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:44.077291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c36f3d-a06b-4ae7-9fc1-53aa390ec593 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:44.098444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:44.099935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:44.100590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:44.101283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] PATH_INFO: `/v3/projects/d7cf7cb57f9d4669ada30867918f1f76/users/fbd8bc5ca7e5414385892e0e4e519316/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:44.168013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7cf7cb57f9d4669ada30867918f1f76, user_id=fbd8bc5ca7e5414385892e0e4e519316, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:44.172609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:44.200559 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1092/2157] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:44 2022] PUT /identity/v3/projects/d7cf7cb57f9d4669ada30867918f1f76/users/fbd8bc5ca7e5414385892e0e4e519316/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:44.231334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:44.231835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:44.232315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:44.243430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:44.247049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:44.415139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] MFA Rules not processed for user `fbd8bc5ca7e5414385892e0e4e519316`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:44.426693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:44.506571 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:44.570200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc5592-9d65-4bcc-808b-98cee571a66b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:44.586815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:44.588481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:44.589005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:44.589493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] PATH_INFO: `/v3/projects/b47e6c73c97c48159ac489d5f93a0b02` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:44.594542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b47e6c73c97c48159ac489d5f93a0b02)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:44.598535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:44.747378 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1066/2158] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 522 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:44.754546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:44.789930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6337f3-e9d0-4e2f-8a1b-ebac1aa0a1b4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:44.828116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b47e6c73c97c48159ac489d5f93a0b02', 'request_id': 'req-cac678eb-7d11-471f-a106-00a9b0e4c498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:44.853102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b47e6c73c97c48159ac489d5f93a0b02', 'request_id': 'req-cac678eb-7d11-471f-a106-00a9b0e4c498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:44.875542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b47e6c73c97c48159ac489d5f93a0b02', 'request_id': 'req-cac678eb-7d11-471f-a106-00a9b0e4c498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:44.915433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] The token cache is being invalidate because project b47e6c73c97c48159ac489d5f93a0b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:44.915902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:44.917672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:44.922052 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1093/2159] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:44 2022] DELETE /identity/v3/projects/b47e6c73c97c48159ac489d5f93a0b02 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:44.929042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:44.931016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:44.961196 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:44.979234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:44.980389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:44.980856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:44.981303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:44.982208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:44.996664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:45.052710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1067/2160] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:44 2022] POST /identity/v3/projects => generated 383 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:45.054007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:45.056140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:45.203927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb5231-fd1a-405b-a8ba-45057008d1b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.219521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.220670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.221131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.221607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:45.222521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:45.224669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac678eb-7d11-471f-a106-00a9b0e4c498 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.225022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:45.241816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.243387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.250324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.250987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] PATH_INFO: `/v3/users/fdc23e15360f403889e23c2b72144e7c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:45.255163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdc23e15360f403889e23c2b72144e7c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:45.261725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:45.274565 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1068/2161] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:45 2022] POST /identity/v3/users => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:45.276037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:45.298734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48388894-085e-4e64-ac49-f24ad0fc95dd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.313952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.314973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.315438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.315915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:45.316886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:45.318754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:45.349240 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1069/2162] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:45.350564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:45.371151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe4ee19-84b8-4c90-9c6f-70c7c445727d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.389371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.390636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.391113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.391563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] PATH_INFO: `/v3/projects/5271f6fcc5274e9f8913fc4982fb564a/users/e74542a312b142809f0cb1d6d89acaf1/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:45.430382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271f6fcc5274e9f8913fc4982fb564a, user_id=e74542a312b142809f0cb1d6d89acaf1, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:45.433504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:45.460145 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:45.465735 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1070/2163] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:45 2022] PUT /identity/v3/projects/5271f6fcc5274e9f8913fc4982fb564a/users/e74542a312b142809f0cb1d6d89acaf1/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:45.466998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:45.570505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdc23e15360f403889e23c2b72144e7c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:45.572297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdc23e15360f403889e23c2b72144e7c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:45.597601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdc23e15360f403889e23c2b72144e7c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:45.597601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdc23e15360f403889e23c2b72144e7c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:45.614045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdc23e15360f403889e23c2b72144e7c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:45.657080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e229e99-daef-4a52-a759-781e1b10feb4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.660740 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1094/2164] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:44 2022] DELETE /identity/v3/users/fdc23e15360f403889e23c2b72144e7c => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:45.848272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.858323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.858606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.858883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:45.859839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:45.865858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:45.895073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:45.897698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:45.917055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1071/2165] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:09:45.922890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:45.927749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:45.952075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8046e39b-cf7c-4352-8ee7-dbf280a7c0b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.974815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.979602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b9a6b-1115-4ff3-a103-f724b497e66a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:45.981365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.982571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.984250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] PATH_INFO: `/v3/projects/83419f33442b45329fcda43e8d8406a0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:45.990387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] RBAC: Authorizing `identity:delete_project(project_id=83419f33442b45329fcda43e8d8406a0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:45.994016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818477c9-cf26-484f-883e-40d37a76d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:45.996011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818477c9-cf26-484f-883e-40d37a76d1ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:45.998352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818477c9-cf26-484f-883e-40d37a76d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:45.998919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818477c9-cf26-484f-883e-40d37a76d1ba admin admin] PATH_INFO: `/v3/projects/5271f6fcc5274e9f8913fc4982fb564a/users/e74542a312b142809f0cb1d6d89acaf1/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:46.000764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:46.003432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818477c9-cf26-484f-883e-40d37a76d1ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=5271f6fcc5274e9f8913fc4982fb564a, user_id=e74542a312b142809f0cb1d6d89acaf1, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:46.012249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818477c9-cf26-484f-883e-40d37a76d1ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:46.039752 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1072/2166] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:45 2022] PUT /identity/v3/projects/5271f6fcc5274e9f8913fc4982fb564a/users/e74542a312b142809f0cb1d6d89acaf1/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:46.052206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31345-4e37-4971-81d4-6e3be17a3d99 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:46.052656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31345-4e37-4971-81d4-6e3be17a3d99 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:46.052829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa31345-4e37-4971-81d4-6e3be17a3d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:46.093645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2aa31345-4e37-4971-81d4-6e3be17a3d99 None None] MFA Rules not processed for user `e74542a312b142809f0cb1d6d89acaf1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:46.095012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2aa31345-4e37-4971-81d4-6e3be17a3d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:46.196046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83419f33442b45329fcda43e8d8406a0', 'request_id': 'req-899ba6cc-74e9-4443-b435-3278b734134f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.225733 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1073/2167] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:46.246839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83419f33442b45329fcda43e8d8406a0', 'request_id': 'req-899ba6cc-74e9-4443-b435-3278b734134f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.261288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83419f33442b45329fcda43e8d8406a0', 'request_id': 'req-899ba6cc-74e9-4443-b435-3278b734134f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.289142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] The token cache is being invalidate because project 83419f33442b45329fcda43e8d8406a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:46.289447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.295963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899ba6cc-74e9-4443-b435-3278b734134f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.304701 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1095/2168] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:45 2022] DELETE /identity/v3/projects/83419f33442b45329fcda43e8d8406a0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:46.306767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:46.307156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:46.307325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:46.346051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:46.347445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:46.373910 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:46.535499 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1074/2169] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:46.536797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:46.537097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:46.537381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:46.559045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:46.566040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:46.585867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:46.587201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:46.638791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1096/2170] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:46.642793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62ef563-2bfd-4096-b1d9-c602623e0f16 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:46.645494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:46.666578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:46.668309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:46.668901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:46.669418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] PATH_INFO: `/v3/projects/7f6ed214091a4a93b8b6b56fba308570` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:46.673512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f6ed214091a4a93b8b6b56fba308570)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:46.675700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:46.677934 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:46.688276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1882ede8-ea5d-483d-ab8e-083ec5e4537a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:46.713858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:46.714826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:46.715115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:46.715395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:46.716175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:46.716523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:46.721593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:46.758655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1097/2171] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:46.760283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:46.766130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:46.910301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f6ed214091a4a93b8b6b56fba308570', 'request_id': 'req-78a81272-76ce-45b9-a62d-f9148776ae76'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.937360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f6ed214091a4a93b8b6b56fba308570', 'request_id': 'req-78a81272-76ce-45b9-a62d-f9148776ae76'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:46.972731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f6ed214091a4a93b8b6b56fba308570', 'request_id': 'req-78a81272-76ce-45b9-a62d-f9148776ae76'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.040206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b263e-45c5-4228-b0df-19965a76f387 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:47.041194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] The token cache is being invalidate because project 7f6ed214091a4a93b8b6b56fba308570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:47.041733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.042870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.054564 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1075/2172] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:46 2022] DELETE /identity/v3/projects/7f6ed214091a4a93b8b6b56fba308570 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:47.055593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:47.062912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:47.199342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:47.200032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.200456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.200743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.202920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:47.329626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a81272-76ce-45b9-a62d-f9148776ae76 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:47.344532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:47.345712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.346183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.346651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.347575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:47.350178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:47.385762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:47.387756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075b6d7-10e6-4157-8e7b-3887ccf1d9d7 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:47.413126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1098/2173] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:47.414533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1076/2174] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:47 2022] POST /identity/v3/projects => generated 385 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:47.416526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.416526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.416526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.420043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:47.439582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:47.442101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:47.469894 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:47.488983 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:47.534511 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1099/2175] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:47.536655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:47.540718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:47.594194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e4533d-93e6-4398-9b32-7123f16788cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:47.607973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:47.609710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.610214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.610695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] PATH_INFO: `/v3/users/fbd8bc5ca7e5414385892e0e4e519316` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.611120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abcdb57-c37a-48a6-acba-283f5ae6f33f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:47.614339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd8bc5ca7e5414385892e0e4e519316)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:47.620243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:47.628386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecec3fc-074c-42dc-9a32-2ba663a977f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:47.629292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec3fc-074c-42dc-9a32-2ba663a977f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.629765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec3fc-074c-42dc-9a32-2ba663a977f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.630044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecec3fc-074c-42dc-9a32-2ba663a977f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.630790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec3fc-074c-42dc-9a32-2ba663a977f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:47.632872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecec3fc-074c-42dc-9a32-2ba663a977f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:47.699727 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1077/2176] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:47 2022] POST /identity/v3/users => generated 293 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:47.706183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.708502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.710958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.770202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd8bc5ca7e5414385892e0e4e519316'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.774277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd8bc5ca7e5414385892e0e4e519316'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.798473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd8bc5ca7e5414385892e0e4e519316'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.799846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd8bc5ca7e5414385892e0e4e519316'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.800370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:47.806553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:47.829035 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1078/2177] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:47.830659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:47.833827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:47.839505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd8bc5ca7e5414385892e0e4e519316'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:47.850418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672542d9-ad42-4d3e-adae-2a6b78092587 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:47.856275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:47.857445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.857950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.858439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.859449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:47.862119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:47.881186 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1079/2178] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:47.882685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:47.895711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee12553-d6cf-4581-9fdd-29ff6c30f761 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:47.905765 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1100/2179] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:47 2022] DELETE /identity/v3/users/fbd8bc5ca7e5414385892e0e4e519316 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:47.911279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:47.913958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:47.914809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.916493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.916906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:47.918005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:47.919381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:47.926086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b965e6-0772-4ba1-9c1e-a649fa4e870d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:47.976408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1080/2180] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:47.976657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:47.977870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:47.979564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.038510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:48.049725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:48.098044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fb9802-48e6-4eb9-b448-b93a90548234 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.103687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:48.104588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.104973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.105344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.106203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:48.108175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:48.127773 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1101/2181] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:48.128868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:48.154889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f9c78-246b-46ec-9783-11e2aa4a6fd6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.166736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:48.167588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.167974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.168377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.169232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:48.171340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:48.237653 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1102/2182] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:48 2022] POST /identity/v3/projects => generated 395 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:48.245575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:48.251042 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1081/2183] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:48.251340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:48.279354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad46200-7de4-475e-80b9-3fb120714e18 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.287517 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:48.407529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c7cd17-2ef8-4c04-8713-1dcfb75e34fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.422830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:48.426935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.427393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.428291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] PATH_INFO: `/v3/projects/5009cb74fd244072bd58e1b4a33fa9b3/users/f92bc2ec5f54417485cf54cc93e664c9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.467187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e741561-7b0c-4f48-aed1-40b8261c0672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:48.468247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741561-7b0c-4f48-aed1-40b8261c0672 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.468711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741561-7b0c-4f48-aed1-40b8261c0672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.469139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e741561-7b0c-4f48-aed1-40b8261c0672 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.470311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741561-7b0c-4f48-aed1-40b8261c0672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:48.470525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5009cb74fd244072bd58e1b4a33fa9b3, user_id=f92bc2ec5f54417485cf54cc93e664c9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:48.473987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e741561-7b0c-4f48-aed1-40b8261c0672 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:48.476269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:48.501076 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1103/2184] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:48 2022] PUT /identity/v3/projects/5009cb74fd244072bd58e1b4a33fa9b3/users/f92bc2ec5f54417485cf54cc93e664c9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:48.512081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:48.518323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:48.528145 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1082/2185] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:48 2022] POST /identity/v3/users => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:48.529889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.530180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.530500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.560951 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:48.574025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] MFA Rules not processed for user `f92bc2ec5f54417485cf54cc93e664c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:48.576444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:48.706918 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1083/2186] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:48.707977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:48.781911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb4079-07b5-41c2-8fef-a4a744f02da4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.796758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:48.798599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.799296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.799909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.875062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae50fe-90dd-4b01-a62b-87e59074cede None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.904466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:48.907583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:48.907810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:48.908089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:48.912665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:48.917878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:48.955143 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1084/2187] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:48.955143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:48.970534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:48.972334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:48.981781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2976f76-6187-436f-8d28-d2bd03a81158 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:48.997657 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1104/2188] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:48.998003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:49.000760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.002819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.003668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.004454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.004585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:49.013655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:49.038905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e9d92-0e84-4c87-9258-e1bdbe771d51 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:49.057444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:49.058885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.059378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.059822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.062849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:49.064879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:49.111530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1105/2189] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:49.122861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.123086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1085/2190] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:49.124559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.158372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07351d9-0353-4f2c-ac92-20592c335219 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:49.285779 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:49.336831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd84c02-14d7-49ce-8449-d3a52126b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:49.338774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd84c02-14d7-49ce-8449-d3a52126b07b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.339293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd84c02-14d7-49ce-8449-d3a52126b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.339822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd84c02-14d7-49ce-8449-d3a52126b07b admin admin] PATH_INFO: `/v3/projects/d7c4a6ba59624ebb8a6cc42dd71fcd15/users/d0c0d7c9eb4a46acaae026905041d08b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.353663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c5dc63-ab23-45af-a2ef-fabb28092e50 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:49.359609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:49.360316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.361998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.361998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.362521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:49.365756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:49.398000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd84c02-14d7-49ce-8449-d3a52126b07b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c4a6ba59624ebb8a6cc42dd71fcd15, user_id=d0c0d7c9eb4a46acaae026905041d08b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:49.399508 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1086/2191] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:49 2022] POST /identity/v3/users => generated 299 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:49.401920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd84c02-14d7-49ce-8449-d3a52126b07b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:49.404048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.411328 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:49.419293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbae7834-c980-4246-a3af-71838b0254f0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:49.427001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:49.428792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.429248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.429673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.430608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:49.433595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:49.435276 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1106/2192] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:49 2022] PUT /identity/v3/projects/d7c4a6ba59624ebb8a6cc42dd71fcd15/users/d0c0d7c9eb4a46acaae026905041d08b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:49.453209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.453638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.453860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.455804 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1087/2193] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:49.457189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.498327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] MFA Rules not processed for user `d0c0d7c9eb4a46acaae026905041d08b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:49.500733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:49.502934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648a24-555d-4f1e-b632-39dae48f9c32 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:49.703887 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1107/2194] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:49.708598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.767350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:49.768988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:49.769443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:49.769862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] PATH_INFO: `/v3/projects/32f18b5b677d48ef8d0af955c89b1ddd/users/fa41479ef6214a479f6ccb06d09106fd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:49.805604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f18b5b677d48ef8d0af955c89b1ddd, user_id=fa41479ef6214a479f6ccb06d09106fd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:49.809544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:49.843127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1088/2195] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:49 2022] PUT /identity/v3/projects/32f18b5b677d48ef8d0af955c89b1ddd/users/fa41479ef6214a479f6ccb06d09106fd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:49.847808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:49.878008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9de803-325f-434f-a0a6-bfdbf03ecf36 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:50.030141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58377672-2f94-4e24-9ece-12789bfdddff admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:50.037666 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:50.056849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:50.056849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.056849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.056849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.061904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:50.070055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:50.070674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:50.071567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.071853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.072205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.072965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:50.074985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:50.104858 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1089/2196] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:50.111890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:50.150461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0daee54-077c-4a56-ba7a-881d3f4daf43 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:50.159821 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1108/2197] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:49 2022] POST /identity/v3/projects => generated 395 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:50.160862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:50.173532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e165a97-59ab-45aa-8879-8995679518ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:50.175295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165a97-59ab-45aa-8879-8995679518ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.175746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165a97-59ab-45aa-8879-8995679518ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.176196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e165a97-59ab-45aa-8879-8995679518ad admin admin] PATH_INFO: `/v3/projects/32f18b5b677d48ef8d0af955c89b1ddd/users/fa41479ef6214a479f6ccb06d09106fd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.179999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e165a97-59ab-45aa-8879-8995679518ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=32f18b5b677d48ef8d0af955c89b1ddd, user_id=fa41479ef6214a479f6ccb06d09106fd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:50.188015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e165a97-59ab-45aa-8879-8995679518ad admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:50.242438 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1090/2198] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:50 2022] PUT /identity/v3/projects/32f18b5b677d48ef8d0af955c89b1ddd/users/fa41479ef6214a479f6ccb06d09106fd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:50.251280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.254530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.255652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.345553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b029c0-5ba7-4518-ad68-bdbdaf0eafa6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:50.368089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] MFA Rules not processed for user `fa41479ef6214a479f6ccb06d09106fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:50.375567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:50.529893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:50.530305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.530582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.530851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.531574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:50.533630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:50.567091 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:50.606286 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1109/2199] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:50 2022] POST /identity/v3/users => generated 304 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:50.607281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:50.615791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:50.640512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18321cf6-9ffd-45d5-9c6f-8ada83a09099 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:50.644067 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1091/2200] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:50 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:09:50.646339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:50.653825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:50.654787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.655070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.655346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] PATH_INFO: `/v3/projects/d7cf7cb57f9d4669ada30867918f1f76` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.657936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7cf7cb57f9d4669ada30867918f1f76)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:50.662541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:50.673213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fcc52-38b6-4a20-bb49-4fb3671f5811 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:50.682696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:50.684845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:50.685499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:50.686329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:50.688104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:50.691017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:50.713695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1092/2201] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:50.716512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:50.719601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:50.778678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7cf7cb57f9d4669ada30867918f1f76', 'request_id': 'req-4749e93a-a06c-4323-b4e1-f55598d66e30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:50.801196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7cf7cb57f9d4669ada30867918f1f76', 'request_id': 'req-4749e93a-a06c-4323-b4e1-f55598d66e30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:50.815325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7cf7cb57f9d4669ada30867918f1f76', 'request_id': 'req-4749e93a-a06c-4323-b4e1-f55598d66e30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:50.840737 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:50.866254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] The token cache is being invalidate because project d7cf7cb57f9d4669ada30867918f1f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:50.870574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:50.874453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:50.885752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1110/2202] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:50 2022] DELETE /identity/v3/projects/d7cf7cb57f9d4669ada30867918f1f76 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:50.896066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:50.906605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:50.918489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787e5fa3-6f86-43ce-bfe7-0affa9ec0780 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:51.038669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4749e93a-a06c-4323-b4e1-f55598d66e30 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:51.055909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:51.057575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:51.057575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:51.057873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] PATH_INFO: `/v3/projects/ec92abef811f4c1c90b364187f2ef5dd/users/5da91d7274184727a0d153e2bc26d709/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:51.090241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec92abef811f4c1c90b364187f2ef5dd, user_id=5da91d7274184727a0d153e2bc26d709, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:51.094033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:51.126599 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1111/2203] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:50 2022] PUT /identity/v3/projects/ec92abef811f4c1c90b364187f2ef5dd/users/5da91d7274184727a0d153e2bc26d709/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:51.127967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:51.129877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:51.208697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:51.212717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:51.218444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:51.219653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:51.229075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:51.271339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977723ac-b8db-4106-801e-9687956ca91b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:51.278747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:51.279845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:51.279845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:51.279845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] PATH_INFO: `/v3/users/e74542a312b142809f0cb1d6d89acaf1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:51.282094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74542a312b142809f0cb1d6d89acaf1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:51.286056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:51.410820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74542a312b142809f0cb1d6d89acaf1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:51.413345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74542a312b142809f0cb1d6d89acaf1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:51.435462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74542a312b142809f0cb1d6d89acaf1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:51.436842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74542a312b142809f0cb1d6d89acaf1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:51.506659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:51.511128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:51.537883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de1ae16c-590d-43b4-86ac-41b355046c36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74542a312b142809f0cb1d6d89acaf1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:51.543348 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1093/2204] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 828 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:51.544335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:51.553203 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:51.564554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d87572b-a7ce-4c2d-bbbf-39103f8fa99c service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:51.570675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:51.571436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:51.571895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:51.572291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:51.573380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:51.575107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:51.611694 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1094/2205] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:51 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:51.612746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:51.621425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:51.640577 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1112/2206] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:51 2022] DELETE /identity/v3/users/e74542a312b142809f0cb1d6d89acaf1 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:51.671478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bec7de-5cd5-41e3-a13e-264d5d965873 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:51.821923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdd303b-74ab-47cb-9c41-531193e33e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:51.823467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd303b-74ab-47cb-9c41-531193e33e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:51.824032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd303b-74ab-47cb-9c41-531193e33e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:51.824504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdd303b-74ab-47cb-9c41-531193e33e89 admin admin] PATH_INFO: `/v3/projects/ec92abef811f4c1c90b364187f2ef5dd/users/5da91d7274184727a0d153e2bc26d709/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:51.839162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd303b-74ab-47cb-9c41-531193e33e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec92abef811f4c1c90b364187f2ef5dd, user_id=5da91d7274184727a0d153e2bc26d709, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:51.842207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdd303b-74ab-47cb-9c41-531193e33e89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:51.875380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1095/2207] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:51 2022] PUT /identity/v3/projects/ec92abef811f4c1c90b364187f2ef5dd/users/5da91d7274184727a0d153e2bc26d709/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:51.877291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:51.877679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:51.878548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:51.885949 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:51.932064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] MFA Rules not processed for user `5da91d7274184727a0d153e2bc26d709`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:51.939401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:52.182456 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1113/2208] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:52.186547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:52.187381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:52.187535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:52.219384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] MFA Rules not processed for user `d0c0d7c9eb4a46acaae026905041d08b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:52.221644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:52.369603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1096/2209] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:52.756158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:52.762536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:53.026811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72e7ad-463b-45a7-8772-7bace8b6ac80 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:53.040780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:53.048382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:53.048843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:53.049110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:53.059958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:53.078069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:53.080482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50c2984-939a-48d6-9deb-3f63f1a99ab6 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:53.106158 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1114/2210] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:53.859891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:53.862177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:54.179646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5b94ab-e90d-47cd-b853-f4c2ff97fbae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:54.190689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:54.192853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:54.193407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:54.193832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] PATH_INFO: `/v3/projects/5271f6fcc5274e9f8913fc4982fb564a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:54.195926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5271f6fcc5274e9f8913fc4982fb564a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:54.199233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:54.311051 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:54.340818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5271f6fcc5274e9f8913fc4982fb564a', 'request_id': 'req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.364008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5271f6fcc5274e9f8913fc4982fb564a', 'request_id': 'req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.388570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5271f6fcc5274e9f8913fc4982fb564a', 'request_id': 'req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.413056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] The token cache is being invalidate because project 5271f6fcc5274e9f8913fc4982fb564a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:54.413451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.414263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f3ad7ee-ec04-49a8-bcec-09923c89a1d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:54.440485 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1097/2211] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:53 2022] DELETE /identity/v3/projects/5271f6fcc5274e9f8913fc4982fb564a => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:54.451402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:54.452964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:54.453580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:54.491588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:54.495059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:54.661613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:54.661922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:54.662108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:54.664410 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1115/2212] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:54.689014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:54.704864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:54.731919 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1098/2213] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:54.735889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:54.764414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55c5d3c-2050-4634-b4e5-c5bf2476fcd3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:54.787774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:54.789824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:54.790581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:54.790871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:54.791725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:09:54.800786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:54.817815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:54.837343 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:54.848286 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1116/2214] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:09:54.855164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:54.893400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a4bf62-488a-4ed8-bbf5-de1619574bb9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:54.936984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:54.937790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:54.941537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:54.942271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:54.943189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:54.945393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.051526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.061632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1099/2215] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:54 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:55.076517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ed05f-5bdf-4d58-8d2a-7071f73d74a6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.137231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.139563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:55.342671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.343397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.343682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.343960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.344724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.350944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.369714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dadba93-66e6-48e0-8d50-b46919b01005 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.380711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.381653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.381936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.382208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] PATH_INFO: `/v3/users/f92bc2ec5f54417485cf54cc93e664c9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.393008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f92bc2ec5f54417485cf54cc93e664c9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.395094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.398942 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1117/2216] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:55 2022] POST /identity/v3/users => generated 292 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:09:55.400558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.425982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd52f2a4-c084-4c4c-b328-85da6980c462 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.447576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.449944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.450272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.450491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.451270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.453023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.505621 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1118/2217] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:55.506592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.546950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1c364-8179-4a8a-a5d7-505da68d3893 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.550660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f92bc2ec5f54417485cf54cc93e664c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:55.559496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.560507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.560971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.561397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.562303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.564157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.569122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f92bc2ec5f54417485cf54cc93e664c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:55.596148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1119/2218] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:55.602569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:55.607314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f92bc2ec5f54417485cf54cc93e664c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:55.609319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f92bc2ec5f54417485cf54cc93e664c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:55.626849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1bf0d-6094-4bd2-b9b4-2ebb99d27cc1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:55.627837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8be048b8-4e7e-4108-9f4c-2aecd6187d86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f92bc2ec5f54417485cf54cc93e664c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:55.644414 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1100/2219] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:55 2022] DELETE /identity/v3/users/f92bc2ec5f54417485cf54cc93e664c9 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:55.647611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a3fb6-119d-49bb-8fc2-8f37c4a79c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:55.648991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3fb6-119d-49bb-8fc2-8f37c4a79c30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.658299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.658614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.658871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.661230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3fb6-119d-49bb-8fc2-8f37c4a79c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.661512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a3fb6-119d-49bb-8fc2-8f37c4a79c30 admin admin] PATH_INFO: `/v3/projects/cd5f44256f2746dea837d4af9a08f11d/users/bc491613d1cf4f618087c552919377b9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.718892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3fb6-119d-49bb-8fc2-8f37c4a79c30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5f44256f2746dea837d4af9a08f11d, user_id=bc491613d1cf4f618087c552919377b9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:55.726880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a3fb6-119d-49bb-8fc2-8f37c4a79c30 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:55.732215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:55.733537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:55.775506 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:55.779256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1120/2220] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:55 2022] PUT /identity/v3/projects/cd5f44256f2746dea837d4af9a08f11d/users/bc491613d1cf4f618087c552919377b9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:55.800462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:55.800760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:55.801075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:55.873488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] MFA Rules not processed for user `bc491613d1cf4f618087c552919377b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:55.875408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:56.048267 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1101/2221] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:56.092794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1121/2222] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:56.097977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:56.100689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:56.127702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec2eabe-4a37-496f-a30b-a194e5c80a1f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:56.340820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:56.344400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.344730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.345744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.346794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:56.351115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:56.362510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:56.365331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:56.423871 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1102/2223] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:09:56 2022] POST /identity/v3/projects => generated 381 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:56.425335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:56.434872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568028a-5017-4f68-b50f-967df723f8f3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:56.622133 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:56.636704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d452cc-8a7b-4496-88fe-44749aa6ceaa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:56.669281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:56.671998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.672593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.673622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.684689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:56.697786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:56.738794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:56.740675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:56.741498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:56.742635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] PATH_INFO: `/v3/users/a5098d2a57b64502be98d9eea5a91cca` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:56.745371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5098d2a57b64502be98d9eea5a91cca)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:56.749884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:56.766028 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1103/2224] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:09:56 2022] POST /identity/v3/users => generated 297 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:09:56.767885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:56.775069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:56.851960 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:56.931901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5098d2a57b64502be98d9eea5a91cca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.933421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5098d2a57b64502be98d9eea5a91cca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.951735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5098d2a57b64502be98d9eea5a91cca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.954738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5098d2a57b64502be98d9eea5a91cca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:56.984180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7335c7c1-3905-4572-ba6c-800f2165254c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:56.990621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5098d2a57b64502be98d9eea5a91cca'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:57.001624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.003801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.004479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.007906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.013640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.070286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.071335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1122/2225] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:56 2022] DELETE /identity/v3/users/a5098d2a57b64502be98d9eea5a91cca => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:57.075019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aca3b9-d355-474e-8ce8-7fce06494fdc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.075510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.077449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.112379 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1104/2226] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:57.117328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.122039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.122720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.192676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041608d-df2f-4a98-aec9-eefa3376338f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.197978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.198209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:57.199298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.199729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.200150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.201014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.201254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.203251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.216686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1123/2227] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:57.224543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.233991 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1105/2228] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:57.256192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f122a097-f56b-4da4-a820-ea7e82326927 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.262356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.268505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.272495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913173d3-a450-4cde-8143-c5aeefef9d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.274283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913173d3-a450-4cde-8143-c5aeefef9d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.278452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913173d3-a450-4cde-8143-c5aeefef9d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.279050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913173d3-a450-4cde-8143-c5aeefef9d28 admin admin] PATH_INFO: `/v3/projects/2280f85132a94a4b8dbe4747888fcc41/users/67adb1f0f94b4d319920a6ef5411ffa0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.341756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913173d3-a450-4cde-8143-c5aeefef9d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2280f85132a94a4b8dbe4747888fcc41, user_id=67adb1f0f94b4d319920a6ef5411ffa0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.354355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913173d3-a450-4cde-8143-c5aeefef9d28 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.407773 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1124/2229] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:57 2022] PUT /identity/v3/projects/2280f85132a94a4b8dbe4747888fcc41/users/67adb1f0f94b4d319920a6ef5411ffa0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:57.410637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db0ae-8a7a-4313-8d38-aaf8aac95302 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.411153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db0ae-8a7a-4313-8d38-aaf8aac95302 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.411647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259db0ae-8a7a-4313-8d38-aaf8aac95302 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.430162 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1125/2230] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:09:57 2022] GET /identity => generated 270 bytes in 21 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:09:57.431815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db0ae-8a7a-4313-8d38-aaf8aac95302 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.440734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-259db0ae-8a7a-4313-8d38-aaf8aac95302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:57.496519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02a1dc-0ff5-4ae8-bfae-f3cfca5d39c4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.551387 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:57.696679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259db0ae-8a7a-4313-8d38-aaf8aac95302 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.702000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.703047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.703611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.704214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.715163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.717532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.719655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.720414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] PATH_INFO: `/v3/users/d6e042fb81da4e03bdb3a2d8caecea29` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.734226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e042fb81da4e03bdb3a2d8caecea29)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.740127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.746557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.749735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.791548 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1106/2231] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:57.793244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:57.835778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7c2c5c-2b35-417b-bd08-a4fe5dcd9500 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:57.855694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5e8d05-a1e0-4bbe-908b-f0577f839764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:57.856820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8d05-a1e0-4bbe-908b-f0577f839764 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.857368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8d05-a1e0-4bbe-908b-f0577f839764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.857900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5e8d05-a1e0-4bbe-908b-f0577f839764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.859375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e8d05-a1e0-4bbe-908b-f0577f839764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:57.867246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e042fb81da4e03bdb3a2d8caecea29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:57.868921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5e8d05-a1e0-4bbe-908b-f0577f839764 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:57.870357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e042fb81da4e03bdb3a2d8caecea29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:57.889290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e042fb81da4e03bdb3a2d8caecea29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:57.891031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e042fb81da4e03bdb3a2d8caecea29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:57.912526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e042fb81da4e03bdb3a2d8caecea29'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:57.913312 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1107/2232] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:09:57.919195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:57.920028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:57.927922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:57.990322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:57.992039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:58.035201 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1126/2233] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:57 2022] DELETE /identity/v3/users/d6e042fb81da4e03bdb3a2d8caecea29 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:58.043662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:58.053295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:58.217232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1108/2234] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:09:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:58.221710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a2d4da-961e-4e39-b8fd-7bc99ad4a2c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:58.234925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba279c28-c909-44aa-a90a-5f5aefcdcd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:58.238507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba279c28-c909-44aa-a90a-5f5aefcdcd94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:58.239467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba279c28-c909-44aa-a90a-5f5aefcdcd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:58.239670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba279c28-c909-44aa-a90a-5f5aefcdcd94 admin admin] PATH_INFO: `/v3/projects/2280f85132a94a4b8dbe4747888fcc41/users/67adb1f0f94b4d319920a6ef5411ffa0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:58.243724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba279c28-c909-44aa-a90a-5f5aefcdcd94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2280f85132a94a4b8dbe4747888fcc41, user_id=67adb1f0f94b4d319920a6ef5411ffa0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:58.248670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba279c28-c909-44aa-a90a-5f5aefcdcd94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:58.265439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:58.266940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:58.269396 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1127/2235] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:09:58 2022] PUT /identity/v3/projects/2280f85132a94a4b8dbe4747888fcc41/users/67adb1f0f94b4d319920a6ef5411ffa0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:58.283504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:58.285918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:58.286478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:58.293364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb07dac-2b70-4ad4-bbe2-b04804ab8fa6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:58.304236 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:58.357518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] MFA Rules not processed for user `67adb1f0f94b4d319920a6ef5411ffa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:58.360436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:58.444866 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:58.507593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:58.508945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:58.509260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:58.509569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:58.521063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:58.523024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:58.560088 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1109/2236] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:58.567540 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1128/2237] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:58.577186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:58.578894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:58.742542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8b9e22-96ff-4856-9c3f-d7e77001a463 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:58.751719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:58.752588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:58.752948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:58.753297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:58.765848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:58.772112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:58.805118 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1110/2238] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:09:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:09:58.949543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:58.950701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:58.952882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:59.081985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814a4fcd-a9e8-4958-b5b5-74ebc37c262b service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:59.098060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b468b0-bccc-4ad4-9a94-42c7d30afee5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:59.105200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:59.106327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.106776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.107064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] PATH_INFO: `/v3/users/bc491613d1cf4f618087c552919377b9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.108872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc491613d1cf4f618087c552919377b9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:59.109025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:59.109948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.110231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.110577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] PATH_INFO: `/v3/projects/50fafdf084754fb682a8bf5407f37c84` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.111874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:59.112930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fafdf084754fb682a8bf5407f37c84)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:59.115315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:59.149498 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:59.209299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc491613d1cf4f618087c552919377b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.221629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fafdf084754fb682a8bf5407f37c84', 'request_id': 'req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.230620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc491613d1cf4f618087c552919377b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.232720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fafdf084754fb682a8bf5407f37c84', 'request_id': 'req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.244339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fafdf084754fb682a8bf5407f37c84', 'request_id': 'req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.259965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc491613d1cf4f618087c552919377b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.261057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc491613d1cf4f618087c552919377b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.269378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] The token cache is being invalidate because project 50fafdf084754fb682a8bf5407f37c84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:59.269926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.270902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6ea2f93-9d16-4c7f-b0ff-0409056c1922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.274624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1129/2239] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:58 2022] DELETE /identity/v3/projects/50fafdf084754fb682a8bf5407f37c84 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:09:59.276034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54fa7-f2db-4ce0-89f2-0fcd6f91765e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.276564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54fa7-f2db-4ce0-89f2-0fcd6f91765e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.276983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de54fa7-f2db-4ce0-89f2-0fcd6f91765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.277773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc491613d1cf4f618087c552919377b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.300726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1111/2240] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:58 2022] DELETE /identity/v3/users/bc491613d1cf4f618087c552919377b9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:59.300726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:59.304553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:59.338752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9de54fa7-f2db-4ce0-89f2-0fcd6f91765e None None] MFA Rules not processed for user `b20b9d3a9539420fa8cfe87da29ca1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:59.358390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9de54fa7-f2db-4ce0-89f2-0fcd6f91765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:59.397877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f0461-7c20-440a-af17-ed4be6092516 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:59.411997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:59.414367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.414824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.415328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] PATH_INFO: `/v3/users/157d394363444db8a72d3119f9d01226` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.418981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=157d394363444db8a72d3119f9d01226)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:59.421813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:59.447648 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:59.496106 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1130/2241] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:59.499192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.499926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.501939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.544419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '157d394363444db8a72d3119f9d01226'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.556880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '157d394363444db8a72d3119f9d01226'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.575357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '157d394363444db8a72d3119f9d01226'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.576498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '157d394363444db8a72d3119f9d01226'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.581088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:09:59.583784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:59.591092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '157d394363444db8a72d3119f9d01226'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.599325 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1112/2242] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:09:59 2022] DELETE /identity/v3/users/157d394363444db8a72d3119f9d01226 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:59.600153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:59.605343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:59.623391 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1131/2243] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:09:59.628434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:09:59.634053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:09:59.649513 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:09:59.681229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b134-37b2-45bc-b692-4821e8bb7f0f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:59.744053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dede0d1-311e-4f5e-ba56-dee2e4611c00 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:09:59.757571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:59.758509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.758905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.759151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] PATH_INFO: `/v3/projects/0f764b9ac3934ab09bb175da5ac696d3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.764218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f764b9ac3934ab09bb175da5ac696d3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:59.765690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:59.847059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:09:59.850708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.851410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.852024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] PATH_INFO: `/v3/projects/5009cb74fd244072bd58e1b4a33fa9b3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:09:59.857819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5009cb74fd244072bd58e1b4a33fa9b3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:09:59.864375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:09:59.888912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f764b9ac3934ab09bb175da5ac696d3', 'request_id': 'req-0045fd09-3acc-426e-b541-0d7647e2496a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.905051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f764b9ac3934ab09bb175da5ac696d3', 'request_id': 'req-0045fd09-3acc-426e-b541-0d7647e2496a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.921075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f764b9ac3934ab09bb175da5ac696d3', 'request_id': 'req-0045fd09-3acc-426e-b541-0d7647e2496a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.947641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] The token cache is being invalidate because project 0f764b9ac3934ab09bb175da5ac696d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:09:59.947946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.949306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0045fd09-3acc-426e-b541-0d7647e2496a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:09:59.957867 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1113/2244] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:59 2022] DELETE /identity/v3/projects/0f764b9ac3934ab09bb175da5ac696d3 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:09:59.959345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:09:59.959710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:09:59.959896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:00.000709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] MFA Rules not processed for user `b20b9d3a9539420fa8cfe87da29ca1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:00.005029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:00.118692 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1114/2245] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:09:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:00.119717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:00.121932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:00.128309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5009cb74fd244072bd58e1b4a33fa9b3', 'request_id': 'req-ad39a33d-e786-4f78-9d5c-52b83f30c191'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.146001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5009cb74fd244072bd58e1b4a33fa9b3', 'request_id': 'req-ad39a33d-e786-4f78-9d5c-52b83f30c191'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.186616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5009cb74fd244072bd58e1b4a33fa9b3', 'request_id': 'req-ad39a33d-e786-4f78-9d5c-52b83f30c191'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.231102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae41959-8766-4c56-8101-5751a77e41c9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:00.249651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] The token cache is being invalidate because project 5009cb74fd244072bd58e1b4a33fa9b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:00.251046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.252471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.255253 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:00.267676 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1132/2246] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:09:59 2022] DELETE /identity/v3/projects/5009cb74fd244072bd58e1b4a33fa9b3 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:00.269773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:00.274447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:00.417380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:00.418505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:00.419006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:00.419505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:00.431943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:00.487479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad39a33d-e786-4f78-9d5c-52b83f30c191 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:00.506247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:00.508241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:00.509287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:00.510544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] PATH_INFO: `/v3/users/c660523d9e8a4ae99ae8c2545a7312d4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:00.514834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] RBAC: Authorizing `identity:delete_user(user_id=c660523d9e8a4ae99ae8c2545a7312d4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:00.521097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:00.536183 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:00.624471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c660523d9e8a4ae99ae8c2545a7312d4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.625206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c660523d9e8a4ae99ae8c2545a7312d4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.638645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c660523d9e8a4ae99ae8c2545a7312d4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.639591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c660523d9e8a4ae99ae8c2545a7312d4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.651237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c660523d9e8a4ae99ae8c2545a7312d4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:00.681079 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1133/2247] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:00 2022] DELETE /identity/v3/users/c660523d9e8a4ae99ae8c2545a7312d4 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:00.683201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:00.686438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:00.703366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:00.705396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:00.722030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1115/2248] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:00.723553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:00.730056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:00.746597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4aad26-eba4-4abd-a0d8-cd137032f212 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:00.904583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:00.906277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:00.906806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:00.907229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] PATH_INFO: `/v3/users/fa41479ef6214a479f6ccb06d09106fd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:00.909330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa41479ef6214a479f6ccb06d09106fd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:00.913513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:00.914525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d00ec-d44e-454a-b364-5415a6eeeaab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:00.947633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:00.949409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:00.949920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:00.950802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:00.954292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:01.014725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa41479ef6214a479f6ccb06d09106fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.044065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa41479ef6214a479f6ccb06d09106fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.070695 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:01.093665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa41479ef6214a479f6ccb06d09106fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.094733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa41479ef6214a479f6ccb06d09106fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.116519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa41479ef6214a479f6ccb06d09106fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.133589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1116/2249] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:00 2022] DELETE /identity/v3/users/fa41479ef6214a479f6ccb06d09106fd => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:01.135822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:01.139088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:01.149578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:01.151285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb9d4f7-8f31-4d7c-97a7-515b70178058 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:01.193632 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1134/2250] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:01.380210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73713965-db66-4755-8cfc-1bc5d5a40b02 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:01.386103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:01.387027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:01.387326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:01.387601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] PATH_INFO: `/v3/projects/e796aa50ed284a069202647d1bd1cb31` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:01.389091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e796aa50ed284a069202647d1bd1cb31)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:01.391108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:01.476938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e796aa50ed284a069202647d1bd1cb31', 'request_id': 'req-c4b7bafc-b403-4ee4-8461-b74a8436d992'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.488734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e796aa50ed284a069202647d1bd1cb31', 'request_id': 'req-c4b7bafc-b403-4ee4-8461-b74a8436d992'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.513319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e796aa50ed284a069202647d1bd1cb31', 'request_id': 'req-c4b7bafc-b403-4ee4-8461-b74a8436d992'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.533363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] The token cache is being invalidate because project e796aa50ed284a069202647d1bd1cb31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:01.535639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.539106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c4b7bafc-b403-4ee4-8461-b74a8436d992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:01.548131 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1117/2251] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:01 2022] DELETE /identity/v3/projects/e796aa50ed284a069202647d1bd1cb31 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:01.557060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:01.557540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:01.558018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:01.606974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:01.608902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:01.694236 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:01.819114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1135/2252] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:01.847387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:01.847923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:01.848588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:01.883008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:01.885747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:01.911635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f4d481-e315-4844-be0c-f624e4f03866 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:01.928205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:01.929322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:01.929860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:01.931718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] PATH_INFO: `/v3/projects/6b6d440cc9904911bdbb2cf199047ccc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:01.934007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6d440cc9904911bdbb2cf199047ccc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:01.938516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:01.945476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:01.949597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:01.985402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1118/2253] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:01.992306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.027368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2619ce95-d0a4-4405-913e-994e0b53a54b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:02.076820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6d440cc9904911bdbb2cf199047ccc', 'request_id': 'req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:02.092693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6d440cc9904911bdbb2cf199047ccc', 'request_id': 'req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:02.109174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6d440cc9904911bdbb2cf199047ccc', 'request_id': 'req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:02.139327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] The token cache is being invalidate because project 6b6d440cc9904911bdbb2cf199047ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:02.140662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:02.143875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0adbda2b-4b1c-4c5b-a8e1-3319facb5cc4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:02.153398 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1136/2254] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:01 2022] DELETE /identity/v3/projects/6b6d440cc9904911bdbb2cf199047ccc => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:02.156849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5eb3d-57cf-4726-8510-3cc88a78d265 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.157141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5eb3d-57cf-4726-8510-3cc88a78d265 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.157467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5eb3d-57cf-4726-8510-3cc88a78d265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.209180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21e5eb3d-57cf-4726-8510-3cc88a78d265 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:02.211232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21e5eb3d-57cf-4726-8510-3cc88a78d265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:02.216231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:02.217252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.217437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.217598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.218382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:02.218689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:02.221246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:02.245971 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1137/2255] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:02.246227 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:02.246227 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1119/2256] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:02.254835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.254835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.254835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.257653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.268050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:02.306445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:02.308656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:02.315391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5071e-a3ae-4c7c-905a-bf12082bd334 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:02.330198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:02.345649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.346609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.347502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.351465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:02.355650 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1138/2257] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:02.356869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.358866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:02.378656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269f2ac1-e748-4afd-a7a1-2a440465c0bb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:02.386667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:02.387378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.387667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.387986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.389577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:02.389898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:02.391787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:02.416832 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1139/2258] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:02.418217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.443846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d0e691-1bca-4a7a-b75f-84887189c582 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:02.446230 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1120/2259] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:02 2022] POST /identity/v3/projects => generated 385 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:02.452151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.610442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:02.612094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.612094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.612615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.613952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:02.618274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:02.692669 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1140/2260] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:02 2022] POST /identity/v3/projects => generated 373 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:02.698362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.709772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412fea2-5cc6-4826-a3bf-910642bc9609 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:02.713379 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:02.881128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:02.881772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:02.882058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:02.882339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:02.883070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:02.886499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:02.950981 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1121/2261] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:02 2022] POST /identity/v3/users => generated 293 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:02.952566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:02.991678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c434d3-55b2-4988-a49c-a6400eb3d8ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.009171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2979c85-0412-4dec-a8ea-28e6d697fd56 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.013716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.019148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.019786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.022638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.025073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.054034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.089713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.090779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.092211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.092758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.099676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.133801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.135181 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1141/2262] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:02 2022] POST /identity/v3/users => generated 287 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:03.141247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:03.177501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb28bcf-25ad-4237-8a58-8a58b4a25c59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.186592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.187871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.188256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.188803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.190180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.193837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.210107 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1122/2263] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:03.214937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:03.230032 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1142/2264] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:03.235201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:03.265154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5efd2d-3b66-4e7a-9e29-43e7b7d72daa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.270191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94c924-f14c-41e5-b5c0-ae389b739803 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.283524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.285584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.286413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.286774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.287658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.288452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.288952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.289428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.290884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.291449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.293973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.295194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.343581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1143/2265] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:03.345316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:03.361843 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1123/2266] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:03.365816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:03.381544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42b4b3-a69b-485c-b161-ac8f3bcb651c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.411624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9d119-3345-4787-bd5e-6816f33f9bde admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:03.421951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e9cad-0a83-4029-92ed-50846d23293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.423788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9cad-0a83-4029-92ed-50846d23293f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.424507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9cad-0a83-4029-92ed-50846d23293f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.425120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e9cad-0a83-4029-92ed-50846d23293f admin admin] PATH_INFO: `/v3/projects/cabb8d31ceb0440ca54bf54373b291d4/users/789759a049524588af4a8b98fde3be46/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.430956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477b64d-048e-44c3-8261-18b2921d8729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:03.434939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b64d-048e-44c3-8261-18b2921d8729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.435531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b64d-048e-44c3-8261-18b2921d8729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.438985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477b64d-048e-44c3-8261-18b2921d8729 admin admin] PATH_INFO: `/v3/projects/b99a9538c59a4d03bb5009d604418a08/users/58bc0575f20d4ab38351a8345f1691a0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.516839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e9cad-0a83-4029-92ed-50846d23293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cabb8d31ceb0440ca54bf54373b291d4, user_id=789759a049524588af4a8b98fde3be46, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.527899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b64d-048e-44c3-8261-18b2921d8729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b99a9538c59a4d03bb5009d604418a08, user_id=58bc0575f20d4ab38351a8345f1691a0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:03.538581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3e9cad-0a83-4029-92ed-50846d23293f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.546261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477b64d-048e-44c3-8261-18b2921d8729 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:03.592726 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1144/2267] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:03 2022] PUT /identity/v3/projects/b99a9538c59a4d03bb5009d604418a08/users/58bc0575f20d4ab38351a8345f1691a0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:03.612559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.614301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.614301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.625731 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1124/2268] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:03 2022] PUT /identity/v3/projects/cabb8d31ceb0440ca54bf54373b291d4/users/789759a049524588af4a8b98fde3be46/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:03.634109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:03.634658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:03.635332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:03.689394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] MFA Rules not processed for user `58bc0575f20d4ab38351a8345f1691a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:03.707899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:03.809331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] MFA Rules not processed for user `789759a049524588af4a8b98fde3be46`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:03.813065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:03.927357 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:04.047379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1145/2269] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:04.049446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:04.058450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.127780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1125/2270] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 496 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:04.128823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:04.130548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.188305 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:04.288687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5a924-f323-4b12-a31f-701f23cab3c4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:04.319771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:04.321668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:04.322080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:04.322522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] PATH_INFO: `/v3/projects/cd5f44256f2746dea837d4af9a08f11d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:04.328527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5f44256f2746dea837d4af9a08f11d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:04.343745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:04.421128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613c469-3a41-4754-b344-30099ed75de7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:04.427913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:04.429053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:04.429412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:04.429703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] PATH_INFO: `/v3/projects/32f18b5b677d48ef8d0af955c89b1ddd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:04.431184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32f18b5b677d48ef8d0af955c89b1ddd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:04.433380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:04.511993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32f18b5b677d48ef8d0af955c89b1ddd', 'request_id': 'req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.512918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5f44256f2746dea837d4af9a08f11d', 'request_id': 'req-afa5889a-4c31-4857-85cb-52cbafba2bde'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.528489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32f18b5b677d48ef8d0af955c89b1ddd', 'request_id': 'req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.552487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5f44256f2746dea837d4af9a08f11d', 'request_id': 'req-afa5889a-4c31-4857-85cb-52cbafba2bde'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.565896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32f18b5b677d48ef8d0af955c89b1ddd', 'request_id': 'req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.570513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5f44256f2746dea837d4af9a08f11d', 'request_id': 'req-afa5889a-4c31-4857-85cb-52cbafba2bde'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.619724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] The token cache is being invalidate because project 32f18b5b677d48ef8d0af955c89b1ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:04.620027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.624067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.625739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] The token cache is being invalidate because project cd5f44256f2746dea837d4af9a08f11d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:04.628787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.629974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:04.630915 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1126/2271] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:04 2022] DELETE /identity/v3/projects/32f18b5b677d48ef8d0af955c89b1ddd => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:04.633033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:04.635833 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1146/2272] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:04 2022] DELETE /identity/v3/projects/cd5f44256f2746dea837d4af9a08f11d => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:04.640844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.641931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:04.644691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.761993 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:04.795002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5889a-4c31-4857-85cb-52cbafba2bde admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:04.797531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b424dbe9-aa83-4d6e-8475-1aaad9dd6e90 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:04.806091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:04.807292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:04.808468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:04.809499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a47390-fe78-4d7c-8ac8-37d52dc68c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:04.810085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:04.810969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47390-fe78-4d7c-8ac8-37d52dc68c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:04.811968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:04.812375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47390-fe78-4d7c-8ac8-37d52dc68c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:04.812734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a47390-fe78-4d7c-8ac8-37d52dc68c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:04.815007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47390-fe78-4d7c-8ac8-37d52dc68c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:04.816755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:04.818935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a47390-fe78-4d7c-8ac8-37d52dc68c57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:04.885109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1127/2273] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:04 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:04.894664 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1147/2274] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:04 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:04.894664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:04.894664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:04.894664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:04.895352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:04.896632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:04.951402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:04.959180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:05.176057 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:05.220745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc49404-b229-4f9e-87c3-58d1f32bb23f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.223096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1148/2275] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:05.226295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.232528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:05.293410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3ad0b6-0ecc-4bcd-b901-1f89f8f47066 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.307717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.308652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.308938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.309211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] PATH_INFO: `/v3/users/67adb1f0f94b4d319920a6ef5411ffa0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.313690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67adb1f0f94b4d319920a6ef5411ffa0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.315953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.433865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.436456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.441576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.442293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.446873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:05.463189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67adb1f0f94b4d319920a6ef5411ffa0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:05.464618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67adb1f0f94b4d319920a6ef5411ffa0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:05.492413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67adb1f0f94b4d319920a6ef5411ffa0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:05.496511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67adb1f0f94b4d319920a6ef5411ffa0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:05.521358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67adb1f0f94b4d319920a6ef5411ffa0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:05.570861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1149/2276] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:05 2022] DELETE /identity/v3/users/67adb1f0f94b4d319920a6ef5411ffa0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:05.577110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.579659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:05.598242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.600492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.614820 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1128/2277] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:04 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 729 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:05.615528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.623314 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:05.630182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45f4e9d-2cef-4ac6-be37-899de4f04ed4 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.735529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e6149-bb28-4eb0-adfb-90791f85fa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.736238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6149-bb28-4eb0-adfb-90791f85fa01 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.737205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6149-bb28-4eb0-adfb-90791f85fa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.737506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e6149-bb28-4eb0-adfb-90791f85fa01 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.738269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e6149-bb28-4eb0-adfb-90791f85fa01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.741024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e6149-bb28-4eb0-adfb-90791f85fa01 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.782996 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1129/2278] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:05 2022] POST /identity/v3/users => generated 299 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:05.786987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.787434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.787591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.826037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9640ba-4cf3-44c1-be4a-32132ae80a38 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.838526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:05.840732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.842363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:05.842689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.843283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.844251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.846057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.853139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.873525 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1130/2279] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:05.875716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.880550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:05.903716 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1150/2280] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:05 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:05.904303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922d5cc-69bc-4b55-9622-7c04bf9ec53a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.906337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.911090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.912179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.912658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.913225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.914580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.916818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.930823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce070c-f1e1-4364-a1a9-887c32f1d358 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.935117 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1131/2281] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:05.936518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.942092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.944028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.944661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.945903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.947568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:05.949074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.950566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c113de86-3b91-443b-b8f5-69512e69aa34 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:05.952310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.956847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:05.958151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:05.958613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:05.959039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:05.960864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:05.962772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:05.980949 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1132/2282] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:05.982479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:05.985354 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1151/2283] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:05.991917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.015223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e1e02-6140-4384-9104-ccf49acea6d0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.020430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e3685-58f8-4b62-90e6-79653cb3ddca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.022281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.023341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.023631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.023956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] PATH_INFO: `/v3/projects/2f920d32ff4a4a06b003db697954d6d1/users/f996f7f01734428fafb5ed5cc3d149ac/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.032411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.034264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.035119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.036040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.038833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.043732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.047391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f920d32ff4a4a06b003db697954d6d1, user_id=f996f7f01734428fafb5ed5cc3d149ac, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.059512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.084148 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1133/2284] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:05 2022] PUT /identity/v3/projects/2f920d32ff4a4a06b003db697954d6d1/users/f996f7f01734428fafb5ed5cc3d149ac/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:06.088683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.100637 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1152/2285] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:05 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:06.102712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.158006 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:06.220295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32dcff-de9c-4731-83d4-dd0b4df21293 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.299146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908f5040-7e9e-49d3-9ba1-7fc02b1fd8e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.311643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.313417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.313984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.314587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.326816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.329100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.365360 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:06.380619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1153/2286] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:06.380619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.398653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b34a64-01d5-4c60-b8c4-746df5e436fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.407799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.409315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.409524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.410087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.410673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.411939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.412395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.412530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.412954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] PATH_INFO: `/v3/projects/d8b42df81ff54db6b60cee8f83d14b78/users/f04d61263f744dea942d064956a8c5e5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.416503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.455274 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1154/2287] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:06 2022] POST /identity/v3/users => generated 288 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:06.457565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.475140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7eddbf-9234-420c-ae20-53b72fc9d64e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.486665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.488562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.489104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.489701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] PATH_INFO: `/v3/projects/2f920d32ff4a4a06b003db697954d6d1/users/f996f7f01734428fafb5ed5cc3d149ac/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.493778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f920d32ff4a4a06b003db697954d6d1, user_id=f996f7f01734428fafb5ed5cc3d149ac, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.499937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.507387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b42df81ff54db6b60cee8f83d14b78, user_id=f04d61263f744dea942d064956a8c5e5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.515904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.536515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1155/2288] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:06 2022] PUT /identity/v3/projects/2f920d32ff4a4a06b003db697954d6d1/users/f996f7f01734428fafb5ed5cc3d149ac/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:06.536515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.552436 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1134/2289] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:06 2022] PUT /identity/v3/projects/d8b42df81ff54db6b60cee8f83d14b78/users/f04d61263f744dea942d064956a8c5e5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:06.577412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.579758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:06.698369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af57d7-aa06-448f-b380-1bdde4c1c8a7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.705176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.706492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.708532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.709129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] PATH_INFO: `/v3/projects/2280f85132a94a4b8dbe4747888fcc41` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.710595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc148386-f2ec-4e34-92c3-f18fbd92765c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.711846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2280f85132a94a4b8dbe4747888fcc41)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.714749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.718945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a913-c484-4e27-8d49-2be2a1c3ba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.720081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a913-c484-4e27-8d49-2be2a1c3ba9f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.720496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a913-c484-4e27-8d49-2be2a1c3ba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.720850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a913-c484-4e27-8d49-2be2a1c3ba9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.722133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1a913-c484-4e27-8d49-2be2a1c3ba9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.723909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1a913-c484-4e27-8d49-2be2a1c3ba9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.748752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1156/2290] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:06.752027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.752027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.752458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.798465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2280f85132a94a4b8dbe4747888fcc41', 'request_id': 'req-f017094d-b6f1-4d47-ab85-958a893ce251'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:06.801153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] MFA Rules not processed for user `f996f7f01734428fafb5ed5cc3d149ac`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:06.803521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:06.816545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2280f85132a94a4b8dbe4747888fcc41', 'request_id': 'req-f017094d-b6f1-4d47-ab85-958a893ce251'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:06.829293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2280f85132a94a4b8dbe4747888fcc41', 'request_id': 'req-f017094d-b6f1-4d47-ab85-958a893ce251'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:06.854920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] The token cache is being invalidate because project 2280f85132a94a4b8dbe4747888fcc41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:06.855203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:06.856206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:06.861915 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1135/2291] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:06 2022] DELETE /identity/v3/projects/2280f85132a94a4b8dbe4747888fcc41 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:06.863849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.866971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:06.936397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1157/2292] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:06.936397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:06.936397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:06.961351 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:06.986479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017094d-b6f1-4d47-ab85-958a893ce251 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:06.991842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a49d9b5-1123-4054-a300-f8c20664f6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:06.992844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d9b5-1123-4054-a300-f8c20664f6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:06.993132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d9b5-1123-4054-a300-f8c20664f6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:06.993411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a49d9b5-1123-4054-a300-f8c20664f6c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:06.994583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49d9b5-1123-4054-a300-f8c20664f6c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:06.997130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a49d9b5-1123-4054-a300-f8c20664f6c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:06.999773 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:07.011642 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1136/2293] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:07.013789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.015525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.031501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.076901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:07.078483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.090274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1137/2294] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:07.092130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:07.095059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.117884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b51c57-f0b2-487b-9997-d44ed1ce1ade None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.124021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.124821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.125131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.125390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.126206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:07.127933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:07.150262 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1158/2295] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:06 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:07.152103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:07.171951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce859027-4213-4f06-8985-3d80273ea4c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.183368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609a332-a2d2-418c-a25d-8a4f088e4b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.184723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a332-a2d2-418c-a25d-8a4f088e4b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.185180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a332-a2d2-418c-a25d-8a4f088e4b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.185728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a332-a2d2-418c-a25d-8a4f088e4b9f admin admin] PATH_INFO: `/v3/projects/d8b42df81ff54db6b60cee8f83d14b78/users/f04d61263f744dea942d064956a8c5e5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.189726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609a332-a2d2-418c-a25d-8a4f088e4b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b42df81ff54db6b60cee8f83d14b78, user_id=f04d61263f744dea942d064956a8c5e5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:07.196444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609a332-a2d2-418c-a25d-8a4f088e4b9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:07.232167 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1159/2296] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:07 2022] PUT /identity/v3/projects/d8b42df81ff54db6b60cee8f83d14b78/users/f04d61263f744dea942d064956a8c5e5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:07.244596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.244596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.244596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.279260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:07.280769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.314071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805ab899-d9f6-4364-89c3-dcdb0f222ae7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.410920 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1160/2297] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:07.416124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:07.439052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ad5454-3537-448d-9047-58d91a7bc5f9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.452687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3c279-3893-450b-aec1-a09b81b9f658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.453786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c279-3893-450b-aec1-a09b81b9f658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.454176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c279-3893-450b-aec1-a09b81b9f658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.454558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c279-3893-450b-aec1-a09b81b9f658 admin admin] PATH_INFO: `/v3/projects/a77035d933424cebbf6eaedea0c58d3d/users/009bddf9d3f3470e8b6d760a274dc212/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.489233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3c279-3893-450b-aec1-a09b81b9f658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a77035d933424cebbf6eaedea0c58d3d, user_id=009bddf9d3f3470e8b6d760a274dc212, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:07.492618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.493541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.493927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.494304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.494731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3c279-3893-450b-aec1-a09b81b9f658 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:07.520851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1161/2298] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:07 2022] PUT /identity/v3/projects/a77035d933424cebbf6eaedea0c58d3d/users/009bddf9d3f3470e8b6d760a274dc212/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:07.524881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0471-95dd-47b8-b612-918e12d7c6e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.526546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0471-95dd-47b8-b612-918e12d7c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.527289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20c0471-95dd-47b8-b612-918e12d7c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.578622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f20c0471-95dd-47b8-b612-918e12d7c6e8 None None] MFA Rules not processed for user `f04d61263f744dea942d064956a8c5e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:07.579741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f20c0471-95dd-47b8-b612-918e12d7c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.678954 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:07.689543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:07.698360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:07.715878 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1138/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:07.717162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:07.731267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac42870-1e40-4a88-a475-7a16b2dc68d3 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.755978 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1162/2300] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:07.763757 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:07.765832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a93269-a0af-4dc1-bb7b-ca76f9cb2959 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.766384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a93269-a0af-4dc1-bb7b-ca76f9cb2959 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.777138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a93269-a0af-4dc1-bb7b-ca76f9cb2959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.886827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.887886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.888236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.888647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.890832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:07.892811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:07.894722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7a93269-a0af-4dc1-bb7b-ca76f9cb2959 None None] MFA Rules not processed for user `009bddf9d3f3470e8b6d760a274dc212`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:07.894966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:07.897669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7a93269-a0af-4dc1-bb7b-ca76f9cb2959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:07.931813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1139/2301] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:07.933006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:07.958824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e8ff8a-c3a1-422a-b6d1-324e09b7aa1e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:07.988902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:07.997003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:07.997446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:07.997834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:07.998710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.001079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.100691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1163/2302] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:08.103701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96b1a-9f17-4d2a-857a-a433e2a8abe9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.108775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96b1a-9f17-4d2a-857a-a433e2a8abe9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.109666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b96b1a-9f17-4d2a-857a-a433e2a8abe9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.113455 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1140/2303] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:07 2022] POST /identity/v3/projects => generated 361 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:08.115176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.120157 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1164/2304] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:10:08 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:08.122572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96b1a-9f17-4d2a-857a-a433e2a8abe9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.327206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b96b1a-9f17-4d2a-857a-a433e2a8abe9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.342351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8def77-1a3d-4dcd-8aed-b0d4be58e509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.344633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8def77-1a3d-4dcd-8aed-b0d4be58e509 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.345140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8def77-1a3d-4dcd-8aed-b0d4be58e509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.345647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8def77-1a3d-4dcd-8aed-b0d4be58e509 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.354975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8def77-1a3d-4dcd-8aed-b0d4be58e509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.359167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08d99f-d127-4427-8a80-9759c54fb9a7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.361938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8def77-1a3d-4dcd-8aed-b0d4be58e509 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.368170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.369499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.370229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.370824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.372861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.376961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.424078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1165/2305] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:08 2022] POST /identity/v3/users => generated 281 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:08.427265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0300-e375-4301-85af-07176885b1cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.427914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0300-e375-4301-85af-07176885b1cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.428467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad0300-e375-4301-85af-07176885b1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.453860 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1141/2306] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:08 2022] POST /identity/v3/projects => generated 375 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:08.456142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.466877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-04ad0300-e375-4301-85af-07176885b1cd None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:08.469733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04ad0300-e375-4301-85af-07176885b1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:08.596540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06b960-4fc9-4383-a3d1-0389274cab66 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.602374 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1166/2307] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:08.604572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0300-e375-4301-85af-07176885b1cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.613548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.615282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.615953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.616691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.620066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.625882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.645487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad0300-e375-4301-85af-07176885b1cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.652215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.654905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.655409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.655818 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1142/2308] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:08.656161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.657100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.657748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.660059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.660929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:08.669947 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:08.694565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbd53bc-f914-4e17-a501-9cf24a9a173c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.697949 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1167/2309] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:08 2022] POST /identity/v3/users => generated 294 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:08.699522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.705817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.707479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.707938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.708426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.718503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb28059-ef42-4876-90a4-a54a9946df06 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.726399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.727267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.727555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.727889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.729548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.730859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.731502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.736135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.760136 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1168/2310] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:08.761442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.768265 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1143/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:08.770116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.782614 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:08.798055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b04aa-f722-4421-b42f-0f00b55d5727 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.800008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c381d81-51e6-4260-bcbe-0b95c7254d9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.812495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.814443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.814948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.815405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.816857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.818904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.825302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8118bfa-9159-4e80-b3a5-6521694b48ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.827677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8118bfa-9159-4e80-b3a5-6521694b48ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.828204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8118bfa-9159-4e80-b3a5-6521694b48ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.828678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8118bfa-9159-4e80-b3a5-6521694b48ad admin admin] PATH_INFO: `/v3/projects/ee9e305835434e16894eb9c54224f1cd/users/8c45acdcd0b84144acf88296491af0a6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.839827 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1169/2312] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:08.841851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.856715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b8e84-8da4-44ac-8a2d-406efc2abfa5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:08.863182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:08.864156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.864471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.864878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] PATH_INFO: `/v3/projects/15dff487243e4639865e726b11a7ee85/users/12e92f5c356b42da82eb8d29f0678823/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:08.867187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8118bfa-9159-4e80-b3a5-6521694b48ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9e305835434e16894eb9c54224f1cd, user_id=8c45acdcd0b84144acf88296491af0a6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.875865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8118bfa-9159-4e80-b3a5-6521694b48ad admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.884853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15dff487243e4639865e726b11a7ee85, user_id=12e92f5c356b42da82eb8d29f0678823, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:08.888130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:08.924996 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1170/2313] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:08 2022] PUT /identity/v3/projects/15dff487243e4639865e726b11a7ee85/users/12e92f5c356b42da82eb8d29f0678823/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:08.936388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1144/2314] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:08 2022] PUT /identity/v3/projects/ee9e305835434e16894eb9c54224f1cd/users/8c45acdcd0b84144acf88296491af0a6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:08.936837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:08.965957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:08.966853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:08.967204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.047424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] MFA Rules not processed for user `8c45acdcd0b84144acf88296491af0a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:09.052551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:09.139461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c283c-4494-4f09-a91e-0d90e95e7d83 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.230505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1145/2315] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:09.236922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.333126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.334998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.335544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.336083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.337609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.341062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.362502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08834991-0bd5-4eb6-bade-71f21ce88b99 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.363054 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1171/2316] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:09.364242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.371393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.372601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.373085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.373589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.374896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.378993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.452970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1146/2317] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:09 2022] POST /identity/v3/projects => generated 359 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:09.455640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.492646 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:09.564628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe609-2e97-4add-8def-5d35399dea86 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.573657 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:09.614809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578612da-da84-4841-9637-4e68a5268025 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.627406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.628868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.629512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.631229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.638830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:09.669486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.672988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.678745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.679436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.679758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.680100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.693823 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1147/2318] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:09.697062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.772017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.774315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.789801 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1172/2319] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:09.790686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.802281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82158acf-dc54-4e38-94e9-3c721640ccee service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.804312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fdfd8-ee0c-4d88-8870-14b48d741eb5 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.807815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47ac734-003a-4f6c-973a-b3287e79f7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.810158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac734-003a-4f6c-973a-b3287e79f7ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.810537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac734-003a-4f6c-973a-b3287e79f7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.810871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47ac734-003a-4f6c-973a-b3287e79f7ab admin admin] PATH_INFO: `/v3/projects/15dff487243e4639865e726b11a7ee85/users/12e92f5c356b42da82eb8d29f0678823/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.811126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:09.811764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.812267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.812599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.813713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.814091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac734-003a-4f6c-973a-b3287e79f7ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=15dff487243e4639865e726b11a7ee85, user_id=12e92f5c356b42da82eb8d29f0678823, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:09.816177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.817343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47ac734-003a-4f6c-973a-b3287e79f7ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:09.836986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1148/2320] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:09 2022] PUT /identity/v3/projects/15dff487243e4639865e726b11a7ee85/users/12e92f5c356b42da82eb8d29f0678823/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:09.855388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:09.857233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:09.858086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:09.863814 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1173/2321] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:09 2022] POST /identity/v3/users => generated 286 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:09.865084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:09.901019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d629f5-64d1-45b4-95b3-9f8c581b7c5f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:09.907634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] MFA Rules not processed for user `12e92f5c356b42da82eb8d29f0678823`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:09.909258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:10.060887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:10.061560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.062324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.062707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.063788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:10.066108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:10.068021 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:10.093879 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1174/2322] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:10.095318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:10.101482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1149/2323] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:09 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:10.111003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51157a4-c25c-4a52-b2e6-53268694500c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:10.118437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:10.119619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.120003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.120596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] PATH_INFO: `/v3/projects/82352902510b43d6ad570db579a16b63/users/df7097d68e694a3b8166e97dcacf0d08/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.147225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82352902510b43d6ad570db579a16b63, user_id=df7097d68e694a3b8166e97dcacf0d08, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:10.150359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:10.171675 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1175/2324] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:10 2022] PUT /identity/v3/projects/82352902510b43d6ad570db579a16b63/users/df7097d68e694a3b8166e97dcacf0d08/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:10.176266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:10.191503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ce165-7932-4d87-909b-11d2b6554afb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:10.293995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d584f36-7f92-45f9-8f17-fe5994f3a560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:10.295941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584f36-7f92-45f9-8f17-fe5994f3a560 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.296511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584f36-7f92-45f9-8f17-fe5994f3a560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.297023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d584f36-7f92-45f9-8f17-fe5994f3a560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.298741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584f36-7f92-45f9-8f17-fe5994f3a560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:10.302244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d584f36-7f92-45f9-8f17-fe5994f3a560 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:10.307153 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:10.331457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1150/2325] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:10.333585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:10.351179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfef7c05-0e82-46ce-b4cc-8ad5b575feb0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:10.373590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:10.376110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.377035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.378034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] PATH_INFO: `/v3/projects/82352902510b43d6ad570db579a16b63/users/df7097d68e694a3b8166e97dcacf0d08/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.382060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82352902510b43d6ad570db579a16b63, user_id=df7097d68e694a3b8166e97dcacf0d08, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:10.393736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:10.407664 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1176/2326] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:10 2022] PUT /identity/v3/projects/82352902510b43d6ad570db579a16b63/users/df7097d68e694a3b8166e97dcacf0d08/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:10.422132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c60e3a-d858-4bbe-ba5c-375c6b142dc2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.422902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c60e3a-d858-4bbe-ba5c-375c6b142dc2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.423624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c60e3a-d858-4bbe-ba5c-375c6b142dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.489408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:10.502165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a8c60e3a-d858-4bbe-ba5c-375c6b142dc2 None None] MFA Rules not processed for user `df7097d68e694a3b8166e97dcacf0d08`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:10.504966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a8c60e3a-d858-4bbe-ba5c-375c6b142dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:10.618049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ca049-2314-4602-bdff-d6d2b28278a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:10.629553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:10.630236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.630521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.630799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.635961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:10.657791 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1151/2327] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:10 2022] POST /identity/v3/auth/tokens => generated 3293 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:10.659312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.659652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.660157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.690436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] MFA Rules not processed for user `d5c36018cd5145148fa4e7c6132545bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:10.691792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:10.742526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:10.744891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbde82a-0e3b-429f-a3ac-0c6373222424 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:10.756766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1177/2328] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:10.759081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91c5f-b08c-42e0-bb5b-3464bf286036 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.759787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91c5f-b08c-42e0-bb5b-3464bf286036 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.760526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a91c5f-b08c-42e0-bb5b-3464bf286036 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.762674 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1178/2329] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:10.770203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfabbd-93df-44a7-ac0b-06aa1ac07548 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.771874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfabbd-93df-44a7-ac0b-06aa1ac07548 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.772448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfabbd-93df-44a7-ac0b-06aa1ac07548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.780566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1152/2330] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:10.798971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2adfabbd-93df-44a7-ac0b-06aa1ac07548 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:10.800838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2adfabbd-93df-44a7-ac0b-06aa1ac07548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:10.823024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1179/2331] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:10:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:10.851665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:10.853988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:10.966527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cd0f6e-37be-4fd6-b7f1-931d2c369485 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:10.970736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:10.971441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:10.971724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:10.971993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:10.985523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:10.987561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:11.009356 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1153/2332] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:11.065914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:11.066828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:11.067186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:11.101762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:11.103939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:11.120884 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1180/2333] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:10:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:11.146019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:11.158753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cf9d4f-eda5-4e91-a2f6-28673a123559 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:11.163420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:11.164273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:11.164694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:11.165238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:11.175966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:11.177675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:11.201352 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1154/2334] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:11.634397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:11.661557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370c216-c417-4702-b64a-648f3ff69662 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:11.672273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:11.673631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:11.674183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:11.674672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:11.692926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:11.696684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:11.720127 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1181/2335] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:11 2022] GET /identity/v3/auth/tokens => generated 3293 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:12.297387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:12.301230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:12.367978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:12.396913 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:12.459682 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:12.486590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa168bd-7484-4f9d-80ab-af441dc1b5b6 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:12.492315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:12.493489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:12.493777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:12.494093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] PATH_INFO: `/v3/users/789759a049524588af4a8b98fde3be46` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:12.496595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] RBAC: Authorizing `identity:delete_user(user_id=789759a049524588af4a8b98fde3be46)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:12.500615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:12.504053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bfe956-eac1-4f68-aabb-b21a4d35ed4f service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:12.512857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:12.513583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:12.513872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:12.514163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:12.514993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:12.515339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:12.517410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:12.539817 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1182/2336] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:12.546615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:12.567985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0868edb-073d-4f4d-a511-fdac469662b5 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:12.578994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:12.580841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:12.581528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:12.583941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:12.586329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:12.590758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:12.593553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '789759a049524588af4a8b98fde3be46'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:12.609521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '789759a049524588af4a8b98fde3be46'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:12.634107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '789759a049524588af4a8b98fde3be46'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:12.636134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '789759a049524588af4a8b98fde3be46'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:12.650033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1638d2f0-6f15-49fe-a9f2-2af2fcab5136 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '789759a049524588af4a8b98fde3be46'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:12.653971 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1183/2337] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:12 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:12.661869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:12.665284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:12.666911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1155/2338] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:12 2022] DELETE /identity/v3/users/789759a049524588af4a8b98fde3be46 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:12.674233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:12.675283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:12.675283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:12.707485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:12.709700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:12.842329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ccfd71-b895-4b23-80de-d22aab67c9f2 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:12.869077 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1156/2339] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:12.887649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:12.891639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:12.968882 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:12.984268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:12.985495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:12.986013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:12.986519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:12.987892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:12.988300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:12.990201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:12.993183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8e3fa-3079-4516-b202-860098c7a177 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:12.999006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:13.000081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:13.000576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:13.001002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:13.006873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1184/2340] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:13.018270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:13.021229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:13.035755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1157/2341] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:13.504869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:13.506741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:13.511987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:13.513490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:13.537863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0fcd2d-e575-4805-a22e-1c59cebd9956 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:13.548752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:13.549684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:13.549977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:13.550255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] PATH_INFO: `/v3/users/8c45acdcd0b84144acf88296491af0a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:13.557864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c45acdcd0b84144acf88296491af0a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:13.560964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:13.665214 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:13.695660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c45acdcd0b84144acf88296491af0a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:13.696498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c45acdcd0b84144acf88296491af0a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:13.710864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c45acdcd0b84144acf88296491af0a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:13.714497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c45acdcd0b84144acf88296491af0a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:13.736008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2dddbf1b-db00-42f4-82c9-c2999a7bb8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c45acdcd0b84144acf88296491af0a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:13.791968 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1185/2342] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:13 2022] DELETE /identity/v3/users/8c45acdcd0b84144acf88296491af0a6 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:13.793972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:13.794266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:13.794619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:13.824763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:13.826395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:13.935307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c18bef-0222-483d-b7ed-fb32f82648b6 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:14.090825 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1186/2343] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:14.102759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:14.105294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:14.281379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:14.284172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:14.284604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:14.284886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:14.291366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:14.324442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea84596-274f-4c67-9dd9-c8dcd698b2a7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:14.337733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:14.338394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:14.338678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:14.338951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:14.356251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:14.357765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:14.387069 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1187/2344] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:14.388224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:14.395967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:14.421178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37253f3c-2336-46a2-adb5-6988b19452e7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:14.448644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:14.451461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:14.452704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:14.453371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] PATH_INFO: `/v3/projects/cabb8d31ceb0440ca54bf54373b291d4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:14.456017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cabb8d31ceb0440ca54bf54373b291d4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:14.463946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:14.485432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:14.490038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798bb5a-272e-4304-a083-fa74f1dea5d6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:14.517660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1158/2345] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 1006 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:14.543979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:14.544780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:14.545214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:14.547434 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1159/2346] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:14.553227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:14.555651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:14.592977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:14.597284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cabb8d31ceb0440ca54bf54373b291d4', 'request_id': 'req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.607424 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:14.618120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5586301-25b3-4874-baa4-a9510879d99a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:14.619832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cabb8d31ceb0440ca54bf54373b291d4', 'request_id': 'req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.625221 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:14.635740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cabb8d31ceb0440ca54bf54373b291d4', 'request_id': 'req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.666865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] The token cache is being invalidate because project cabb8d31ceb0440ca54bf54373b291d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:14.667951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.670700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.672635 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1188/2347] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:14 2022] DELETE /identity/v3/projects/cabb8d31ceb0440ca54bf54373b291d4 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:14.680292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:14.690605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:14.783736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ccf0f-9680-48b8-a3e6-6e6078e71e53 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:14.790071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:14.791412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:14.791879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:14.792299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] PATH_INFO: `/v3/users/f996f7f01734428fafb5ed5cc3d149ac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:14.794819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f996f7f01734428fafb5ed5cc3d149ac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:14.797774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:14.881221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d96d658-9e0f-4758-829b-6e6ef9b77c84 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:14.888846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d658-9e0f-4758-829b-6e6ef9b77c84 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:14.889378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d658-9e0f-4758-829b-6e6ef9b77c84 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:14.889863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96d658-9e0f-4758-829b-6e6ef9b77c84 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/projects/0d37cfd2af144845911dc754a4ddf500` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:14.899197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96d658-9e0f-4758-829b-6e6ef9b77c84 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d37cfd2af144845911dc754a4ddf500)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:14.900007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f996f7f01734428fafb5ed5cc3d149ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.901001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f996f7f01734428fafb5ed5cc3d149ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.907523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d96d658-9e0f-4758-829b-6e6ef9b77c84 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:14.918491 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1160/2348] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:14 2022] GET /identity/v3/projects/0d37cfd2af144845911dc754a4ddf500 => generated 371 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:14.927949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f996f7f01734428fafb5ed5cc3d149ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.929225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f996f7f01734428fafb5ed5cc3d149ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:14.959366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f996f7f01734428fafb5ed5cc3d149ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:15.112148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1189/2349] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:14 2022] DELETE /identity/v3/users/f996f7f01734428fafb5ed5cc3d149ac => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:16.156666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.157817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.158448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.161013 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1161/2350] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:16.163869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.176873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:16.177907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.187697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.376278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231819bf-cf30-4a4b-ac94-3a495a92d776 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:16.389107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:16.390544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.391088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.395129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] PATH_INFO: `/v3/users/58bc0575f20d4ab38351a8345f1691a0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.399328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=58bc0575f20d4ab38351a8345f1691a0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:16.401944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:16.406283 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:16.412630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.417875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.515063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58bc0575f20d4ab38351a8345f1691a0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.515807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58bc0575f20d4ab38351a8345f1691a0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.531938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58bc0575f20d4ab38351a8345f1691a0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.532852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58bc0575f20d4ab38351a8345f1691a0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.546375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-487be14a-fb57-4fc1-80f4-e57c4fd673aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58bc0575f20d4ab38351a8345f1691a0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:16.583132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80e4df-6943-4cc8-8eeb-1427e3efeede None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:16.588725 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1190/2351] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:16 2022] DELETE /identity/v3/users/58bc0575f20d4ab38351a8345f1691a0 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:16.592318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:16.593560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.595275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.595680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.596593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.597071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.597500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/projects/0d37cfd2af144845911dc754a4ddf500` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.600237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d37cfd2af144845911dc754a4ddf500)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:16.603182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:16.626782 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1162/2352] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:16 2022] GET /identity/v3/projects/0d37cfd2af144845911dc754a4ddf500 => generated 371 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:16.650683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:16.652280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.682199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.684196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.719499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf120c24-e036-4dbf-972d-145cb410a86f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:16.753172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1191/2353] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:16.836629 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:16.851142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.853025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:16.879896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:16.880945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.881426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.881904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:16.883332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:16.883782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:16.886034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:16.950962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1163/2354] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:16.953162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:16.979546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9220eb4-b39e-4b03-a57c-874db9ff926e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:16.994175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f348591-f3c3-4f57-a873-adbd533cc55c tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:16.994496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:16.994496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:16.994834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:16.995212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.022199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.025125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.031034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.034718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.038715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.039237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.040389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.046172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1192/2355] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:17.064134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.121299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.124751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.128630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1164/2356] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:16 2022] POST /identity/v3/users => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:17.134890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.161660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4b934d-131b-411e-ad6a-06d0617938ca service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.178290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.180941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.181787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd726373-6b41-46d4-bd8a-4090ead29267 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.183167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.184265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] PATH_INFO: `/v3/projects/2f920d32ff4a4a06b003db697954d6d1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.187631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f920d32ff4a4a06b003db697954d6d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.195809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.217397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.218639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.219095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.219574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.221020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:17.222316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.238890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e40e66-7539-48c6-ae7d-658d5c1e5d4d tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.250203 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:17.295293 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1165/2357] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:17.333525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f920d32ff4a4a06b003db697954d6d1', 'request_id': 'req-6944fde7-dadc-4f46-a14c-4aa33a4f3511'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.353177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f920d32ff4a4a06b003db697954d6d1', 'request_id': 'req-6944fde7-dadc-4f46-a14c-4aa33a4f3511'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.378979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f920d32ff4a4a06b003db697954d6d1', 'request_id': 'req-6944fde7-dadc-4f46-a14c-4aa33a4f3511'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.417341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] The token cache is being invalidate because project 2f920d32ff4a4a06b003db697954d6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:17.418084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.419545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6944fde7-dadc-4f46-a14c-4aa33a4f3511 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:17.427531 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1193/2358] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:17 2022] DELETE /identity/v3/projects/2f920d32ff4a4a06b003db697954d6d1 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:17.429459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.429746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.430013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.475818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:17.477153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.601284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1166/2359] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:17.612316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035d0a-2676-4873-886c-689504dd47d0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.614142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035d0a-2676-4873-886c-689504dd47d0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.614142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5035d0a-2676-4873-886c-689504dd47d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.644645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d5035d0a-2676-4873-886c-689504dd47d0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:17.647097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5035d0a-2676-4873-886c-689504dd47d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.661717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1194/2360] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:17.672750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.690976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0eefb1-e75d-4ae3-8e73-93a5b0b7b3eb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.707400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.708979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.709262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.709541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.710346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:17.711146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.716680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.724803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.725677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.725861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.730828 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1195/2361] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:17.743703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:17.749436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:17.765793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1167/2362] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:17.772405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.806302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a1a124-749e-41ee-a417-86219e003bf8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:17.818991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:17.823188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:17.824234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:17.825055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:17.827064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:17.834602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:17.902666 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1168/2363] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:17 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:17.908652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.936515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:17.941854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:18.104754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831401b2-6854-43db-b437-6c5dd2f5fbed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.120530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.122750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.123537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.124272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.126549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870df5da-17e5-4c8c-bb89-6c9b364376e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.127234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.146764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.238495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1169/2364] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:17 2022] POST /identity/v3/users => generated 287 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:18.245881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.280112 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:18.306689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2da02a-50ed-43c1-970a-3c34fe77e92a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.343662 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:18.355853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.362271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.367174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.368140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.373293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.379240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.405569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.407926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.408296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.409591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/projects/0d37cfd2af144845911dc754a4ddf500` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.413011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d37cfd2af144845911dc754a4ddf500)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.416391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.421968 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1196/2365] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:17 2022] GET /identity/v3/projects/0d37cfd2af144845911dc754a4ddf500 => generated 371 bytes in 679 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:18.423245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.426354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:18.441966 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1170/2366] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:18.443652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.480404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2c3cc5-1c8d-41f1-b627-fa5f1865d731 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.496928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.500524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.500524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.500524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] PATH_INFO: `/v3/projects/ee9e305835434e16894eb9c54224f1cd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.501733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9e305835434e16894eb9c54224f1cd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.503456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.519535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833a343-93c6-4e68-9b24-ad15bd2f4387 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.550519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.551703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.552219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.559536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.562516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.568428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.606117 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1171/2367] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:18.607706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.611491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:18.625167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9e305835434e16894eb9c54224f1cd', 'request_id': 'req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.634125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9e305835434e16894eb9c54224f1cd', 'request_id': 'req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.641633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53842dc8-980d-4d5f-8546-b6d67e3cf2e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.645970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9e305835434e16894eb9c54224f1cd', 'request_id': 'req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.667639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] The token cache is being invalidate because project ee9e305835434e16894eb9c54224f1cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:18.667985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.671127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:18.674980 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1197/2368] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:18 2022] DELETE /identity/v3/projects/ee9e305835434e16894eb9c54224f1cd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:18.676116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.678811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:18.830927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.833335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.834221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.836876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] PATH_INFO: `/v3/projects/b99a9538c59a4d03bb5009d604418a08` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.843831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b99a9538c59a4d03bb5009d604418a08)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.848474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.869232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ae2e7f-2a70-4363-ab30-6a51e3f6eb10 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:18.878418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:18.882037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:18.883091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:18.883578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] PATH_INFO: `/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6/users/0da28d6c7d1e4acab715aea907dad887/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:18.908872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce58084b8c3f46af9e6aa254dc4ec6e6, user_id=0da28d6c7d1e4acab715aea907dad887, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:18.912750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:18.940869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1198/2369] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:18 2022] PUT /identity/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6/users/0da28d6c7d1e4acab715aea907dad887/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:18.942362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:18.957655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.040079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b99a9538c59a4d03bb5009d604418a08', 'request_id': 'req-53db7245-ee1b-443a-b83d-83fe4240a627'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.071241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b99a9538c59a4d03bb5009d604418a08', 'request_id': 'req-53db7245-ee1b-443a-b83d-83fe4240a627'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.085056 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:19.093048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b99a9538c59a4d03bb5009d604418a08', 'request_id': 'req-53db7245-ee1b-443a-b83d-83fe4240a627'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.108859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5ebed-d934-444d-8e77-3454361f58be admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:19.143042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] The token cache is being invalidate because project b99a9538c59a4d03bb5009d604418a08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:19.143554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.150360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-53db7245-ee1b-443a-b83d-83fe4240a627 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.153279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1172/2370] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:18 2022] DELETE /identity/v3/projects/b99a9538c59a4d03bb5009d604418a08 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:19.157006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.158493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.159063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.216336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] MFA Rules not processed for user `0da28d6c7d1e4acab715aea907dad887`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:19.217926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.262214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:19.263850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.264811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.265305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] PATH_INFO: `/v3/users/df7097d68e694a3b8166e97dcacf0d08` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.267709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df7097d68e694a3b8166e97dcacf0d08)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:19.272800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:19.388770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df7097d68e694a3b8166e97dcacf0d08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.390194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df7097d68e694a3b8166e97dcacf0d08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.412750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df7097d68e694a3b8166e97dcacf0d08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.413513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df7097d68e694a3b8166e97dcacf0d08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.429975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd12e52f-68e6-4f60-a11d-a9f74df97c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df7097d68e694a3b8166e97dcacf0d08'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.493228 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1173/2371] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:19.494074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:19.497239 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1199/2372] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:18 2022] DELETE /identity/v3/users/df7097d68e694a3b8166e97dcacf0d08 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:19.499955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098394-6eb6-4c34-8f7f-1c188559bdc4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.500239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098394-6eb6-4c34-8f7f-1c188559bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.500536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72098394-6eb6-4c34-8f7f-1c188559bdc4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.502633 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1200/2373] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:19.503585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.503775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098394-6eb6-4c34-8f7f-1c188559bdc4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:19.505555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72098394-6eb6-4c34-8f7f-1c188559bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.526098 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:19.548267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565a2af-7b4c-4453-b88d-df104c84aacc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:19.677028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72098394-6eb6-4c34-8f7f-1c188559bdc4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:19.690444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:19.693304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.694229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.695319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] PATH_INFO: `/v3/users/f04d61263f744dea942d064956a8c5e5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.698826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:19.700058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:19.700318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04d61263f744dea942d064956a8c5e5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:19.700581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:19.701025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:19.702369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:19.706125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:19.707084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:19.789285 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:19.812497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04d61263f744dea942d064956a8c5e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.818086 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1201/2374] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/projects => generated 375 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:19.818086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:19.821664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:19.831736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04d61263f744dea942d064956a8c5e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.854808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04d61263f744dea942d064956a8c5e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.855590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04d61263f744dea942d064956a8c5e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.887098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04d61263f744dea942d064956a8c5e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:19.903999 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1174/2375] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:19 2022] DELETE /identity/v3/users/f04d61263f744dea942d064956a8c5e5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:19.904983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:19.907645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:20.073117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.076381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:20.085333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ad09d-5cdd-42fb-8a6b-48c053aaa580 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.091171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.092240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.092865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.093370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.094513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.097169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.162359 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1175/2376] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:19 2022] POST /identity/v3/users => generated 294 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:20.170491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.196252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931cce8-e676-47be-974c-b7e754bdf0b0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.213494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.214605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.217098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.217806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.218982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.222956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.252630 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:20.281029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d386e5b-8d41-4664-b348-288236a2dfff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.296225 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1176/2377] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:20.300811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.357679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4329056c-e195-43b7-9e09-0aef736d76ce admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.374907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.376051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.376602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.376987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/projects/0d37cfd2af144845911dc754a4ddf500` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.378598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:get_project(project_id=0d37cfd2af144845911dc754a4ddf500)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.381153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.382861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.384838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.385314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.385781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] PATH_INFO: `/v3/projects/f790294c961f4152b074979381040e56/users/31e78bf0ff4b4028a362578682892230/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.395867 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1202/2378] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:19 2022] GET /identity/v3/projects/0d37cfd2af144845911dc754a4ddf500 => generated 371 bytes in 579 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:20.432550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.434647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:20.468689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d7b6aa-7dfb-4259-88eb-e4b8305192da tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.475055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f790294c961f4152b074979381040e56, user_id=31e78bf0ff4b4028a362578682892230, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.484863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.487760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.488490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.489943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.490244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/users/73db7dedf44b465d81efc6ffe102edcc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.519938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:delete_user(user_id=73db7dedf44b465d81efc6ffe102edcc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.522726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:20.574604 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:20.575588 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1177/2379] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:20 2022] PUT /identity/v3/projects/f790294c961f4152b074979381040e56/users/31e78bf0ff4b4028a362578682892230/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:20.603070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.605357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73db7dedf44b465d81efc6ffe102edcc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:20.606432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73db7dedf44b465d81efc6ffe102edcc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:20.622380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73db7dedf44b465d81efc6ffe102edcc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:20.623313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73db7dedf44b465d81efc6ffe102edcc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:20.636105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73db7dedf44b465d81efc6ffe102edcc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:20.692320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1203/2380] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:20 2022] DELETE /identity/v3/users/73db7dedf44b465d81efc6ffe102edcc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:20.693962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:20.696124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:20.864252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b1d94-02b0-4505-a24b-8e77e99d5cd4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.913413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc2ebb9-976d-42db-a8d9-3c841b2bfd80 tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:20.919097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '12e92f5c356b42da82eb8d29f0678823', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '15dff487243e4639865e726b11a7ee85', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:20.920247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:20.920640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:20.920992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] PATH_INFO: `/v3/projects/0d37cfd2af144845911dc754a4ddf500` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:20.922995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0d37cfd2af144845911dc754a4ddf500)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:20.925276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.025388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d37cfd2af144845911dc754a4ddf500', 'request_id': 'req-ce50ff65-e48b-4b9f-8650-72f6275a188f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.035826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.037566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.037566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.037973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.038090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d37cfd2af144845911dc754a4ddf500', 'request_id': 'req-ce50ff65-e48b-4b9f-8650-72f6275a188f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.039618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.049666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d37cfd2af144845911dc754a4ddf500', 'request_id': 'req-ce50ff65-e48b-4b9f-8650-72f6275a188f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.052296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.087576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] The token cache is being invalidate because project 0d37cfd2af144845911dc754a4ddf500 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:21.088086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.089299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.089882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1178/2381] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 496 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:21.096008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.097119 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1204/2382] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:20 2022] DELETE /identity/v3/projects/0d37cfd2af144845911dc754a4ddf500 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:21.100513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:21.103697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.108982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:21.122661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca1121c-0124-444c-99a8-f44ba51e73e7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.316971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e63da63-2765-4ec9-b8f2-867828d09a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.318539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63da63-2765-4ec9-b8f2-867828d09a10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.319022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63da63-2765-4ec9-b8f2-867828d09a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.319537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e63da63-2765-4ec9-b8f2-867828d09a10 admin admin] PATH_INFO: `/v3/projects/f790294c961f4152b074979381040e56/users/31e78bf0ff4b4028a362578682892230/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.328733 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:21.329932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63da63-2765-4ec9-b8f2-867828d09a10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f790294c961f4152b074979381040e56, user_id=31e78bf0ff4b4028a362578682892230, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.339153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e63da63-2765-4ec9-b8f2-867828d09a10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.382521 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1179/2383] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:21 2022] PUT /identity/v3/projects/f790294c961f4152b074979381040e56/users/31e78bf0ff4b4028a362578682892230/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:21.406006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.406785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.407517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.414218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50ff65-e48b-4b9f-8650-72f6275a188f tempest-QuotasAdminTestV257-1607907011 tempest-QuotasAdminTestV257-1607907011-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.465870 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:21.474091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] MFA Rules not processed for user `31e78bf0ff4b4028a362578682892230`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:21.478127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:21.594008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.598051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.599168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.601083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] PATH_INFO: `/v3/users/009bddf9d3f3470e8b6d760a274dc212` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.605022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=009bddf9d3f3470e8b6d760a274dc212)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.637074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.761933 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1180/2384] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:21.763754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.769661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:21.823975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '009bddf9d3f3470e8b6d760a274dc212'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.825253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '009bddf9d3f3470e8b6d760a274dc212'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.826126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ded5c-8e44-44a9-bcb8-04b51120506c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:21.849932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:21.851614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:21.852112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:21.852629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] PATH_INFO: `/v3/projects/82352902510b43d6ad570db579a16b63` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:21.856153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82352902510b43d6ad570db579a16b63)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:21.859829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:21.867295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '009bddf9d3f3470e8b6d760a274dc212'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.876392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '009bddf9d3f3470e8b6d760a274dc212'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.912882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '009bddf9d3f3470e8b6d760a274dc212'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:21.973921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1205/2385] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:21 2022] DELETE /identity/v3/users/009bddf9d3f3470e8b6d760a274dc212 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:21.973921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:21.975944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.031150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82352902510b43d6ad570db579a16b63', 'request_id': 'req-7685f9d1-209b-4f09-a707-5c295eb101e0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.048749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82352902510b43d6ad570db579a16b63', 'request_id': 'req-7685f9d1-209b-4f09-a707-5c295eb101e0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.073239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82352902510b43d6ad570db579a16b63', 'request_id': 'req-7685f9d1-209b-4f09-a707-5c295eb101e0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.103846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] The token cache is being invalidate because project 82352902510b43d6ad570db579a16b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:22.104484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.107508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7685f9d1-209b-4f09-a707-5c295eb101e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.114421 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1181/2386] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:21 2022] DELETE /identity/v3/projects/82352902510b43d6ad570db579a16b63 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:22.114665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035171-718b-438d-add3-fcdc5db2e0a9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.114903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035171-718b-438d-add3-fcdc5db2e0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.115415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb035171-718b-438d-add3-fcdc5db2e0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.143560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bb035171-718b-438d-add3-fcdc5db2e0a9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:22.145098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb035171-718b-438d-add3-fcdc5db2e0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.187239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a5b6-9c39-4d46-892d-f6423856a60b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.221336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.222473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.222971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.223473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.224776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:22.225533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.228774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.234492 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:22.237979 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1182/2387] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:22.239831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435835-fedc-4d8c-9f57-62cc07859b57 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.240437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435835-fedc-4d8c-9f57-62cc07859b57 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.240828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37435835-fedc-4d8c-9f57-62cc07859b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.263165 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1206/2388] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:22.268924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.278497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-37435835-fedc-4d8c-9f57-62cc07859b57 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:22.280308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-37435835-fedc-4d8c-9f57-62cc07859b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.280566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.297950 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1183/2389] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:22.299645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.300132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.300529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.320507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74721d60-e0a0-44cc-8830-5ad3489a3843 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.328449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:22.330144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.336945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.346587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.346587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.347021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1184/2390] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:22.347183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.347350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.347500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.349648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.351749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.364002 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:22.446714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f51807-f7e3-42b1-8a49-800e77826110 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.451539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.453734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.454143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.454528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.455262 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1207/2391] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:22 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:22.456897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.471273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.473627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.487371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1185/2392] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:22.488396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.500815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe536c-ca76-4072-80fa-cd218138dfa3 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.575016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.575920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.576313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.576776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.577677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:22.578099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.579876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.600052 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1186/2393] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:22.601472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.606932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.614494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd141da-eb29-4eb9-8ee3-3adbe64fe469 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.627132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.628811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.629404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.630002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.631502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:22.632209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.632754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1f2f8c-2849-461e-8b29-eec17302166a tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.637424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.638596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.639588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.639954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.640233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] PATH_INFO: `/v3/projects/d8b42df81ff54db6b60cee8f83d14b78` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.642117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b42df81ff54db6b60cee8f83d14b78)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.644397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.673084 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1208/2394] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:22.679992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.699350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332b3315-adbc-463b-82b3-5bba12e579fb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:22.798082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b42df81ff54db6b60cee8f83d14b78', 'request_id': 'req-b1670083-27ce-4041-85e2-72a7b8c3a599'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.818096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b42df81ff54db6b60cee8f83d14b78', 'request_id': 'req-b1670083-27ce-4041-85e2-72a7b8c3a599'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.837564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9fbdcb-6be0-470b-9bc3-6347036b77ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:22.840595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbdcb-6be0-470b-9bc3-6347036b77ce admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.843118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbdcb-6be0-470b-9bc3-6347036b77ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.844045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9fbdcb-6be0-470b-9bc3-6347036b77ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.845771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbdcb-6be0-470b-9bc3-6347036b77ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:22.846941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b42df81ff54db6b60cee8f83d14b78', 'request_id': 'req-b1670083-27ce-4041-85e2-72a7b8c3a599'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.851228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9fbdcb-6be0-470b-9bc3-6347036b77ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:22.877428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] The token cache is being invalidate because project d8b42df81ff54db6b60cee8f83d14b78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:22.878392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.879727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:22.882883 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1187/2395] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:22 2022] DELETE /identity/v3/projects/d8b42df81ff54db6b60cee8f83d14b78 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:22.886093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:22.888848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:22.943071 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1209/2396] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:22 2022] POST /identity/v3/projects => generated 373 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:22.946782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105943e1-addb-4095-abee-ead7293feb64 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:22.947383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105943e1-addb-4095-abee-ead7293feb64 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:22.947733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105943e1-addb-4095-abee-ead7293feb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:22.950556 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:23.005998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-105943e1-addb-4095-abee-ead7293feb64 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:23.009544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-105943e1-addb-4095-abee-ead7293feb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:23.046740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1670083-27ce-4041-85e2-72a7b8c3a599 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.202207 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:23.265450 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1210/2397] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:23.269365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105943e1-addb-4095-abee-ead7293feb64 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.273731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-105943e1-addb-4095-abee-ead7293feb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:23.307566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105943e1-addb-4095-abee-ead7293feb64 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.313547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.316585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.317134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.317568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.326616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:23.342310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a431355-324c-41b4-8a6c-701fcfc21ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.344672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a431355-324c-41b4-8a6c-701fcfc21ee8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.345490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a431355-324c-41b4-8a6c-701fcfc21ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.346243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a431355-324c-41b4-8a6c-701fcfc21ee8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.347762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a431355-324c-41b4-8a6c-701fcfc21ee8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.354554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a431355-324c-41b4-8a6c-701fcfc21ee8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.414873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1211/2398] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:23 2022] POST /identity/v3/users => generated 287 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:23.419258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.423755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.436504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.482916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:23.484194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:23.522923 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1212/2399] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:23.523789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.534727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.536565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc0c91-dd86-46d8-9339-1974fc7c837e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.537390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.545665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.545665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.546100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.546100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.546850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.549316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.565628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1213/2401] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:23.566785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.569478 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1188/2401] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:23.572700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.584030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfbd3-5484-42f4-99f2-507bc982dda3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.589567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.590900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.591425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.591714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.592690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:23.593008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.595123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4c0750-3c19-4606-964f-f4dc625e8007 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.617649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ce9f7-3d9e-4748-8e53-f800dccc49da service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.618927 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1214/2402] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:23.621366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a63fa-a4f1-4641-bab1-1ce2ff3325b5 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.621828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a63fa-a4f1-4641-bab1-1ce2ff3325b5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.622768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96a63fa-a4f1-4641-bab1-1ce2ff3325b5 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.625112 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1215/2403] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:23.626122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a63fa-a4f1-4641-bab1-1ce2ff3325b5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.639329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.640485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.641054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.641457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.642352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.644439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.646457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96a63fa-a4f1-4641-bab1-1ce2ff3325b5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.654812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.656084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.656745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.657202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.658350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.660572 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1189/2404] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:23.661600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.666936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:23.684455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.702214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510560f-9ab9-4ceb-9d10-18928d532aa5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.712587 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1216/2405] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:23 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:23.712587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.717959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.721461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.723223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.723656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/9be90074fa1a4822b9a9faa6a46a86da` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.726768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=9be90074fa1a4822b9a9faa6a46a86da)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.729910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.734090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1190/2406] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:23 2022] GET /identity/v3/projects/9be90074fa1a4822b9a9faa6a46a86da => generated 369 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:23.734719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.761632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79449f-f49d-454e-a398-8b37aac9179f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.864754 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:23.891626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5a2eeb-1d8a-4c67-b574-951c1de93fee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.901082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55eff93-f408-431a-9889-49826fa97d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.903020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eff93-f408-431a-9889-49826fa97d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.903693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eff93-f408-431a-9889-49826fa97d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.905252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55eff93-f408-431a-9889-49826fa97d66 admin admin] PATH_INFO: `/v3/projects/5eb8268b6307471a9b0f2766885e1df8/users/a100b52a9543441ca9f2f413e48a0d90/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.905718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:23.907264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.907264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.907537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:23.908840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.912313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.934137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eff93-f408-431a-9889-49826fa97d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eb8268b6307471a9b0f2766885e1df8, user_id=a100b52a9543441ca9f2f413e48a0d90, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:23.939149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55eff93-f408-431a-9889-49826fa97d66 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:23.951274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1191/2407] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:23 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:23.956538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:23.969214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1217/2408] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:23 2022] PUT /identity/v3/projects/5eb8268b6307471a9b0f2766885e1df8/users/a100b52a9543441ca9f2f413e48a0d90/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:23.977552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e74b0-1ed6-440a-8c16-b6cbea6c557c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:23.986095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:23.986618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:23.987021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.039692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] MFA Rules not processed for user `a100b52a9543441ca9f2f413e48a0d90`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:24.042144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:24.165388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.169730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.170429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.170866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.173203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.179644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.189180 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:24.213003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1192/2409] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:24.215352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.240615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd906ad-0b32-49b6-9ab6-ebe0505fd94d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.241824 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1218/2410] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:24.246360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.263475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.264772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.265299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.265798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.267361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.272490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89782a12-21e8-4b9d-8f07-07cb49e72004 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.272693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.284823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aae83-1470-44ce-8226-84046483450b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.285717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aae83-1470-44ce-8226-84046483450b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.286219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aae83-1470-44ce-8226-84046483450b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.286638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794aae83-1470-44ce-8226-84046483450b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.287628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aae83-1470-44ce-8226-84046483450b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.297711 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1193/2411] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:24.299764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794aae83-1470-44ce-8226-84046483450b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.304038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.311024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:24.335873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859da91a-6828-42bb-a8e4-78c05e9bf5fd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.343827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.345234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.345777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.346245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] PATH_INFO: `/v3/projects/a77035d933424cebbf6eaedea0c58d3d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.348385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a77035d933424cebbf6eaedea0c58d3d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.351477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.359714 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1219/2412] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:24 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:24.360629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aae83-1470-44ce-8226-84046483450b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.442456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a77035d933424cebbf6eaedea0c58d3d', 'request_id': 'req-9ace13d7-567d-4696-8cd4-25019a42f150'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.457911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a77035d933424cebbf6eaedea0c58d3d', 'request_id': 'req-9ace13d7-567d-4696-8cd4-25019a42f150'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.471623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a77035d933424cebbf6eaedea0c58d3d', 'request_id': 'req-9ace13d7-567d-4696-8cd4-25019a42f150'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.478066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794aae83-1470-44ce-8226-84046483450b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.494566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] The token cache is being invalidate because project a77035d933424cebbf6eaedea0c58d3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:24.495348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.497814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.501074 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1194/2413] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:24 2022] DELETE /identity/v3/projects/a77035d933424cebbf6eaedea0c58d3d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:24.502632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.504845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:24.574301 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:24.598460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.599566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.599855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.600133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] PATH_INFO: `/v3/projects/430349576f4f44e0965c7418709af57a/users/75fcd603cceb4d5684d35a1f3bd13c3b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.621818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace13d7-567d-4696-8cd4-25019a42f150 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.631373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f8f91-fe57-4cb1-824e-3541183b8e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.632317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8f91-fe57-4cb1-824e-3541183b8e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.632901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8f91-fe57-4cb1-824e-3541183b8e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.633314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f8f91-fe57-4cb1-824e-3541183b8e1f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.634896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f8f91-fe57-4cb1-824e-3541183b8e1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.635247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=430349576f4f44e0965c7418709af57a, user_id=75fcd603cceb4d5684d35a1f3bd13c3b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.637278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f8f91-fe57-4cb1-824e-3541183b8e1f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.638263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.660999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1220/2414] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:24 2022] PUT /identity/v3/projects/430349576f4f44e0965c7418709af57a/users/75fcd603cceb4d5684d35a1f3bd13c3b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:24.674353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1195/2415] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:24 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:24.676970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273121-7cdd-401f-b334-3ec3450285cb None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.677534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273121-7cdd-401f-b334-3ec3450285cb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.677951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13273121-7cdd-401f-b334-3ec3450285cb None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.678056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.685976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:24.688578 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1196/2416] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:24 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:24.690465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273121-7cdd-401f-b334-3ec3450285cb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:24.814420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13273121-7cdd-401f-b334-3ec3450285cb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.826204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3149e-5014-4c4b-b4c0-4a323f052be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.827297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3149e-5014-4c4b-b4c0-4a323f052be4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.828617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3149e-5014-4c4b-b4c0-4a323f052be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.829085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3149e-5014-4c4b-b4c0-4a323f052be4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.830430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3149e-5014-4c4b-b4c0-4a323f052be4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.831272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2075b3b-852a-4140-9812-cc090e9a7d0d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:24.834779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3149e-5014-4c4b-b4c0-4a323f052be4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.841533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:24.843072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.843792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.844501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] PATH_INFO: `/v3/users/12e92f5c356b42da82eb8d29f0678823` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.846349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12e92f5c356b42da82eb8d29f0678823)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:24.848324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:24.855070 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:24.863283 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1197/2417] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:24.866233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:24.866887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:24.867228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:24.913036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] MFA Rules not processed for user `75fcd603cceb4d5684d35a1f3bd13c3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:24.916721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:24.944293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12e92f5c356b42da82eb8d29f0678823'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.945724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12e92f5c356b42da82eb8d29f0678823'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.974626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12e92f5c356b42da82eb8d29f0678823'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:24.977172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12e92f5c356b42da82eb8d29f0678823'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.005034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12e92f5c356b42da82eb8d29f0678823'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.047633 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1221/2418] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:24 2022] DELETE /identity/v3/users/12e92f5c356b42da82eb8d29f0678823 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:25.050550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:25.053577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.126730 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1198/2419] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:25.128590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.132283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.161192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54133fb9-0d11-4c9f-ad19-cbe8ffb95882 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.233138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.237508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.256910 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:25.282360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.284661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.284948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.285227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] PATH_INFO: `/v3/projects/a2df7ec89476462dbf6e794e17e0c82e/users/d4aaba47d9bb424eadbe07b47bb6011f/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.326240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2df7ec89476462dbf6e794e17e0c82e, user_id=d4aaba47d9bb424eadbe07b47bb6011f, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.332450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.335426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c5d3b4-da0b-4114-bb27-f4fd5aad32d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.342554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.346659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.346659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.346659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/9be90074fa1a4822b9a9faa6a46a86da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.351418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=9be90074fa1a4822b9a9faa6a46a86da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.355301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.364885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1222/2420] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:25 2022] GET /identity/v3/projects/9be90074fa1a4822b9a9faa6a46a86da => generated 369 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:25.365948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.368123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.380535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1199/2421] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:25 2022] PUT /identity/v3/projects/a2df7ec89476462dbf6e794e17e0c82e/users/d4aaba47d9bb424eadbe07b47bb6011f/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:25.385736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.393950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af30804-87c0-4c91-b6d0-a8e9a821e968 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.418674 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:25.494979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.495692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.496735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.497050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.497822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.505500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af7324f-8033-4de2-bd33-e11d6f504c3a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.506839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.513605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.514622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.514911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.515192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.517442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.519314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.541921 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1200/2422] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:25.546425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.582949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3874902d-e7f8-465b-bd42-f5b7c727b629 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.593112 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1223/2423] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:25 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:25.598938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.600194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.601368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.606313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.606747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] PATH_INFO: `/v3/projects/a2df7ec89476462dbf6e794e17e0c82e/users/d4aaba47d9bb424eadbe07b47bb6011f/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.617479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2df7ec89476462dbf6e794e17e0c82e, user_id=d4aaba47d9bb424eadbe07b47bb6011f, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.620676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.656457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1201/2424] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:25 2022] PUT /identity/v3/projects/a2df7ec89476462dbf6e794e17e0c82e/users/d4aaba47d9bb424eadbe07b47bb6011f/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:25.669580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.674749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.738835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888af8e3-b32b-43f7-b3d2-c0a0016e1297 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.801691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc6d2b-993c-41fe-8e35-f7550fb14186 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:25.807325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.808242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.808600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.808981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] PATH_INFO: `/v3/projects/15dff487243e4639865e726b11a7ee85` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.810731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] RBAC: Authorizing `identity:delete_project(project_id=15dff487243e4639865e726b11a7ee85)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.812842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.838392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3c5a79-84f5-41de-ab54-83a81f8d3bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:25.839280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5a79-84f5-41de-ab54-83a81f8d3bc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.840770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5a79-84f5-41de-ab54-83a81f8d3bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.841152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c5a79-84f5-41de-ab54-83a81f8d3bc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.841806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c5a79-84f5-41de-ab54-83a81f8d3bc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:25.843860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3c5a79-84f5-41de-ab54-83a81f8d3bc9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:25.874184 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1224/2425] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:25 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:25.876764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d22128-8629-4f0e-8cd1-9de047ec92f8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:25.877065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d22128-8629-4f0e-8cd1-9de047ec92f8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:25.877481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d22128-8629-4f0e-8cd1-9de047ec92f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:25.908249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15dff487243e4639865e726b11a7ee85', 'request_id': 'req-b6313b08-9d42-4e24-8b8a-749eb7b2713e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.919224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15dff487243e4639865e726b11a7ee85', 'request_id': 'req-b6313b08-9d42-4e24-8b8a-749eb7b2713e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.924833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-26d22128-8629-4f0e-8cd1-9de047ec92f8 None None] MFA Rules not processed for user `d4aaba47d9bb424eadbe07b47bb6011f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:25.927940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-26d22128-8629-4f0e-8cd1-9de047ec92f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.930291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15dff487243e4639865e726b11a7ee85', 'request_id': 'req-b6313b08-9d42-4e24-8b8a-749eb7b2713e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.932208 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:25.954273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] The token cache is being invalidate because project 15dff487243e4639865e726b11a7ee85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:25.955752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.957366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:25.959485 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1202/2426] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:25 2022] DELETE /identity/v3/projects/15dff487243e4639865e726b11a7ee85 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:25.963451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:25.967039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:25.987549 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:26.082482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1225/2427] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:26.085070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50a9e-3f46-47cb-a248-0b935a76256a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.085573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50a9e-3f46-47cb-a248-0b935a76256a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.086116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f50a9e-3f46-47cb-a248-0b935a76256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.114965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6313b08-9d42-4e24-8b8a-749eb7b2713e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.118199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-02f50a9e-3f46-47cb-a248-0b935a76256a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:26.120071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02f50a9e-3f46-47cb-a248-0b935a76256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.125416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.126559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.127048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.127529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.129266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.133698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.168481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1203/2428] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:25 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:26.170534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.171244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1226/2429] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:26.173525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.173809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.174289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.174787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.199997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d059c8-3266-428e-8b07-90aa5541242d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.208225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.210917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.211412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.211919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] PATH_INFO: `/v3/users/d0c0d7c9eb4a46acaae026905041d08b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.214556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c0d7c9eb4a46acaae026905041d08b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.215031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:26.217400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.218342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.235995 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1227/2430] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:26.243787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.263865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce9a04-d033-4cde-a089-5875ce5ff8a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.272624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.273703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.274144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.274780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] PATH_INFO: `/v3/projects/328e699c6ea64ff287af42301a55a8fa/users/cb54b0978e7c430da769c747f68a1fb9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.304724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328e699c6ea64ff287af42301a55a8fa, user_id=cb54b0978e7c430da769c747f68a1fb9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.307905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.316557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c0d7c9eb4a46acaae026905041d08b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:26.327679 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1228/2431] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:26 2022] PUT /identity/v3/projects/328e699c6ea64ff287af42301a55a8fa/users/cb54b0978e7c430da769c747f68a1fb9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:26.328999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.329894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c0d7c9eb4a46acaae026905041d08b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:26.358147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c0d7c9eb4a46acaae026905041d08b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:26.359044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c0d7c9eb4a46acaae026905041d08b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:26.377957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c0d7c9eb4a46acaae026905041d08b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:26.387259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1204/2432] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:26 2022] DELETE /identity/v3/users/d0c0d7c9eb4a46acaae026905041d08b => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:26.388884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.393251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.470328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9ce91-acb8-433c-b393-bfa102dba9c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.522195 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:26.527074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d14c18-8702-4d90-9190-670a33f83182 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.539692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e62d094-be9b-421c-9ca1-7d517102890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.541621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d094-be9b-421c-9ca1-7d517102890b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.542229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d094-be9b-421c-9ca1-7d517102890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.542981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e62d094-be9b-421c-9ca1-7d517102890b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.545465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62d094-be9b-421c-9ca1-7d517102890b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.548821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e62d094-be9b-421c-9ca1-7d517102890b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.570027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1205/2433] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:26 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:26.572532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.573139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.573794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.579487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.580696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.581787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.582282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.583703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:26.584325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.588006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.609821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:26.612240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.617772 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1229/2434] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:26.619403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.631064 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1206/2435] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:26.632571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.635538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.647011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a25cee-32ca-4840-88ef-0e268755aae2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.655986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.657732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.658386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.658872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] PATH_INFO: `/v3/projects/328e699c6ea64ff287af42301a55a8fa/users/cb54b0978e7c430da769c747f68a1fb9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.660654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cb516c-46fa-4814-b956-e4b0e64f40c3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.663484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328e699c6ea64ff287af42301a55a8fa, user_id=cb54b0978e7c430da769c747f68a1fb9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.669423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.670494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca90bb9-0112-4a1a-9cb5-f58ddaf7a341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.671148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90bb9-0112-4a1a-9cb5-f58ddaf7a341 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.671556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90bb9-0112-4a1a-9cb5-f58ddaf7a341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.672018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca90bb9-0112-4a1a-9cb5-f58ddaf7a341 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.673905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90bb9-0112-4a1a-9cb5-f58ddaf7a341 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:26.677018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca90bb9-0112-4a1a-9cb5-f58ddaf7a341 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:26.700621 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1230/2436] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:26 2022] PUT /identity/v3/projects/328e699c6ea64ff287af42301a55a8fa/users/cb54b0978e7c430da769c747f68a1fb9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:26.702515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.705543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.756281 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:26.766746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1207/2437] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:26 2022] POST /identity/v3/projects => generated 407 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:26.766746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.766746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.766746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:26.822986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] MFA Rules not processed for user `cb54b0978e7c430da769c747f68a1fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:26.831573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:26.854493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59566c8-a644-4f66-b8a6-12160af13594 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:26.946402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1208/2438] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:26 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:26.950545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:26.966146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77a7b87-83c1-4a32-83bc-d86ca5e2f7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:26.966529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a7b87-83c1-4a32-83bc-d86ca5e2f7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:26.966529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a7b87-83c1-4a32-83bc-d86ca5e2f7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:26.966800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77a7b87-83c1-4a32-83bc-d86ca5e2f7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.071623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a7b87-83c1-4a32-83bc-d86ca5e2f7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.073392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77a7b87-83c1-4a32-83bc-d86ca5e2f7b3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.090436 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1231/2439] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:27.092907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.093290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.093646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.093945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e0e08-a635-4a79-ac72-330384514988 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.095781 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1232/2440] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:27.102798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.104728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.104967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:27.105629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.106501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.107548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:27.108253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.112202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.171974 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1209/2441] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:26 2022] POST /identity/v3/users => generated 304 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:27.174328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.195874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d506050-391a-4165-861e-dca6e4d6071e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.206986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.209733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.210651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.211616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.213543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.219203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.242434 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1210/2442] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:27.249763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.269768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbe4c0-a6aa-42f5-9f16-2ed7a982e549 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.278653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.280185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.281049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.281768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.297634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.301513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.348403 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1211/2443] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:27 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:27.348403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.349831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:27.350729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.353717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:27.382075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603f96a-19b3-4441-becd-e4af67fabb4f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.395403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579758b-be23-4721-9b50-2583eb3e9234 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.397702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579758b-be23-4721-9b50-2583eb3e9234 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.398283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579758b-be23-4721-9b50-2583eb3e9234 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.398788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579758b-be23-4721-9b50-2583eb3e9234 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.406783 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:27.417874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579758b-be23-4721-9b50-2583eb3e9234 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.420980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579758b-be23-4721-9b50-2583eb3e9234 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.442200 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1212/2444] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:27 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:27.444994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.445471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.446009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.458832 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:27.493603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] MFA Rules not processed for user `b20b9d3a9539420fa8cfe87da29ca1e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:27.498022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:27.546135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2315c-8cec-4890-8f60-0b63026798ad None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.561037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.562651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.563157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.563673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/9be90074fa1a4822b9a9faa6a46a86da` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.566087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=9be90074fa1a4822b9a9faa6a46a86da)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.572065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.589335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1233/2445] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:27 2022] GET /identity/v3/projects/9be90074fa1a4822b9a9faa6a46a86da => generated 369 bytes in 482 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:27.594318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.648223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f94081-ff32-4044-8b1c-deea54250893 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.658306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.660695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.661218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.661730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] PATH_INFO: `/v3/projects/9da754809ec14731ac8070139c05a3a1/users/8ac6aba3041d4f23badf338ad5486df9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.727424 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1213/2446] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:27.728906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.749753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da754809ec14731ac8070139c05a3a1, user_id=8ac6aba3041d4f23badf338ad5486df9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.754613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5ff06-1d74-40bd-8295-fcef2ec3db19 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:27.760154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:27.761099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.761385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.762569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/9be90074fa1a4822b9a9faa6a46a86da` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:27.763460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9be90074fa1a4822b9a9faa6a46a86da)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:27.765011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.765749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:27.827998 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1234/2447] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:27 2022] PUT /identity/v3/projects/9da754809ec14731ac8070139c05a3a1/users/8ac6aba3041d4f23badf338ad5486df9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:27.832579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:27.840829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:27.905932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9be90074fa1a4822b9a9faa6a46a86da', 'request_id': 'req-977c026b-9df4-43ed-a243-a3554d988a5f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:27.928538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9be90074fa1a4822b9a9faa6a46a86da', 'request_id': 'req-977c026b-9df4-43ed-a243-a3554d988a5f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:27.942848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9be90074fa1a4822b9a9faa6a46a86da', 'request_id': 'req-977c026b-9df4-43ed-a243-a3554d988a5f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:27.978348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] The token cache is being invalidate because project 9be90074fa1a4822b9a9faa6a46a86da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:27.979194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:27.980056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-977c026b-9df4-43ed-a243-a3554d988a5f tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:27.984589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1214/2448] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:27 2022] DELETE /identity/v3/projects/9be90074fa1a4822b9a9faa6a46a86da => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:27.991497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:27.991497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:27.991497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.033748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e623e-997b-4684-a3b2-cd5793071b6e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.081948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] MFA Rules not processed for user `8ac6aba3041d4f23badf338ad5486df9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:28.088292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:28.211433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.213115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.216163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.216931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] PATH_INFO: `/v3/projects/d7c4a6ba59624ebb8a6cc42dd71fcd15` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.226127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c4a6ba59624ebb8a6cc42dd71fcd15)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.230651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.240261 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1215/2449] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:28.246672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.270836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:28.329985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9e0fc-3caf-4604-98a6-4a03fbb7ec0a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.354536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.356315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.356848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.358313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.359954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.366200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.406931 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:28.413438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c4a6ba59624ebb8a6cc42dd71fcd15', 'request_id': 'req-0b2caf87-2634-49bb-b0c8-124d3fab3efb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.438478 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:28.454131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c4a6ba59624ebb8a6cc42dd71fcd15', 'request_id': 'req-0b2caf87-2634-49bb-b0c8-124d3fab3efb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.463566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1216/2450] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:28 2022] POST /identity/v3/projects => generated 407 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:28.465775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.492795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c4a6ba59624ebb8a6cc42dd71fcd15', 'request_id': 'req-0b2caf87-2634-49bb-b0c8-124d3fab3efb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.555772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] The token cache is being invalidate because project d7c4a6ba59624ebb8a6cc42dd71fcd15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:28.556524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.558077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.569223 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1235/2451] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:27 2022] DELETE /identity/v3/projects/d7c4a6ba59624ebb8a6cc42dd71fcd15 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:28.577110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.581720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:28.588609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9ace0-aef8-444b-98c2-12f859ebfe8e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.597378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.597684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.597973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.598334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.599215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.602336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.639797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1217/2452] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:28 2022] POST /identity/v3/users => generated 310 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:28.645849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.649705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:28.667338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e2212-8b18-4fa7-af71-b371c1749b5a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.673210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.674209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.674861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.675317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.676258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.678408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.696049 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1218/2453] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:28.704287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.717699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838b9909-4b67-42f9-a375-a8bec155ae0b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.723540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.724805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.725283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.725706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] PATH_INFO: `/v3/projects/64d9c3b0af8243f1a445d7b9e8459c70/users/d098afec244d44c6a00f01d1284a85b0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.737400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2caf87-2634-49bb-b0c8-124d3fab3efb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.746484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.747639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.748143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.748695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] PATH_INFO: `/v3/users/5da91d7274184727a0d153e2bc26d709` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.751096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da91d7274184727a0d153e2bc26d709)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.752218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d9c3b0af8243f1a445d7b9e8459c70, user_id=d098afec244d44c6a00f01d1284a85b0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.755079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.755584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.780463 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1219/2454] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:28 2022] PUT /identity/v3/projects/64d9c3b0af8243f1a445d7b9e8459c70/users/d098afec244d44c6a00f01d1284a85b0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:28.781596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.844926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da91d7274184727a0d153e2bc26d709'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.846356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da91d7274184727a0d153e2bc26d709'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.858119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da91d7274184727a0d153e2bc26d709'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.859265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da91d7274184727a0d153e2bc26d709'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.872079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da91d7274184727a0d153e2bc26d709'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:28.876895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453c3ee-1386-42d0-814f-4c1c1de0b9f3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:28.884090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa3cf7-369a-4810-b757-80273b35f79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:28.884090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3cf7-369a-4810-b757-80273b35f79a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:28.884540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3cf7-369a-4810-b757-80273b35f79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:28.884816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa3cf7-369a-4810-b757-80273b35f79a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:28.885778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa3cf7-369a-4810-b757-80273b35f79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:28.887630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa3cf7-369a-4810-b757-80273b35f79a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:28.902811 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1236/2455] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:28 2022] DELETE /identity/v3/users/5da91d7274184727a0d153e2bc26d709 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:28.904903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1220/2456] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:28.914672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:28.916860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.029874 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:29.057414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2364f361-0292-40bf-8fd5-44af3489c205 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:29.070886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:29.072220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.073946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.075319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] PATH_INFO: `/v3/projects/64d9c3b0af8243f1a445d7b9e8459c70/users/d098afec244d44c6a00f01d1284a85b0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.081504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64d9c3b0af8243f1a445d7b9e8459c70, user_id=d098afec244d44c6a00f01d1284a85b0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:29.088129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:29.124189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1237/2457] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:28 2022] PUT /identity/v3/projects/64d9c3b0af8243f1a445d7b9e8459c70/users/d098afec244d44c6a00f01d1284a85b0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:29.127695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.128269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.128737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.210833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] MFA Rules not processed for user `d098afec244d44c6a00f01d1284a85b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:29.212500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.281960 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:29.362282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:29.362589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1221/2458] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:29.387023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:29.390707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.491494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc2f27-e25e-4d03-ba05-eea00847ee36 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:29.498424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:29.499347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.499765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.500053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] PATH_INFO: `/v3/users/8ac6aba3041d4f23badf338ad5486df9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.502255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ac6aba3041d4f23badf338ad5486df9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:29.504475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:29.520380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e802f7-6e11-48bc-85fb-dedfb95485f0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:29.526298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:29.527359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.527738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.528109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] PATH_INFO: `/v3/projects/ec92abef811f4c1c90b364187f2ef5dd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.529567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec92abef811f4c1c90b364187f2ef5dd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:29.531802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:29.571670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ac6aba3041d4f23badf338ad5486df9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.572331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ac6aba3041d4f23badf338ad5486df9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.583863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ac6aba3041d4f23badf338ad5486df9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.584979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ac6aba3041d4f23badf338ad5486df9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.594555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9e9ea28-8273-4b77-9234-43a548d7a7ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ac6aba3041d4f23badf338ad5486df9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.609110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec92abef811f4c1c90b364187f2ef5dd', 'request_id': 'req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.619093 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1238/2459] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:29 2022] DELETE /identity/v3/users/8ac6aba3041d4f23badf338ad5486df9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:29.623402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26be37-6905-4a24-bb09-90d1491412e4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.623402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26be37-6905-4a24-bb09-90d1491412e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.623402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae26be37-6905-4a24-bb09-90d1491412e4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.623402 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1239/2460] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:29.626736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec92abef811f4c1c90b364187f2ef5dd', 'request_id': 'req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.628390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd05d-25c2-4992-8e91-ec49d4911c1f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.628925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd05d-25c2-4992-8e91-ec49d4911c1f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.629389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305dd05d-25c2-4992-8e91-ec49d4911c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.642089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec92abef811f4c1c90b364187f2ef5dd', 'request_id': 'req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.659874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-305dd05d-25c2-4992-8e91-ec49d4911c1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:29.661612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] The token cache is being invalidate because project ec92abef811f4c1c90b364187f2ef5dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:29.661907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-305dd05d-25c2-4992-8e91-ec49d4911c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.662085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.663188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:29.670991 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1222/2461] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:29 2022] DELETE /identity/v3/projects/ec92abef811f4c1c90b364187f2ef5dd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:29.670991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:29.670991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.812857 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:29.821526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:29.825460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.856962 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1240/2462] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:29.859652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:29.860273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:29.860824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:29.906577 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:29.926928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:29.929423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15103bf9-4a7f-4fbb-ad77-5f41a78e11ba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:29.932129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:29.989932 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1241/2463] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:29.991480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:29.998241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:30.144119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5ff7b9-ee0c-493a-b44b-5eb2e4b87afa tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.145607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff7b9-ee0c-493a-b44b-5eb2e4b87afa tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.147231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff7b9-ee0c-493a-b44b-5eb2e4b87afa tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.147231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5ff7b9-ee0c-493a-b44b-5eb2e4b87afa tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.150952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ff7b9-ee0c-493a-b44b-5eb2e4b87afa tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce58084b8c3f46af9e6aa254dc4ec6e6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.156558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5ff7b9-ee0c-493a-b44b-5eb2e4b87afa tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.168077 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1223/2464] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:29 2022] GET /identity/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6 => generated 373 bytes in 502 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:30.170696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.171152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.171622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.194735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e7b6ff-5cb6-4d4a-8d60-b4e80a434db8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.209759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.212501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.213058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.213530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.233965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.237183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.249534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:30.251475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:30.276572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1242/2465] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:30.279226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.283967 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1224/2466] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:30.289599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.331660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883e252-3382-44bd-b923-24a8f7bd64df service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.347134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737d050-abda-4eef-9f74-bd36d52e98c9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.367225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.368308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.368831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.369450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.371336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:30.371667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.385940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.387433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.387953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.388555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.390092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:30.390659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.394446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.399360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.460851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1243/2467] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:30.461155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.476312 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1225/2468] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:30.478491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.512839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71db4dc-7c85-4de1-ad70-3f88e8912c2d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.527194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.527724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61726d9-7a4c-4214-82d4-d14f56ea20ac tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.528079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.530637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.530940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.533069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.539592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.575012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.589989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.590512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.591023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.607724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.612127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.629898 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1226/2469] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:30 2022] POST /identity/v3/projects => generated 377 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:30.633804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.765561 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1244/2470] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:30 2022] POST /identity/v3/projects => generated 371 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:30.768819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:30.854225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647eeb-8cf9-40cd-94bf-9a96e45b0d37 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.880764 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:30.932127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd1eb28-121a-45cd-b172-b89ce6983703 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:30.948543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.949382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.949817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.950235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:30.951314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:30.951777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:30.956649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:30.986469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e847367-0727-4eb6-9ecd-65d1ebb34e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:30.987536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e847367-0727-4eb6-9ecd-65d1ebb34e1d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:30.990195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e847367-0727-4eb6-9ecd-65d1ebb34e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:30.991415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e847367-0727-4eb6-9ecd-65d1ebb34e1d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.011341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e847367-0727-4eb6-9ecd-65d1ebb34e1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.013426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e847367-0727-4eb6-9ecd-65d1ebb34e1d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.018975 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1245/2471] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:31.020030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.029946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.079795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8207f5c-e857-4cd2-a318-769b685e6a5c tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.080978 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1227/2472] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:30 2022] POST /identity/v3/users => generated 289 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:31.085615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c57ede-71b8-49a2-b257-eaa6c5ccfc00 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.086946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c57ede-71b8-49a2-b257-eaa6c5ccfc00 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.086946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c57ede-71b8-49a2-b257-eaa6c5ccfc00 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.089054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.090053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1228/2473] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:31.090336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.090615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.090892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] PATH_INFO: `/v3/users/75fcd603cceb4d5684d35a1f3bd13c3b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.096695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fcd603cceb4d5684d35a1f3bd13c3b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.100849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.101697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c57ede-71b8-49a2-b257-eaa6c5ccfc00 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.154550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c57ede-71b8-49a2-b257-eaa6c5ccfc00 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.180801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.181634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.181958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.182270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.183059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.184976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.205072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fcd603cceb4d5684d35a1f3bd13c3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.206187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fcd603cceb4d5684d35a1f3bd13c3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.213511 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1229/2474] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:31.214706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:31.216908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.218465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fcd603cceb4d5684d35a1f3bd13c3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.219408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fcd603cceb4d5684d35a1f3bd13c3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.222691 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:31.234374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fcd603cceb4d5684d35a1f3bd13c3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.274759 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1246/2475] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:31 2022] DELETE /identity/v3/users/75fcd603cceb4d5684d35a1f3bd13c3b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:31.282797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.286078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.368733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.371052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.398721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c66da-147e-4d25-842b-94e267b0bc67 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.438114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c2e23a-d10c-45fc-bc2d-0431971722ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.444789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b5bc4-9591-4c59-8d85-c19054bdaccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.445802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b5bc4-9591-4c59-8d85-c19054bdaccc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.446193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b5bc4-9591-4c59-8d85-c19054bdaccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.446723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b5bc4-9591-4c59-8d85-c19054bdaccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.447931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b5bc4-9591-4c59-8d85-c19054bdaccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.451086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b5bc4-9591-4c59-8d85-c19054bdaccc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.466669 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1247/2476] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:31.468302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.468729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.469196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.498408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.499488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.499779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.500057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/3d23d4d199064fa28d20415d13466f59` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.501871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d23d4d199064fa28d20415d13466f59)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.505452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.508130 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1230/2477] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:31 2022] GET /identity/v3/projects/3d23d4d199064fa28d20415d13466f59 => generated 371 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:31.509193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.514443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.526717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:31.528427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.539174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7c6c5f-9c7c-420b-b2a0-8e82185bd94b tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.546774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.548873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.549737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.550581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] PATH_INFO: `/v3/projects/9da754809ec14731ac8070139c05a3a1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.556074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1248/2478] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:31.556074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.558296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da754809ec14731ac8070139c05a3a1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.561653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.575815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ea1ca8-79da-4b57-9d41-3281e3872d22 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.587975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.589996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.590470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.591790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] PATH_INFO: `/v3/projects/ce536fc277d046e3aba647879c9ea3f8/users/b5132fe26e5d4d94a289f71a8c08f9c7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.609643 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:31.619203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce536fc277d046e3aba647879c9ea3f8, user_id=b5132fe26e5d4d94a289f71a8c08f9c7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.625749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.652659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da754809ec14731ac8070139c05a3a1', 'request_id': 'req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.664260 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1249/2479] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:31 2022] PUT /identity/v3/projects/ce536fc277d046e3aba647879c9ea3f8/users/b5132fe26e5d4d94a289f71a8c08f9c7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:31.665591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.667906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.671756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da754809ec14731ac8070139c05a3a1', 'request_id': 'req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.688484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da754809ec14731ac8070139c05a3a1', 'request_id': 'req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.726384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] The token cache is being invalidate because project 9da754809ec14731ac8070139c05a3a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:31.726795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.727905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2bf3f9d0-078c-49f4-a637-a7aa90403bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:31.730876 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1231/2480] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:31 2022] DELETE /identity/v3/projects/9da754809ec14731ac8070139c05a3a1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:31.733859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22394d3-e6d5-4bbc-979a-af3badac4a31 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.734157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22394d3-e6d5-4bbc-979a-af3badac4a31 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.734478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22394d3-e6d5-4bbc-979a-af3badac4a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.761504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e1623-6007-45fc-ae10-2c6130f29915 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.766890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.767804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.768257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.768764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.771816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.774300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d22394d3-e6d5-4bbc-979a-af3badac4a31 None None] MFA Rules not processed for user `b5132fe26e5d4d94a289f71a8c08f9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:31.776718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d22394d3-e6d5-4bbc-979a-af3badac4a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.911606 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:31.930609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.932270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:31.946326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1250/2481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:31.947844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.949740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.956301 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1232/2482] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:31.959166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28335-ff72-4ef3-931e-268048f16654 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.959617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28335-ff72-4ef3-931e-268048f16654 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.960557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e28335-ff72-4ef3-931e-268048f16654 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.963768 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1233/2483] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:31.965163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28335-ff72-4ef3-931e-268048f16654 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:31.967827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80e28335-ff72-4ef3-931e-268048f16654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:31.973486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322bcbb-d521-476c-a724-8a2e74302690 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:31.980484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:31.981683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:31.981850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:31.982115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] PATH_INFO: `/v3/users/d098afec244d44c6a00f01d1284a85b0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:31.983607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d098afec244d44c6a00f01d1284a85b0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:31.986165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.001557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e28335-ff72-4ef3-931e-268048f16654 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.010482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.011643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.012390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.012940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.014388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.018443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.091355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd098afec244d44c6a00f01d1284a85b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:32.092708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd098afec244d44c6a00f01d1284a85b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:32.110460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd098afec244d44c6a00f01d1284a85b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:32.114737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1234/2484] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:31 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:32.117050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd098afec244d44c6a00f01d1284a85b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:32.122912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:32.126893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:32.145199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd098afec244d44c6a00f01d1284a85b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:32.201255 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1251/2485] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:31 2022] DELETE /identity/v3/users/d098afec244d44c6a00f01d1284a85b0 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:32.205153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.211523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:32.312586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.314601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:32.340509 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:32.498418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a2bbf-d882-41f8-83db-51a7cd2f8089 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.514607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512615e-cf3f-4b2d-8878-29296e9d1d3c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.540130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd438f5-2af8-461b-86a8-0738ac7735f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.540906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd438f5-2af8-461b-86a8-0738ac7735f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.541197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd438f5-2af8-461b-86a8-0738ac7735f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.541482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd438f5-2af8-461b-86a8-0738ac7735f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.542218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd438f5-2af8-461b-86a8-0738ac7735f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.547073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd438f5-2af8-461b-86a8-0738ac7735f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.582727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1252/2486] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:32 2022] POST /identity/v3/users => generated 294 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:32.584822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.585173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.585463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.607494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] MFA Rules not processed for user `6f034d6e3a874e9892df5c3188235e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:32.608966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:32.643814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.645753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.646263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.646805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/3d23d4d199064fa28d20415d13466f59` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.649451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d23d4d199064fa28d20415d13466f59)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.654146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.658254 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1235/2487] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:32 2022] GET /identity/v3/projects/3d23d4d199064fa28d20415d13466f59 => generated 371 bytes in 543 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:32.659784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.680618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dadb89-83ad-4067-8138-b6b4962b1777 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.689371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.691152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.691658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.692144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.693815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.697466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.707611 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:32.735793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1236/2488] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:32.739872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.744584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1253/2489] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:32.774768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.785515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786f1621-d8e9-4271-9be0-b834850d81a5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.795639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da5045-f1fa-4d92-bb52-c2474aa55860 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.797513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.798483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.799015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.800828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] PATH_INFO: `/v3/projects/44dd5707ceb14eb58560d139251e0170/users/4869a9131eeb455db3c875778f262c06/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.805604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.806370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.806662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.806947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.807731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:32.808099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.810609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.834022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1254/2490] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:32.834022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.842188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:32.866188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44dd5707ceb14eb58560d139251e0170, user_id=4869a9131eeb455db3c875778f262c06, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.873125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.884649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cddaa98-dc35-45b9-b61f-57619b2de385 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:32.905975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1237/2491] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:32 2022] PUT /identity/v3/projects/44dd5707ceb14eb58560d139251e0170/users/4869a9131eeb455db3c875778f262c06/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:32.905975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:32.908741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:32.911083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:32.911603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:32.912057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] PATH_INFO: `/v3/projects/430349576f4f44e0965c7418709af57a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:32.914263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] RBAC: Authorizing `identity:delete_project(project_id=430349576f4f44e0965c7418709af57a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:32.918508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:32.986740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '430349576f4f44e0965c7418709af57a', 'request_id': 'req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:32.995993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '430349576f4f44e0965c7418709af57a', 'request_id': 'req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.006475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '430349576f4f44e0965c7418709af57a', 'request_id': 'req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.025477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] The token cache is being invalidate because project 430349576f4f44e0965c7418709af57a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:33.025779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.026560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.029569 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1255/2492] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:32 2022] DELETE /identity/v3/projects/430349576f4f44e0965c7418709af57a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:33.030618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.032501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.036845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44004030-cd82-4797-9cb3-c9a3f3876004 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.094857 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:33.136076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.137408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.137852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.138282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.139268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.141918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.143531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633fe0d-86e6-4cf9-9d79-5b0f8448495e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.151469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.160438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.163617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.164015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.164883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.171432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.178750 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1238/2493] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:32 2022] POST /identity/v3/users => generated 381 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:33.186976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.189602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.193543 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1256/2494] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:33.194678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.196970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.215999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c9a4-1bfe-4930-b2c5-a6f044e88355 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.217063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f4925e-fb71-49c7-ac4a-41e6ae7dd752 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.227632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.228602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.229061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.229993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] PATH_INFO: `/v3/users/cb54b0978e7c430da769c747f68a1fb9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.231442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb54b0978e7c430da769c747f68a1fb9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.233676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.239822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.242782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.243130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.244019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.244410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:33.244789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.248119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.299881 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1257/2495] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:33.302549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.322575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb54b0978e7c430da769c747f68a1fb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.337345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb54b0978e7c430da769c747f68a1fb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.342980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68081643-7c80-45e2-aeb8-77ac86c6a5c5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.358630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb54b0978e7c430da769c747f68a1fb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.359498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb54b0978e7c430da769c747f68a1fb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.369411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.370511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d3405d2-5e73-47fa-a41f-5d749c3f082b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb54b0978e7c430da769c747f68a1fb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.374916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.375672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.376163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] PATH_INFO: `/v3/projects/44dd5707ceb14eb58560d139251e0170/users/4869a9131eeb455db3c875778f262c06/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.380445 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1239/2496] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:33 2022] DELETE /identity/v3/users/cb54b0978e7c430da769c747f68a1fb9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:33.390475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44dd5707ceb14eb58560d139251e0170, user_id=4869a9131eeb455db3c875778f262c06, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.403512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.420225 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1258/2497] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:33 2022] PUT /identity/v3/projects/44dd5707ceb14eb58560d139251e0170/users/4869a9131eeb455db3c875778f262c06/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:33.521613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8eb3-6615-4e1b-a9cc-6b34dbecd204 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.521613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8eb3-6615-4e1b-a9cc-6b34dbecd204 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.521613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b8eb3-6615-4e1b-a9cc-6b34dbecd204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.575841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:33.583281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.590771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-997b8eb3-6615-4e1b-a9cc-6b34dbecd204 None None] MFA Rules not processed for user `4869a9131eeb455db3c875778f262c06`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:33.592446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-997b8eb3-6615-4e1b-a9cc-6b34dbecd204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.711600 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:33.758236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83b7b0-3033-463b-90ed-ee1b76de4968 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:33.764290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:33.765668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.766078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.766449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] PATH_INFO: `/v3/projects/64d9c3b0af8243f1a445d7b9e8459c70` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.768328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64d9c3b0af8243f1a445d7b9e8459c70)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:33.772439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:33.782037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1240/2498] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:33.833362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64d9c3b0af8243f1a445d7b9e8459c70', 'request_id': 'req-651ed154-73e8-47b0-8093-3fe91bb1b5c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.842710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64d9c3b0af8243f1a445d7b9e8459c70', 'request_id': 'req-651ed154-73e8-47b0-8093-3fe91bb1b5c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.852810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64d9c3b0af8243f1a445d7b9e8459c70', 'request_id': 'req-651ed154-73e8-47b0-8093-3fe91bb1b5c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.871609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] The token cache is being invalidate because project 64d9c3b0af8243f1a445d7b9e8459c70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:33.872000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.873034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-651ed154-73e8-47b0-8093-3fe91bb1b5c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:33.875211 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1259/2499] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:33 2022] DELETE /identity/v3/projects/64d9c3b0af8243f1a445d7b9e8459c70 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:33.885314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2296b9-5708-4163-9cc4-d80241bfa25e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.885852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2296b9-5708-4163-9cc4-d80241bfa25e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.886323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2296b9-5708-4163-9cc4-d80241bfa25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.907292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3a2296b9-5708-4163-9cc4-d80241bfa25e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:33.908621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a2296b9-5708-4163-9cc4-d80241bfa25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:33.932945 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:33.976093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:33.977060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:33.977610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:33.979919 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1260/2500] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:33.985309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:33.987369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.007043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1241/2501] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:34.016719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.017011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.017660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.058091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:34.061949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.081444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1242/2502] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:34.087302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.106630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aea893-064a-49ae-8bd1-904839b83543 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.113914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.115599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.116611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.118096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.118667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.119222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.121881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:34.122500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.132222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.161713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1243/2503] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:34.165986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.179777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516982a7-7191-4839-8104-986720114ad2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.185657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.186319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.186769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.187061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.187945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.189999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.218502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdddad-6958-484b-bfb7-483e84fad03e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.223851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.225061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.225443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.225818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/3d23d4d199064fa28d20415d13466f59` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.227655 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1244/2504] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:34 2022] POST /identity/v3/projects => generated 393 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:34.228520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d23d4d199064fa28d20415d13466f59)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.231543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.232922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.235458 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1261/2505] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:33 2022] GET /identity/v3/projects/3d23d4d199064fa28d20415d13466f59 => generated 371 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:34.316036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff16f5b-05b3-48f1-b67d-cd47afd3d9c8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.323149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.324105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.324490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.325277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.326114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.329475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.359659 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1245/2506] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:34 2022] POST /identity/v3/users => generated 297 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:34.364987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.371424 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:34.379832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eac2b36-ce0b-489b-b300-a61fa5923144 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.392548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.399593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.400041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.400331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.401621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.403167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.403613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.420578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1262/2507] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:34.421609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.435102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723b30b-dc3d-468b-b0ac-5f220b065727 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.441042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.441750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.442043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.442316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.443124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.445316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.463576 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1263/2508] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:34.464804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.477170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244ad121-85f6-4d39-9899-20675fd797b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.485506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d212e04-1951-4671-b262-b7f2f79b4801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.486225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d212e04-1951-4671-b262-b7f2f79b4801 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.486503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d212e04-1951-4671-b262-b7f2f79b4801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.487521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d212e04-1951-4671-b262-b7f2f79b4801 admin admin] PATH_INFO: `/v3/projects/0a53245bece44905990a019a8cac6e0a/users/9c344ca2596044438f72e07545056a44/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.509869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d212e04-1951-4671-b262-b7f2f79b4801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a53245bece44905990a019a8cac6e0a, user_id=9c344ca2596044438f72e07545056a44, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.512686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d212e04-1951-4671-b262-b7f2f79b4801 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.526653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72380f98-600c-46c2-9ba6-0ce7a7cac668 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.540650 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1264/2509] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:34 2022] PUT /identity/v3/projects/0a53245bece44905990a019a8cac6e0a/users/9c344ca2596044438f72e07545056a44/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:34.552318 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:34.557594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.558074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.558307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.603067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] MFA Rules not processed for user `9c344ca2596044438f72e07545056a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:34.604459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.707792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.708628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.709055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.709543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.713136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.716329 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1265/2510] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:34.723027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.837246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:34.848889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cda2c-691b-434f-8a01-553b9e6c816f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:34.888268 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1246/2511] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:34.890445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.893295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.895151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.904426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1247/2512] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:34 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:34.907564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:34.914115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:34.935757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b1ef4b-a7e5-4e44-a7b1-a36cac5bab43 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:34.957836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:34.958108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:34.959182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:34.959761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:34.960541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:34.980501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.004563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.085478 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1266/2513] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:34 2022] POST /identity/v3/projects => generated 391 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:35.090361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.118317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d4c4-4be9-4354-a6f2-2676237667d3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.182487 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:35.212180 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:35.252240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.255023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.258577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.259723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/3d23d4d199064fa28d20415d13466f59` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.267919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=3d23d4d199064fa28d20415d13466f59)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.272556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.280745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751505-59da-4fee-9525-495554cb1af9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.286657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.287972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.288590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.288804 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1248/2514] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:34 2022] GET /identity/v3/projects/3d23d4d199064fa28d20415d13466f59 => generated 371 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:35.289171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.290050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.292677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.325341 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1267/2515] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:35 2022] POST /identity/v3/users => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:35.325811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.340810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.344243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c9614b-74b5-4f17-af1e-ff52c47a3fc5 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.362377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.363249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.363612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.363958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.364835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.366662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.366876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672fe65-24b3-482a-8def-700c88d7fe4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.380538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.383417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.383773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.384175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/users/d021068ba6d748b987a15f8ee73a9a78` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.386241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1249/2516] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:35.391724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.424282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae3ce3-0eb9-4279-bed6-4e10d24f84ed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.434460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d021068ba6d748b987a15f8ee73a9a78)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.438069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.438069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.438069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.438640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] PATH_INFO: `/v3/projects/e99e7a5e8a484a21b0cae18cd3cb2461/users/f2b18016c04e496895652b6ff2822c63/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.440103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.475489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99e7a5e8a484a21b0cae18cd3cb2461, user_id=f2b18016c04e496895652b6ff2822c63, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.480432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.514500 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1250/2517] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:35 2022] PUT /identity/v3/projects/e99e7a5e8a484a21b0cae18cd3cb2461/users/f2b18016c04e496895652b6ff2822c63/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:35.515876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.533365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd021068ba6d748b987a15f8ee73a9a78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.534328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd021068ba6d748b987a15f8ee73a9a78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.549650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd021068ba6d748b987a15f8ee73a9a78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.551550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd021068ba6d748b987a15f8ee73a9a78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.573097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd021068ba6d748b987a15f8ee73a9a78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.628063 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1268/2518] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:35 2022] DELETE /identity/v3/users/d021068ba6d748b987a15f8ee73a9a78 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:35.629944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:35.635617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:35.741615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e97b6-dae1-4be7-b85b-088aa02c561a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.787794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2be2290-5093-4949-8dd5-7168024e3201 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:35.797536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:35.799165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:35.799747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:35.800301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] PATH_INFO: `/v3/projects/328e699c6ea64ff287af42301a55a8fa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:35.804242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328e699c6ea64ff287af42301a55a8fa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:35.808577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:35.873505 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:35.960705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328e699c6ea64ff287af42301a55a8fa', 'request_id': 'req-ba2d32b4-22d8-47ec-8d91-779d069ed792'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:35.973867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328e699c6ea64ff287af42301a55a8fa', 'request_id': 'req-ba2d32b4-22d8-47ec-8d91-779d069ed792'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.061725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.062892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.063460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.063837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.065323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.075970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328e699c6ea64ff287af42301a55a8fa', 'request_id': 'req-ba2d32b4-22d8-47ec-8d91-779d069ed792'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.078284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.123596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] The token cache is being invalidate because project 328e699c6ea64ff287af42301a55a8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:36.124084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.130650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.136560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1269/2519] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:35 2022] DELETE /identity/v3/projects/328e699c6ea64ff287af42301a55a8fa => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:36.147855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.152393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.154008 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1251/2520] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 639 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:36.155933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.166127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.228706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb9474-199e-480e-a9f5-ac610fa3e81a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.367977 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:36.405733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.411029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.412246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.412921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] PATH_INFO: `/v3/users/b5132fe26e5d4d94a289f71a8c08f9c7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.420576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5132fe26e5d4d94a289f71a8c08f9c7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.426603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.447879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2d32b4-22d8-47ec-8d91-779d069ed792 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.462823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.465523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.466362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.467293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/3d23d4d199064fa28d20415d13466f59` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.474545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d23d4d199064fa28d20415d13466f59)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.488338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.523862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5132fe26e5d4d94a289f71a8c08f9c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.538701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5132fe26e5d4d94a289f71a8c08f9c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.559465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5132fe26e5d4d94a289f71a8c08f9c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.560845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5132fe26e5d4d94a289f71a8c08f9c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.588021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-777ddf2a-8695-4c61-947a-43a0da7f06f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5132fe26e5d4d94a289f71a8c08f9c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.612628 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1252/2521] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:36 2022] DELETE /identity/v3/users/b5132fe26e5d4d94a289f71a8c08f9c7 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:36.614682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a647c00-3bec-447b-8910-b138d5f816fb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.615729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a647c00-3bec-447b-8910-b138d5f816fb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.616196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a647c00-3bec-447b-8910-b138d5f816fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.647126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1a647c00-3bec-447b-8910-b138d5f816fb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:36.649028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a647c00-3bec-447b-8910-b138d5f816fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.657999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d23d4d199064fa28d20415d13466f59', 'request_id': 'req-277e577c-ee56-4839-9879-f0c60910b918'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.675536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d23d4d199064fa28d20415d13466f59', 'request_id': 'req-277e577c-ee56-4839-9879-f0c60910b918'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.724753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d23d4d199064fa28d20415d13466f59', 'request_id': 'req-277e577c-ee56-4839-9879-f0c60910b918'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.755178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] The token cache is being invalidate because project 3d23d4d199064fa28d20415d13466f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:36.755648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.757653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:36.762730 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1270/2522] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:36 2022] DELETE /identity/v3/projects/3d23d4d199064fa28d20415d13466f59 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:36.766328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.776559 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1253/2523] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:36.776559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747863-f934-4218-80c1-7c6849d4ee35 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.776559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747863-f934-4218-80c1-7c6849d4ee35 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.776559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed747863-f934-4218-80c1-7c6849d4ee35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.784222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.815441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ed747863-f934-4218-80c1-7c6849d4ee35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:36.816561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e577c-ee56-4839-9879-f0c60910b918 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:36.819723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed747863-f934-4218-80c1-7c6849d4ee35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.824508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058855ef-3040-484c-85e5-570b07bc224f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:36.825495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058855ef-3040-484c-85e5-570b07bc224f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.825832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058855ef-3040-484c-85e5-570b07bc224f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.826112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058855ef-3040-484c-85e5-570b07bc224f admin admin] PATH_INFO: `/v3/projects/e99e7a5e8a484a21b0cae18cd3cb2461/users/f2b18016c04e496895652b6ff2822c63/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.833738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058855ef-3040-484c-85e5-570b07bc224f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99e7a5e8a484a21b0cae18cd3cb2461, user_id=f2b18016c04e496895652b6ff2822c63, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:36.841695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058855ef-3040-484c-85e5-570b07bc224f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:36.853633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1254/2524] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:36.858995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8d5c-6242-4602-832e-2f334e1dd34c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.859573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8d5c-6242-4602-832e-2f334e1dd34c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.860617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e8d5c-6242-4602-832e-2f334e1dd34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.879112 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1271/2525] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:36 2022] PUT /identity/v3/projects/e99e7a5e8a484a21b0cae18cd3cb2461/users/f2b18016c04e496895652b6ff2822c63/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:36.879112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe12e-3383-45a3-8c2d-fae39ba14eb3 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:36.879112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe12e-3383-45a3-8c2d-fae39ba14eb3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:36.879112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdbe12e-3383-45a3-8c2d-fae39ba14eb3 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:36.879112 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1272/2526] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:36.879112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe12e-3383-45a3-8c2d-fae39ba14eb3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:36.879811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9bdbe12e-3383-45a3-8c2d-fae39ba14eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.915954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-740e8d5c-6242-4602-832e-2f334e1dd34c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:36.919671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-740e8d5c-6242-4602-832e-2f334e1dd34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:36.992038 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:37.051042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdbe12e-3383-45a3-8c2d-fae39ba14eb3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:37.082796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:37.084366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.090786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.091406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.162599 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1255/2527] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:37.162599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.163565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.167363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.233542 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:37.258187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] MFA Rules not processed for user `f2b18016c04e496895652b6ff2822c63`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:37.259595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:37.278332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:37.279771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:37.304186 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1273/2528] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:37.305654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:37.310621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:37.446089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1256/2529] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:37.447032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:37.479752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d736c8b-828c-4630-be4d-451e5832ed7d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:37.496208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:37.497417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:37.499718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.499893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:37.500321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.500925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.501876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:37.502359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:37.504633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fa682-8676-4b94-90c2-dc06cd37ba8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:37.547432 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1257/2530] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:37.549215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d48c7-85ce-43f6-8216-c9884778f021 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.549576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d48c7-85ce-43f6-8216-c9884778f021 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.549828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d48c7-85ce-43f6-8216-c9884778f021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.591594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-196d48c7-85ce-43f6-8216-c9884778f021 None None] MFA Rules not processed for user `9c344ca2596044438f72e07545056a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:37.593175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-196d48c7-85ce-43f6-8216-c9884778f021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:37.646849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bdd871-c261-4df7-a9f7-18d14c967b9a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:37.659730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:37.660804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.661154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.661499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.663172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce58084b8c3f46af9e6aa254dc4ec6e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:37.665479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:37.696713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1274/2531] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:37 2022] GET /identity/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6 => generated 373 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:37.698564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:37.718255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eba156-9572-4d54-81ae-b34c9bfa70a8 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:37.729687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:37.731179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.731834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.733033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.734601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:37.739231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:37.752430 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1258/2532] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:37.759062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:37.759399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:37.759853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:37.769152 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1259/2533] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:37 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:37.771144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:37.773205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:37.773518 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:37.810256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1275/2534] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:37 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:37.812860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:37.815952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:37.842975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e7a2af-af22-4a87-87ed-4f6f3ff52c8b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.016577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.018186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.020687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.021416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.027000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce58084b8c3f46af9e6aa254dc4ec6e6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.038103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.071191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1260/2535] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:37 2022] GET /identity/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6 => generated 373 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:38.073343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c49fd90-0599-4944-a7bc-09e455d99fe3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.074361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.083857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.085250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.085762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.086328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.090334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:38.138481 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:38.219567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd1984-d932-48ae-bcac-3cba60f0eac2 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.236896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.237942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.238520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.239321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.240170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.243327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.285838 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1261/2536] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:38 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:38.291879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.310243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46b7a46-6d64-47c6-af99-31b7718992ed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.329569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.334322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.335786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.340242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.342896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.343431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.350535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.359068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.372444 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1276/2537] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:38.437953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.442379 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1262/2538] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:38.458780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcf2b1-5f89-4a28-a89a-c6f01ad80240 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.487790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.490679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.492565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.493051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.494344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.500852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.557319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1277/2539] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:38.566469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.587433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.589053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602254a6-43ef-4d48-a196-81c3a9282d22 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.589487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:38.611781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0043b5c-7a05-413f-832d-5d47df3e2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.614202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043b5c-7a05-413f-832d-5d47df3e2ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.614558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043b5c-7a05-413f-832d-5d47df3e2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.615125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0043b5c-7a05-413f-832d-5d47df3e2ba0 admin admin] PATH_INFO: `/v3/projects/b6ac8324fec44f9ba74b5c7f56e5bb17/users/71f3af124f8140ed86c95ddf73a0289f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.625555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32a8eb1-bb06-4adc-b095-d5d3885d03ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:38.652074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:38.653163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.653418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.659083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] PATH_INFO: `/v3/projects/ce536fc277d046e3aba647879c9ea3f8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.661323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce536fc277d046e3aba647879c9ea3f8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.663461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.668115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043b5c-7a05-413f-832d-5d47df3e2ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ac8324fec44f9ba74b5c7f56e5bb17, user_id=71f3af124f8140ed86c95ddf73a0289f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:38.670942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0043b5c-7a05-413f-832d-5d47df3e2ba0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:38.698933 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1263/2540] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:38 2022] PUT /identity/v3/projects/b6ac8324fec44f9ba74b5c7f56e5bb17/users/71f3af124f8140ed86c95ddf73a0289f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:38.724788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:38.725266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:38.725697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:38.788172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] MFA Rules not processed for user `71f3af124f8140ed86c95ddf73a0289f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:38.789756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:38.809171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce536fc277d046e3aba647879c9ea3f8', 'request_id': 'req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:38.817877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce536fc277d046e3aba647879c9ea3f8', 'request_id': 'req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:38.842573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce536fc277d046e3aba647879c9ea3f8', 'request_id': 'req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:38.882241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] The token cache is being invalidate because project ce536fc277d046e3aba647879c9ea3f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:38.882542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:38.885171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:38.895694 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1278/2541] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:38 2022] DELETE /identity/v3/projects/ce536fc277d046e3aba647879c9ea3f8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:38.897495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.899344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:38.907213 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:38.977118 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1264/2542] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:38.983517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:38.987879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:39.024600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0b541-cb4b-4e8b-ae82-6a4bd478a349 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.033649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.035524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.038231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.039034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] PATH_INFO: `/v3/users/4869a9131eeb455db3c875778f262c06` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.084987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4869a9131eeb455db3c875778f262c06)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.095999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.148629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd43b4-fb82-4780-bcde-1cb15023625c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.155189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.155719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.156003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.156454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.158734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.162546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.201090 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:39.219220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4869a9131eeb455db3c875778f262c06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:39.221061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4869a9131eeb455db3c875778f262c06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:39.237220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4869a9131eeb455db3c875778f262c06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:39.238166 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1265/2543] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:38 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:39.238817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4869a9131eeb455db3c875778f262c06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:39.244995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:39.247652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:39.273861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4869a9131eeb455db3c875778f262c06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:39.315044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1279/2544] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:38 2022] DELETE /identity/v3/users/4869a9131eeb455db3c875778f262c06 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:39.398402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226bc583-264b-460a-b511-965ee84ff1d8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.512453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.513495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.513762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.514021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.514756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.516849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.544824 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1266/2545] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:39 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:39.549089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:39.562709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b775-3309-4a48-b3b0-dbb46112bd27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.570501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.572185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.572620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.573033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.574821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.577491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.593530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1280/2546] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:39.598212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:39.611428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87444ae-068f-4b45-8e1a-5b78f59f79c8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.617145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.618300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.618949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.618949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] PATH_INFO: `/v3/projects/1f933eb87d234c8ba42cc89785693cee/users/5192698440014f7f86c89a0a6c584e43/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.647595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f933eb87d234c8ba42cc89785693cee, user_id=5192698440014f7f86c89a0a6c584e43, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.651223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.669902 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1267/2547] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:39 2022] PUT /identity/v3/projects/1f933eb87d234c8ba42cc89785693cee/users/5192698440014f7f86c89a0a6c584e43/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:39.674504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:39.686251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17073df-c017-4ad2-96e3-6d36cbffadc7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.780324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f5e2a-4fdf-4ad1-9d75-ec157a98338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.789341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5e2a-4fdf-4ad1-9d75-ec157a98338b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.790408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5e2a-4fdf-4ad1-9d75-ec157a98338b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.791878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f5e2a-4fdf-4ad1-9d75-ec157a98338b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.792728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f5e2a-4fdf-4ad1-9d75-ec157a98338b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.794672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f5e2a-4fdf-4ad1-9d75-ec157a98338b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.811810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1281/2548] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:39.814542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:39.833387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c2659-ca78-4424-a19a-e7e0a71b9d8b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:39.848398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c771af78-9b10-46df-aaf2-98c026169921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:39.851007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771af78-9b10-46df-aaf2-98c026169921 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.851601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771af78-9b10-46df-aaf2-98c026169921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.852310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c771af78-9b10-46df-aaf2-98c026169921 admin admin] PATH_INFO: `/v3/projects/1f933eb87d234c8ba42cc89785693cee/users/5192698440014f7f86c89a0a6c584e43/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.856749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771af78-9b10-46df-aaf2-98c026169921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f933eb87d234c8ba42cc89785693cee, user_id=5192698440014f7f86c89a0a6c584e43, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:39.864949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c771af78-9b10-46df-aaf2-98c026169921 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:39.924392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1268/2549] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:39 2022] PUT /identity/v3/projects/1f933eb87d234c8ba42cc89785693cee/users/5192698440014f7f86c89a0a6c584e43/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:39.932752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:39.933339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:39.934180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:39.958185 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:39.999165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] MFA Rules not processed for user `5192698440014f7f86c89a0a6c584e43`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:40.003254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:40.197060 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1282/2550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:40.357269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:40.357987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:40.358435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:40.361534 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1269/2551] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:40.369262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:40.371561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:40.373738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:40.376647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:40.523246 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:40.585049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad1fdf3-cfba-4ac1-87b9-35d91d4f373e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:40.592988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:40.597010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:40.597257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:40.598430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:40.598968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:40.599658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:40.613041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:40.616032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:40.638976 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1283/2552] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:40.640187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:40.642252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:40.762612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffcec38-ae7a-4b94-9e3d-3b445fde3e9f service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:40.769016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:40.770015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:40.770619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:40.771216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] PATH_INFO: `/v3/projects/44dd5707ceb14eb58560d139251e0170` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:40.773068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=44dd5707ceb14eb58560d139251e0170)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:40.776276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:40.817304 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:40.817616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021df51e-2b65-4600-99ae-60fdcf697f78 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:40.828920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac91a00-b9ed-4b11-8a54-e986ba5bff62 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '31e78bf0ff4b4028a362578682892230', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f790294c961f4152b074979381040e56', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:40.829901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91a00-b9ed-4b11-8a54-e986ba5bff62 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:40.830515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91a00-b9ed-4b11-8a54-e986ba5bff62 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:40.830778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac91a00-b9ed-4b11-8a54-e986ba5bff62 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] PATH_INFO: `/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:40.832755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac91a00-b9ed-4b11-8a54-e986ba5bff62 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorizing `identity:get_project(project_id=ce58084b8c3f46af9e6aa254dc4ec6e6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:40.834945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac91a00-b9ed-4b11-8a54-e986ba5bff62 tempest-QuotasAdminTestJSON-1581725239 tempest-QuotasAdminTestJSON-1581725239-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:40.850901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1270/2553] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:40 2022] GET /identity/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6 => generated 373 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:40.899838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44dd5707ceb14eb58560d139251e0170', 'request_id': 'req-35d4b256-70ee-49b8-bc42-1796125c35ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:40.917359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44dd5707ceb14eb58560d139251e0170', 'request_id': 'req-35d4b256-70ee-49b8-bc42-1796125c35ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:40.948232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44dd5707ceb14eb58560d139251e0170', 'request_id': 'req-35d4b256-70ee-49b8-bc42-1796125c35ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:40.981507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] The token cache is being invalidate because project 44dd5707ceb14eb58560d139251e0170 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:40.981853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:40.985884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-35d4b256-70ee-49b8-bc42-1796125c35ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:41.003813 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1284/2554] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:40 2022] DELETE /identity/v3/projects/44dd5707ceb14eb58560d139251e0170 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:41.005165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.005641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.006021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.028421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:41.030318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:41.152386 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1271/2555] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:41.154381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.154889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.155323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.200926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:41.203002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:41.219623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1285/2556] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:41.225703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.247247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cf6b8-6b7c-4471-b28b-2d917b64fb6c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:41.273988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:41.275085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.276685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.277708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.280600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:41.281123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:41.284579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:41.306288 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1272/2557] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:41.310086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.327234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba1a4f8-3fbe-4467-a31c-a8a02b441e11 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:41.341187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:41.342917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.343218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.345281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.346217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:41.353695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:41.408399 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1286/2558] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:41 2022] POST /identity/v3/projects => generated 413 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:41.409632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.422688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3de28e-5438-40d2-836d-bd3365f042eb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:41.587400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:41.590776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.591442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.591888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.593219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:41.606449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:41.611247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.614136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:41.650397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5a8ec-bbd3-42db-bba0-25ac72622d37 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:41.656229 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1273/2559] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:41 2022] POST /identity/v3/users => generated 307 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:41.657888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.664959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:41.674138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.674912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.675396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] PATH_INFO: `/v3/users/0da28d6c7d1e4acab715aea907dad887` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.679318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0da28d6c7d1e4acab715aea907dad887)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:41.681657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e604e-8736-4e7a-b0ca-ad9da67d3dfd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:41.687463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:41.700407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:41.706765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:41.707218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:41.709777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:41.710611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:41.718939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:41.727814 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:41.757043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1274/2560] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:41.758852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.761803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:41.837600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0da28d6c7d1e4acab715aea907dad887'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:41.838380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0da28d6c7d1e4acab715aea907dad887'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:41.867796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0da28d6c7d1e4acab715aea907dad887'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:41.877596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0da28d6c7d1e4acab715aea907dad887'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:41.903913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0da28d6c7d1e4acab715aea907dad887'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:41.977521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db3c8c-e0ff-4a8b-9d20-9914ff1c5b8f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:41.984611 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1287/2561] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:41 2022] DELETE /identity/v3/users/0da28d6c7d1e4acab715aea907dad887 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:41.987559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:41.997133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.109374 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:42.132935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390315b-c7be-4acb-a8dc-0c6791ce4303 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:42.143061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366500d-86b0-46af-b290-c8896416b114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.144152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366500d-86b0-46af-b290-c8896416b114 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.144660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366500d-86b0-46af-b290-c8896416b114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.145137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366500d-86b0-46af-b290-c8896416b114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.146402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366500d-86b0-46af-b290-c8896416b114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.149058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c366500d-86b0-46af-b290-c8896416b114 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:42.150255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.151329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.152077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.153017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.154024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:42.154604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.158502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:42.176375 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1288/2562] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:42.178738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.180758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.181264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.200060 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1275/2563] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:42.205219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.224293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c138b9f5-252e-4128-9d94-8530a6a2da48 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:42.230180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.231184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.231488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.231787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] PATH_INFO: `/v3/projects/ef0c3ff13c6e4bf590962fc683f0a5a0/users/0b06170e53ba4047b500b0a55f5b0210/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.258337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef0c3ff13c6e4bf590962fc683f0a5a0, user_id=0b06170e53ba4047b500b0a55f5b0210, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.275667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:42.340539 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1276/2564] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:42 2022] PUT /identity/v3/projects/ef0c3ff13c6e4bf590962fc683f0a5a0/users/0b06170e53ba4047b500b0a55f5b0210/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:42.342227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.345823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.404293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:42.406064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.467905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f6d3da-bb4e-4f2a-b5d4-6032e5996f04 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:42.473308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a908f1-b8ba-409b-a7f7-40ba64f519e9 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.474123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a908f1-b8ba-409b-a7f7-40ba64f519e9 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.474508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a908f1-b8ba-409b-a7f7-40ba64f519e9 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.474887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a908f1-b8ba-409b-a7f7-40ba64f519e9 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.475711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a908f1-b8ba-409b-a7f7-40ba64f519e9 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.477848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a908f1-b8ba-409b-a7f7-40ba64f519e9 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:42.510641 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:42.523404 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1277/2565] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:42 2022] POST /identity/v3/projects => generated 371 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:42.525187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.525742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.526060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.541208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1289/2566] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:42.542767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.546822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.550349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:42.552563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.574291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e168b42-a32f-4b1e-9e42-af37624a69ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:42.648496 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1278/2567] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:42.649479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.705197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.706736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.707245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.707713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] PATH_INFO: `/v3/users/71f3af124f8140ed86c95ddf73a0289f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.710220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71f3af124f8140ed86c95ddf73a0289f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.713363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:42.767262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9189f92e-8224-4157-ab38-8b35b4a5ac22 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:42.780079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:42.782472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:42.783348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:42.784165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:42.786213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:42.786892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:42.795917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:42.810258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71f3af124f8140ed86c95ddf73a0289f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:42.811002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71f3af124f8140ed86c95ddf73a0289f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:42.816633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1279/2568] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:42.818056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.821021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.822649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71f3af124f8140ed86c95ddf73a0289f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:42.823552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71f3af124f8140ed86c95ddf73a0289f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:42.866985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71f3af124f8140ed86c95ddf73a0289f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:42.918713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1290/2569] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:42 2022] DELETE /identity/v3/users/71f3af124f8140ed86c95ddf73a0289f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:42.921168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:42.925128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:42.944677 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:42.976747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77843072-48aa-4eb3-8167-b08f1454784f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:43.072528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714980d8-b5f3-4625-a285-fb623f6cd873 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:43.077005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:43.078562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.079089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.079261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.082222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:43.102057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:43.103411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.104003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.104623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.116687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:43.129939 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:43.206059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:43.207910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:43.229587 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1291/2570] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:43.236211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:43.242147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:43.379427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:43.382473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864e45f8-2646-4e5c-848d-f77f93a2745b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:43.431999 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1280/2571] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:43.434380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.434657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2faaa-b5d9-495e-8cf7-cc1cbc0d18fc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:43.435487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.435487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.466807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:43.467999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.468589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.469140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.472523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:43.534153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:43.536250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:43.561077 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1281/2572] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:43.614083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:43.616579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:43.659025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28bcfd-e72e-4912-8d5c-4db031aa9690 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:43.674756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51cffa0-84d4-49a8-a599-f5f418105f5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:43.675807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cffa0-84d4-49a8-a599-f5f418105f5f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.676273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cffa0-84d4-49a8-a599-f5f418105f5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.676778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51cffa0-84d4-49a8-a599-f5f418105f5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.701867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:43.716306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cffa0-84d4-49a8-a599-f5f418105f5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:43.719140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51cffa0-84d4-49a8-a599-f5f418105f5f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:43.759354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:43.761369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:43.767633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1282/2573] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:43.806004 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1292/2574] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:43 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:43.860376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cbd75-8765-4880-8433-8d946b630ec8 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.861188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cbd75-8765-4880-8433-8d946b630ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.861853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cbd75-8765-4880-8433-8d946b630ec8 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.864828 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1283/2575] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:43.875215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:43.913644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:43.955600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6ea9c-0a70-4012-b150-0aa62bdb858e service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:43.977060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:43.978759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:43.979386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:43.980179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/projects/138586fa4a5a4310a55cd62240d0e1a4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:43.997623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:get_project(project_id=138586fa4a5a4310a55cd62240d0e1a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:44.001884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:44.012993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1293/2576] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:43 2022] GET /identity/v3/projects/138586fa4a5a4310a55cd62240d0e1a4 => generated 371 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:44.562693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ea83-6d8d-41da-80d5-6ad8f131a3b0 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:44.563497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ea83-6d8d-41da-80d5-6ad8f131a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:44.566027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47ea83-6d8d-41da-80d5-6ad8f131a3b0 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:44.569365 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1284/2577] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:44.579487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:44.582413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:44.636949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:44.667496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a62074-8ef8-49c3-86d5-e8285af0966b tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:44.675770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:44.678004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:44.678815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:44.679527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/projects/138586fa4a5a4310a55cd62240d0e1a4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:44.682329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:get_project(project_id=138586fa4a5a4310a55cd62240d0e1a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:44.687219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:44.704497 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1294/2578] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:44 2022] GET /identity/v3/projects/138586fa4a5a4310a55cd62240d0e1a4 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:44.792930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47ea83-6d8d-41da-80d5-6ad8f131a3b0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:44.863345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47ea83-6d8d-41da-80d5-6ad8f131a3b0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:44.888814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:44.890468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:44.891324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:44.892092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:44.894929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:44.896013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:44.899732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:44.925482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1285/2579] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:44.933188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:44.958817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ee04d3-8524-496b-b78a-753ae9e196a7 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:44.985047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:44.986692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:44.989426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:44.990326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:44.992075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:44.996621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:45.060940 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1295/2580] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:44 2022] POST /identity/v3/users => generated 381 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:45.063109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:45.096959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f1df5-35a2-4ce9-a943-130ca624d54f tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:45.118257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:45.123586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:45.124551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:45.126039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:45.130664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:45.133783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:45.139211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c609d2e6-4177-484a-b6fd-5448033038f0 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:45.203004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1286/2581] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:45.394905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:45.397884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:45.449739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f94e8c-22f1-4f72-a7e7-0cfc9fc3f27c tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:45.469309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:45.470897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:45.471369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:45.471847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] PATH_INFO: `/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:45.484338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce58084b8c3f46af9e6aa254dc4ec6e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:45.484640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:45.605226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e952cf-50af-4979-941f-85ac6f932bc5 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:45.607533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e952cf-50af-4979-941f-85ac6f932bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:45.608532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e952cf-50af-4979-941f-85ac6f932bc5 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:45.612174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1287/2582] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:45 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:45.633396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e952cf-50af-4979-941f-85ac6f932bc5 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:45.682910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce58084b8c3f46af9e6aa254dc4ec6e6', 'request_id': 'req-7f5ac18a-5dba-447f-baa1-078e441c3436'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:45.712124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce58084b8c3f46af9e6aa254dc4ec6e6', 'request_id': 'req-7f5ac18a-5dba-447f-baa1-078e441c3436'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:45.755372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce58084b8c3f46af9e6aa254dc4ec6e6', 'request_id': 'req-7f5ac18a-5dba-447f-baa1-078e441c3436'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:45.804147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] The token cache is being invalidate because project ce58084b8c3f46af9e6aa254dc4ec6e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:45.805117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:45.811103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:45.825959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1296/2583] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:45 2022] DELETE /identity/v3/projects/ce58084b8c3f46af9e6aa254dc4ec6e6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:45.832273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:45.835378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:45.966352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e952cf-50af-4979-941f-85ac6f932bc5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:46.143344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ac18a-5dba-447f-baa1-078e441c3436 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:46.165499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:46.167283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:46.167766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:46.168246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] PATH_INFO: `/v3/users/31e78bf0ff4b4028a362578682892230` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:46.171936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31e78bf0ff4b4028a362578682892230)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:46.175779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:46.227908 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:46.303205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e952cf-50af-4979-941f-85ac6f932bc5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:46.311202 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:46.325540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:46.344252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:46.345283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:46.345283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/projects/138586fa4a5a4310a55cd62240d0e1a4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:46.350962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:get_project(project_id=138586fa4a5a4310a55cd62240d0e1a4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:46.354707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31e78bf0ff4b4028a362578682892230'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:46.356586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31e78bf0ff4b4028a362578682892230'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:46.366852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:46.376649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31e78bf0ff4b4028a362578682892230'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:46.377769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31e78bf0ff4b4028a362578682892230'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:46.380384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1288/2584] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:45 2022] GET /identity/v3/projects/138586fa4a5a4310a55cd62240d0e1a4 => generated 371 bytes in 747 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:46.406341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d28a9db7-f7e1-4de2-a5c0-e62d0a7b4105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31e78bf0ff4b4028a362578682892230'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:46.472176 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1297/2585] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:45 2022] DELETE /identity/v3/users/31e78bf0ff4b4028a362578682892230 => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:46.764865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:46.774073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:46.821217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:46.822240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:46.822824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:46.825804 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1298/2586] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:46.826797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369211d-cef2-4881-aba4-b15eec45a8cb tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:46.846785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:46.849403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:47.057067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:47.063151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:47.064397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:47.064867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] PATH_INFO: `/v3/projects/b6ac8324fec44f9ba74b5c7f56e5bb17` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:47.065985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:47.067429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:47.072095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ac8324fec44f9ba74b5c7f56e5bb17)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:47.087825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:47.173759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c111d-0fe7-4827-8e3e-9d255f925583 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:47.190132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:47.191423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:47.191984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:47.192515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/projects/138586fa4a5a4310a55cd62240d0e1a4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:47.196560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:get_project(project_id=138586fa4a5a4310a55cd62240d0e1a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:47.199176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:47.205928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1299/2587] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:46 2022] GET /identity/v3/projects/138586fa4a5a4310a55cd62240d0e1a4 => generated 371 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:47.314437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:47.327491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ac8324fec44f9ba74b5c7f56e5bb17', 'request_id': 'req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.329117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961ad5-fda5-4828-971c-764a5bff6fa6 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:47.362626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ac8324fec44f9ba74b5c7f56e5bb17', 'request_id': 'req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.425079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ac8324fec44f9ba74b5c7f56e5bb17', 'request_id': 'req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.460630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] The token cache is being invalidate because project b6ac8324fec44f9ba74b5c7f56e5bb17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:47.461268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.462462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.469835 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1289/2588] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:46 2022] DELETE /identity/v3/projects/b6ac8324fec44f9ba74b5c7f56e5bb17 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:47.471493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:47.474383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:47.494333 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:47.508032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:47.509447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:47.510604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:47.511417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/users/f7e40884c13a4783a56801e11f40e045` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:47.530185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f7e40884c13a4783a56801e11f40e045)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:47.534412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:47.613645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e40884c13a4783a56801e11f40e045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.622881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e40884c13a4783a56801e11f40e045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.637479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d2ffa-3ee0-4494-a3bf-f9c105d88a59 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:47.641020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e40884c13a4783a56801e11f40e045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.642513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e40884c13a4783a56801e11f40e045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.650268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:47.654561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:47.655271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:47.656004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] PATH_INFO: `/v3/users/5192698440014f7f86c89a0a6c584e43` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:47.659523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e40884c13a4783a56801e11f40e045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.660127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5192698440014f7f86c89a0a6c584e43)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:47.664307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:47.731269 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:47.755426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1300/2589] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:47 2022] DELETE /identity/v3/users/f7e40884c13a4783a56801e11f40e045 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:47.757343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:47.759144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:47.808606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5192698440014f7f86c89a0a6c584e43'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.825751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5192698440014f7f86c89a0a6c584e43'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.901170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5192698440014f7f86c89a0a6c584e43'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.902606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5192698440014f7f86c89a0a6c584e43'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.935212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5192698440014f7f86c89a0a6c584e43'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:47.956457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1290/2590] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:47 2022] DELETE /identity/v3/users/5192698440014f7f86c89a0a6c584e43 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:48.000084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a69ad8-5ff2-483c-a795-2fccb42d6f27 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:48.128512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd4aaba47d9bb424eadbe07b47bb6011f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a2df7ec89476462dbf6e794e17e0c82e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:48.129747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:48.130153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:48.130530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] PATH_INFO: `/v3/projects/138586fa4a5a4310a55cd62240d0e1a4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:48.134051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorizing `identity:delete_project(project_id=138586fa4a5a4310a55cd62240d0e1a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:48.138363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:48.160938 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:48.259197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138586fa4a5a4310a55cd62240d0e1a4', 'request_id': 'req-0233b6e2-37b6-42e6-bde6-07c27905a004'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.275157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138586fa4a5a4310a55cd62240d0e1a4', 'request_id': 'req-0233b6e2-37b6-42e6-bde6-07c27905a004'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.287936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138586fa4a5a4310a55cd62240d0e1a4', 'request_id': 'req-0233b6e2-37b6-42e6-bde6-07c27905a004'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.322252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] The token cache is being invalidate because project 138586fa4a5a4310a55cd62240d0e1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:48.322521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.323816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0233b6e2-37b6-42e6-bde6-07c27905a004 tempest-QuotasAdminTestV236-511051415 tempest-QuotasAdminTestV236-511051415-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.326922 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1301/2591] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:47 2022] DELETE /identity/v3/projects/138586fa4a5a4310a55cd62240d0e1a4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:48.333847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:48.335725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:48.471751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b6bc1-288c-49ab-ace9-c2eed2273bf8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:48.618876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:48.620021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:48.620306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:48.620674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] PATH_INFO: `/v3/users/a100b52a9543441ca9f2f413e48a0d90` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:48.624521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a100b52a9543441ca9f2f413e48a0d90)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:48.627735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:48.737275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a100b52a9543441ca9f2f413e48a0d90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.745349 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:48.759136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a100b52a9543441ca9f2f413e48a0d90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.801680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a100b52a9543441ca9f2f413e48a0d90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.803253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a100b52a9543441ca9f2f413e48a0d90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.819716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a100b52a9543441ca9f2f413e48a0d90'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:48.846078 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1291/2592] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:48 2022] DELETE /identity/v3/users/a100b52a9543441ca9f2f413e48a0d90 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:48.850611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:48.851144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:48.851572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:48.891776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:48.893776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:49.029731 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1302/2593] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:49.077425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:49.079108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:49.097355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:49.099804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:49.143965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccff8709-7254-411f-8cb0-118708f0e9e5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:49.160792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:49.162459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:49.162945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:49.163435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] PATH_INFO: `/v3/projects/f790294c961f4152b074979381040e56` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:49.169762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f790294c961f4152b074979381040e56)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:49.174150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:49.322486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e42b-1988-4cd8-89fe-e779a8b944d9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:49.339015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088bb6f-c3e5-41d4-a0cd-7b4fe212351c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:49.340172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088bb6f-c3e5-41d4-a0cd-7b4fe212351c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:49.340671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088bb6f-c3e5-41d4-a0cd-7b4fe212351c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:49.341160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088bb6f-c3e5-41d4-a0cd-7b4fe212351c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:49.375260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f790294c961f4152b074979381040e56', 'request_id': 'req-75fa9275-f1ea-469e-bbcd-0deb2365b282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:49.381862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088bb6f-c3e5-41d4-a0cd-7b4fe212351c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:49.385507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f790294c961f4152b074979381040e56', 'request_id': 'req-75fa9275-f1ea-469e-bbcd-0deb2365b282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:49.385952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088bb6f-c3e5-41d4-a0cd-7b4fe212351c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:49.397739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f790294c961f4152b074979381040e56', 'request_id': 'req-75fa9275-f1ea-469e-bbcd-0deb2365b282'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:49.422994 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1292/2594] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:49.427938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] The token cache is being invalidate because project f790294c961f4152b074979381040e56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:49.428314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:49.434353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75fa9275-f1ea-469e-bbcd-0deb2365b282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:49.436752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1303/2595] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:49 2022] DELETE /identity/v3/projects/f790294c961f4152b074979381040e56 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:49.446902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:49.447361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:49.447822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:49.502980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:49.508239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:49.713023 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1293/2596] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:49.724791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:49.725079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:49.725352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:49.761411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:49.769080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:49.817101 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1304/2597] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:49.817314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:49.840802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c36125-b4e6-4fca-8c85-815bedc62fe4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:49.858468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:49.860292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:49.861125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:49.861740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:49.864806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:49.865543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:49.871372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:49.922974 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1294/2598] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:49.928254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:49.971731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d2b0aa-f668-4e2d-9bb4-63adcfff79ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.005765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:50.007570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.008577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.009348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.011049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:50.018882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:50.044437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.070287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:50.075847 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:50.099103 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1305/2599] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:49 2022] POST /identity/v3/projects => generated 383 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:50.101765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9b56f3-0a73-4d55-85f5-107a165672e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.105692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.224505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff94cf9-46bf-446a-84f7-1b01c7dc5a5a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.233090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:50.234622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.234622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.234622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.235597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:50.238307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:50.294339 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1306/2600] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:50 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:50.296513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.333722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5c118-5379-4e51-8e65-35b097290fcb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.346037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:50.347442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.348154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.350420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.353649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:50.357087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:50.359364 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:50.380950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:50.383751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.384683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.385502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] PATH_INFO: `/v3/projects/1f933eb87d234c8ba42cc89785693cee` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.388379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f933eb87d234c8ba42cc89785693cee)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:50.393812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:50.399872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1307/2601] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:50.403982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.435500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007711a2-2891-4573-8199-2d75654f3860 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.444790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:50.445888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.446367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.446839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.449240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:50.454985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:50.504994 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1308/2602] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:50.509292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.528191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f933eb87d234c8ba42cc89785693cee', 'request_id': 'req-44cc374f-14c7-4f39-a650-725263d56195'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:50.532928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c34cf-59f4-4263-974b-8f932be6bc03 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.545450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f933eb87d234c8ba42cc89785693cee', 'request_id': 'req-44cc374f-14c7-4f39-a650-725263d56195'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:50.565693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f933eb87d234c8ba42cc89785693cee', 'request_id': 'req-44cc374f-14c7-4f39-a650-725263d56195'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:50.590642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] The token cache is being invalidate because project 1f933eb87d234c8ba42cc89785693cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:50.591214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:50.592810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44cc374f-14c7-4f39-a650-725263d56195 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:50.597879 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1295/2603] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:50 2022] DELETE /identity/v3/projects/1f933eb87d234c8ba42cc89785693cee => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:50.606234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.606901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.607525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.660668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:50.663435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:50.726460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1112e385-43f9-4165-bfe2-11c1ccbbb74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:50.732899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112e385-43f9-4165-bfe2-11c1ccbbb74b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.733436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112e385-43f9-4165-bfe2-11c1ccbbb74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.733932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1112e385-43f9-4165-bfe2-11c1ccbbb74b admin admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a/users/b3ba35f3b2eb476ab15a311d7685e071/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:50.845146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112e385-43f9-4165-bfe2-11c1ccbbb74b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17b79edd522c45029f3fe83a0366740a, user_id=b3ba35f3b2eb476ab15a311d7685e071, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:50.858840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1112e385-43f9-4165-bfe2-11c1ccbbb74b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:50.898186 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1296/2604] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:50.899368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:50.909773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:50.956975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29952e6-e685-449f-9a47-eb68de5992dc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:50.991714 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1309/2605] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:50 2022] PUT /identity/v3/projects/17b79edd522c45029f3fe83a0366740a/users/b3ba35f3b2eb476ab15a311d7685e071/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:50.994267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3c3f-bd22-410a-9e90-351e574692ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:50.994721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3c3f-bd22-410a-9e90-351e574692ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:50.995264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a3c3f-bd22-410a-9e90-351e574692ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:51.098681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-720a3c3f-bd22-410a-9e90-351e574692ad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:51.106811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-720a3c3f-bd22-410a-9e90-351e574692ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.271279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:51.272534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:51.273032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:51.273518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] PATH_INFO: `/v3/projects/5eb8268b6307471a9b0f2766885e1df8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:51.277043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eb8268b6307471a9b0f2766885e1df8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:51.281087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:51.326289 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:51.376445 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:51.408922 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1310/2606] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:51.410913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:51.415728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:51.420190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:51.458443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eb8268b6307471a9b0f2766885e1df8', 'request_id': 'req-2dee1df9-5210-4397-a669-95692e759559'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:51.496051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eb8268b6307471a9b0f2766885e1df8', 'request_id': 'req-2dee1df9-5210-4397-a669-95692e759559'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:51.524681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eb8268b6307471a9b0f2766885e1df8', 'request_id': 'req-2dee1df9-5210-4397-a669-95692e759559'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:51.533954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] MFA Rules not processed for user `b3ba35f3b2eb476ab15a311d7685e071`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:51.535637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.577106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] The token cache is being invalidate because project 5eb8268b6307471a9b0f2766885e1df8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:51.578590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:51.583615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:51.588732 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1297/2607] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:50 2022] DELETE /identity/v3/projects/5eb8268b6307471a9b0f2766885e1df8 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:51.590800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:51.595448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.782017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dee1df9-5210-4397-a669-95692e759559 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:51.812483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:51.813970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:51.819865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:51.820849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:51.835134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:51.836024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:51.849209 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1311/2608] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:51.857180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:51.857574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:51.866313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.925799 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1298/2609] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:51.926994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f67618d-7201-4626-8ff9-42c31c1214a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:51.938450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:51.943731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:51.953347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:51.954800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:51.955116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:51.955416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] PATH_INFO: `/v3/users/d4aaba47d9bb424eadbe07b47bb6011f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:51.959265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4aaba47d9bb424eadbe07b47bb6011f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:51.966915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.060460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7348-0970-4b94-8f0c-ef126f93e1db admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:52.101071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:52.103956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:52.105700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:52.106097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:52.113291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:52.116566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.124784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4aaba47d9bb424eadbe07b47bb6011f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:52.129063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4aaba47d9bb424eadbe07b47bb6011f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:52.143282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4aaba47d9bb424eadbe07b47bb6011f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:52.144327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4aaba47d9bb424eadbe07b47bb6011f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:52.165062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4aaba47d9bb424eadbe07b47bb6011f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:52.230720 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1299/2610] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:51 2022] POST /identity/v3/projects => generated 383 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:52.235279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.239161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:52.251481 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1312/2611] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:51 2022] DELETE /identity/v3/users/d4aaba47d9bb424eadbe07b47bb6011f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:52.252867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.256319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:52.415881 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:52.461887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688bddcb-1cb1-4d43-abd8-4ecd1f21e0ca admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:52.466728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d6514-113f-40f5-a60d-2be2f7a0bd4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:52.473631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:52.474381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:52.474705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:52.474985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:52.475694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:52.478757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.481539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:52.482305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:52.482650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:52.482946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:52.483640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:52.486914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.532408 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1313/2612] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:52 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:52.534881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.559454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764a77b-1d0f-4bc6-888d-890a3f6e3bb1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:52.568410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:52.569208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:52.569499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:52.569781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:52.572309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:52.577134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.586281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1300/2613] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:52 2022] POST /identity/v3/projects => generated 395 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:52.610274 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1314/2614] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:52.615464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.616435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.649575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c14c0-2138-415e-b49a-958b29ea6060 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:52.692815 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:52.784526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:52.787299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:52.787978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:52.789862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] PATH_INFO: `/v3/projects/2b0c36772ea444629da834f6d66f9209/users/938cf8b96d164f34ba2d0320b0866e42/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:52.822699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8202fa2-9b65-4f02-9fbf-110fd6283418 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:52.833062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c36772ea444629da834f6d66f9209, user_id=938cf8b96d164f34ba2d0320b0866e42, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:52.838933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:52.840917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:52.842279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.845429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:52.845917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:52.846994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:52.850387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:52.871398 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1315/2615] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:52 2022] PUT /identity/v3/projects/2b0c36772ea444629da834f6d66f9209/users/938cf8b96d164f34ba2d0320b0866e42/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:52.878020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.901674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1301/2616] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:52 2022] POST /identity/v3/users => generated 298 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:52.905611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:52.931857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2aa680-105b-48c7-a240-72bd71fe05ba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:53.061990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330a010-7a55-4073-aeab-7c3d87c289e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:53.072106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:53.072972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.073187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.073470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.074296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:53.076024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:53.101689 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1316/2617] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:53.106533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:53.107287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.107587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.107847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.109457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:53.110473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:53.112423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:53.138923 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1302/2618] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:53.145750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:53.151867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2a1e9-d273-4e38-828f-afca763dd244 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:53.168049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27144a0-22de-4ef7-8b3c-94948d26d9c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:53.183610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0d107-9e43-4506-996c-a7f5699d4598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:53.184163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:53.184586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d107-9e43-4506-996c-a7f5699d4598 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.184942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d107-9e43-4506-996c-a7f5699d4598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.185104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.185279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0d107-9e43-4506-996c-a7f5699d4598 admin admin] PATH_INFO: `/v3/projects/2b0c36772ea444629da834f6d66f9209/users/938cf8b96d164f34ba2d0320b0866e42/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.185428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.185582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.186492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:53.189828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:53.193610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0d107-9e43-4506-996c-a7f5699d4598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b0c36772ea444629da834f6d66f9209, user_id=938cf8b96d164f34ba2d0320b0866e42, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:53.204708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0d107-9e43-4506-996c-a7f5699d4598 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:53.232257 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1303/2619] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:53.236227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:53.240623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1317/2620] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:53 2022] PUT /identity/v3/projects/2b0c36772ea444629da834f6d66f9209/users/938cf8b96d164f34ba2d0320b0866e42/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:53.262688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6c44b-0d0f-4c54-a72d-6c5b4d6c50a3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.263014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6c44b-0d0f-4c54-a72d-6c5b4d6c50a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.263412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d6c44b-0d0f-4c54-a72d-6c5b4d6c50a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.275622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a699e-ee11-4402-8a8f-301c21cd0a50 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:53.333575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a1d6c44b-0d0f-4c54-a72d-6c5b4d6c50a3 None None] MFA Rules not processed for user `938cf8b96d164f34ba2d0320b0866e42`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:53.335263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1d6c44b-0d0f-4c54-a72d-6c5b4d6c50a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:53.380164 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:53.459975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:53.461240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.461523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.461801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] PATH_INFO: `/v3/projects/06d6cf2488654ce8b4bab30863bc2b49/users/b282924811a04559b6038f0eb383d3e3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.499062 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1318/2621] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:53.499384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06d6cf2488654ce8b4bab30863bc2b49, user_id=b282924811a04559b6038f0eb383d3e3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:53.501026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:53.529517 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1304/2622] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:53 2022] PUT /identity/v3/projects/06d6cf2488654ce8b4bab30863bc2b49/users/b282924811a04559b6038f0eb383d3e3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:10:53.542676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:53.543018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:53.543466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:53.605880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] MFA Rules not processed for user `b282924811a04559b6038f0eb383d3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:53.607166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:53.795048 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1319/2623] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:53.799344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:53.820993 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:53.993017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce79e5ed-aa6f-4649-bcce-4218bd09ead1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:54.002196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:54.003193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.003580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.005914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:54.009014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:54.011240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:54.073835 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1305/2624] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:53 2022] POST /identity/v3/projects => generated 395 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:54.075899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:54.100669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a10daa7-726c-4752-a488-90160e100b30 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:54.271600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:54.272582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.272877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.273161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:54.273894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:54.276009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:54.336290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:54.347601 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1320/2625] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:54 2022] POST /identity/v3/users => generated 304 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:54.374716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5175f-3132-4bc1-94eb-215a1ac28978 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:54.382658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:54.397161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.397542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.397751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:54.398566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:54.404472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:54.443707 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1306/2626] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:54.448258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:54.469648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6740aad6-206b-4cbd-84b6-9d31d94128e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:54.475951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:54.478204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.478995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.479442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] PATH_INFO: `/v3/projects/3d3e3646a7414ca79176080567b6ae41/users/3854a4ae0a89472c88a3d4d04129865b/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:54.568217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3e3646a7414ca79176080567b6ae41, user_id=3854a4ae0a89472c88a3d4d04129865b, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:54.584782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:54.617402 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1321/2627] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:54 2022] PUT /identity/v3/projects/3d3e3646a7414ca79176080567b6ae41/users/3854a4ae0a89472c88a3d4d04129865b/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:54.621559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:54.634361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f3af2-76bc-4126-a8d1-71f5ab8ad866 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:54.793658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd2bff9-2566-491e-81ae-f441e0a72f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:54.795419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2bff9-2566-491e-81ae-f441e0a72f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.796997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2bff9-2566-491e-81ae-f441e0a72f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.798038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd2bff9-2566-491e-81ae-f441e0a72f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:54.799103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2bff9-2566-491e-81ae-f441e0a72f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:54.803418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd2bff9-2566-491e-81ae-f441e0a72f4c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:54.832575 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1307/2628] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:54.838075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:54.861442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303f30db-b17c-418d-b46c-b61b157caf6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:54.933019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:54.935323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.935323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.935865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] PATH_INFO: `/v3/projects/3d3e3646a7414ca79176080567b6ae41/users/3854a4ae0a89472c88a3d4d04129865b/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:54.943303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3e3646a7414ca79176080567b6ae41, user_id=3854a4ae0a89472c88a3d4d04129865b, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:54.948940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:54.962141 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:54.971778 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1322/2629] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:54 2022] PUT /identity/v3/projects/3d3e3646a7414ca79176080567b6ae41/users/3854a4ae0a89472c88a3d4d04129865b/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:54.982142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62fb7-235c-40ba-b852-086084f7b403 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:54.983003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62fb7-235c-40ba-b852-086084f7b403 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:54.984163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b62fb7-235c-40ba-b852-086084f7b403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:55.087409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d8b62fb7-235c-40ba-b852-086084f7b403 None None] MFA Rules not processed for user `3854a4ae0a89472c88a3d4d04129865b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:55.088715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d8b62fb7-235c-40ba-b852-086084f7b403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:55.159161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:55.161129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:55.282480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39ea59-ec85-4711-9a4c-7d8067ab35cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:55.302317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1308/2630] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:55.314616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:55.315560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:55.316044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:55.316336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] PATH_INFO: `/v3/projects/a2df7ec89476462dbf6e794e17e0c82e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:55.318000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2df7ec89476462dbf6e794e17e0c82e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:55.325979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:55.430746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2df7ec89476462dbf6e794e17e0c82e', 'request_id': 'req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:55.440857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2df7ec89476462dbf6e794e17e0c82e', 'request_id': 'req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:55.448749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2df7ec89476462dbf6e794e17e0c82e', 'request_id': 'req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:55.474657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] The token cache is being invalidate because project a2df7ec89476462dbf6e794e17e0c82e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:10:55.474657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:55.475923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:55.478332 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1323/2631] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:10:55 2022] DELETE /identity/v3/projects/a2df7ec89476462dbf6e794e17e0c82e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:55.485246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5daf9-12b3-47b2-b138-1eea6f423f35 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:55.485634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5daf9-12b3-47b2-b138-1eea6f423f35 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:55.486063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb5daf9-12b3-47b2-b138-1eea6f423f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:55.534963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8bb5daf9-12b3-47b2-b138-1eea6f423f35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:55.536771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8bb5daf9-12b3-47b2-b138-1eea6f423f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:55.539251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:55.541120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:55.579708 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:55.771767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a8a7e-2b94-4b68-a9d0-f5ee66e5f114 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:55.783893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:55.784609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:55.784891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:55.785171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:55.787184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:55.821977 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1309/2632] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:55.825669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:55.826327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:55.827652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:55.852790 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:55.895927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:55.897397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:55.913885 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1310/2633] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:55.920239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:55.940836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd1211-83c3-42f2-9c6c-2648388386ad None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:55.959101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:55.961333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:55.961871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:55.962320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:55.963451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:10:55.963916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:55.965858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:55.999934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.006463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0590dcbc-7e74-4519-84b7-3d7e89c70da3 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.006748 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1311/2634] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:10:56.010106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.027664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d56668-3c5d-4ded-8710-ccd39140706a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.032438 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1324/2635] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:55 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:10:56.053361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.058151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.060008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.060770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.063518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.070990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.079971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6849d-7dba-4cc3-9dc7-2e7ae68f804b None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.080294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6849d-7dba-4cc3-9dc7-2e7ae68f804b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.080582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f6849d-7dba-4cc3-9dc7-2e7ae68f804b None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.083798 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1325/2636] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:10:56.096765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6849d-7dba-4cc3-9dc7-2e7ae68f804b None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:56.126275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6849d-7dba-4cc3-9dc7-2e7ae68f804b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.141444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f6849d-7dba-4cc3-9dc7-2e7ae68f804b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.148314 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1312/2637] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/projects => generated 401 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:56.153986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.166438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.167522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.167886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.168415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.175480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.179839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.183589 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1326/2638] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:56 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:56.288058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfd5e0-adb8-4fcf-82ee-fb0242dd37c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.294915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91df91-6395-4429-a1e0-70ff87aace07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.295615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91df91-6395-4429-a1e0-70ff87aace07 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.295898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91df91-6395-4429-a1e0-70ff87aace07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.296168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91df91-6395-4429-a1e0-70ff87aace07 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.296943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91df91-6395-4429-a1e0-70ff87aace07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.299112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91df91-6395-4429-a1e0-70ff87aace07 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.331486 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1313/2639] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:56.335584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.342836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290429c4-ec87-4e04-b662-260d02bd1ed2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.343395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290429c4-ec87-4e04-b662-260d02bd1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.343876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290429c4-ec87-4e04-b662-260d02bd1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.347355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979224b6-b67a-4afe-9ecc-3d401a7ee539 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.352382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.353096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.353375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.353646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.354386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.356010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.370444 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1327/2640] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:56.375445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.384826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-290429c4-ec87-4e04-b662-260d02bd1ed2 None None] MFA Rules not processed for user `0b06170e53ba4047b500b0a55f5b0210`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:56.385775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4759ae1f-4b7e-42b4-bc22-6d76210f800e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.386968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-290429c4-ec87-4e04-b662-260d02bd1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:56.397186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.401616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.402080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.402359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.403133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.404844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.427777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1328/2641] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:56.429597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.443080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0589f8d-08e2-4efe-ba2f-a504a71fc2ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.455119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7565b-99f4-4be2-890f-64cc5262f4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.456036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7565b-99f4-4be2-890f-64cc5262f4f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.456317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7565b-99f4-4be2-890f-64cc5262f4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.457572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7565b-99f4-4be2-890f-64cc5262f4f9 admin admin] PATH_INFO: `/v3/projects/a29d27d3c4f24173850a016c032b46b4/users/0e6cdc96f67241fc87e57ac4680c5011/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.461680 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:56.480807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7565b-99f4-4be2-890f-64cc5262f4f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a29d27d3c4f24173850a016c032b46b4, user_id=0e6cdc96f67241fc87e57ac4680c5011, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.484718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7565b-99f4-4be2-890f-64cc5262f4f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.506404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1329/2642] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:56 2022] PUT /identity/v3/projects/a29d27d3c4f24173850a016c032b46b4/users/0e6cdc96f67241fc87e57ac4680c5011/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:56.524803 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1314/2643] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:56.528424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.528887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.529293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.536523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.537069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.538724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.565834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] MFA Rules not processed for user `0e6cdc96f67241fc87e57ac4680c5011`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:56.567528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:56.573195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] MFA Rules not processed for user `0b06170e53ba4047b500b0a55f5b0210`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:56.575247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:56.698836 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1315/2644] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:56.717340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.729277 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1330/2645] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:56.733809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:56.864386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7140b967-557e-4321-ba7c-501a4cdf5492 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.878371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.879523 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:56.880612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.882272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.882761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.887835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:56.892462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8312bd-6084-404e-856c-1de991cca509 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:56.908195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:56.909845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:56.911319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:56.911967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:56.914365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:56.918314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:56.973617 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1331/2646] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/projects => generated 401 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:10:56.974058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.099615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:57.102541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:57.122739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1316/2647] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:56 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:57.125946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5b0f5b-69ce-4747-9220-db5b1817daad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:57.141890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:57.143452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.144285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.144858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.146517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:57.150509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:57.203077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.204018 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1332/2648] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:10:56 2022] POST /identity/v3/users => generated 307 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:10:57.217996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e9433-54a0-40e4-b109-79bd077c8c4a service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:57.246894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:57.247664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.248051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.248291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.252587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:57.257749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:57.290241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1317/2649] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:10:57.297965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.341455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a1b69-e984-4536-9278-0c962fd0c1a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:57.352726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73672565-242b-4ece-b688-e19e8500a309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:57.354315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73672565-242b-4ece-b688-e19e8500a309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.354819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73672565-242b-4ece-b688-e19e8500a309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.355319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73672565-242b-4ece-b688-e19e8500a309 admin admin] PATH_INFO: `/v3/projects/29c44e9cb5e849e596e90552de2f32e7/users/4d25c4bb8e6443679a816f3b135dbe35/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.461281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73672565-242b-4ece-b688-e19e8500a309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c44e9cb5e849e596e90552de2f32e7, user_id=4d25c4bb8e6443679a816f3b135dbe35, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:57.468818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73672565-242b-4ece-b688-e19e8500a309 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:57.516057 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1333/2650] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:57 2022] PUT /identity/v3/projects/29c44e9cb5e849e596e90552de2f32e7/users/4d25c4bb8e6443679a816f3b135dbe35/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:57.517041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.563812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3829d-d9fe-496b-97a3-794a7db4301b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:57.624310 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:57.824272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3f86a-2faf-4103-a7f8-777c20e7962c None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.825105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3f86a-2faf-4103-a7f8-777c20e7962c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.825621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3f86a-2faf-4103-a7f8-777c20e7962c None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.827727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1334/2651] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:10:57.833825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3f86a-2faf-4103-a7f8-777c20e7962c None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:10:57.879190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:57.880510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.881007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.886078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:57.887741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:57.899408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:57.930749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1318/2652] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:10:57.940187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.966930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3f86a-2faf-4103-a7f8-777c20e7962c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:57.971392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd936edf-0716-4539-94ce-44c6b490419c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:57.990970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9251aadd-e51a-48b9-a772-7d3ba26a5415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:57.991914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251aadd-e51a-48b9-a772-7d3ba26a5415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:57.992199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251aadd-e51a-48b9-a772-7d3ba26a5415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:57.992516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9251aadd-e51a-48b9-a772-7d3ba26a5415 admin admin] PATH_INFO: `/v3/projects/29c44e9cb5e849e596e90552de2f32e7/users/4d25c4bb8e6443679a816f3b135dbe35/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.010079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251aadd-e51a-48b9-a772-7d3ba26a5415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c44e9cb5e849e596e90552de2f32e7, user_id=4d25c4bb8e6443679a816f3b135dbe35, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:58.014680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9251aadd-e51a-48b9-a772-7d3ba26a5415 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:58.077806 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1319/2653] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:10:57 2022] PUT /identity/v3/projects/29c44e9cb5e849e596e90552de2f32e7/users/4d25c4bb8e6443679a816f3b135dbe35/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:58.086349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:58.086647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:58.087042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.125765 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:58.175195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] MFA Rules not processed for user `4d25c4bb8e6443679a816f3b135dbe35`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:58.179094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:58.192543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3f86a-2faf-4103-a7f8-777c20e7962c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:58.331005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e9134-a544-4beb-b223-3e386821ba9f tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:58.332328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9134-a544-4beb-b223-3e386821ba9f tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:58.332328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9134-a544-4beb-b223-3e386821ba9f tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:58.332611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e9134-a544-4beb-b223-3e386821ba9f tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.335382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e9134-a544-4beb-b223-3e386821ba9f tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:58.337618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e9134-a544-4beb-b223-3e386821ba9f tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:58.356620 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1335/2654] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:10:57 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 522 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:10:58.368233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1320/2655] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:58.453151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:58.454912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:58.455308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.472744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:58.488258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] MFA Rules not processed for user `b3ba35f3b2eb476ab15a311d7685e071`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:58.491230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:58.611699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1336/2656] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:10:58.627934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61833b8f-12b3-4122-945c-7e8e8d0d7a19 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:58.636073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f8131e-95fb-4448-b102-0046c3c72cf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:58.636787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8131e-95fb-4448-b102-0046c3c72cf9 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:58.637322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8131e-95fb-4448-b102-0046c3c72cf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:58.637711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f8131e-95fb-4448-b102-0046c3c72cf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:58.671649 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:58.741030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8131e-95fb-4448-b102-0046c3c72cf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:58.743818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f8131e-95fb-4448-b102-0046c3c72cf9 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:58.772259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1321/2657] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:58 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:10:59.130922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:59.135289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:59.352941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032b832-4d92-4179-85ad-9edee551a2b4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:10:59.364688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:10:59.366403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:59.366403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:59.366403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] PATH_INFO: `/v3/users/b282924811a04559b6038f0eb383d3e3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:59.367630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=b282924811a04559b6038f0eb383d3e3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:10:59.369854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:10:59.475147 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:10:59.506376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b282924811a04559b6038f0eb383d3e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:59.512924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b282924811a04559b6038f0eb383d3e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:59.552008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b282924811a04559b6038f0eb383d3e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:59.553225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b282924811a04559b6038f0eb383d3e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:59.603928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b282924811a04559b6038f0eb383d3e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:10:59.669338 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1337/2658] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:10:59 2022] DELETE /identity/v3/users/b282924811a04559b6038f0eb383d3e3 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:10:59.674241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:10:59.674241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:10:59.675040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:10:59.709616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:10:59.710895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:10:59.888190 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1322/2659] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:10:59.904775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:10:59.906332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.027071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceb6cfe-c295-4378-94e1-7d7956e1a7ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.034945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.036695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.037222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.037927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.063237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.067857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.095672 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1338/2660] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:10:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:00.123253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.125123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.346904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50689c58-15ef-4ed9-bb1e-d420394c6219 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.371406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.373351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.374748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.375546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.389592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.582437 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:00.611337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.615121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.638215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.639781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.655757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1323/2661] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:00.663834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb229bd-fdb2-456f-a228-7ee7d23b2c44 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.670216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.671182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.671704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.671965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.674344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.762388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:00.764015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:00.807550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ed82f4-5ef6-4bd6-a1d3-ce3102592468 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:00.825518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:00.827259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:00.827545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:00.827823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] PATH_INFO: `/v3/projects/06d6cf2488654ce8b4bab30863bc2b49` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:00.830845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] RBAC: Authorizing `identity:delete_project(project_id=06d6cf2488654ce8b4bab30863bc2b49)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.836569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.885380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:00.892637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:00.921602 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1339/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:00.979763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06d6cf2488654ce8b4bab30863bc2b49', 'request_id': 'req-c83fed76-d44d-49ea-9837-32dc0e66666e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.011072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06d6cf2488654ce8b4bab30863bc2b49', 'request_id': 'req-c83fed76-d44d-49ea-9837-32dc0e66666e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.027933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06d6cf2488654ce8b4bab30863bc2b49', 'request_id': 'req-c83fed76-d44d-49ea-9837-32dc0e66666e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.052337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] The token cache is being invalidate because project 06d6cf2488654ce8b4bab30863bc2b49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:01.052720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.059284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.065513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1324/2663] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:00 2022] DELETE /identity/v3/projects/06d6cf2488654ce8b4bab30863bc2b49 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:01.065812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:01.095943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1154e8-2938-44dc-ba9c-6da34669615c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:01.171495 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:01.185348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:01.187793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:01.188429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:01.189054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] PATH_INFO: `/v3/users/3854a4ae0a89472c88a3d4d04129865b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:01.192012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3854a4ae0a89472c88a3d4d04129865b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:01.194240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:01.280268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3854a4ae0a89472c88a3d4d04129865b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.282745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3854a4ae0a89472c88a3d4d04129865b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.306664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3854a4ae0a89472c88a3d4d04129865b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.307515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3854a4ae0a89472c88a3d4d04129865b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.329864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3854a4ae0a89472c88a3d4d04129865b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:01.381937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1340/2664] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:01 2022] DELETE /identity/v3/users/3854a4ae0a89472c88a3d4d04129865b => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:01.879057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:01.881566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:02.011775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fed76-d44d-49ea-9837-32dc0e66666e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:02.057020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:02.059864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:02.121008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:02.122517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:02.123045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:02.123585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:02.143806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:02.198640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:02.202652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3434c92a-afd0-4c95-af77-117c1a03bd96 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:02.233479 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1325/2665] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:02.303378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b804df2-b07e-45ea-8f43-0320ea3f5fe9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:02.311943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:02.313552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:02.314048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:02.314542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] PATH_INFO: `/v3/projects/3d3e3646a7414ca79176080567b6ae41` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:02.317108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3e3646a7414ca79176080567b6ae41)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:02.337536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:02.460852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3e3646a7414ca79176080567b6ae41', 'request_id': 'req-1d55588c-7b9f-4da9-8aa3-9d5dead31157'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:02.471943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3e3646a7414ca79176080567b6ae41', 'request_id': 'req-1d55588c-7b9f-4da9-8aa3-9d5dead31157'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:02.495384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3e3646a7414ca79176080567b6ae41', 'request_id': 'req-1d55588c-7b9f-4da9-8aa3-9d5dead31157'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:02.535933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] The token cache is being invalidate because project 3d3e3646a7414ca79176080567b6ae41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:02.536220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:02.537090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d55588c-7b9f-4da9-8aa3-9d5dead31157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:02.543123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1341/2666] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:02 2022] DELETE /identity/v3/projects/3d3e3646a7414ca79176080567b6ae41 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:02.544368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:02.544683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:02.545021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:02.562598 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:02.577813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:02.579402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:02.736847 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1326/2667] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:02.744637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:02.745101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:02.745385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:02.755034 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:02.768911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:02.770760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:02.782386 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1342/2668] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:02.792052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:02.809006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee041b1-2369-4786-8db6-f6c37d338e51 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:02.816499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:02.817251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:02.817811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:02.818138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:02.819135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:02.819502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:02.821865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:02.856534 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1327/2669] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:02.861573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:02.872714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb863-52bb-4642-be09-0704a272460b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:02.878794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617a28c0-534e-4404-92b7-c4652166f9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:02.879517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a28c0-534e-4404-92b7-c4652166f9cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:02.879798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a28c0-534e-4404-92b7-c4652166f9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:02.880078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617a28c0-534e-4404-92b7-c4652166f9cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:02.880894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a28c0-534e-4404-92b7-c4652166f9cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:02.882913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617a28c0-534e-4404-92b7-c4652166f9cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:02.919378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1343/2670] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:02 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:02.924127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:02.935728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47fac6-6962-4c90-9264-d0c5486ca178 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:03.019784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:03.021421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.021998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.022427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.023593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:03.025959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:03.057911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1328/2671] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:02 2022] POST /identity/v3/users => generated 286 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:03.062725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.063535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:03.065467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.066308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.069822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1344/2672] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:03.078568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:03.082363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:03.088183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c6fe17-bad0-4fed-a891-cb4e3b5c6483 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:03.100960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:03.102371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.103092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.103833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.105694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:03.109190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:03.136478 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1329/2673] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:03.141233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:03.160156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d4a75-7f3d-4135-9396-15b79e85fa84 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:03.165885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:03.166984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.167349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.167628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.168771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:03.170651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:03.184761 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1330/2674] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:03.190894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:03.215526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b4ba5-4ae5-454b-98d4-1a2b355653f6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:03.241737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266cca0-048a-49c5-9cb1-dd3daaa08967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:03.247764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cca0-048a-49c5-9cb1-dd3daaa08967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.248191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cca0-048a-49c5-9cb1-dd3daaa08967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.248745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266cca0-048a-49c5-9cb1-dd3daaa08967 admin admin] PATH_INFO: `/v3/projects/1e01f70c403347b38dd0dd88e44be953/users/2b2950eec4754c328f600d770a8860d1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.309105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:03.311475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:03.311947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266cca0-048a-49c5-9cb1-dd3daaa08967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e01f70c403347b38dd0dd88e44be953, user_id=2b2950eec4754c328f600d770a8860d1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:03.315181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266cca0-048a-49c5-9cb1-dd3daaa08967 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:03.363617 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1331/2675] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:03 2022] PUT /identity/v3/projects/1e01f70c403347b38dd0dd88e44be953/users/2b2950eec4754c328f600d770a8860d1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:03.372243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.372815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.373343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.425610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:03.427169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:03.471284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc87eb7-2768-44f5-91fd-437df010d97d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:03.487112 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:03.546192 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1332/2676] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:03.560026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:03.561652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:03.633532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447e3134-9593-47e9-a832-726c9f2b4dbc tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:03.635459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3134-9593-47e9-a832-726c9f2b4dbc tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.636024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3134-9593-47e9-a832-726c9f2b4dbc tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.636510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447e3134-9593-47e9-a832-726c9f2b4dbc tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.639179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e3134-9593-47e9-a832-726c9f2b4dbc tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:03.642257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447e3134-9593-47e9-a832-726c9f2b4dbc tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:03.646970 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1345/2677] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:03 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 569 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:11:03.683593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9143e236-cb87-44ba-9e46-1643749c760a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:03.690275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:03.692191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:03.692677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:03.693114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:03.716178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:03.718016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:03.731692 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1333/2678] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:04.744278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98da11-cf20-4e10-b0a0-8e53434e7ea4 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:04.745547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98da11-cf20-4e10-b0a0-8e53434e7ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:04.745547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98da11-cf20-4e10-b0a0-8e53434e7ea4 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:04.747072 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1346/2679] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:11:04.753473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:04.905898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:04.934991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc75b6-2ce0-4371-b650-137d9df7f6ac service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:04.953374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b8dc3f-260e-4161-84af-a0817e6d8a80 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:04.958459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8dc3f-260e-4161-84af-a0817e6d8a80 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:04.959117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8dc3f-260e-4161-84af-a0817e6d8a80 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:04.959801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b8dc3f-260e-4161-84af-a0817e6d8a80 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:04.964699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8dc3f-260e-4161-84af-a0817e6d8a80 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:04.990963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b8dc3f-260e-4161-84af-a0817e6d8a80 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:04.998432 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1334/2680] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:04 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:07.139392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265e4e-67b1-483c-8233-634295075957 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:07.140895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265e4e-67b1-483c-8233-634295075957 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:07.141582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265e4e-67b1-483c-8233-634295075957 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:07.145200 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1347/2681] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:11:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:07.156982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b32fa-8128-4528-8a4d-74c280b7a2b6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:07.157919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b32fa-8128-4528-8a4d-74c280b7a2b6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:07.157919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1b32fa-8128-4528-8a4d-74c280b7a2b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:07.192803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4c1b32fa-8128-4528-8a4d-74c280b7a2b6 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:07.196215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c1b32fa-8128-4528-8a4d-74c280b7a2b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:07.347801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1335/2682] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:11:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:07.439862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265e4e-67b1-483c-8233-634295075957 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:07.444262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f265e4e-67b1-483c-8233-634295075957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:07.507957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265e4e-67b1-483c-8233-634295075957 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:07.515375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:07.516405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:07.517318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:07.517779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:07.529382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:07.531441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:07.544260 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1348/2683] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:09.878684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ec9e-46f9-48ba-afa0-38f3ff4230b9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:09.879854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ec9e-46f9-48ba-afa0-38f3ff4230b9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:09.880393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6057ec9e-46f9-48ba-afa0-38f3ff4230b9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:09.884424 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1336/2684] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:09 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:09.892381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:09.967737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:09.987696 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:10.007164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127359-e162-4a22-88ba-3d9ba85d484c service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:10.033550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:10.035618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:10.036445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:10.037190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:10.039888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:10.044480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:10.055566 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1349/2685] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:09 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:10.176023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece4f88-6188-47bd-a57a-e13109b9c330 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:10.176796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece4f88-6188-47bd-a57a-e13109b9c330 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:10.177188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece4f88-6188-47bd-a57a-e13109b9c330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:10.196955 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:10.225733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3ece4f88-6188-47bd-a57a-e13109b9c330 None None] MFA Rules not processed for user `b3ba35f3b2eb476ab15a311d7685e071`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:10.227602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ece4f88-6188-47bd-a57a-e13109b9c330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:10.329731 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1337/2686] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:10.433544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:10.435570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:10.456232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611f5144-224c-446f-a942-531bf609a922 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:10.463408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:10.464335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:10.464677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:10.464957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:10.467362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:10.574276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:10.577725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a060fb7b-ff51-45a6-bfc3-a2e438d87f1a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:10.599544 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1350/2687] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:10 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:10.689003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa7c72-1e65-4e92-91fa-00e1628cff45 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:10.689472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa7c72-1e65-4e92-91fa-00e1628cff45 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:10.690305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caa7c72-1e65-4e92-91fa-00e1628cff45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:10.737289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8caa7c72-1e65-4e92-91fa-00e1628cff45 None None] MFA Rules not processed for user `9c344ca2596044438f72e07545056a44`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:10.740039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8caa7c72-1e65-4e92-91fa-00e1628cff45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:10.888897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1338/2688] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:13.553858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:13.554438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:13.555221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:13.603321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892e265-6684-4270-857a-2404a10fab10 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:13.603960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892e265-6684-4270-857a-2404a10fab10 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:13.604256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892e265-6684-4270-857a-2404a10fab10 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:13.606340 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1339/2689] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:13.628193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892e265-6684-4270-857a-2404a10fab10 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:13.661939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892e265-6684-4270-857a-2404a10fab10 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:13.675417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] MFA Rules not processed for user `2b2950eec4754c328f600d770a8860d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:13.679928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:13.689305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892e265-6684-4270-857a-2404a10fab10 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:13.711277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:13.712443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:13.713633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:13.714141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:13.717527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:13.721448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:13.732945 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1340/2690] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:13 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:13.860420 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1351/2691] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:13.864908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:13.882689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24414ed8-0df5-4b0b-91e5-7ff9750c71f6 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:13.897216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:13.897917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:13.898204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:13.898478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:13.909041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:13.911205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:13.973973 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1341/2692] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:13 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:13.978884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:13.995830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da40e5a2-567b-4c39-87a4-963c21631897 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:14.193279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:14.200093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.206171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.206988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.209398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:14.218245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:14.279891 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1352/2693] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:13 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:14.283348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:14.301932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c863d29-d5cb-4b0a-9cbf-3f27b2594360 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:14.315987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:14.316741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.317135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.317417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.318469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:14.327287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:14.354583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1342/2694] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:11:14.358312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:14.377652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e1d78b-4bbd-4197-88de-fac2b0da6406 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:14.386548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:14.387556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.387840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.388108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] PATH_INFO: `/v3/projects/444aa6f96abe47ce81c74f15a23e94bd/users/f1bddd8631c54897a8bb41b2703f4e47/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.414165 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:14.461237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444aa6f96abe47ce81c74f15a23e94bd, user_id=f1bddd8631c54897a8bb41b2703f4e47, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:14.481997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:14.521563 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1353/2695] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:14 2022] PUT /identity/v3/projects/444aa6f96abe47ce81c74f15a23e94bd/users/f1bddd8631c54897a8bb41b2703f4e47/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:14.526036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:14.541154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e1960-3493-412c-99f6-4700b60f70d5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:14.850165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69d93-d2e0-4e59-8075-b2343f254803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:14.851231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69d93-d2e0-4e59-8075-b2343f254803 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.851464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69d93-d2e0-4e59-8075-b2343f254803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.851553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69d93-d2e0-4e59-8075-b2343f254803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.852473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69d93-d2e0-4e59-8075-b2343f254803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:14.863481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69d93-d2e0-4e59-8075-b2343f254803 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:14.910191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:14.910725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1343/2696] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:14.946698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20a8126-fdae-4b37-a855-34753ea01fb4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:14.960312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e569bac-676b-483f-bd72-63af88ff6c53 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.961281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e569bac-676b-483f-bd72-63af88ff6c53 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.961942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e569bac-676b-483f-bd72-63af88ff6c53 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.971233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:14.972925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:14.973530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:14.974080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] PATH_INFO: `/v3/projects/444aa6f96abe47ce81c74f15a23e94bd/users/f1bddd8631c54897a8bb41b2703f4e47/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:14.975251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1344/2697] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:14 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:14.981648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] RBAC: Authorizing `identity:create_grant(project_id=444aa6f96abe47ce81c74f15a23e94bd, user_id=f1bddd8631c54897a8bb41b2703f4e47, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:14.992735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e569bac-676b-483f-bd72-63af88ff6c53 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:15.008693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:15.044640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1354/2698] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:14 2022] PUT /identity/v3/projects/444aa6f96abe47ce81c74f15a23e94bd/users/f1bddd8631c54897a8bb41b2703f4e47/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:15.068638 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:15.204711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e569bac-676b-483f-bd72-63af88ff6c53 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:15.371423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e569bac-676b-483f-bd72-63af88ff6c53 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:15.405994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:15.574438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30938def-793e-434a-a60b-ccd10c6bb477 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:15.576845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938def-793e-434a-a60b-ccd10c6bb477 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:15.580436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938def-793e-434a-a60b-ccd10c6bb477 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:15.581638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30938def-793e-434a-a60b-ccd10c6bb477 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:15.588290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30938def-793e-434a-a60b-ccd10c6bb477 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:15.610941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30938def-793e-434a-a60b-ccd10c6bb477 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:15.620191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1345/2699] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:14 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 633 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:15.637993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6aeba1-5872-44b0-a8d0-8a88748f773a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:15.653938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:15.654847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:15.655897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:15.657516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:15.665681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:15.696596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:15.707685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:15.756005 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1355/2700] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:19.111897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c349-792e-4dcc-a7c9-618023ff6c75 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:19.112828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c349-792e-4dcc-a7c9-618023ff6c75 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:19.112828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03c349-792e-4dcc-a7c9-618023ff6c75 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:19.114434 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1346/2701] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:19.139178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:19.415102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:19.455111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fffd3d-5181-4697-9003-ddb2858aa0af service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:19.471654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:19.472815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:19.474323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:19.475288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:19.480198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:19.485126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:19.492897 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1356/2702] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:19 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:11:19.641791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:19.643197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:19.643666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:19.676814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] MFA Rules not processed for user `b3ba35f3b2eb476ab15a311d7685e071`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:19.678512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:19.758144 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:19.771571 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1347/2703] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:23.081734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:23.122340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229d60d9-7079-4d2d-abd1-59694f517185 tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:23.146975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:23.148813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:23.149615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:23.150334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:23.160688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.307663 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:23.352129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:23.357054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdf1fdb-37c4-43a2-8336-0f6d4c25dc73 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:23.411413 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1357/2704] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:23.457462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:23.460060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:23.744890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa078021-5f7b-4417-bb43-a5fe0d497338 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:23.754777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:23.756753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:23.757518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:23.758259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] PATH_INFO: `/v3/users/0e6cdc96f67241fc87e57ac4680c5011` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:23.761028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e6cdc96f67241fc87e57ac4680c5011)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:23.765356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:23.892572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e6cdc96f67241fc87e57ac4680c5011'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.913388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e6cdc96f67241fc87e57ac4680c5011'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.958058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e6cdc96f67241fc87e57ac4680c5011'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.960249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e6cdc96f67241fc87e57ac4680c5011'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.977979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889a253c-c275-4593-bbb9-32534bbe5738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e6cdc96f67241fc87e57ac4680c5011'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:23.997680 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1348/2705] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:23 2022] DELETE /identity/v3/users/0e6cdc96f67241fc87e57ac4680c5011 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:24.000744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:24.001225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:24.001732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:24.070066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:24.074839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:24.137736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:24.138261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:24.138780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:24.142108 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1349/2706] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:11:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:11:24.154917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:11:24.160052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:24.229048 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1358/2707] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:24.299210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:24.301402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:24.375307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:24.380487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:24.427022 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:24.472523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2001c49-7606-43c1-b3bd-b201e3dd4bdf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:24.489480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:24.491214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:24.492256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:24.496485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:24.538725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:24.545391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:24.574590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0379a-1fd2-4071-917c-fff305581195 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:24.586056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '938cf8b96d164f34ba2d0320b0866e42', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2b0c36772ea444629da834f6d66f9209', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:24.587031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:24.587367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:24.587637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:24.591320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorizing `identity:get_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:24.595943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:24.599227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1359/2708] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:24.603117 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1350/2709] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:11:24 2022] GET /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 383 bytes in 451 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:25.552217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.554999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:25.594513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a677ba-5e99-4f62-a05a-4ed52095dffa service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:25.612388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:25.612752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:25.613412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:25.613412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] PATH_INFO: `/v3/projects/a29d27d3c4f24173850a016c032b46b4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:25.615782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a29d27d3c4f24173850a016c032b46b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:25.623065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:25.859144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a29d27d3c4f24173850a016c032b46b4', 'request_id': 'req-658ae7b9-7320-4aa6-b115-2d9179bcef98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:25.878758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a29d27d3c4f24173850a016c032b46b4', 'request_id': 'req-658ae7b9-7320-4aa6-b115-2d9179bcef98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:25.902775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a29d27d3c4f24173850a016c032b46b4', 'request_id': 'req-658ae7b9-7320-4aa6-b115-2d9179bcef98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:25.960117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] The token cache is being invalidate because project a29d27d3c4f24173850a016c032b46b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:25.962198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:25.964982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-658ae7b9-7320-4aa6-b115-2d9179bcef98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:25.976478 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1360/2710] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:25 2022] DELETE /identity/v3/projects/a29d27d3c4f24173850a016c032b46b4 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:25.982472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:25.984739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:26.003821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf337dc-3151-4f2b-8abc-e66962d6f80c tempest-QuotasAdminNegativeTest-1806251953 tempest-QuotasAdminNegativeTest-1806251953-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:26.218733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:26.220522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:26.222708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:26.223664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] PATH_INFO: `/v3/users/4d25c4bb8e6443679a816f3b135dbe35` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:26.228408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d25c4bb8e6443679a816f3b135dbe35)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:26.235759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:26.368884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d25c4bb8e6443679a816f3b135dbe35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.383842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d25c4bb8e6443679a816f3b135dbe35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.416745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d25c4bb8e6443679a816f3b135dbe35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.420615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d25c4bb8e6443679a816f3b135dbe35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.433612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d25c4bb8e6443679a816f3b135dbe35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:26.460810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1351/2711] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:25 2022] DELETE /identity/v3/users/4d25c4bb8e6443679a816f3b135dbe35 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:27.371513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d7d41-d651-4ea8-a8ae-7cd4e4314f78 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.372056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d7d41-d651-4ea8-a8ae-7cd4e4314f78 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.372544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d7d41-d651-4ea8-a8ae-7cd4e4314f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.480073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e45d7d41-d651-4ea8-a8ae-7cd4e4314f78 None None] MFA Rules not processed for user `f1bddd8631c54897a8bb41b2703f4e47`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:27.482113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e45d7d41-d651-4ea8-a8ae-7cd4e4314f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:27.506304 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:27.646438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:27.647988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:27.855479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1361/2712] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:27.855479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa94fa-810b-4b5b-932a-c58d63fde8b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:27.855479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa94fa-810b-4b5b-932a-c58d63fde8b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:27.856098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa94fa-810b-4b5b-932a-c58d63fde8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:27.893861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a7aa94fa-810b-4b5b-932a-c58d63fde8b1 None None] MFA Rules not processed for user `2b2950eec4754c328f600d770a8860d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:27.895790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7aa94fa-810b-4b5b-932a-c58d63fde8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:28.041842 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:28.158756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1362/2713] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:28.219633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bc66d-bbff-4255-bf87-25997b602ded admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:28.245968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:28.252424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:28.254540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:28.255052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] PATH_INFO: `/v3/projects/29c44e9cb5e849e596e90552de2f32e7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:28.261187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c44e9cb5e849e596e90552de2f32e7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:28.269094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:28.545659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c44e9cb5e849e596e90552de2f32e7', 'request_id': 'req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:28.593140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c44e9cb5e849e596e90552de2f32e7', 'request_id': 'req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:28.622140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c44e9cb5e849e596e90552de2f32e7', 'request_id': 'req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:28.648493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] The token cache is being invalidate because project 29c44e9cb5e849e596e90552de2f32e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:28.649550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:28.650900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7f0b7c8-8593-4f0c-9980-53a3fe6ce156 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:28.677080 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1352/2714] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:27 2022] DELETE /identity/v3/projects/29c44e9cb5e849e596e90552de2f32e7 => generated 0 bytes in 1031 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:28.688251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:28.690320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:28.692004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:28.805983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:28.807591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:29.106991 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1363/2715] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:29.117788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.118584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.119596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.153379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:29.154948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:29.165841 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1353/2716] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:29.171291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.209873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda127ce-8bf3-40ae-8e67-044099931247 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.249419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.251941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.252451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.253873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.255469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:29.255998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:29.260140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:29.313933 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1364/2717] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:29.320729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.334225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8aa2e3e-e750-4ed2-875d-51b2869b2750 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.348542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.349547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.350047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.351804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.353457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:29.355679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:29.450373 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1354/2718] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:29 2022] POST /identity/v3/projects => generated 387 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:29.456995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.473304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6ad144-0b9b-4e04-8c7c-073a68b0d96e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.597477 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:29.655447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.658298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.659338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.659855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.662714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:29.668496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:29.726080 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1365/2719] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:29 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:29.728912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.770172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03a6bac-ce53-4b10-9f2f-ed908c3045bf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.790614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.791351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.791636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.791913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.792738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:29.795912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:29.829547 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1355/2720] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:29.833246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.883960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeb7bb-ff9b-41ee-a87d-b6a66eaa2cd3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.893951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be7daf4-b75d-46c2-a63f-04732d6e2445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.898300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7daf4-b75d-46c2-a63f-04732d6e2445 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.898871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7daf4-b75d-46c2-a63f-04732d6e2445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.899588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be7daf4-b75d-46c2-a63f-04732d6e2445 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:29.901572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7daf4-b75d-46c2-a63f-04732d6e2445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:29.905492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be7daf4-b75d-46c2-a63f-04732d6e2445 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:29.939819 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1366/2721] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:29.946213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:29.981756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81bb1b5-d5d3-43ed-9ebd-d572d5fff8ef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:29.994190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:29.995838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:29.998385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:29.998745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] PATH_INFO: `/v3/projects/2acb4d9c7f794879abfcb46f58764444/users/091fde210dc946e6b8d41a4c678f6a65/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.038809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acb4d9c7f794879abfcb46f58764444, user_id=091fde210dc946e6b8d41a4c678f6a65, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.064489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:30.127646 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1356/2722] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:29 2022] PUT /identity/v3/projects/2acb4d9c7f794879abfcb46f58764444/users/091fde210dc946e6b8d41a4c678f6a65/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:30.130023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.130023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.130425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.168536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:30.170047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:30.319859 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1367/2723] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:30.337262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:30.339811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:30.467236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513b434-0335-45e5-a593-cf80d0cd84c8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:30.472004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b934f7-b276-4054-b5f7-bb59bb0d3b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:30.473023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b934f7-b276-4054-b5f7-bb59bb0d3b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:30.473517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b934f7-b276-4054-b5f7-bb59bb0d3b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:30.474459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b934f7-b276-4054-b5f7-bb59bb0d3b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:30.492226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b934f7-b276-4054-b5f7-bb59bb0d3b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:30.495988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b934f7-b276-4054-b5f7-bb59bb0d3b1f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:30.516701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1357/2724] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:11:31.943475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:31.945886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:32.002385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9f2f1-8844-48bb-986c-706b2156eda4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:32.026253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:32.028887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:32.029180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:32.029460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] PATH_INFO: `/v3/users/b3ba35f3b2eb476ab15a311d7685e071` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:32.034748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3ba35f3b2eb476ab15a311d7685e071)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:32.037898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:32.201536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3ba35f3b2eb476ab15a311d7685e071'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:32.202455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3ba35f3b2eb476ab15a311d7685e071'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:32.222055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3ba35f3b2eb476ab15a311d7685e071'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:32.223073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3ba35f3b2eb476ab15a311d7685e071'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:32.238475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3ba35f3b2eb476ab15a311d7685e071'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:32.295013 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1368/2725] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:31 2022] DELETE /identity/v3/users/b3ba35f3b2eb476ab15a311d7685e071 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:32.302453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:32.303015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:32.303593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:32.322092 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:32.382638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:32.386401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:32.639968 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1358/2726] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:32.700543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:32.703182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:32.805952 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:32.897504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defc11a6-20a9-4238-b9e1-7986b7278d1e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:32.911655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:32.912887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:32.913333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:32.913753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:32.945794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:32.948087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:32.976460 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1369/2727] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:33.613043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:33.616013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:33.892135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84360d2b-bef7-4945-a3b0-fc054df4bdf0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:33.911366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:33.912880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:33.913582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:33.914366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:33.933468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:34.114977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:34.116856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:34.133339 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1359/2728] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:34.441852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:34.445189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:34.507860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0891dc49-4c56-4300-ac7d-55929388814a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:34.522140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:34.523482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.523835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.524105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] PATH_INFO: `/v3/projects/17b79edd522c45029f3fe83a0366740a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.527807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] RBAC: Authorizing `identity:delete_project(project_id=17b79edd522c45029f3fe83a0366740a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:34.529885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:34.656759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17b79edd522c45029f3fe83a0366740a', 'request_id': 'req-8b036c20-a9da-485c-8d6a-7c296f49380b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.672089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17b79edd522c45029f3fe83a0366740a', 'request_id': 'req-8b036c20-a9da-485c-8d6a-7c296f49380b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.687308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17b79edd522c45029f3fe83a0366740a', 'request_id': 'req-8b036c20-a9da-485c-8d6a-7c296f49380b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.717324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] The token cache is being invalidate because project 17b79edd522c45029f3fe83a0366740a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:34.718015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.719060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:34.721668 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1370/2729] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:34 2022] DELETE /identity/v3/projects/17b79edd522c45029f3fe83a0366740a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:34.728395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:34.751043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b5f5a-c72b-4127-993f-fb82bd167a9d service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:34.842343 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:34.890406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:34.893375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:34.894354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:34.895482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] PATH_INFO: `/v3/users/938cf8b96d164f34ba2d0320b0866e42` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:34.899608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] RBAC: Authorizing `identity:delete_user(user_id=938cf8b96d164f34ba2d0320b0866e42)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:34.904908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:35.034417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938cf8b96d164f34ba2d0320b0866e42'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:35.072965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938cf8b96d164f34ba2d0320b0866e42'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:35.153608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938cf8b96d164f34ba2d0320b0866e42'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:35.156222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938cf8b96d164f34ba2d0320b0866e42'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:35.185286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ada4901c-53f8-403c-a058-0994877d674d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938cf8b96d164f34ba2d0320b0866e42'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:35.204997 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1360/2730] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:11:34 2022] DELETE /identity/v3/users/938cf8b96d164f34ba2d0320b0866e42 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:36.807690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:36.809487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:36.836138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b036c20-a9da-485c-8d6a-7c296f49380b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:37.098755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:37.101483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:37.102521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:37.103317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] PATH_INFO: `/v3/projects/2b0c36772ea444629da834f6d66f9209` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:37.110825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b0c36772ea444629da834f6d66f9209)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:37.136718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:37.323704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b0c36772ea444629da834f6d66f9209', 'request_id': 'req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:37.337921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b0c36772ea444629da834f6d66f9209', 'request_id': 'req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:37.341703 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:37.353349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b0c36772ea444629da834f6d66f9209', 'request_id': 'req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:37.397301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] The token cache is being invalidate because project 2b0c36772ea444629da834f6d66f9209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:11:37.404622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:37.406527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e9f0cd30-2325-470f-90a4-8fc90cde1cd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:11:37.417724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:37.418305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:37.418696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:37.418862 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1371/2731] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:11:36 2022] DELETE /identity/v3/projects/2b0c36772ea444629da834f6d66f9209 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:37.485128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:37.495163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:37.771704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:37.772968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:37.773435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:37.783473 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1361/2732] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:37.813515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:37.814851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:37.835952 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1372/2733] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:37.841245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:37.856209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138201e9-7ee0-40c2-a7f0-d2fd96d2f470 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:37.865049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:37.865998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:37.866278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:37.866547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:37.867375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:11:37.867634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:37.870239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:37.903109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:37.913919 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1362/2734] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:11:37.916226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d454bb-e796-418f-a493-04efd75c3409 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:37.922740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:37.923824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:37.924297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:37.925304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:37.926411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:37.929315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:37.994210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:38.004443 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1373/2735] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:37 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:38.025103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05dcb7-9419-4d99-be00-dc6da7e7ba7a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:38.171762 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:38.210801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:38.212020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:38.212428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:38.212777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:38.213579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:38.218107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:38.263624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:38.267271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1363/2736] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:37 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:38.279117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bff673-d3ee-4271-9ea5-2cbae032f992 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:38.286684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:38.288012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:38.288601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:38.289824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:38.291059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:38.292963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:38.312688 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1374/2737] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:38.313328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:38.335374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be5231-0f54-45da-82be-11bd576053d2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:38.348670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4aef7-7699-4d7a-9f89-ece9d29445ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:38.349657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4aef7-7699-4d7a-9f89-ece9d29445ca admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:38.352593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4aef7-7699-4d7a-9f89-ece9d29445ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:38.352871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4aef7-7699-4d7a-9f89-ece9d29445ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:38.357563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4aef7-7699-4d7a-9f89-ece9d29445ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:38.363098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c4aef7-7699-4d7a-9f89-ece9d29445ca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:38.395246 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1364/2738] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:38.396969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:38.443514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c9fb91-98ad-4b55-89d8-e3a81e9fd6ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:38.471729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:38.475473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:38.480317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:38.481369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] PATH_INFO: `/v3/projects/f6a6004105e34241b75eba1a0b341166/users/13a1ff48828145069e579627af7ef2f3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:38.528932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6a6004105e34241b75eba1a0b341166, user_id=13a1ff48828145069e579627af7ef2f3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:38.536205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:38.559713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1375/2739] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:38 2022] PUT /identity/v3/projects/f6a6004105e34241b75eba1a0b341166/users/13a1ff48828145069e579627af7ef2f3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:38.573464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:38.574284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:38.574284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:38.684185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] MFA Rules not processed for user `13a1ff48828145069e579627af7ef2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:38.688124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:38.873998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1365/2740] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:38.879323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:39.193491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370136b-ca9a-481b-81c5-9084df741402 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:39.215997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:39.217157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:39.217621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:39.218080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:39.220265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:39.223928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:39.328087 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1376/2741] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:11:38 2022] POST /identity/v3/projects => generated 377 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:39.330244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:39.364534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908cdfe-8bb1-47be-a464-b19f0b760a9c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:39.671300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:39.672616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:39.673121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:39.673813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:39.684068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:39.688633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:39.781082 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1366/2742] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:11:39 2022] POST /identity/v3/users => generated 295 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:11:39.783178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:39.828096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1edd97-0c63-4dab-b37f-8b8ec0b739df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:39.859814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:39.864960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:39.865637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:39.866390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:39.868288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:39.884972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:39.952071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:39.953704 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1377/2743] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:39.985848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3c343-b457-46e8-a532-3bf980973033 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:39.995298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:39.997430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:39.997936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:40.002250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] PATH_INFO: `/v3/projects/60aae014bb754b86b33da5ff8bf7501c/users/366e78c05df942b594fa9b50325f4efa/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:40.067219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=60aae014bb754b86b33da5ff8bf7501c, user_id=366e78c05df942b594fa9b50325f4efa, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:40.072278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:40.101999 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1367/2744] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:39 2022] PUT /identity/v3/projects/60aae014bb754b86b33da5ff8bf7501c/users/366e78c05df942b594fa9b50325f4efa/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:11:40.119764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:40.190264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6941e-5f56-406d-bdcb-8860632b29f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:40.431842 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:40.470330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab57ce-8838-49fd-aa3c-0704ece100e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:40.471503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab57ce-8838-49fd-aa3c-0704ece100e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:40.472013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab57ce-8838-49fd-aa3c-0704ece100e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:40.472557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab57ce-8838-49fd-aa3c-0704ece100e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:40.473933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab57ce-8838-49fd-aa3c-0704ece100e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:40.477203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab57ce-8838-49fd-aa3c-0704ece100e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:40.532267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:40.532843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1378/2745] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:11:40.574250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9866ca37-88ec-4994-ae94-5c2142fb27ee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:40.583204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dba324-e045-42ed-b191-aa276d40f642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:40.585247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba324-e045-42ed-b191-aa276d40f642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:40.585741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba324-e045-42ed-b191-aa276d40f642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:40.586194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dba324-e045-42ed-b191-aa276d40f642 admin admin] PATH_INFO: `/v3/projects/60aae014bb754b86b33da5ff8bf7501c/users/366e78c05df942b594fa9b50325f4efa/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:40.588781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dba324-e045-42ed-b191-aa276d40f642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60aae014bb754b86b33da5ff8bf7501c, user_id=366e78c05df942b594fa9b50325f4efa, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:40.592106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dba324-e045-42ed-b191-aa276d40f642 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:40.649527 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1368/2746] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:11:40 2022] PUT /identity/v3/projects/60aae014bb754b86b33da5ff8bf7501c/users/366e78c05df942b594fa9b50325f4efa/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:11:40.756819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3b92-3906-4d66-b585-a4fecfc40408 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:40.757141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3b92-3906-4d66-b585-a4fecfc40408 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:40.757383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae3b92-3906-4d66-b585-a4fecfc40408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:40.829170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4fae3b92-3906-4d66-b585-a4fecfc40408 None None] MFA Rules not processed for user `366e78c05df942b594fa9b50325f4efa`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:40.831141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fae3b92-3906-4d66-b585-a4fecfc40408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:41.008023 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1379/2747] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:41.019111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d968db-cdac-4573-b535-4b20c68bad18 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:41.019677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d968db-cdac-4573-b535-4b20c68bad18 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:41.019677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d968db-cdac-4573-b535-4b20c68bad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:41.056636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-69d968db-cdac-4573-b535-4b20c68bad18 None None] MFA Rules not processed for user `13a1ff48828145069e579627af7ef2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:41.058230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-69d968db-cdac-4573-b535-4b20c68bad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:41.071552 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:41.274917 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1369/2748] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:41.286679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:41.287112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:41.287485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:41.353462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] MFA Rules not processed for user `091fde210dc946e6b8d41a4c678f6a65`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:41.355939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:41.526616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1380/2749] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:46.268671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:46.269188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:46.269537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:46.363218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] MFA Rules not processed for user `6f034d6e3a874e9892df5c3188235e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:46.366435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:46.512657 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1370/2750] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:11:47.330948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:47.332733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:47.441322 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:47.453544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df458e83-43ee-45a4-b759-d256d3aa310d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:47.464539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e307a47-53ca-4eb2-a03b-321de0b7e27b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:47.465745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307a47-53ca-4eb2-a03b-321de0b7e27b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:47.466502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307a47-53ca-4eb2-a03b-321de0b7e27b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:47.466999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e307a47-53ca-4eb2-a03b-321de0b7e27b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:47.483450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e307a47-53ca-4eb2-a03b-321de0b7e27b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:47.486939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e307a47-53ca-4eb2-a03b-321de0b7e27b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:47.505876 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1381/2751] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:47.634594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:11:47.637890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:47.669371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3bbf35-a420-4330-ba1a-1928dada8c2a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:11:47.679345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:11:47.680918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:47.681414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:47.681895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:47.700672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:11:47.704643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:11:47.724497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1371/2752] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:11:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:11:48.299336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf183b-daaf-4597-834f-ca46b8435cab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:11:48.299652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf183b-daaf-4597-834f-ca46b8435cab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:11:48.299900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf183b-daaf-4597-834f-ca46b8435cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:11:48.342979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f7cf183b-daaf-4597-834f-ca46b8435cab None None] MFA Rules not processed for user `13a1ff48828145069e579627af7ef2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:11:48.345316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7cf183b-daaf-4597-834f-ca46b8435cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:11:48.354720 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1382/2753] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:11:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:11:57.715020 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=52 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:11:58.319126 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:06.798284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:06.815683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa177e-1574-442e-92b7-2d861e20819a service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:06.822626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:06.823897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:06.824437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:06.825127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:06.830494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:06.997904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:07.004211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdc6fb1-0b6a-4ead-821e-ce2f73c35c29 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:07.017528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1372/2754] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:10.907723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2638a-bdfc-4d2c-9f07-85c8cee88785 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:10.908468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2638a-bdfc-4d2c-9f07-85c8cee88785 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:10.908468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2638a-bdfc-4d2c-9f07-85c8cee88785 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:10.910251 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1383/2755] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:12:10.917242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:10.918762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:10.919140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:10.939965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:10.941120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:11.073716 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1373/2756] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:12:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:11.101074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2638a-bdfc-4d2c-9f07-85c8cee88785 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:11.103870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ced2638a-bdfc-4d2c-9f07-85c8cee88785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:11.124570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2638a-bdfc-4d2c-9f07-85c8cee88785 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:11.130596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:11.131275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:11.131553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:11.131829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:11.149073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:11.152153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:11.187630 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1384/2757] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:20.138893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:20.140501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:20.246610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ac7656-612c-4c57-9d9b-72abc7e2af3e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:20.254925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:20.256586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:20.257111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:20.257590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] PATH_INFO: `/v3/users/b20b9d3a9539420fa8cfe87da29ca1e4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:20.260023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b20b9d3a9539420fa8cfe87da29ca1e4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:20.264714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:20.335581 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:20.362471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b20b9d3a9539420fa8cfe87da29ca1e4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:20.377539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b20b9d3a9539420fa8cfe87da29ca1e4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:20.409186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b20b9d3a9539420fa8cfe87da29ca1e4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:20.410452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b20b9d3a9539420fa8cfe87da29ca1e4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:20.434193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3ba4e4c-e3e5-401c-9f33-1877313ad74e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b20b9d3a9539420fa8cfe87da29ca1e4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:20.442689 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1374/2758] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:20 2022] DELETE /identity/v3/users/b20b9d3a9539420fa8cfe87da29ca1e4 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:20.772556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:20.810285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0fc66a-9583-40d6-aadc-ca5926701b5e service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:21.013099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:21.014941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.015708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.016187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] PATH_INFO: `/v3/projects/3b7797d2a66144f880e517268ca01088` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.018417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b7797d2a66144f880e517268ca01088)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:21.021816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:21.142086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b7797d2a66144f880e517268ca01088', 'request_id': 'req-a838e00c-09a7-44b0-8dee-e3eed04039ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.172785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b7797d2a66144f880e517268ca01088', 'request_id': 'req-a838e00c-09a7-44b0-8dee-e3eed04039ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.193334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b7797d2a66144f880e517268ca01088', 'request_id': 'req-a838e00c-09a7-44b0-8dee-e3eed04039ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.228407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] The token cache is being invalidate because project 3b7797d2a66144f880e517268ca01088 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:21.228766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.232448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a838e00c-09a7-44b0-8dee-e3eed04039ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:21.232448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1385/2759] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:20 2022] DELETE /identity/v3/projects/3b7797d2a66144f880e517268ca01088 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:21.237704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c29a6-381f-4482-a79f-ee9e74db02f9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.238529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c29a6-381f-4482-a79f-ee9e74db02f9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.238529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70c29a6-381f-4482-a79f-ee9e74db02f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.264432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c70c29a6-381f-4482-a79f-ee9e74db02f9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:21.267256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c70c29a6-381f-4482-a79f-ee9e74db02f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:21.466744 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1375/2760] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:21.477398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.477740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.478485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.487845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.488623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.488897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.539252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] MFA Rules not processed for user `13a1ff48828145069e579627af7ef2f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:21.540140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:21.549195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:21.550689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:21.610170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1386/2761] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:21.612955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:21.655618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d4cef0-4ced-4daf-ae6b-0abb6deb9d6f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:21.668082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:21.670448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.671805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.672841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.675116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:21.676277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:21.679964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:21.723903 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1387/2762] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:21.726732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:21.759244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6b7423-adb9-4f03-aba8-fd465dfee34f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:21.772214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:21.773622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:21.774207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:21.775158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:21.777726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:21.782942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:21.789167 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1376/2763] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:21.856412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1388/2764] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/projects => generated 393 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:21.858596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:21.933954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e94f31d-5110-4ade-8872-9ccf4efe58ff None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.077123 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:22.093009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.093738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.094081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.094366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.095511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.098289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.134691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1377/2765] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:21 2022] POST /identity/v3/users => generated 297 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:12:22.141636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.176884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0b9af5-1972-49b1-8c6e-3187740d7ea4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.193662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.195193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.195936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.198787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.200724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.207791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.228964 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1389/2766] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:22.234440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.254837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5886de7-e141-41b3-9f49-72625a5e5ba1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.261936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72357c-b384-4355-a144-36d3639e5f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.262692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72357c-b384-4355-a144-36d3639e5f8c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.262975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72357c-b384-4355-a144-36d3639e5f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.263249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72357c-b384-4355-a144-36d3639e5f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.264054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72357c-b384-4355-a144-36d3639e5f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.266119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72357c-b384-4355-a144-36d3639e5f8c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.295939 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1378/2767] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:22.303781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:22.316891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d496c-8e31-4f04-b5a7-e468b383dbb0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:22.323664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:22.324692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.324974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.325249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] PATH_INFO: `/v3/projects/c3fa32c6d0654a1796082bcf3dcdec70/users/9a1a66e1565241bd95d50e5d4924044a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.349395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3fa32c6d0654a1796082bcf3dcdec70, user_id=9a1a66e1565241bd95d50e5d4924044a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:22.353342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:22.368643 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:22.394028 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1390/2768] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:22 2022] PUT /identity/v3/projects/c3fa32c6d0654a1796082bcf3dcdec70/users/9a1a66e1565241bd95d50e5d4924044a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:12:22.416778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:22.417084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:22.417329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:22.472756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] MFA Rules not processed for user `9a1a66e1565241bd95d50e5d4924044a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:22.475880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:22.584630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1379/2769] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:24.555717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:24.557776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:24.560087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:24.562711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:24.716189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f3af6-5079-4b44-9ca6-5c3ea95ca9c5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:24.725948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4bc6e-341c-4de9-8219-c81c0593595f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:24.727215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4bc6e-341c-4de9-8219-c81c0593595f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:24.728241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4bc6e-341c-4de9-8219-c81c0593595f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:24.728669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4bc6e-341c-4de9-8219-c81c0593595f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:24.743974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4bc6e-341c-4de9-8219-c81c0593595f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:24.745901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4bc6e-341c-4de9-8219-c81c0593595f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:24.767973 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1380/2770] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:24.775607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61de0a9f-995b-444f-8554-88e13b1d4e24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:24.785109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:24.786041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:24.786333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:24.786657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] PATH_INFO: `/v3/users/9c344ca2596044438f72e07545056a44` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:24.793392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c344ca2596044438f72e07545056a44)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:24.795877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:24.949102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c344ca2596044438f72e07545056a44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:24.950032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c344ca2596044438f72e07545056a44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:24.971285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c344ca2596044438f72e07545056a44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:24.973039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c344ca2596044438f72e07545056a44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:24.993238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c344ca2596044438f72e07545056a44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:25.035865 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1391/2771] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:24 2022] DELETE /identity/v3/users/9c344ca2596044438f72e07545056a44 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:12:25.040268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:25.041304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:25.041961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:25.073683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:25.075375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:25.153393 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:25.178920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1381/2772] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:25.195667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:25.197586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:25.381975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1395feb-9fe5-4b23-a90d-42d65866f574 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:25.414756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf009c8-5d47-430f-a2d6-ed02da1e08d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:25.418906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf009c8-5d47-430f-a2d6-ed02da1e08d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:25.418906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf009c8-5d47-430f-a2d6-ed02da1e08d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:25.418906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf009c8-5d47-430f-a2d6-ed02da1e08d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:25.519360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf009c8-5d47-430f-a2d6-ed02da1e08d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:25.530414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf009c8-5d47-430f-a2d6-ed02da1e08d6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:25.553003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1392/2773] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:25.821115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:25.821115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:25.855918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f272bf-f238-4c63-924e-07d4ca2393be None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:25.870069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:25.873426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:25.873698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:25.873979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] PATH_INFO: `/v3/users/9a1a66e1565241bd95d50e5d4924044a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:25.878434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1a66e1565241bd95d50e5d4924044a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:25.883292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:26.038113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1a66e1565241bd95d50e5d4924044a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:26.054053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1a66e1565241bd95d50e5d4924044a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:26.091163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1a66e1565241bd95d50e5d4924044a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:26.094102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1a66e1565241bd95d50e5d4924044a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:26.116933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1a66e1565241bd95d50e5d4924044a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:26.136786 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1382/2774] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:25 2022] DELETE /identity/v3/users/9a1a66e1565241bd95d50e5d4924044a => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:26.141457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:26.142324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:26.142324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:26.182155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:26.197347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:26.235492 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:26.329226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1393/2775] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:26.384297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:26.385926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:26.461399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711213e7-451a-4e85-9c2b-87cec2ccf526 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:26.465304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:26.465997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:26.466279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:26.466556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:26.477208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:26.479224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:26.491801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1383/2776] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:27.077710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:27.080997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:27.144816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef512dae-8f40-4359-9e49-001234fb63ff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:27.168549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:27.171184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:27.172091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:27.173164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] PATH_INFO: `/v3/projects/0a53245bece44905990a019a8cac6e0a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:27.180433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a53245bece44905990a019a8cac6e0a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:27.184731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:27.345035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a53245bece44905990a019a8cac6e0a', 'request_id': 'req-01cd2299-0474-47cf-8976-251f1f19ee1c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.356095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a53245bece44905990a019a8cac6e0a', 'request_id': 'req-01cd2299-0474-47cf-8976-251f1f19ee1c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.367542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a53245bece44905990a019a8cac6e0a', 'request_id': 'req-01cd2299-0474-47cf-8976-251f1f19ee1c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.408001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] The token cache is being invalidate because project 0a53245bece44905990a019a8cac6e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:27.409367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.412068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.421422 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1394/2777] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:27 2022] DELETE /identity/v3/projects/0a53245bece44905990a019a8cac6e0a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:27.428998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:27.459112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e070f-e5a8-4d7c-8dd0-430a65ef2d39 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:27.558460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:27.563216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:27.620513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:27.622313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:27.623112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:27.623410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] PATH_INFO: `/v3/users/f2b18016c04e496895652b6ff2822c63` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:27.625534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2b18016c04e496895652b6ff2822c63)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:27.631839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:27.639283 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:27.750666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2b18016c04e496895652b6ff2822c63'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.768302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cd2299-0474-47cf-8976-251f1f19ee1c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:27.776272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2b18016c04e496895652b6ff2822c63'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.776751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:27.778340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:27.780190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:27.780682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] PATH_INFO: `/v3/users/0b06170e53ba4047b500b0a55f5b0210` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:27.783019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b06170e53ba4047b500b0a55f5b0210)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:27.796583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:27.828889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2b18016c04e496895652b6ff2822c63'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.832474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2b18016c04e496895652b6ff2822c63'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.858273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2b18016c04e496895652b6ff2822c63'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.875494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1384/2778] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:27 2022] DELETE /identity/v3/users/f2b18016c04e496895652b6ff2822c63 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:27.969632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b06170e53ba4047b500b0a55f5b0210'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.974540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b06170e53ba4047b500b0a55f5b0210'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:27.977867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:28.006222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b06170e53ba4047b500b0a55f5b0210'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:28.006773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b06170e53ba4047b500b0a55f5b0210'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:28.021639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b06170e53ba4047b500b0a55f5b0210'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:28.081894 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1395/2779] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:27 2022] DELETE /identity/v3/users/0b06170e53ba4047b500b0a55f5b0210 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:28.602363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:28.603914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:28.758598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d1a95-4f4c-4a29-8bd3-5962f1ee5158 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:28.785696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:28.788752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:28.951639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:28.952096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:28.952416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:28.952686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] PATH_INFO: `/v3/users/d5c36018cd5145148fa4e7c6132545bf` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:28.954428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c36018cd5145148fa4e7c6132545bf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:28.956736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:28.960783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd62db5-f043-4464-81df-3d0450f3c4e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:28.969404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:28.972722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:28.973161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:28.973432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] PATH_INFO: `/v3/projects/c3fa32c6d0654a1796082bcf3dcdec70` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:28.976506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3fa32c6d0654a1796082bcf3dcdec70)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:28.978811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.016973 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:29.067865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c36018cd5145148fa4e7c6132545bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.085193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c36018cd5145148fa4e7c6132545bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.117001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c36018cd5145148fa4e7c6132545bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.118111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c36018cd5145148fa4e7c6132545bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.125995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3fa32c6d0654a1796082bcf3dcdec70', 'request_id': 'req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.134057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c36018cd5145148fa4e7c6132545bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.135317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3fa32c6d0654a1796082bcf3dcdec70', 'request_id': 'req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.142819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3fa32c6d0654a1796082bcf3dcdec70', 'request_id': 'req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.150120 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1385/2780] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:28 2022] DELETE /identity/v3/users/d5c36018cd5145148fa4e7c6132545bf => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:29.154228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.156669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.166844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] The token cache is being invalidate because project c3fa32c6d0654a1796082bcf3dcdec70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:29.167143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.168044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9fdede03-7ea1-4aef-b7be-8a8601f04b5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.170226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1396/2781] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:28 2022] DELETE /identity/v3/projects/c3fa32c6d0654a1796082bcf3dcdec70 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:29.177099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1f566-c038-4ad8-b0da-6f7022c7e07e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.177429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1f566-c038-4ad8-b0da-6f7022c7e07e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.177950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1f566-c038-4ad8-b0da-6f7022c7e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.200577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-43f1f566-c038-4ad8-b0da-6f7022c7e07e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:29.201620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43f1f566-c038-4ad8-b0da-6f7022c7e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.269985 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:29.289659 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1397/2782] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:29.301363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.302124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.302681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.307049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d8894e-fb46-425c-a742-233d6f25247d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.324954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.327705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.328169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.329040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] PATH_INFO: `/v3/projects/ef0c3ff13c6e4bf590962fc683f0a5a0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.331891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef0c3ff13c6e4bf590962fc683f0a5a0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.339278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.352698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:29.355117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.364969 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1398/2783] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:29.372296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.396057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f905b72-c761-47b0-acbb-3ec7e51639d4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.411772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.412569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.413900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.413900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.414424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:29.414764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.417247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.453433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef0c3ff13c6e4bf590962fc683f0a5a0', 'request_id': 'req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.474384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef0c3ff13c6e4bf590962fc683f0a5a0', 'request_id': 'req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.480104 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1399/2784] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:29.486933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef0c3ff13c6e4bf590962fc683f0a5a0', 'request_id': 'req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.490386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.512797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d40f2-4faf-4020-b107-0d4d4d29ec2a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.542995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] The token cache is being invalidate because project ef0c3ff13c6e4bf590962fc683f0a5a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:29.545947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.547290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da3a006e-9ec4-4c90-bbfb-70c89934a0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:29.551032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1386/2785] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:29 2022] DELETE /identity/v3/projects/ef0c3ff13c6e4bf590962fc683f0a5a0 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:29.560047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e61-8208-4caf-8c8a-3536e8cfe3ec None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.560807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e61-8208-4caf-8c8a-3536e8cfe3ec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.561545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8e61-8208-4caf-8c8a-3536e8cfe3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.607643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.611675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.612099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.612398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.613516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.615963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.617391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6b6f8e61-8208-4caf-8c8a-3536e8cfe3ec None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:29.620615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6b6f8e61-8208-4caf-8c8a-3536e8cfe3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.655541 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1400/2786] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:29 2022] POST /identity/v3/projects => generated 397 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:29.661644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.665326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.672338 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1387/2787] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:29.684533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.684934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.685387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.726885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:29.730374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.782386 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:29.826714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1651342-1b29-457c-8a96-b94f70a89ea3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.837745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.838872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.839765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.840443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.842085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.847262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.864579 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1388/2788] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:29.866462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.868424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:29.893494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c5b7c-f46a-4121-99cf-42c94546da86 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.898908 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1401/2789] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:29 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:29.899915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.906270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.908169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.908934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.909391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] PATH_INFO: `/v3/projects/c3600ce6f9ce4e74bbe4885216741573` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.912567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3600ce6f9ce4e74bbe4885216741573)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.917095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.918975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9582cd-3465-49b1-b0dc-eea2e105064d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.926179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.927033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.939887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.941250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.942155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:29.942482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.946365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:29.969436 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1402/2790] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:29.970776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:29.987760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c1040b-ef9b-4add-b93d-7554876bff1c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:29.994810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:29.995653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:29.995939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:29.996217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:29.997396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:29.998738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.013403 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1403/2791] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:30.014464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.021906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.074321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a75268-fea2-40a2-8b06-cb04940c0524 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:30.079429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3600ce6f9ce4e74bbe4885216741573', 'request_id': 'req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.105192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3600ce6f9ce4e74bbe4885216741573', 'request_id': 'req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.130232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3600ce6f9ce4e74bbe4885216741573', 'request_id': 'req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.160555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] The token cache is being invalidate because project c3600ce6f9ce4e74bbe4885216741573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:30.160823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.161845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.164304 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1389/2792] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:29 2022] DELETE /identity/v3/projects/c3600ce6f9ce4e74bbe4885216741573 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:30.165308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.167230 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:30.169845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.252276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:30.253157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.253438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.253711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] PATH_INFO: `/v3/projects/e99e7a5e8a484a21b0cae18cd3cb2461` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.257274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99e7a5e8a484a21b0cae18cd3cb2461)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:30.259504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.286916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e819e7cf-9b0a-4e09-9b75-5f34ab52ed32 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:30.292779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:30.293666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.293949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.294223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.294949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:30.297042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.343550 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1390/2793] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:30 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:30.345241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.347957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.431913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99e7a5e8a484a21b0cae18cd3cb2461', 'request_id': 'req-333725c7-0e6e-4aff-8a59-62a67b21a98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.456697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99e7a5e8a484a21b0cae18cd3cb2461', 'request_id': 'req-333725c7-0e6e-4aff-8a59-62a67b21a98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.459655 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:30.505031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99e7a5e8a484a21b0cae18cd3cb2461', 'request_id': 'req-333725c7-0e6e-4aff-8a59-62a67b21a98a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.510566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228f95ee-c600-4cf7-abab-017f18f9279b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:30.565533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] The token cache is being invalidate because project e99e7a5e8a484a21b0cae18cd3cb2461 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:30.566351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.568538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.572163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1404/2794] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:30 2022] DELETE /identity/v3/projects/e99e7a5e8a484a21b0cae18cd3cb2461 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:30.573775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.580823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.662613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:30.664112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.664462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.664770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.665687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:30.667575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.686165 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1391/2795] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:30.686165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.688539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.694544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333725c7-0e6e-4aff-8a59-62a67b21a98a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:30.701521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:30.702871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.703186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.704675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] PATH_INFO: `/v3/users/bb8a5288786f48209fdfa67ad057ddbe` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.705810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a9614-08d8-4481-9a25-e18745348da1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:30.709845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb8a5288786f48209fdfa67ad057ddbe)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:30.711593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1136ad-c9a8-494f-82cd-079e1b6b4a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:30.712508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1136ad-c9a8-494f-82cd-079e1b6b4a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.712902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1136ad-c9a8-494f-82cd-079e1b6b4a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.713289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1136ad-c9a8-494f-82cd-079e1b6b4a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.714227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.714537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1136ad-c9a8-494f-82cd-079e1b6b4a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:30.716740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1136ad-c9a8-494f-82cd-079e1b6b4a99 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.748083 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1392/2796] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:30 2022] POST /identity/v3/users => generated 283 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:30.748083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.748083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.748083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.770423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:30.772478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.788392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1393/2797] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:30.788392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.793958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.826921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e082f-3a68-4d42-b782-042f843a205a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:30.844938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:30.846207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.846597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.846987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] PATH_INFO: `/v3/projects/80a9d471126c4f2aaf56f347be3a5b86/users/73a0667782d44c9fa0411e60168afd53/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.879230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb8a5288786f48209fdfa67ad057ddbe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.881549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb8a5288786f48209fdfa67ad057ddbe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.885926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] RBAC: Authorizing `identity:create_grant(project_id=80a9d471126c4f2aaf56f347be3a5b86, user_id=73a0667782d44c9fa0411e60168afd53, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:30.891787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:30.899296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb8a5288786f48209fdfa67ad057ddbe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.910902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb8a5288786f48209fdfa67ad057ddbe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.915792 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:30.920918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-262620ee-7958-4947-9a36-086dc68e056b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb8a5288786f48209fdfa67ad057ddbe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:30.937843 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1394/2798] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:30 2022] PUT /identity/v3/projects/80a9d471126c4f2aaf56f347be3a5b86/users/73a0667782d44c9fa0411e60168afd53/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:30.937843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:30.940946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:30.953584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1405/2799] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:30 2022] DELETE /identity/v3/users/bb8a5288786f48209fdfa67ad057ddbe => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:30.953584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ec4c-793d-48e0-a386-b6fb3a257d5d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:30.953584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ec4c-793d-48e0-a386-b6fb3a257d5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:30.953584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a96ec4c-793d-48e0-a386-b6fb3a257d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:30.975278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3a96ec4c-793d-48e0-a386-b6fb3a257d5d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:30.977281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a96ec4c-793d-48e0-a386-b6fb3a257d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:31.057476 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1406/2800] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:31.072844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.073294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.073445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb00f29-3f67-4c1b-bb07-4d8a794f974d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.073589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.079752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.080640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.080934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.081217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.087861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.090638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.105019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1395/2801] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:31.105951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.108221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:31.109677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:31.119746 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1407/2802] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:31.120698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.131802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3fff1-339a-418b-9d3f-4e2559cec0f7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.139352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.140213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.140653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.140963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.141981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:31.142396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.144536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.163110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c220878-7516-4006-beb3-64cc19cff688 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.169037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.170096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.170555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.171035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.172197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.174749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.187248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1396/2803] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:31.187841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.192968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:31.199533 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1408/2804] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:31.200536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.227247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c6b10-749a-4217-8fdd-c2a1ccdf8d52 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.240799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.243028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.243502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.243988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.246095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.252396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.253796 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:31.326394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05ad04-3158-41c3-ad4e-7fd173aca0ed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.333402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.335431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.335959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.336496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.350132 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1409/2805] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:31 2022] POST /identity/v3/projects => generated 391 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:31.354530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.356256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.358201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.386422 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1397/2806] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:31.390010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.417543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c5e71-f223-4a0c-8eb2-318c78b2da72 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.435583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6bc01-7eb3-4e8d-8ff4-0c5d24852a88 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.447785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acdb06a-0b9d-4732-a370-76b7b3fd54b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.448785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb06a-0b9d-4732-a370-76b7b3fd54b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.448962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb06a-0b9d-4732-a370-76b7b3fd54b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.449216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acdb06a-0b9d-4732-a370-76b7b3fd54b4 admin admin] PATH_INFO: `/v3/projects/5a65e78bb995464996fe313201392b95/users/7c11c0d82ccf4472b35194fcc5a8ea1c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.481184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdb06a-0b9d-4732-a370-76b7b3fd54b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a65e78bb995464996fe313201392b95, user_id=7c11c0d82ccf4472b35194fcc5a8ea1c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.484262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acdb06a-0b9d-4732-a370-76b7b3fd54b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.515713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1410/2807] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:31 2022] PUT /identity/v3/projects/5a65e78bb995464996fe313201392b95/users/7c11c0d82ccf4472b35194fcc5a8ea1c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:31.518672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.518948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.520750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.550933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:31.551925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:31.571099 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:31.601346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.603713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.605158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.606102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.609469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.621103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.671767 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1398/2808] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:31 2022] POST /identity/v3/users => generated 296 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:31.676664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.691286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d356bca2-94a1-46d9-8629-6e2737f4cdb7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.717298 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1411/2809] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:31.747360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.848181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.853678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.855489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.855954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.859928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.863680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.893215 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1399/2810] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:31.897654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:31.907713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5f22ad-8ebb-421a-a9f4-757bbaa50aa2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.913099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.914094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.915585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.916114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.921815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012731eb-3177-4f8a-914c-d7731b7737ae admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:31.950313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.953372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32689e6f-fcf5-4a9f-ba33-24749fe76168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:31.955469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689e6f-fcf5-4a9f-ba33-24749fe76168 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:31.955768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689e6f-fcf5-4a9f-ba33-24749fe76168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:31.958452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.960192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32689e6f-fcf5-4a9f-ba33-24749fe76168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:31.961279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32689e6f-fcf5-4a9f-ba33-24749fe76168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:31.963229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32689e6f-fcf5-4a9f-ba33-24749fe76168 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:31.975573 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1412/2811] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:32.000160 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1400/2812] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:31 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:32.005102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:32.024172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364cb791-b26f-461d-80b1-8d83afa8b9ac service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:32.032231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:32.033362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:32.033802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:32.034097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] PATH_INFO: `/v3/projects/7bc4c604d39a47d4a4093c1d55426b9c/users/aadc9ee37ec94325bd1733744b0f0940/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:32.069909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bc4c604d39a47d4a4093c1d55426b9c, user_id=aadc9ee37ec94325bd1733744b0f0940, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:32.074744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:32.106711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1413/2813] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:32 2022] PUT /identity/v3/projects/7bc4c604d39a47d4a4093c1d55426b9c/users/aadc9ee37ec94325bd1733744b0f0940/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:32.112526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:32.112808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:32.113088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:32.154554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:32.155461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:32.181781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:32.183932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:32.306896 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:32.352730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2034b865-2bb6-4d1d-9c21-10acbae8c169 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:32.361523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:32.362444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:32.362723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:32.362998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] PATH_INFO: `/v3/projects/c98206a6abba4c948eb7c67dba3a4cb3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:32.367069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98206a6abba4c948eb7c67dba3a4cb3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:32.377216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:32.404541 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1401/2814] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:32.447690 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:32.469429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98206a6abba4c948eb7c67dba3a4cb3', 'request_id': 'req-48a2a211-3550-4c5b-8d67-f68cfc4abdab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:32.471599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:32.473949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:32.479299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98206a6abba4c948eb7c67dba3a4cb3', 'request_id': 'req-48a2a211-3550-4c5b-8d67-f68cfc4abdab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:32.493160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98206a6abba4c948eb7c67dba3a4cb3', 'request_id': 'req-48a2a211-3550-4c5b-8d67-f68cfc4abdab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:32.538085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] The token cache is being invalidate because project c98206a6abba4c948eb7c67dba3a4cb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:32.538793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:32.540915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48a2a211-3550-4c5b-8d67-f68cfc4abdab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:32.573646 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1414/2815] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:32 2022] DELETE /identity/v3/projects/c98206a6abba4c948eb7c67dba3a4cb3 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:32.588135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9ee2e-750e-4012-bf83-2d08bd0305c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:32.589945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9ee2e-750e-4012-bf83-2d08bd0305c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:32.590876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a9ee2e-750e-4012-bf83-2d08bd0305c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:32.634921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5762b75a-e6a0-4d69-af14-448b22edec43 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:32.660839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3a9ee2e-750e-4012-bf83-2d08bd0305c2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:32.663898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3a9ee2e-750e-4012-bf83-2d08bd0305c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:32.740263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:32.743402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:32.744827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:32.745607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:32.752295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:32.895797 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1415/2816] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:32.910802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:32.911443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:32.911944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:32.955860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:32.957283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:32.966036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:32.968857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:32.982367 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1416/2817] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:32.988380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:33.008156 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1402/2818] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:33.010278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d67805-8f18-4ccc-963f-44273cab6b9b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:33.033488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:33.034004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.034288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.034812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.036316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:33.036316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:33.037732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:33.084176 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1417/2819] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:12:33.090328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:33.125474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d45d63a-4fe5-48a4-ae03-38f8bdd8c877 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:33.133768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:33.134902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.135355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.135764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.137237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:33.140682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:33.257308 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1403/2820] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:33 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:33.257581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:33.285036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edecd0-a0df-4da3-bca0-b80b21e2c2e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:33.486244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:33.488748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.490079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.492575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.494035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:33.499536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:33.573241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:33.580608 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1418/2821] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:33 2022] POST /identity/v3/users => generated 288 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:33.588447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b450d-a872-4c62-ba09-ff9b652162b3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:33.594799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:33.595747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.596088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.597190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.597569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:33.603270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:33.632127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1404/2822] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:33.633884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:33.668893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24fb2d-8208-4c4b-bab7-edd21a51fbcf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:33.677958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95697482-0514-49a8-8cbf-ec5561bdb827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:33.679178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697482-0514-49a8-8cbf-ec5561bdb827 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.679680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697482-0514-49a8-8cbf-ec5561bdb827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.680894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95697482-0514-49a8-8cbf-ec5561bdb827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.681989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697482-0514-49a8-8cbf-ec5561bdb827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:33.686153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95697482-0514-49a8-8cbf-ec5561bdb827 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:33.712543 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1419/2823] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:33.714952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:33.728474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8263d40b-0e7b-408d-a745-8a95b565f4c9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:33.734512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:33.735441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.735733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.737182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] PATH_INFO: `/v3/projects/cdb3998daa7f46dabd79e11c6ea68c43/users/ab6939eb175b4eee8ecb80527df2778f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.752057 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:33.769733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdb3998daa7f46dabd79e11c6ea68c43, user_id=ab6939eb175b4eee8ecb80527df2778f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:33.781851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:33.856581 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1405/2824] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:33 2022] PUT /identity/v3/projects/cdb3998daa7f46dabd79e11c6ea68c43/users/ab6939eb175b4eee8ecb80527df2778f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:33.867095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:33.868185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:33.868777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:33.937339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] MFA Rules not processed for user `ab6939eb175b4eee8ecb80527df2778f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:33.938789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:33.978142 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:34.210089 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1420/2825] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:34.211299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:34.416042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c9075-8f79-4cca-8bac-aeef000ccfca admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:34.441681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:34.442762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:34.443229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:34.443692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:34.444964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:34.448596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:34.521380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1406/2826] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:34 2022] POST /identity/v3/projects => generated 377 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:34.525438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:34.552584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028196b9-f04c-4119-bdd4-131cee6ee19a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:34.716095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:34.717358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:34.717822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:34.718271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:34.723839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:34.746903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:34.809847 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1421/2827] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:34 2022] POST /identity/v3/users => generated 295 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:34.813851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:34.830315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50362d8c-e54f-4f76-be30-7fd833c61ac4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:34.837809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:34.839025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:34.840813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:34.841583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:34.843522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:34.846354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:34.867859 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1407/2828] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:34.877593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:34.941959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7a5ed8-0919-4a3f-9807-fd1f0286509f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:34.954707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:34.958059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:34.959315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:34.960821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] PATH_INFO: `/v3/projects/6e1434a4242f4a72b104feb1d55b4ef5/users/215721c699cb4a43a1a3c2c7b0e7b596/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:35.007580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1434a4242f4a72b104feb1d55b4ef5, user_id=215721c699cb4a43a1a3c2c7b0e7b596, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:35.014800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:35.062034 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1422/2829] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:34 2022] PUT /identity/v3/projects/6e1434a4242f4a72b104feb1d55b4ef5/users/215721c699cb4a43a1a3c2c7b0e7b596/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:12:35.066577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:35.083151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c800b0-49c4-4570-897b-02b0e52ed166 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:35.303948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940382a-b5a8-4a62-a591-274845329b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:35.305238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940382a-b5a8-4a62-a591-274845329b3e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:35.305787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940382a-b5a8-4a62-a591-274845329b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:35.306364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940382a-b5a8-4a62-a591-274845329b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:35.307823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940382a-b5a8-4a62-a591-274845329b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:35.310235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940382a-b5a8-4a62-a591-274845329b3e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:35.331651 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1408/2830] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:35.341728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:35.361927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6283cc-7d79-47b5-afbd-bba92ff28c5e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:35.376055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:35.378091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:35.378590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:35.379072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] PATH_INFO: `/v3/projects/6e1434a4242f4a72b104feb1d55b4ef5/users/215721c699cb4a43a1a3c2c7b0e7b596/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:35.384880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e1434a4242f4a72b104feb1d55b4ef5, user_id=215721c699cb4a43a1a3c2c7b0e7b596, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:35.393915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:35.438405 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1423/2831] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:35 2022] PUT /identity/v3/projects/6e1434a4242f4a72b104feb1d55b4ef5/users/215721c699cb4a43a1a3c2c7b0e7b596/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:35.448769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:35.449329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:35.450429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:35.499128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] MFA Rules not processed for user `215721c699cb4a43a1a3c2c7b0e7b596`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:35.500524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:35.573281 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:35.645094 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1409/2832] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:35.667774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:35.671285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:35.925810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fabe92a-8f45-4335-bb48-9a550c870dda admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:35.956524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d033-5df3-49dd-a4a1-be5ad540028c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:35.959262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d033-5df3-49dd-a4a1-be5ad540028c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:35.959441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d033-5df3-49dd-a4a1-be5ad540028c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:35.959588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d033-5df3-49dd-a4a1-be5ad540028c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:35.982535 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:35.989384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760d033-5df3-49dd-a4a1-be5ad540028c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:35.992604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760d033-5df3-49dd-a4a1-be5ad540028c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:36.006176 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1424/2833] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:35 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:37.037205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:37.231372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccf80cd-8a52-4a3e-9c1d-edf84f5c49eb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:37.242464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:37.244793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:37.245510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:37.246255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] PATH_INFO: `/v3/users/ab6939eb175b4eee8ecb80527df2778f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:37.249276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab6939eb175b4eee8ecb80527df2778f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:37.255087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:37.470969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab6939eb175b4eee8ecb80527df2778f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.487036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab6939eb175b4eee8ecb80527df2778f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.511845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab6939eb175b4eee8ecb80527df2778f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.512643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab6939eb175b4eee8ecb80527df2778f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.524362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab6939eb175b4eee8ecb80527df2778f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:37.534787 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1410/2834] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:37 2022] DELETE /identity/v3/users/ab6939eb175b4eee8ecb80527df2778f => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:37.538945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993868a-57d6-40f4-9445-e9593224fd35 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:37.538945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993868a-57d6-40f4-9445-e9593224fd35 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:37.538945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993868a-57d6-40f4-9445-e9593224fd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:37.574765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c993868a-57d6-40f4-9445-e9593224fd35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:37.577117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c993868a-57d6-40f4-9445-e9593224fd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:37.736279 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1425/2835] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:37.807452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:37.809226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:37.962086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8646080e-a613-4608-9759-ea2ba011c4c4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:37.969677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:37.971203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:37.971806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:37.972392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:37.990262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:37.992225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:38.013723 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1411/2836] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:39.996071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:39.997139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:39.997636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.042729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] MFA Rules not processed for user `2b2950eec4754c328f600d770a8860d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:40.045629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:40.230734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:40.232472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:40.258305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75a0d0f-d232-4209-a2b3-e937d348540f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:40.264166 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:40.268437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:40.269675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:40.270061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:40.270436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] PATH_INFO: `/v3/users/091fde210dc946e6b8d41a4c678f6a65` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:40.287985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091fde210dc946e6b8d41a4c678f6a65)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:40.288336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1426/2837] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:40.288577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:40.374636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091fde210dc946e6b8d41a4c678f6a65'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.427958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091fde210dc946e6b8d41a4c678f6a65'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.476408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091fde210dc946e6b8d41a4c678f6a65'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.477960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091fde210dc946e6b8d41a4c678f6a65'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.499505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091fde210dc946e6b8d41a4c678f6a65'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:40.519086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1412/2838] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:40 2022] DELETE /identity/v3/users/091fde210dc946e6b8d41a4c678f6a65 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:40.833842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:40.836316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:40.926321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11794c25-87cc-415d-a210-713b3fcaba7d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:41.241955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:41.245262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:41.245774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:41.246240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] PATH_INFO: `/v3/projects/cdb3998daa7f46dabd79e11c6ea68c43` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:41.257542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdb3998daa7f46dabd79e11c6ea68c43)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:41.262699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:41.446886 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:41.456086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdb3998daa7f46dabd79e11c6ea68c43', 'request_id': 'req-b3a5b529-b2d9-46ac-a221-3403e1181d10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:41.493505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdb3998daa7f46dabd79e11c6ea68c43', 'request_id': 'req-b3a5b529-b2d9-46ac-a221-3403e1181d10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:41.516311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdb3998daa7f46dabd79e11c6ea68c43', 'request_id': 'req-b3a5b529-b2d9-46ac-a221-3403e1181d10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:41.588729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] The token cache is being invalidate because project cdb3998daa7f46dabd79e11c6ea68c43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:41.589583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:41.591213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:41.594494 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1427/2839] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:40 2022] DELETE /identity/v3/projects/cdb3998daa7f46dabd79e11c6ea68c43 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:41.600065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:41.602771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:41.638564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1966e8-8582-408d-a87a-ff6d49e4efe4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:41.852583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:41.854087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:41.854378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:41.854659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] PATH_INFO: `/v3/users/215721c699cb4a43a1a3c2c7b0e7b596` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:41.856280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] RBAC: Authorizing `identity:delete_user(user_id=215721c699cb4a43a1a3c2c7b0e7b596)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:41.858371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:41.981187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '215721c699cb4a43a1a3c2c7b0e7b596'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.000890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '215721c699cb4a43a1a3c2c7b0e7b596'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.034378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '215721c699cb4a43a1a3c2c7b0e7b596'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.035211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '215721c699cb4a43a1a3c2c7b0e7b596'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.062184 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:42.069098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '215721c699cb4a43a1a3c2c7b0e7b596'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:42.086602 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1413/2840] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:12:41 2022] DELETE /identity/v3/users/215721c699cb4a43a1a3c2c7b0e7b596 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:43.424974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:43.429603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:43.452395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:43.453409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:43.491195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a5b529-b2d9-46ac-a221-3403e1181d10 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:43.713835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c56929-226a-4d99-9e31-6b39397bc1db admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:43.733753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:43.734572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:43.734859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:43.735139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] PATH_INFO: `/v3/projects/2acb4d9c7f794879abfcb46f58764444` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:43.737388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:43.738635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:43.741989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:43.742647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] PATH_INFO: `/v3/projects/6e1434a4242f4a72b104feb1d55b4ef5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:43.743325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acb4d9c7f794879abfcb46f58764444)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:43.747682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:43.750032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e1434a4242f4a72b104feb1d55b4ef5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:43.764043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:43.948073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acb4d9c7f794879abfcb46f58764444', 'request_id': 'req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.972771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acb4d9c7f794879abfcb46f58764444', 'request_id': 'req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:43.992562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acb4d9c7f794879abfcb46f58764444', 'request_id': 'req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.008435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e1434a4242f4a72b104feb1d55b4ef5', 'request_id': 'req-c73ae21b-bca2-4bd1-a590-9e282cea4600'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.024589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] The token cache is being invalidate because project 2acb4d9c7f794879abfcb46f58764444 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:44.025807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.027282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee586a4d-af5f-4ea1-b3be-3ff08c181c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.028423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e1434a4242f4a72b104feb1d55b4ef5', 'request_id': 'req-c73ae21b-bca2-4bd1-a590-9e282cea4600'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.058881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e1434a4242f4a72b104feb1d55b4ef5', 'request_id': 'req-c73ae21b-bca2-4bd1-a590-9e282cea4600'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.074642 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1414/2841] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:43 2022] DELETE /identity/v3/projects/2acb4d9c7f794879abfcb46f58764444 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:12:44.078247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8407-231f-4707-931f-18e757ec3931 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.079127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8407-231f-4707-931f-18e757ec3931 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.080598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760b8407-231f-4707-931f-18e757ec3931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.087918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] The token cache is being invalidate because project 6e1434a4242f4a72b104feb1d55b4ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:12:44.088577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.089728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c73ae21b-bca2-4bd1-a590-9e282cea4600 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:12:44.094477 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1428/2842] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:12:43 2022] DELETE /identity/v3/projects/6e1434a4242f4a72b104feb1d55b4ef5 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:44.099902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe29d2-a925-40e1-9e80-8931e51cc799 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.100182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe29d2-a925-40e1-9e80-8931e51cc799 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.100487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe29d2-a925-40e1-9e80-8931e51cc799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.142745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-99fe29d2-a925-40e1-9e80-8931e51cc799 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:44.144218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99fe29d2-a925-40e1-9e80-8931e51cc799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:44.168629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-760b8407-231f-4707-931f-18e757ec3931 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:44.180781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-760b8407-231f-4707-931f-18e757ec3931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:44.327919 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1429/2843] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:44.339792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.342649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.342649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.381127 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:44.432617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:44.440921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:44.484775 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1415/2845] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:44.491770 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1430/2845] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:44.491770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.494971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.495793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.496564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.527122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cde674-63a3-4a67-96db-391c72db1370 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:44.547441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:44.549075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.549384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.549666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.550448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:44.550758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:44.551004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:44.552506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:44.556512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:44.594723 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1431/2846] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:44.598664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.604774 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1416/2847] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:44.609886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.630684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6693dd5-411a-4447-b742-f16cc8a13403 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:44.642163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:44.643683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.644564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.644888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.646568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:44.652131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:44.716496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60513dcc-9ae9-43ad-9632-c1f2013d1f20 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:44.734802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1432/2848] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:44.739773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.755673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:44.756966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.762181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.762462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.763436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:12:44.763823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:44.772072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:44.810412 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1417/2849] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:12:44.813092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:44.858160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb2048-4036-4479-af0b-10ee19d9d0a4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:44.875840 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:44.950343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45140ba7-158d-4137-b82d-cc7eb0ae9ec0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:44.967320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:44.968593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:44.969133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:44.969621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:44.970593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:44.973037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.084959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1433/2850] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:45.095712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.148663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7ddeb-4ce7-460c-8a97-d7f8c640299d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.174249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.175308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.175781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.176209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.177179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.180828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.181786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.182192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.182652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.182782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.190101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.205065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.263103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1418/2851] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:44 2022] POST /identity/v3/projects => generated 379 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:45.267325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.277818 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1434/2852] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:45.281726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.360691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f5d117-d4a3-421d-870c-f1ee6333f340 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.455261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccc1fa-4ac2-4923-bd8a-29a6b5a1628f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.470227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.471235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.471965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.472961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.475073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.481077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.539351 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1419/2853] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:45 2022] POST /identity/v3/users => generated 290 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:12:45.545195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.550771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.554057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.554307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.554524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.557864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.560679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.564575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5a62-eb28-4f2e-b8b1-cb394d8784bd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.573035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.573758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.574068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.574449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.575646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.577703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.600402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1420/2854] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:45.603723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.614624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1435/2855] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:45.619193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.647890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09df5e-0a6d-4273-b594-e142200cb8b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.650134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61966dbd-683c-4d00-93ce-b127c99f7333 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.660931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.661653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.661934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.662209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.663232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.665051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.675685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27650753-85ea-4ce6-a18d-e497af94560e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.676756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27650753-85ea-4ce6-a18d-e497af94560e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.677039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27650753-85ea-4ce6-a18d-e497af94560e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.677381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27650753-85ea-4ce6-a18d-e497af94560e admin admin] PATH_INFO: `/v3/projects/97bbb2285db74c32b2bf09941c4d1fb8/users/f61221659eee4c57ab0c7817c73e9ffc/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.683644 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1421/2856] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:12:45.684985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:45.697741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d2ec4-f9c0-42b3-8483-c9aa04fd0ef5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:45.703476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdcdf9-a862-478a-8ba8-7e830c8b6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:45.705270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcdf9-a862-478a-8ba8-7e830c8b6e08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.705591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcdf9-a862-478a-8ba8-7e830c8b6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.705950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdcdf9-a862-478a-8ba8-7e830c8b6e08 admin admin] PATH_INFO: `/v3/projects/73680830e84844e9b893e6c444f70284/users/9badff81d3c246139c5f5a2cbb31f06f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.729620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdcdf9-a862-478a-8ba8-7e830c8b6e08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73680830e84844e9b893e6c444f70284, user_id=9badff81d3c246139c5f5a2cbb31f06f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.737102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdcdf9-a862-478a-8ba8-7e830c8b6e08 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.749836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27650753-85ea-4ce6-a18d-e497af94560e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97bbb2285db74c32b2bf09941c4d1fb8, user_id=f61221659eee4c57ab0c7817c73e9ffc, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:45.752958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27650753-85ea-4ce6-a18d-e497af94560e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:45.780428 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1422/2857] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:45 2022] PUT /identity/v3/projects/73680830e84844e9b893e6c444f70284/users/9badff81d3c246139c5f5a2cbb31f06f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:12:45.786324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.786664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.786944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.790791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1436/2858] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:45 2022] PUT /identity/v3/projects/97bbb2285db74c32b2bf09941c4d1fb8/users/f61221659eee4c57ab0c7817c73e9ffc/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:45.816410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:45.816778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:45.816964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:45.852149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] MFA Rules not processed for user `9badff81d3c246139c5f5a2cbb31f06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:45.853883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:45.880080 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:45.911706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] MFA Rules not processed for user `f61221659eee4c57ab0c7817c73e9ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:45.915148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:45.956375 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:46.137005 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1423/2859] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:46.152791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:46.157014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:46.212770 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1437/2860] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:46.217554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:46.352993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9898a4-601a-4be7-89ae-50cb9c8115dc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:46.360436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:46.361389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:46.362521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:46.363171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:46.364227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:46.369901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:46.421488 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1438/2861] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:12:46 2022] POST /identity/v3/projects => generated 375 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:12:46.436842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:46.609353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87df3be-c801-4d0e-8bc1-0c3f9ac7ded0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:46.658452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1d906-44f6-4320-a65a-6a4aa4611f24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:46.684130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:46.686616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:46.686917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:46.687372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:46.688872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:46.690945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:46.748028 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1439/2862] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:12:46 2022] POST /identity/v3/users => generated 294 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:12:46.752730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:46.779123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8346a6-666e-4778-a8e6-7777d36c225e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:46.791004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:46.791827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:46.792119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:46.792479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:46.793213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:46.809505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:46.870897 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1440/2863] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:46.876120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:46.879209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:46.881827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:46.882388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:46.884573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:46.919875 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:46.939309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1203ee97-0926-4ff1-9e50-7b039e702ed7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:46.957336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:46.963672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:46.964047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:46.968660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] PATH_INFO: `/v3/projects/53b6bd3e082f4527b32a68f772b26c85/users/94f536047e90441b91a2efc06d133045/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:47.007605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b6bd3e082f4527b32a68f772b26c85, user_id=94f536047e90441b91a2efc06d133045, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:47.010592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:47.046637 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1441/2864] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:46 2022] PUT /identity/v3/projects/53b6bd3e082f4527b32a68f772b26c85/users/94f536047e90441b91a2efc06d133045/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:47.047760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:47.111472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:47.113126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:47.138126 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1424/2865] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 987 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:47.322826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b120eb6-aded-4cb8-be10-505af4bdf0d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:47.343307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ff58c9-3aa6-4cb1-96f2-100d452c5a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:47.344130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff58c9-3aa6-4cb1-96f2-100d452c5a82 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:47.344308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff58c9-3aa6-4cb1-96f2-100d452c5a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:47.346114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ff58c9-3aa6-4cb1-96f2-100d452c5a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:47.347294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff58c9-3aa6-4cb1-96f2-100d452c5a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:47.351789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ff58c9-3aa6-4cb1-96f2-100d452c5a82 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:47.383056 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1442/2866] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:12:47.389240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:47.413940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0047a-0c89-46ac-a107-36ca258430ca service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:47.428182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c472d28-e72f-45a2-89ea-3538591b56a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:47.429317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c472d28-e72f-45a2-89ea-3538591b56a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:47.429717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c472d28-e72f-45a2-89ea-3538591b56a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:47.430092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c472d28-e72f-45a2-89ea-3538591b56a6 admin admin] PATH_INFO: `/v3/projects/53b6bd3e082f4527b32a68f772b26c85/users/94f536047e90441b91a2efc06d133045/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:47.450454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c472d28-e72f-45a2-89ea-3538591b56a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53b6bd3e082f4527b32a68f772b26c85, user_id=94f536047e90441b91a2efc06d133045, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:47.461834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c472d28-e72f-45a2-89ea-3538591b56a6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:47.475668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2910097-9e65-47ee-b77b-00786902c30e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:47.476098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2910097-9e65-47ee-b77b-00786902c30e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:47.476513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2910097-9e65-47ee-b77b-00786902c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:47.529824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e2910097-9e65-47ee-b77b-00786902c30e None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:47.536217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2910097-9e65-47ee-b77b-00786902c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:47.536793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1425/2867] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:12:47 2022] PUT /identity/v3/projects/53b6bd3e082f4527b32a68f772b26c85/users/94f536047e90441b91a2efc06d133045/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:12:47.553414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:47.554116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:47.554511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:47.647408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] MFA Rules not processed for user `94f536047e90441b91a2efc06d133045`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:47.657218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:47.682721 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:47.792852 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1443/2868] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:47.825122 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1426/2869] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:47.845413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:47.846159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:47.846513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:47.890796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:47.892725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:47.903271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] MFA Rules not processed for user `f61221659eee4c57ab0c7817c73e9ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:47.904832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:48.026139 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1444/2870] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:48.045651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055319a3-563c-4a7a-aea1-025efc16a9fd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:48.072917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413fd8-757c-46e7-80ac-53e1417ce170 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:48.074377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413fd8-757c-46e7-80ac-53e1417ce170 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:48.074882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413fd8-757c-46e7-80ac-53e1417ce170 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:48.075337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413fd8-757c-46e7-80ac-53e1417ce170 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:48.100532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413fd8-757c-46e7-80ac-53e1417ce170 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:48.102926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413fd8-757c-46e7-80ac-53e1417ce170 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:48.108615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:48.110097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:48.120310 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1427/2871] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:12:48.181753 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:48.284678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f955c2c-fa7c-4310-8709-ef774e654b79 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:48.300949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e20bcd-b9f2-4835-9051-1d25b3838072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:48.301928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e20bcd-b9f2-4835-9051-1d25b3838072 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:48.302217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e20bcd-b9f2-4835-9051-1d25b3838072 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:48.302698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e20bcd-b9f2-4835-9051-1d25b3838072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:48.328382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e20bcd-b9f2-4835-9051-1d25b3838072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:48.331132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e20bcd-b9f2-4835-9051-1d25b3838072 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:48.354235 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1445/2872] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:12:49.744834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7a2bf-1081-4906-a3b4-8cc051d53d44 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:49.745451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7a2bf-1081-4906-a3b4-8cc051d53d44 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:49.746000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7a2bf-1081-4906-a3b4-8cc051d53d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:49.825620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6de7a2bf-1081-4906-a3b4-8cc051d53d44 None None] MFA Rules not processed for user `aadc9ee37ec94325bd1733744b0f0940`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:49.826982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6de7a2bf-1081-4906-a3b4-8cc051d53d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:49.983568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1428/2873] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:52.028556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:52.029359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:52.029359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:52.144645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] MFA Rules not processed for user `73a0667782d44c9fa0411e60168afd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:52.147154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:52.367715 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1446/2874] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:52.377940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:52.378697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:52.378697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:52.426360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] MFA Rules not processed for user `73a0667782d44c9fa0411e60168afd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:52.432814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:52.459624 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1429/2875] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:12:52.528711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:52.581067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c15548-36e8-4f29-a7df-7cceaf0ace80 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:52.612453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:52.613540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:52.613987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:52.614329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:52.641108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:52.646054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:52.682468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1447/2876] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:53.093589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:53.144401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2809e-ae58-449c-ad20-f91742aed763 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:53.154965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40bcb86-a19a-4454-921a-74acb28408b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:53.156817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bcb86-a19a-4454-921a-74acb28408b8 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:53.157597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bcb86-a19a-4454-921a-74acb28408b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:53.158367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40bcb86-a19a-4454-921a-74acb28408b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:53.174396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bcb86-a19a-4454-921a-74acb28408b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:53.178070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40bcb86-a19a-4454-921a-74acb28408b8 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:53.231524 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1430/2877] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:53.436498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:12:53.439156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:53.481287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d12e19-a599-413f-9e90-05e55670d23c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:12:53.500211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:12:53.501316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:53.502171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:53.502663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:53.506063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:53.669084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:12:53.677953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a73875-dd60-4407-9efc-0ee5a3e159de service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:12:53.703678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1448/2878] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:12:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:12:57.818229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:57.820656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:57.821676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:57.886152 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:12:57.989699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] MFA Rules not processed for user `7c11c0d82ccf4472b35194fcc5a8ea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:57.998166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:58.316460 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1431/2879] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:12:58.318839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:12:58.319455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:12:58.319800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:12:58.455588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] MFA Rules not processed for user `7c11c0d82ccf4472b35194fcc5a8ea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:12:58.457834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:12:58.518932 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1449/2880] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:12:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:01.082664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:01.172022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97aa7c1f-04bd-42f7-925f-bb19dee846c9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:01.227751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:01.228505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:01.228796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:01.229075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:01.263320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:01.265095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:01.314620 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1432/2881] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:08.414472 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:11.290689 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=35 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:13.325565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:13.327222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:13.429574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad10c22-6abf-4f9a-9ae5-366662066b08 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:13.434509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:13.435860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:13.436297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:13.436781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] PATH_INFO: `/v3/users/aadc9ee37ec94325bd1733744b0f0940` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:13.438542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aadc9ee37ec94325bd1733744b0f0940)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:13.441576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:13.529580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aadc9ee37ec94325bd1733744b0f0940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:13.530504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aadc9ee37ec94325bd1733744b0f0940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:13.544688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aadc9ee37ec94325bd1733744b0f0940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:13.545654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aadc9ee37ec94325bd1733744b0f0940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:13.563618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ac37a9f9-1aa1-4c3a-b270-d1be804abec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aadc9ee37ec94325bd1733744b0f0940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:13.633861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1450/2882] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:13:13 2022] DELETE /identity/v3/users/aadc9ee37ec94325bd1733744b0f0940 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:14.106907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:14.160803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5281e-66f3-404d-8a22-bb1f23f3883b service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:14.286041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:14.287315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:14.287681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:14.288147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] PATH_INFO: `/v3/projects/7bc4c604d39a47d4a4093c1d55426b9c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:14.290091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bc4c604d39a47d4a4093c1d55426b9c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:14.293122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:14.376400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bc4c604d39a47d4a4093c1d55426b9c', 'request_id': 'req-10abffa9-51ea-48e0-a4ef-fbc083e911bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:14.388475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bc4c604d39a47d4a4093c1d55426b9c', 'request_id': 'req-10abffa9-51ea-48e0-a4ef-fbc083e911bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:14.397506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bc4c604d39a47d4a4093c1d55426b9c', 'request_id': 'req-10abffa9-51ea-48e0-a4ef-fbc083e911bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:14.413413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] The token cache is being invalidate because project 7bc4c604d39a47d4a4093c1d55426b9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:13:14.413727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:14.414398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10abffa9-51ea-48e0-a4ef-fbc083e911bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:14.417027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1433/2883] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:13:14 2022] DELETE /identity/v3/projects/7bc4c604d39a47d4a4093c1d55426b9c => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:14.425693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9454-a767-457b-a331-8f148062f029 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:14.430256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9454-a767-457b-a331-8f148062f029 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:14.431046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e9454-a767-457b-a331-8f148062f029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:14.473091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-092e9454-a767-457b-a331-8f148062f029 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:14.475578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-092e9454-a767-457b-a331-8f148062f029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:14.609895 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1451/2884] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:14.618786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:14.619275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:14.619747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:14.666490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:14.668780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:14.690045 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1434/2885] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:14.695403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e9454-a767-457b-a331-8f148062f029 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:14.713434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e9454-a767-457b-a331-8f148062f029 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:14.728640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:14.730094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:14.730613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:14.731130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:14.733869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:13:14.734421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:14.737722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:14.766189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1452/2886] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:13:14.772898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:14.784524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cf0daa-6279-42b8-a349-ac9e0225bcd3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:14.792589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:14.792931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:14.793556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:14.793556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:14.794442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:14.796586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:14.849377 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1435/2887] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:14 2022] POST /identity/v3/projects => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:14.854406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:14.866341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b48b7a-0da7-4e45-880b-7cbc373dc86e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:14.871944 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:15.078980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:15.079794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:15.081047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:15.081398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:15.082157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:15.084722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:15.114734 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1453/2888] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:14 2022] POST /identity/v3/users => generated 292 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:15.120235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:15.138385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750db16-6a7d-4dcf-a491-45a895f75d19 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:15.151251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:15.155417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:15.155417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:15.155417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:15.155417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:15.156337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:15.174523 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1436/2889] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:15.175833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:15.189243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35c4e0-c8d7-4581-9984-e496da8549ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:15.193592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85b426f-90c3-4bc1-a1e2-41c146494cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:15.194294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b426f-90c3-4bc1-a1e2-41c146494cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:15.194579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b426f-90c3-4bc1-a1e2-41c146494cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:15.194857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85b426f-90c3-4bc1-a1e2-41c146494cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:15.195616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b426f-90c3-4bc1-a1e2-41c146494cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:15.197641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85b426f-90c3-4bc1-a1e2-41c146494cfe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:15.210490 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1454/2890] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:15.222098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:15.254168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b7f55-f263-44b0-894f-7b6a3f2210de admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:15.267089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:15.268303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:15.270926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:15.271330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] PATH_INFO: `/v3/projects/c16ae9a2e0994d528daa61b267d88020/users/b57ca8171ff14c9e9161c3602ff69d34/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:15.292297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16ae9a2e0994d528daa61b267d88020, user_id=b57ca8171ff14c9e9161c3602ff69d34, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:15.295766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:15.340694 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1437/2891] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:15 2022] PUT /identity/v3/projects/c16ae9a2e0994d528daa61b267d88020/users/b57ca8171ff14c9e9161c3602ff69d34/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:15.346367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16025b-d1a4-4950-a383-b2af33b5805f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:15.346950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16025b-d1a4-4950-a383-b2af33b5805f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:15.347465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16025b-d1a4-4950-a383-b2af33b5805f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:15.381048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c16025b-d1a4-4950-a383-b2af33b5805f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:15.385564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c16025b-d1a4-4950-a383-b2af33b5805f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:15.511967 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1455/2892] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:15.521057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:15.527128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:15.592472 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:15.646140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a03f4-f6f3-4b24-979b-2293af909885 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:15.651219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:15.651997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:15.652380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:15.652753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:15.668572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:15.670227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:15.688181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1438/2893] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:18.699655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:18.700587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:18.701374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:18.760051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:18.762891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:18.966027 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1456/2894] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:13:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:19.035390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:19.039923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:19.047576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:19.059212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:19.117062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8476e6-a16a-41fd-a752-f3a631096f18 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:19.134586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:19.135544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:19.136120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:19.136526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:19.140217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:19.295938 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:19.396884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:19.396884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:19.411173 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1457/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:19.423826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2bdef-7094-4ed7-b391-39bec5443dc1 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:19.453512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:19.454691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:19.455287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:19.455730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:19.492692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:19.496998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:19.527451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1439/2896] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:13:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:13:19.845782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:19.849174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:19.901489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdcbc4f-1635-4c8e-b2d5-5b9a6ce53122 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:19.912830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:19.917920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:19.918760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:19.920195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] PATH_INFO: `/v3/users/9badff81d3c246139c5f5a2cbb31f06f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:19.929602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9badff81d3c246139c5f5a2cbb31f06f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:19.933652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:20.059556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:20.062486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:20.113033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9badff81d3c246139c5f5a2cbb31f06f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:20.113275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9badff81d3c246139c5f5a2cbb31f06f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:20.129798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9badff81d3c246139c5f5a2cbb31f06f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:20.130531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9badff81d3c246139c5f5a2cbb31f06f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:20.135705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5157-b135-4e4c-858a-a5df40b9384a service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:20.146847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9534395c-8ba5-41c5-bd11-8c5cb8e7aee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9badff81d3c246139c5f5a2cbb31f06f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:20.150398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:20.151474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:20.152794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:20.153246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:20.156250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:20.177184 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1458/2897] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:13:19 2022] DELETE /identity/v3/users/9badff81d3c246139c5f5a2cbb31f06f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:13:20.180578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862439-c6b6-49a9-b24e-02b9b054cc0e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:20.180578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862439-c6b6-49a9-b24e-02b9b054cc0e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:20.180578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9862439-c6b6-49a9-b24e-02b9b054cc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:20.209523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f9862439-c6b6-49a9-b24e-02b9b054cc0e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:20.210949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9862439-c6b6-49a9-b24e-02b9b054cc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:20.309319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:20.311132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:20.352065 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1440/2898] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:20.396467 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1459/2899] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:20.409350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:20.411222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:20.428017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796da70f-e0c0-483e-b142-4d23be2d00b4 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:20.545385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530fad3-f1a0-4ba7-aa3a-62a768af82bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:20.546098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530fad3-f1a0-4ba7-aa3a-62a768af82bf service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:20.546377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530fad3-f1a0-4ba7-aa3a-62a768af82bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:20.547498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530fad3-f1a0-4ba7-aa3a-62a768af82bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:20.559641 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:20.563192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530fad3-f1a0-4ba7-aa3a-62a768af82bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:20.564932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530fad3-f1a0-4ba7-aa3a-62a768af82bf service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:20.606038 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1441/2900] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:21.027499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c57c3-02e6-470d-8458-ed445ad7be75 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.028101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c57c3-02e6-470d-8458-ed445ad7be75 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.028101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34c57c3-02e6-470d-8458-ed445ad7be75 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.029593 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1460/2901] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:13:21.038496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.038947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.039328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.079735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:21.084162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:21.269745 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1442/2902] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:21.310112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c57c3-02e6-470d-8458-ed445ad7be75 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:21.312223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f34c57c3-02e6-470d-8458-ed445ad7be75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:21.351321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34c57c3-02e6-470d-8458-ed445ad7be75 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:21.361583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:21.366381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:21.372970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a4598-c51c-44c2-8cc0-e9d90a0dbd5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:21.373989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4598-c51c-44c2-8cc0-e9d90a0dbd5d service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.376002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4598-c51c-44c2-8cc0-e9d90a0dbd5d service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.376589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a4598-c51c-44c2-8cc0-e9d90a0dbd5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.399360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a4598-c51c-44c2-8cc0-e9d90a0dbd5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:21.404622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a4598-c51c-44c2-8cc0-e9d90a0dbd5d service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:21.425565 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1461/2903] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:21.461569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33eb9a5-3e3c-44c9-ba37-b91cc373ded6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:21.473481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:21.475177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.475815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.476300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] PATH_INFO: `/v3/projects/73680830e84844e9b893e6c444f70284` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.478732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73680830e84844e9b893e6c444f70284)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:21.481962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:21.645529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73680830e84844e9b893e6c444f70284', 'request_id': 'req-edd14f36-717c-4aa3-b151-a0456eb8d146'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:21.669163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73680830e84844e9b893e6c444f70284', 'request_id': 'req-edd14f36-717c-4aa3-b151-a0456eb8d146'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:21.673273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6805b-c60a-44c8-a88d-115ccde6f9f9 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.675025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6805b-c60a-44c8-a88d-115ccde6f9f9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.675025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6805b-c60a-44c8-a88d-115ccde6f9f9 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.676915 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1462/2904] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:13:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:13:21.685196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.685942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.686525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.696819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73680830e84844e9b893e6c444f70284', 'request_id': 'req-edd14f36-717c-4aa3-b151-a0456eb8d146'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:21.725146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:21.725854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] The token cache is being invalidate because project 73680830e84844e9b893e6c444f70284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:13:21.726154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:21.726477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:21.726885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edd14f36-717c-4aa3-b151-a0456eb8d146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:13:21.732020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1443/2905] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:13:21 2022] DELETE /identity/v3/projects/73680830e84844e9b893e6c444f70284 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:21.734954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.735251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.735512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.750427 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:21.795235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:21.796548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:21.844665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1463/2906] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:21.880696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:21.883490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:21.914475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba04f00-dbd3-43e4-b4d2-52e9c62877d9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:21.923482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3a92c-1e3d-4a62-85be-c27ac3f493aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:21.924608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a92c-1e3d-4a62-85be-c27ac3f493aa service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:21.925077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a92c-1e3d-4a62-85be-c27ac3f493aa service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:21.925773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3a92c-1e3d-4a62-85be-c27ac3f493aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:21.937554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3a92c-1e3d-4a62-85be-c27ac3f493aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:21.939605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3a92c-1e3d-4a62-85be-c27ac3f493aa service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:21.967785 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1464/2907] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:22.022293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.022751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.023175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.031859 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1444/2908] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:22.113301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:22.114432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:22.140691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1465/2909] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:22.147987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.170466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a80218-8e5f-4829-9eac-b8ad9781a20b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.183520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.184986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.185636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.186262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.187793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:13:22.189043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.192628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.230132 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1445/2910] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:13:22.236758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.268402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b04de8-5626-4f49-8c50-a1869efaa3c9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.285086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8262c10-24dc-4ab6-8de6-19cd5d8b9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.285777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8262c10-24dc-4ab6-8de6-19cd5d8b9a34 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.286060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8262c10-24dc-4ab6-8de6-19cd5d8b9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.292715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8262c10-24dc-4ab6-8de6-19cd5d8b9a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.293517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8262c10-24dc-4ab6-8de6-19cd5d8b9a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.299523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8262c10-24dc-4ab6-8de6-19cd5d8b9a34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.361825 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1466/2911] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:13:22 2022] POST /identity/v3/projects => generated 379 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:13:22.368618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.376782 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:22.396861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e768ffa-4754-4b8f-9a19-1e868e31b5b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.495082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665c00-bac6-4b94-8513-b9c4c5bdfe54 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.495618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665c00-bac6-4b94-8513-b9c4c5bdfe54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.496087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91665c00-bac6-4b94-8513-b9c4c5bdfe54 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.497945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1467/2912] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:13:22.506025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.506629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.506916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.535511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:22.537680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:22.540918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb5a8f8-fd7c-4761-b0b5-7d12644033e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.541788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a8f8-fd7c-4761-b0b5-7d12644033e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.542216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a8f8-fd7c-4761-b0b5-7d12644033e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.542839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb5a8f8-fd7c-4761-b0b5-7d12644033e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.543684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a8f8-fd7c-4761-b0b5-7d12644033e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.547239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb5a8f8-fd7c-4761-b0b5-7d12644033e7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.575424 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1446/2913] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:13:22 2022] POST /identity/v3/users => generated 290 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:13:22.577517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bc3a7-bda6-4620-b411-d5bcb5309317 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.577517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bc3a7-bda6-4620-b411-d5bcb5309317 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.577940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2bc3a7-bda6-4620-b411-d5bcb5309317 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.587406 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1447/2914] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:13:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:13:22.587406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bc3a7-bda6-4620-b411-d5bcb5309317 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.607803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2bc3a7-bda6-4620-b411-d5bcb5309317 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.615212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51a692-8af8-492c-a97b-350823571b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.616256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51a692-8af8-492c-a97b-350823571b2a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.616580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51a692-8af8-492c-a97b-350823571b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.616864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51a692-8af8-492c-a97b-350823571b2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.617760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51a692-8af8-492c-a97b-350823571b2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.619642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51a692-8af8-492c-a97b-350823571b2a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.637139 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1448/2915] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:22.639255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.640030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.640856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.671241 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1468/2916] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:22.673640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.686024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:22.688641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:22.711985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8195461-4ec5-4512-a961-98ef54330c1c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.718780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.719487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.719795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.720217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.721036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.723152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.760195 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1469/2917] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:13:22.761253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.768987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:22.805366 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1449/2918] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:22.807255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.825289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1680fb32-28f6-49f5-801b-ce7b25364f1d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.840295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636c761-5f4a-42f0-ba88-11808903b585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.843048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636c761-5f4a-42f0-ba88-11808903b585 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.844287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636c761-5f4a-42f0-ba88-11808903b585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.844287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636c761-5f4a-42f0-ba88-11808903b585 admin admin] PATH_INFO: `/v3/projects/17e839a4ddb049039c3b0b2bdb8e084d/users/2c5b9fd1ecf44b95bd2f2e65edbf9e66/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.875954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad8265-30cf-4181-b5d5-c5850c791350 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.881151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636c761-5f4a-42f0-ba88-11808903b585 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17e839a4ddb049039c3b0b2bdb8e084d, user_id=2c5b9fd1ecf44b95bd2f2e65edbf9e66, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.881728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:22.882461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.882724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.883109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.888718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636c761-5f4a-42f0-ba88-11808903b585 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.892040 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:22.898886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:22.900897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:22.918868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1470/2919] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:22.919872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:22.921412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:22.928843 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1450/2920] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:13:22 2022] PUT /identity/v3/projects/17e839a4ddb049039c3b0b2bdb8e084d/users/2c5b9fd1ecf44b95bd2f2e65edbf9e66/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:13:22.937017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:22.938305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:22.941163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:22.951152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d3af18-d9dd-4dcf-babd-88470e342206 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:22.987393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:22.988431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.085151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73893593-4f6a-4536-937d-9cbb49fbe9da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:23.085914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73893593-4f6a-4536-937d-9cbb49fbe9da service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.086418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73893593-4f6a-4536-937d-9cbb49fbe9da service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.086707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73893593-4f6a-4536-937d-9cbb49fbe9da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.089437 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:23.098323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73893593-4f6a-4536-937d-9cbb49fbe9da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:23.102191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73893593-4f6a-4536-937d-9cbb49fbe9da service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:23.115144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1471/2921] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:23.116475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.116767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.117051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.140993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:23.142550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.144122 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1451/2922] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:23.176976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:23.183866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.231583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1472/2923] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:13:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:23.250816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:23.263241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6daa737-04a9-4820-bcea-6b49154f1160 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:23.269097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f855b2-9959-4ec9-bba9-3bfdc4e0c21b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:23.271035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f855b2-9959-4ec9-bba9-3bfdc4e0c21b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.271330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f855b2-9959-4ec9-bba9-3bfdc4e0c21b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.273141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f855b2-9959-4ec9-bba9-3bfdc4e0c21b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.301173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f855b2-9959-4ec9-bba9-3bfdc4e0c21b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:23.307258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f855b2-9959-4ec9-bba9-3bfdc4e0c21b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:23.339542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1473/2924] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:13:23.372021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3a5196-ff5b-428b-9935-9be283131b11 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:23.380092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eede2a53-23e3-485f-9229-28ad04d6733e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:23.381580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede2a53-23e3-485f-9229-28ad04d6733e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.381926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede2a53-23e3-485f-9229-28ad04d6733e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.382486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede2a53-23e3-485f-9229-28ad04d6733e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.404456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede2a53-23e3-485f-9229-28ad04d6733e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:23.411237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eede2a53-23e3-485f-9229-28ad04d6733e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:23.435685 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1452/2925] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:23.465629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ba823-ae7b-435d-a8a0-093dc61d4601 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.466062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ba823-ae7b-435d-a8a0-093dc61d4601 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.466596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562ba823-ae7b-435d-a8a0-093dc61d4601 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.468249 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1474/2926] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:13:23.486114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.486370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.486664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.528095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:23.532504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:23.669171 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1453/2927] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:13:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:23.721717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ba823-ae7b-435d-a8a0-093dc61d4601 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:23.750825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562ba823-ae7b-435d-a8a0-093dc61d4601 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:23.756897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:23.757944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:23.758499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:23.758894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:23.777464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:23.781268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:23.802368 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1475/2928] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:24.249988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.288122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800630ff-fc28-4b50-8148-a216829a9142 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.300797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.302326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.307361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.310330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.318054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:24.362264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:24.372006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:24.386917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f41f405-7f5a-4d45-b58a-08e6265e91e8 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:24.397639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a6b8d-7502-4637-8590-67430563d164 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:24.412721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:24.413409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:24.413686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:24.413950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:24.417468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:24.433106 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1454/2929] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:24.438825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:24.440671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a1702-0df2-4f7c-bc23-2cea27d88959 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:24.460070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1476/2930] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:26.178532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c335-f059-4e76-b395-0cc916b7805a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:26.181721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c335-f059-4e76-b395-0cc916b7805a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:26.182601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6510c335-f059-4e76-b395-0cc916b7805a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:26.196043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1455/2931] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:13:26 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:13:26.201725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1757236-a1b0-4dfa-9ca1-88d7bd176fd7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:26.202591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1757236-a1b0-4dfa-9ca1-88d7bd176fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:26.202591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1757236-a1b0-4dfa-9ca1-88d7bd176fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:26.244715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c1757236-a1b0-4dfa-9ca1-88d7bd176fd7 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:26.248613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c1757236-a1b0-4dfa-9ca1-88d7bd176fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:26.268756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1477/2932] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:13:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:26.297715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510c335-f059-4e76-b395-0cc916b7805a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:26.361260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6510c335-f059-4e76-b395-0cc916b7805a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:26.385757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3df80f-5726-4a20-b279-16d77cc8cfb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:26.392458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3df80f-5726-4a20-b279-16d77cc8cfb6 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:26.393144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3df80f-5726-4a20-b279-16d77cc8cfb6 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:26.393723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3df80f-5726-4a20-b279-16d77cc8cfb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:26.439975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3df80f-5726-4a20-b279-16d77cc8cfb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:26.442219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3df80f-5726-4a20-b279-16d77cc8cfb6 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:26.460539 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1456/2933] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:13:28.493414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:28.493968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:28.494420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:28.627613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] MFA Rules not processed for user `b57ca8171ff14c9e9161c3602ff69d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:28.630481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:28.734179 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:28.902624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1478/2934] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:28.917272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae75255-792f-49be-bb67-ad8506c71b27 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:28.918155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae75255-792f-49be-bb67-ad8506c71b27 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:28.918155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae75255-792f-49be-bb67-ad8506c71b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:28.952592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1ae75255-792f-49be-bb67-ad8506c71b27 None None] MFA Rules not processed for user `b57ca8171ff14c9e9161c3602ff69d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:28.953802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ae75255-792f-49be-bb67-ad8506c71b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:28.982734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1457/2935] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:13:30.270311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:30.271940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:30.315893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7c19e-94bc-42f0-b82f-8daddb374f03 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:30.348009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f47967-c781-4799-b3ac-fd0a92035b7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:30.349086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47967-c781-4799-b3ac-fd0a92035b7d service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:30.349557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47967-c781-4799-b3ac-fd0a92035b7d service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:30.357230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f47967-c781-4799-b3ac-fd0a92035b7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:30.371510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47967-c781-4799-b3ac-fd0a92035b7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:30.381663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f47967-c781-4799-b3ac-fd0a92035b7d service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:30.425155 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1479/2936] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:31.929517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:31.930947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:31.931973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:32.075310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] MFA Rules not processed for user `2c5b9fd1ecf44b95bd2f2e65edbf9e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:32.079460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:32.387029 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:32.499490 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1458/2937] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:31 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:32.522439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692472a-f627-469a-9309-f841ff283775 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:32.523225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692472a-f627-469a-9309-f841ff283775 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:32.523225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8692472a-f627-469a-9309-f841ff283775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:32.559638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8692472a-f627-469a-9309-f841ff283775 None None] MFA Rules not processed for user `2c5b9fd1ecf44b95bd2f2e65edbf9e66`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:32.561034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8692472a-f627-469a-9309-f841ff283775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:32.583600 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1480/2938] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:33.111763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:33.137721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f593581-a1e9-4bb4-995c-381bcf389e10 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:33.160628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:33.161985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:33.162583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:33.163113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:33.198481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:33.208098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:33.238977 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1459/2939] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:33 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:37.849667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:37.853874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:37.854757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:37.928396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:37.934109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:38.141749 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1481/2940] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:13:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:38.173161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:38.176220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:38.358058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f0088-809e-47c7-88ca-13f6bdb325bd service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:38.376713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:38.377777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:38.378268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:38.378745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:38.390419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:38.392726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:38.406681 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1460/2941] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:13:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:13:39.716847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:39.734210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956336ce-23ae-4b30-947f-4431670ac053 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:39.748713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:39.749852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:39.750846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:39.752508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:39.757824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:39.798714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:39.800977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:39.833366 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1482/2942] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:39 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:42.544761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:42.547116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:42.575391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7334452d-9039-4c60-902e-c8da43850a78 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:42.582999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:42.584054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:42.585309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:42.585837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:42.588265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:42.607894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:42.609930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375862b-01f9-4985-b2f9-71ef7138c98b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:42.630861 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1461/2943] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:45.263105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:45.273721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31e70-07f8-4247-9b21-9f26547d6ae2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:45.296332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:45.298867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:45.299479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:45.301194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:45.305443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:45.332961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:45.334804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:45.362327 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1483/2944] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:13:52.625231 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=51 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:55.356488 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=57 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:13:55.976410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ca36-182e-4df6-be79-8c339bc7970d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:55.977007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ca36-182e-4df6-be79-8c339bc7970d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:55.977302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c1ca36-182e-4df6-be79-8c339bc7970d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:56.002673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-66c1ca36-182e-4df6-be79-8c339bc7970d None None] MFA Rules not processed for user `2b2950eec4754c328f600d770a8860d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:13:56.005140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-66c1ca36-182e-4df6-be79-8c339bc7970d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:56.131290 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1462/2945] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:13:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:13:58.167490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:13:58.245123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706fdac-ddfb-4173-9ffc-e7ff1d8edf29 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:13:58.268911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:13:58.272053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:13:58.274144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:13:58.274623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:13:58.278507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:13:58.312450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:13:58.317191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:13:58.363029 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1484/2946] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:13:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:00.425731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abff103-23d8-4d03-9dc9-8e9f6f5b69a0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:00.426402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abff103-23d8-4d03-9dc9-8e9f6f5b69a0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:00.426402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abff103-23d8-4d03-9dc9-8e9f6f5b69a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:00.485276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3abff103-23d8-4d03-9dc9-8e9f6f5b69a0 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:00.486896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3abff103-23d8-4d03-9dc9-8e9f6f5b69a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:00.498555 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1463/2947] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:14:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:00.515398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:00.533804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c98287-fbda-4b13-b4d1-a1dcd9012c64 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:00.543134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d34ea41-bad9-4eb5-8033-34754cfa7ff0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:00.543989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34ea41-bad9-4eb5-8033-34754cfa7ff0 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:00.544582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34ea41-bad9-4eb5-8033-34754cfa7ff0 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:00.545105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d34ea41-bad9-4eb5-8033-34754cfa7ff0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:00.564079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34ea41-bad9-4eb5-8033-34754cfa7ff0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:00.565836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d34ea41-bad9-4eb5-8033-34754cfa7ff0 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:00.616041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1485/2948] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:14:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:14:02.409491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c2a2-3bc7-4367-819e-0c487b2f5f20 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:02.410572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c2a2-3bc7-4367-819e-0c487b2f5f20 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:02.411446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2420c2a2-3bc7-4367-819e-0c487b2f5f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:02.446631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2420c2a2-3bc7-4367-819e-0c487b2f5f20 None None] MFA Rules not processed for user `7c11c0d82ccf4472b35194fcc5a8ea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:02.453758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2420c2a2-3bc7-4367-819e-0c487b2f5f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:02.552484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1464/2949] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:02 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:04.749268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:04.749893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:04.749893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:04.770412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] MFA Rules not processed for user `73a0667782d44c9fa0411e60168afd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:04.771847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:04.856065 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1486/2950] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:14:06.173471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38a53-1536-4242-bc4c-635820392601 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:06.174573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38a53-1536-4242-bc4c-635820392601 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:06.175086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c38a53-1536-4242-bc4c-635820392601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:06.219927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-13c38a53-1536-4242-bc4c-635820392601 None None] MFA Rules not processed for user `f61221659eee4c57ab0c7817c73e9ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:06.221322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13c38a53-1536-4242-bc4c-635820392601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:06.331887 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1465/2951] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:14.841289 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=37 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:15.709467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:15.749878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af53f7f-6236-42dd-8489-0cea83d5e9b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:15.755667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:15.756374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:15.756682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:15.756979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:15.766031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:15.789794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:15.791707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:15.804883 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1487/2952] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:16.323745 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=78 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:17.720196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38a53-1536-4242-bc4c-635820392601 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:17.736077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c38a53-1536-4242-bc4c-635820392601 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:17.750716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:17.752281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:17.754064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:17.755950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] PATH_INFO: `/v3/users/2c5b9fd1ecf44b95bd2f2e65edbf9e66` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:17.759111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c5b9fd1ecf44b95bd2f2e65edbf9e66)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:17.763337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:17.829160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c5b9fd1ecf44b95bd2f2e65edbf9e66'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:17.848621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c5b9fd1ecf44b95bd2f2e65edbf9e66'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:17.875650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c5b9fd1ecf44b95bd2f2e65edbf9e66'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:17.876615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c5b9fd1ecf44b95bd2f2e65edbf9e66'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:17.887358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f464f458-8a56-46ea-bde4-3e32d8534ad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c5b9fd1ecf44b95bd2f2e65edbf9e66'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:17.896128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1466/2953] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:14:17 2022] DELETE /identity/v3/users/2c5b9fd1ecf44b95bd2f2e65edbf9e66 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:14:18.167435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:18.183401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db97b8-68fc-4e85-b7b7-a57e48a7b3e6 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:18.282925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:18.284325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:18.284909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:18.285466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] PATH_INFO: `/v3/projects/17e839a4ddb049039c3b0b2bdb8e084d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:18.287134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=17e839a4ddb049039c3b0b2bdb8e084d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:18.289456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:18.369779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17e839a4ddb049039c3b0b2bdb8e084d', 'request_id': 'req-575ae856-14c5-437a-9f1e-9fc5014eae1f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:18.380262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17e839a4ddb049039c3b0b2bdb8e084d', 'request_id': 'req-575ae856-14c5-437a-9f1e-9fc5014eae1f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:18.392738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17e839a4ddb049039c3b0b2bdb8e084d', 'request_id': 'req-575ae856-14c5-437a-9f1e-9fc5014eae1f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:18.412263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] The token cache is being invalidate because project 17e839a4ddb049039c3b0b2bdb8e084d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:14:18.414349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:18.419848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-575ae856-14c5-437a-9f1e-9fc5014eae1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:14:18.421457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1488/2954] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:14:18 2022] DELETE /identity/v3/projects/17e839a4ddb049039c3b0b2bdb8e084d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:14:18.426641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:18.427059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:18.427395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:18.454011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:18.455588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:18.611641 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1467/2955] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:18.620696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:18.621035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:18.622195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:18.664328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:18.665801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:18.685574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:18.692948 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1489/2956] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:18.698607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a50284-4794-43a7-ad74-cd215d68abd0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:18.719417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:18.720391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:18.721343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:18.722284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:18.723600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:14:18.725060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:18.728089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:18.758834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1468/2957] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:14:18.762447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:18.773150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4cd1f-fd88-4c2f-bf0f-f01dc2b59f01 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:18.779105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:18.779886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:18.780242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:18.780624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:18.781414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:18.783556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:18.823655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1490/2958] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:14:18 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:14:18.828878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:18.844866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2ad6-7677-4b27-a325-08d8285547e0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:18.932562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:18.934320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:18.934487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:18.934703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:18.936464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:18.939791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:18.949973 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:18.999738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:19.012311 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1469/2959] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:14:18 2022] POST /identity/v3/users => generated 291 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:14:19.013531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d805c79-0d7d-4233-9068-18f25aa92f98 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:19.019201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:19.019988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:19.020369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:19.021208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:19.021714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:19.024147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:19.039892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1491/2960] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:14:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:14:19.042554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:19.071731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc11091-adb9-495e-a63f-b0a7435d38ef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:19.078448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c629a6-a840-47e4-ba8a-c7cb484ec61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:19.079503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c629a6-a840-47e4-ba8a-c7cb484ec61f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:19.080024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c629a6-a840-47e4-ba8a-c7cb484ec61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:19.080547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c629a6-a840-47e4-ba8a-c7cb484ec61f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:19.081584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c629a6-a840-47e4-ba8a-c7cb484ec61f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:19.084427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c629a6-a840-47e4-ba8a-c7cb484ec61f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:19.105563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1470/2961] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:14:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:14:19.107622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:19.121537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c4c8-ce0c-4d2a-b24a-3abe66097af8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:19.136244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2d393-8783-4a2e-93ac-94501f63cd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:19.137481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2d393-8783-4a2e-93ac-94501f63cd54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:19.137769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2d393-8783-4a2e-93ac-94501f63cd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:19.138048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2d393-8783-4a2e-93ac-94501f63cd54 admin admin] PATH_INFO: `/v3/projects/20136f897d1649ccad370794ffa229fd/users/648d701be21c4a51a09cdf28f5de1bad/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:19.159434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2d393-8783-4a2e-93ac-94501f63cd54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20136f897d1649ccad370794ffa229fd, user_id=648d701be21c4a51a09cdf28f5de1bad, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:19.162608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa2d393-8783-4a2e-93ac-94501f63cd54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:19.192652 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1492/2962] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:14:19 2022] PUT /identity/v3/projects/20136f897d1649ccad370794ffa229fd/users/648d701be21c4a51a09cdf28f5de1bad/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:14:19.195143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:19.195789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:19.196669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:19.238355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] MFA Rules not processed for user `648d701be21c4a51a09cdf28f5de1bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:19.240975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:19.371358 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1471/2963] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:14:19.375585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56e37-151f-414d-b632-a6057c26295f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:19.376214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56e37-151f-414d-b632-a6057c26295f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:19.376726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56e37-151f-414d-b632-a6057c26295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:19.425747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65b56e37-151f-414d-b632-a6057c26295f None None] MFA Rules not processed for user `648d701be21c4a51a09cdf28f5de1bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:19.429530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65b56e37-151f-414d-b632-a6057c26295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:19.458889 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1493/2964] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:19.624930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:19.626724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:19.736396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fd47f4-9c7f-4a56-9711-0428a3ba8946 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:19.750399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db576282-65ed-4187-8426-d41a4a94e7b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:19.752668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db576282-65ed-4187-8426-d41a4a94e7b1 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:19.753024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db576282-65ed-4187-8426-d41a4a94e7b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:19.753299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db576282-65ed-4187-8426-d41a4a94e7b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:19.780816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db576282-65ed-4187-8426-d41a4a94e7b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:19.786357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db576282-65ed-4187-8426-d41a4a94e7b1 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:19.829079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1472/2965] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:23.210019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8c23f-cf70-463d-8eb5-de1442dcbe03 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:23.210654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8c23f-cf70-463d-8eb5-de1442dcbe03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:23.210654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b8c23f-cf70-463d-8eb5-de1442dcbe03 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:23.211985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1494/2966] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:14:23.220031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9de07-22df-41b2-a7b3-faaedfe7ebe8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:23.222196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9de07-22df-41b2-a7b3-faaedfe7ebe8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:23.222196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee9de07-22df-41b2-a7b3-faaedfe7ebe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:23.255377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ee9de07-22df-41b2-a7b3-faaedfe7ebe8 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:23.257083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ee9de07-22df-41b2-a7b3-faaedfe7ebe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:23.365658 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:23.421203 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1473/2967] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:14:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:23.462668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8c23f-cf70-463d-8eb5-de1442dcbe03 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:23.467150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61b8c23f-cf70-463d-8eb5-de1442dcbe03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:23.497221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b8c23f-cf70-463d-8eb5-de1442dcbe03 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:23.520365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e843fb-c834-402b-ad36-9d83604c00f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:23.533095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e843fb-c834-402b-ad36-9d83604c00f8 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:23.540368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e843fb-c834-402b-ad36-9d83604c00f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:23.540998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e843fb-c834-402b-ad36-9d83604c00f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:23.557912 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:23.570574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e843fb-c834-402b-ad36-9d83604c00f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:23.603749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e843fb-c834-402b-ad36-9d83604c00f8 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:23.643672 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1495/2968] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:33.388339 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:33.627955 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:34.005745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:34.006047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:34.006319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:34.025069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] MFA Rules not processed for user `6f034d6e3a874e9892df5c3188235e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:34.026263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:34.091397 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1474/2969] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:37.785866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747cc8d-0667-4d48-9303-6481b89e804d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:37.786441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747cc8d-0667-4d48-9303-6481b89e804d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:37.786786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747cc8d-0667-4d48-9303-6481b89e804d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:37.789418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:37.791440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:37.813623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9747cc8d-0667-4d48-9303-6481b89e804d None None] MFA Rules not processed for user `b57ca8171ff14c9e9161c3602ff69d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:37.816753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9747cc8d-0667-4d48-9303-6481b89e804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:37.901282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbdbbe4-604e-4486-b027-5d3e4ddefb81 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:37.903239 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1496/2970] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:37.909890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:37.910592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:37.910892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:37.911195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:37.917443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:37.932975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:37.934503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:37.946595 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1475/2971] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:14:38.004839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:38.005120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:38.005381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:38.032096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] MFA Rules not processed for user `73a0667782d44c9fa0411e60168afd53`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:38.034039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:38.111342 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1497/2972] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:38.324053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:38.326187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:38.413656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa002853-c1e1-42e9-9c65-f50ccca5883e service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:38.417341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:38.417999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:38.418540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:38.418814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:38.420914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:38.432159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:38.434008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4963e2ca-8bb7-4c01-8da7-83770c033010 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:38.448942 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1476/2973] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:14:38.522248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:38.536661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e24d36-91f1-4af4-9d43-54747cc4471c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:38.542151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:38.542924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:38.543313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:38.543679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:38.545597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:38.556796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:38.558587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:38.567872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1498/2974] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:14:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:14:39.952532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84920dc-afcc-4d51-91cf-df72863a97c6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:39.953626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84920dc-afcc-4d51-91cf-df72863a97c6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:39.953907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84920dc-afcc-4d51-91cf-df72863a97c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:39.990712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e84920dc-afcc-4d51-91cf-df72863a97c6 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:39.992438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e84920dc-afcc-4d51-91cf-df72863a97c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:40.031466 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:40.105712 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1477/2975] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:14:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:40.126824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:40.129432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:40.320150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894bdf8c-1eb3-4d56-abbb-b78ddaa77ac3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:40.327049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:40.328080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:40.329608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:40.330191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:40.347815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:40.350177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:40.361448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1499/2976] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:14:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:14:50.090114 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=11 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:50.357603 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:14:57.615735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eb2f9-5df7-43c3-a3c7-a43ee310d2ed None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:57.616365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eb2f9-5df7-43c3-a3c7-a43ee310d2ed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:57.616365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3eb2f9-5df7-43c3-a3c7-a43ee310d2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:57.636682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6c3eb2f9-5df7-43c3-a3c7-a43ee310d2ed None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:57.637953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6c3eb2f9-5df7-43c3-a3c7-a43ee310d2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:57.650797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1478/2977] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:14:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:57.664806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:57.680795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f201d22-3f2a-483d-a255-66c6b40145b9 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:57.694583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:57.695249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:57.695533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:57.695807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:57.705019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:57.706672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:57.715763 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1500/2978] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:14:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:14:58.106596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327948-b664-4cf8-8901-03035a58460d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:58.107297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327948-b664-4cf8-8901-03035a58460d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:58.107776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29327948-b664-4cf8-8901-03035a58460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:58.130726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-29327948-b664-4cf8-8901-03035a58460d None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:14:58.132583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29327948-b664-4cf8-8901-03035a58460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:14:58.144633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1479/2979] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:14:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:14:58.158676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:14:58.194513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe527fa-3fda-4c58-a17f-5dd5965dbad3 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:14:58.217905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:14:58.221671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:14:58.226235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:14:58.229109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:14:58.248519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:14:58.248519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:14:58.263357 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1501/2980] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:14:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:15:06.210450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:06.213039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:06.214851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:06.301384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:06.303475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:06.356738 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1480/2981] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:15:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:06.395184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:06.418045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b836a18-c341-493a-b119-67dd15cefabb service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:06.432209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:06.434763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:06.435544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:06.436653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:06.469181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:06.473665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:06.497302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1502/2982] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:15:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:15:12.958770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:12.983613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62363f-d7d7-4bab-8fb8-519ee7178d5f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:12.996798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:12.997491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:12.997770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:12.998053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:13.004385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:13.059039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:13.066197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:13.076252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:13.077964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:13.098648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1481/2983] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:13.237638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0bfc8-a053-4761-bec5-3e59d6ac6025 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:13.254313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:13.256012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:13.256299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:13.256607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] PATH_INFO: `/v3/users/73a0667782d44c9fa0411e60168afd53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:13.257880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73a0667782d44c9fa0411e60168afd53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:13.259845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:13.403314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73a0667782d44c9fa0411e60168afd53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:13.403994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73a0667782d44c9fa0411e60168afd53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:13.420064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73a0667782d44c9fa0411e60168afd53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:13.421136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73a0667782d44c9fa0411e60168afd53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:13.440441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7253ee70-83d4-42a3-84bf-7405d7069ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73a0667782d44c9fa0411e60168afd53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:13.507738 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1503/2984] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:13 2022] DELETE /identity/v3/users/73a0667782d44c9fa0411e60168afd53 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:14.134013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:14.173854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ff2e8-e5ae-4708-a68a-cc6c665cdcab service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:14.402466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:14.403789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:14.404257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:14.404674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] PATH_INFO: `/v3/projects/80a9d471126c4f2aaf56f347be3a5b86` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:14.411003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=80a9d471126c4f2aaf56f347be3a5b86)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:14.419037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:14.539864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80a9d471126c4f2aaf56f347be3a5b86', 'request_id': 'req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:14.552670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80a9d471126c4f2aaf56f347be3a5b86', 'request_id': 'req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:14.575490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80a9d471126c4f2aaf56f347be3a5b86', 'request_id': 'req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:14.605597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] The token cache is being invalidate because project 80a9d471126c4f2aaf56f347be3a5b86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:15:14.605896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:14.612848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b8e7b4f-c1d4-459c-8f15-59e6f41e12bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:14.614658 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1482/2985] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:14 2022] DELETE /identity/v3/projects/80a9d471126c4f2aaf56f347be3a5b86 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:14.620312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:14.621826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:14.622887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:14.706285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:14.709612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:14.835045 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:14.877081 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1504/2986] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:14.886769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:14.887266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:14.887780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:14.934320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:14.938863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:14.963825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:14.965526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1483/2987] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:14.983150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0371b-db56-4ea8-8bfc-e246a369ee5a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:15.000543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:15.001579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.002035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.002334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.003144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:15:15.003451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:15.011393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:15.071338 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1505/2988] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:15:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:15:15.075599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:15.104531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec073ab-4b5d-430d-bdb7-24e64d4440df None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:15.141707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:15.142833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.143154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.143409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.144166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:15.147893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:15.222185 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1484/2989] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:15:15 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:15:15.223778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:15.245126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e710780-3d51-4c2d-9fe5-9cb45e337259 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:15.399436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:15.400610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.401144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.401694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.402845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:15.405157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:15.438105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:15.445805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1506/2990] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:15:15 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:15:15.452824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991e05a-821f-4f41-ae2d-0a18bc3eead9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:15.460936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:15.462907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.464139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.465064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.466757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:15.470692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:15.494066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:15.505099 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1485/2991] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:15.509638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2673b5d-9a73-4c04-80af-5945d2780309 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:15.524708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df535064-7532-4f20-9975-eafe918247dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:15.526303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535064-7532-4f20-9975-eafe918247dc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.526878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535064-7532-4f20-9975-eafe918247dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.527422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df535064-7532-4f20-9975-eafe918247dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.528596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df535064-7532-4f20-9975-eafe918247dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:15.531126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df535064-7532-4f20-9975-eafe918247dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:15.553745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:15.563769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1507/2992] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:15 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:15:15.570402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ecc26-9177-4532-8c16-32549448dc2e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:15.579149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d941e-71e1-43eb-9411-dee51a410e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:15.583858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d941e-71e1-43eb-9411-dee51a410e75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.584553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d941e-71e1-43eb-9411-dee51a410e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.584850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d941e-71e1-43eb-9411-dee51a410e75 admin admin] PATH_INFO: `/v3/projects/fddd007c3a134d4db9dc8746d00fb872/users/79483bad3ccd41fd8f42ab8832792b04/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.609688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d941e-71e1-43eb-9411-dee51a410e75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fddd007c3a134d4db9dc8746d00fb872, user_id=79483bad3ccd41fd8f42ab8832792b04, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:15.613914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d941e-71e1-43eb-9411-dee51a410e75 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:15.617638 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:15.750481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.751044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.754910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.757816 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1486/2993] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:15 2022] PUT /identity/v3/projects/fddd007c3a134d4db9dc8746d00fb872/users/79483bad3ccd41fd8f42ab8832792b04/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:15.810588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] MFA Rules not processed for user `79483bad3ccd41fd8f42ab8832792b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:15.812802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:15.920946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37ef23-941b-4176-97c4-181ded18e8f1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:15.921246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37ef23-941b-4176-97c4-181ded18e8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:15.921567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b37ef23-941b-4176-97c4-181ded18e8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:15.921981 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1508/2994] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:15.969574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7b37ef23-941b-4176-97c4-181ded18e8f1 None None] MFA Rules not processed for user `79483bad3ccd41fd8f42ab8832792b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:15.971098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b37ef23-941b-4176-97c4-181ded18e8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:16.001833 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1487/2995] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:16.882381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:16.885503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:17.008866 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:17.116053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefa07e-a159-4459-a1c2-31899fa454e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:17.116053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:17.116053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:17.116053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:17.117994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] PATH_INFO: `/v3/users/13a1ff48828145069e579627af7ef2f3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:17.117994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] RBAC: Authorizing `identity:delete_user(user_id=13a1ff48828145069e579627af7ef2f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:17.117994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:17.181000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13a1ff48828145069e579627af7ef2f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:17.184019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13a1ff48828145069e579627af7ef2f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:17.204158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13a1ff48828145069e579627af7ef2f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:17.205399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13a1ff48828145069e579627af7ef2f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:17.217763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13a1ff48828145069e579627af7ef2f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:17.263479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1509/2996] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:16 2022] DELETE /identity/v3/users/13a1ff48828145069e579627af7ef2f3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:17.265546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:17.266681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:17.267114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:17.296146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:17.297798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:17.440398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1488/2997] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:17.463106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:17.464765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:17.616589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:17.619140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:17.626976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9554ede7-79ad-4fac-9984-0bc699b13dee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:17.632052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:17.633308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:17.634035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:17.634554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:17.649321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:17.651789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:17.668118 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1510/2998] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:17.795881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315966ed-d7c1-4d84-811f-9ab52b30ce60 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:17.803884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:17.804660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:17.805325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:17.805325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:17.809022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:17.909672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:17.911726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d0103-cec2-4bcb-8058-2e8c9d324168 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:17.936886 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1489/2999] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:17 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:18.153525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:18.155203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:18.179649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a89ba0-acf6-451f-a223-2b22cb20dc70 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:18.194208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:18.200428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:18.200428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:18.200428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] PATH_INFO: `/v3/projects/f6a6004105e34241b75eba1a0b341166` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:18.205625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6a6004105e34241b75eba1a0b341166)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:18.209622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:18.320870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6a6004105e34241b75eba1a0b341166', 'request_id': 'req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.346169 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:18.363845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6a6004105e34241b75eba1a0b341166', 'request_id': 'req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.401255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6a6004105e34241b75eba1a0b341166', 'request_id': 'req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.420060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:18.420708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:18.420708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:18.428264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] The token cache is being invalidate because project f6a6004105e34241b75eba1a0b341166 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:15:18.431878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.433478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.440074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1511/3000] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:18 2022] DELETE /identity/v3/projects/f6a6004105e34241b75eba1a0b341166 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:18.444397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:18.447473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:18.469909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:18.474892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:18.533621 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:18.648317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7565683e-7b7c-4f5b-82d1-02fd6005c9a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:18.655646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:18.657525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:18.657922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:18.658340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] PATH_INFO: `/v3/users/366e78c05df942b594fa9b50325f4efa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:18.660072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=366e78c05df942b594fa9b50325f4efa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:18.665108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:18.671042 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1490/3001] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:15:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:18.701990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:18.703883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:18.773960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '366e78c05df942b594fa9b50325f4efa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.775505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '366e78c05df942b594fa9b50325f4efa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.823572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '366e78c05df942b594fa9b50325f4efa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.824543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '366e78c05df942b594fa9b50325f4efa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.841451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '366e78c05df942b594fa9b50325f4efa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:18.903035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa64514-9dd3-49fa-8007-ad808465acea None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:18.907565 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1512/3002] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:18 2022] DELETE /identity/v3/users/366e78c05df942b594fa9b50325f4efa => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:19.128427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:19.129184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:19.129470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:19.129745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:19.133229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:19.337315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:19.338067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0f5c4c-e39a-4897-92dd-51032f8d4b13 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:19.357612 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1491/3003] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:15:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:15:19.716376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:19.717882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:19.916332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0f5c7-ca30-4db6-a4f4-218ccb99e90b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:19.931523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:19.932335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:19.932651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:19.932935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] PATH_INFO: `/v3/projects/60aae014bb754b86b33da5ff8bf7501c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:19.934815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60aae014bb754b86b33da5ff8bf7501c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:19.936550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:19.939164 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:20.010511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60aae014bb754b86b33da5ff8bf7501c', 'request_id': 'req-53c250a1-bf44-4185-907f-fc1b351d4b8b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:20.017216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60aae014bb754b86b33da5ff8bf7501c', 'request_id': 'req-53c250a1-bf44-4185-907f-fc1b351d4b8b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:20.025541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60aae014bb754b86b33da5ff8bf7501c', 'request_id': 'req-53c250a1-bf44-4185-907f-fc1b351d4b8b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:20.056660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] The token cache is being invalidate because project 60aae014bb754b86b33da5ff8bf7501c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:15:20.056932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:20.060520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-53c250a1-bf44-4185-907f-fc1b351d4b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:20.063965 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1513/3004] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:19 2022] DELETE /identity/v3/projects/60aae014bb754b86b33da5ff8bf7501c => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:20.073290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:20.077612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:20.079144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:20.193783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:20.206772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:20.250996 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:20.440401 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1492/3005] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:20.445583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:20.445855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:20.446037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:20.499479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:20.501542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:20.557711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1514/3006] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:20.562410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:20.583821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a241350-ffe1-4ce5-8743-926dbf722cd7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:20.609109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:20.611709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:20.612072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:20.612372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:20.618312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:15:20.621185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:20.632736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:20.657861 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1493/3007] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:15:20.669339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:20.700655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e385a8e-0854-4715-aa2e-8476be74a282 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:20.711478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:20.712521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:20.712810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:20.713088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:20.718853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:20.721107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:20.784019 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1515/3008] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:15:20 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:20.789040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:20.809673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92db76-54cf-4bfa-a54a-4da924924004 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:20.954731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:20.962721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:20.963209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:20.964435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:20.965292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:20.967344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:21.022232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1494/3009] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:15:20 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:21.023457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:21.036886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7abc4-4bd0-443c-bdf6-e1048299f0eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:21.044398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:21.045114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:21.045389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:21.045735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:21.046502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:21.048091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:21.065094 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1516/3010] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:21.065752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:21.078548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28472e6-630b-4863-a5a9-15a7d9092faa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:21.086312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575e7b5-66a1-4643-ad74-de9fc67dc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:21.087239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575e7b5-66a1-4643-ad74-de9fc67dc213 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:21.087531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575e7b5-66a1-4643-ad74-de9fc67dc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:21.087840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575e7b5-66a1-4643-ad74-de9fc67dc213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:21.089640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575e7b5-66a1-4643-ad74-de9fc67dc213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:21.100102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575e7b5-66a1-4643-ad74-de9fc67dc213 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:21.149307 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1495/3011] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:21.150763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:21.169368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a38f3df-bec7-452c-b711-398a3710d2bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:21.181579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:21.183278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:21.187635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:21.188157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] PATH_INFO: `/v3/projects/884c06b615404d9c884550a4c0a0d7f4/users/d7b0ccca5d874cd995c0ec0cc2ef545d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:21.259798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=884c06b615404d9c884550a4c0a0d7f4, user_id=d7b0ccca5d874cd995c0ec0cc2ef545d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:21.263603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:21.312177 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1517/3012] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:21 2022] PUT /identity/v3/projects/884c06b615404d9c884550a4c0a0d7f4/users/d7b0ccca5d874cd995c0ec0cc2ef545d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:21.314235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d53c2-6b89-4755-bfec-e71a6ffa0954 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:21.314895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d53c2-6b89-4755-bfec-e71a6ffa0954 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:21.315372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394d53c2-6b89-4755-bfec-e71a6ffa0954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:21.377391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-394d53c2-6b89-4755-bfec-e71a6ffa0954 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:21.383643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-394d53c2-6b89-4755-bfec-e71a6ffa0954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:21.554400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1496/3013] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:21.570638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:21.572549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:21.690325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e0d5-4de0-448b-86a6-1994f08d5310 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:21.690848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e0d5-4de0-448b-86a6-1994f08d5310 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:21.691827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c034e0d5-4de0-448b-86a6-1994f08d5310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:21.692310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3bc399-1f37-43dd-88d3-053fe20c7388 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:21.696856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac740ab-b8bf-417a-bd46-90c08a894ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:21.697979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac740ab-b8bf-417a-bd46-90c08a894ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:21.698426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac740ab-b8bf-417a-bd46-90c08a894ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:21.698848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac740ab-b8bf-417a-bd46-90c08a894ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:21.716951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac740ab-b8bf-417a-bd46-90c08a894ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:21.719225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac740ab-b8bf-417a-bd46-90c08a894ad8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:21.741301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c034e0d5-4de0-448b-86a6-1994f08d5310 None None] MFA Rules not processed for user `7c11c0d82ccf4472b35194fcc5a8ea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:21.742888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c034e0d5-4de0-448b-86a6-1994f08d5310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:21.751480 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1518/3014] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:21.773136 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:21.893751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1497/3015] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:23.692623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:23.694207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:23.695294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:23.764736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] MFA Rules not processed for user `f61221659eee4c57ab0c7817c73e9ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:23.767574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:23.837268 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:23.983565 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1519/3016] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:27.914868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:27.915523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:27.915523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:27.955693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:27.957393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:28.144164 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1498/3017] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:15:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:28.161063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:28.164536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:28.373106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdc40b8-af2e-46ff-a8d6-a3dd227fe2ff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:28.388992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dabd60-b8c1-453a-b514-89d2ba3c29e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:28.390257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabd60-b8c1-453a-b514-89d2ba3c29e7 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:28.390802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabd60-b8c1-453a-b514-89d2ba3c29e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:28.391414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dabd60-b8c1-453a-b514-89d2ba3c29e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:28.412194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dabd60-b8c1-453a-b514-89d2ba3c29e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:28.415293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dabd60-b8c1-453a-b514-89d2ba3c29e7 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:28.430931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1520/3018] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:15:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:15:32.999998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:33.001736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:33.028326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690393e3-46d3-4ef0-9aec-7911b637e21b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:33.034916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:33.035676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:33.035986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:33.036431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] PATH_INFO: `/v3/users/79483bad3ccd41fd8f42ab8832792b04` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:33.037744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79483bad3ccd41fd8f42ab8832792b04)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:33.040204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:33.130815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79483bad3ccd41fd8f42ab8832792b04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:33.144089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79483bad3ccd41fd8f42ab8832792b04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:33.164682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79483bad3ccd41fd8f42ab8832792b04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:33.165413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79483bad3ccd41fd8f42ab8832792b04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:33.173658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79483bad3ccd41fd8f42ab8832792b04'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:33.185462 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1499/3019] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:32 2022] DELETE /identity/v3/users/79483bad3ccd41fd8f42ab8832792b04 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:33.190425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:33.191596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:33.191874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:33.215527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:33.217009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:33.376028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:33.381763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:33.384041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1521/3020] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:33.454582 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:33.464511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:33.466314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:33.569777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a780c2d-d5fe-46b6-8f79-b72a9ce8b206 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:33.584381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:33.585221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:33.585766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:33.587342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:33.595685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:33.660601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7156e7-158b-44e9-b67e-cb146b2d4928 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:33.679501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253fe6f-1f9b-417f-8bfa-7708f3bd2f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:33.680306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253fe6f-1f9b-417f-8bfa-7708f3bd2f82 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:33.682548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253fe6f-1f9b-417f-8bfa-7708f3bd2f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:33.682956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253fe6f-1f9b-417f-8bfa-7708f3bd2f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:33.701967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253fe6f-1f9b-417f-8bfa-7708f3bd2f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:33.704700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253fe6f-1f9b-417f-8bfa-7708f3bd2f82 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:33.741026 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1522/3021] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:33.774524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:33.781019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd4cf01-a6ed-4015-808e-8caf27c4ae51 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:33.813636 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1500/3022] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:33 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:35.115315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76dd5-d4f7-4083-9ef1-1a23c8cadb70 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.116479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76dd5-d4f7-4083-9ef1-1a23c8cadb70 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.116885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d76dd5-d4f7-4083-9ef1-1a23c8cadb70 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.119124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1523/3023] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:15:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:15:35.147259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.148232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.148703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.185084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:35.186593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:35.361859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d76dd5-d4f7-4083-9ef1-1a23c8cadb70 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:35.366529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4d76dd5-d4f7-4083-9ef1-1a23c8cadb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:35.394382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1501/3024] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:35.430598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:35.431798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d76dd5-d4f7-4083-9ef1-1a23c8cadb70 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:35.434380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:35.438334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:35.439250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.439737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.440513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] PATH_INFO: `/v3/projects/fddd007c3a134d4db9dc8746d00fb872` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.442049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fddd007c3a134d4db9dc8746d00fb872)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:35.444980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:35.447436 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:35.459556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f202f-2a02-4bbc-8fff-e4e1e5cfc948 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:35.465724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a248c398-fa0c-4611-95df-3e8d764b9d38 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:35.466206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248c398-fa0c-4611-95df-3e8d764b9d38 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.466565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248c398-fa0c-4611-95df-3e8d764b9d38 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.467267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a248c398-fa0c-4611-95df-3e8d764b9d38 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.485528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248c398-fa0c-4611-95df-3e8d764b9d38 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:35.487192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a248c398-fa0c-4611-95df-3e8d764b9d38 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:35.505424 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1502/3025] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:35.524646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fddd007c3a134d4db9dc8746d00fb872', 'request_id': 'req-f39be1f1-6163-4e7a-a727-f901f579b43e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:35.546485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fddd007c3a134d4db9dc8746d00fb872', 'request_id': 'req-f39be1f1-6163-4e7a-a727-f901f579b43e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:35.554627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fddd007c3a134d4db9dc8746d00fb872', 'request_id': 'req-f39be1f1-6163-4e7a-a727-f901f579b43e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:35.575840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] The token cache is being invalidate because project fddd007c3a134d4db9dc8746d00fb872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:15:35.577720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:35.578448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f39be1f1-6163-4e7a-a727-f901f579b43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:35.580458 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1524/3026] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:35 2022] DELETE /identity/v3/projects/fddd007c3a134d4db9dc8746d00fb872 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:35.587423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.588020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.588655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.619623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:35.621907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:35.717655 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:35.730357 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1503/3027] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:35.738885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.739155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.739602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.760849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:35.762894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:35.784243 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1525/3028] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:35.792956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:35.795438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:35.797529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:35.806001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fec320-62f7-41b5-82eb-e735859c5ec7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:35.814795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:35.815597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.816716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.816716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.818483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:15:35.819350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:35.822993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:35.853693 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1504/3029] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:15:35.856614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:35.871866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29b851e-c93f-410c-bab3-29f662c14418 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:35.877223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:35.879120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:35.879568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:35.879850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:35.880630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:35.884694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:35.931908 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1505/3030] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:35.934176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea19da1-fd8c-4c18-9b73-d2d1c88b77b4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:35.935823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.012182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.012899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.013863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.014159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.016749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.034404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.036298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.060226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1526/3031] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:36.101470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d37648c-f0b5-45bf-b574-c4c7d6a23dc6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.110278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.110994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.111265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.111550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.112330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.114346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.142656 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1506/3032] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:15:35 2022] POST /identity/v3/users => generated 287 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:36.147296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.171026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e8cd53-2350-4c7e-ab0b-7c98d33c5328 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.180278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.181036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.181324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.181602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.182430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.184099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.200779 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1527/3033] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:36.204924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.218294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9eabbf-6327-46ac-829f-4a526cc0dc54 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.224828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd4a7e-7db1-4b9c-b243-a6823b795edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.225619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd4a7e-7db1-4b9c-b243-a6823b795edf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.225970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd4a7e-7db1-4b9c-b243-a6823b795edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.226359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd4a7e-7db1-4b9c-b243-a6823b795edf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.227433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd4a7e-7db1-4b9c-b243-a6823b795edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.229643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd4a7e-7db1-4b9c-b243-a6823b795edf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.254414 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1507/3034] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:36.260559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.268970 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:36.276188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec99ba-80ac-47de-9ed8-5d1865f7d818 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.281748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b973331d-1874-43fe-8883-a9c953b43f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.283333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973331d-1874-43fe-8883-a9c953b43f75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.283881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973331d-1874-43fe-8883-a9c953b43f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.284567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b973331d-1874-43fe-8883-a9c953b43f75 admin admin] PATH_INFO: `/v3/projects/1780d718638f4a1882754f2adcd50fb5/users/b91e647e60714df193d94a2fbc4ee2e8/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.320636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973331d-1874-43fe-8883-a9c953b43f75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1780d718638f4a1882754f2adcd50fb5, user_id=b91e647e60714df193d94a2fbc4ee2e8, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.326121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b973331d-1874-43fe-8883-a9c953b43f75 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.361271 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1528/3035] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:36 2022] PUT /identity/v3/projects/1780d718638f4a1882754f2adcd50fb5/users/b91e647e60714df193d94a2fbc4ee2e8/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:36.373255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae9d8-2733-412d-9770-7cad6f9de55f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.374889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae9d8-2733-412d-9770-7cad6f9de55f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.375356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9ae9d8-2733-412d-9770-7cad6f9de55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.452265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-db9ae9d8-2733-412d-9770-7cad6f9de55f None None] MFA Rules not processed for user `b91e647e60714df193d94a2fbc4ee2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:36.455002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-db9ae9d8-2733-412d-9770-7cad6f9de55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.580608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1508/3036] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:36.592234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.592573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.593068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.614714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.615260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.615706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.643332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] MFA Rules not processed for user `b91e647e60714df193d94a2fbc4ee2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:36.644857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.659212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] MFA Rules not processed for user `d7b0ccca5d874cd995c0ec0cc2ef545d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:36.660617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.662515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1529/3037] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:36.683143 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:36.701442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.703164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.747374 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1509/3038] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:36.748282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.749643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.781924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45afb2d8-f74b-4b32-a237-f58cf4576121 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.787065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.788067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.788453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.788969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] PATH_INFO: `/v3/users/648d701be21c4a51a09cdf28f5de1bad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.790275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648d701be21c4a51a09cdf28f5de1bad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.793089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.849266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b8e5-5699-42ea-995d-81438f12b749 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.849614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648d701be21c4a51a09cdf28f5de1bad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:36.850356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648d701be21c4a51a09cdf28f5de1bad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:36.856312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.857183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.857594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.857997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.859508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648d701be21c4a51a09cdf28f5de1bad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:36.860116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.860453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648d701be21c4a51a09cdf28f5de1bad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:36.868664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eb0553ef-5ab8-450a-a066-de81530e4560 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648d701be21c4a51a09cdf28f5de1bad'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:36.876689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.878515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:36.888866 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1510/3039] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:36.889768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:36.891405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.905270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1530/3040] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:36 2022] DELETE /identity/v3/users/648d701be21c4a51a09cdf28f5de1bad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:36.907153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.907494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476c1b1e-9a86-4435-af82-daaf09044a8a service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:36.907877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.908414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.929852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:36.931902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:36.994611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:36.995380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:36.995664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:36.996085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:36.997189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:36.999451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.000850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:37.031744 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1531/3041] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:37.044636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.046934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:37.053136 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1511/3042] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:15:36 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:37.064169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.114384 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:37.136215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa34dca1-9838-4317-ac3b-fc41a7b38ab7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.193979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c513-cbe5-4625-808d-c955ab3bfaf9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.213828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:37.214763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:37.215052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:37.215184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:37.215563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:37.215901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:37.216013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:37.216205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:37.216520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:37.218619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.237530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:37.241128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.261309 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1512/3043] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:15:37 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:37.262520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.270842 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1532/3044] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:37.279390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f3065-2ee4-4d1a-bc19-58ff42877b47 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.286404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:37.287734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:37.288217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:37.288802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:37.290196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:37.292554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.308931 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1513/3045] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:37.310878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.324747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936db316-d056-461e-a0e3-5c88f44234e8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.332660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:37.334258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:37.335274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:37.335274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] PATH_INFO: `/v3/projects/d46df6075c964d6d8fb1b07b9d86041f/users/0352ca03a9bd419b8a2ad6a4157421d0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:37.358561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46df6075c964d6d8fb1b07b9d86041f, user_id=0352ca03a9bd419b8a2ad6a4157421d0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:37.362856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.388916 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1533/3046] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:37 2022] PUT /identity/v3/projects/d46df6075c964d6d8fb1b07b9d86041f/users/0352ca03a9bd419b8a2ad6a4157421d0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:37.393382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.409040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2609d4-77ed-413f-a4ff-433239faf764 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.577752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:37.578582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:37.578939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:37.579272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:37.580105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:37.581936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.606993 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1514/3047] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:37.611689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.627021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c4536-d8a1-429d-b07a-0cd06666f979 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.643382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83681418-5fb5-459c-aab9-31206b1f36aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:37.644433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681418-5fb5-459c-aab9-31206b1f36aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:37.644790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681418-5fb5-459c-aab9-31206b1f36aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:37.645137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83681418-5fb5-459c-aab9-31206b1f36aa admin admin] PATH_INFO: `/v3/projects/d46df6075c964d6d8fb1b07b9d86041f/users/0352ca03a9bd419b8a2ad6a4157421d0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:37.652502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681418-5fb5-459c-aab9-31206b1f36aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46df6075c964d6d8fb1b07b9d86041f, user_id=0352ca03a9bd419b8a2ad6a4157421d0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:37.655639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83681418-5fb5-459c-aab9-31206b1f36aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:37.681770 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1534/3048] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:37 2022] PUT /identity/v3/projects/d46df6075c964d6d8fb1b07b9d86041f/users/0352ca03a9bd419b8a2ad6a4157421d0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:37.789761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:37.792378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:37.832776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db85ef-8a0e-4b09-a719-c233946fdcc5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:37.998997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:38.010228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.010706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.010880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] PATH_INFO: `/v3/projects/20136f897d1649ccad370794ffa229fd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.016189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] RBAC: Authorizing `identity:delete_project(project_id=20136f897d1649ccad370794ffa229fd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:38.018284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:38.146052 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:38.150672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20136f897d1649ccad370794ffa229fd', 'request_id': 'req-a8495f1f-fdf1-4122-8539-1e981643345f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:38.166164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20136f897d1649ccad370794ffa229fd', 'request_id': 'req-a8495f1f-fdf1-4122-8539-1e981643345f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:38.201758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20136f897d1649ccad370794ffa229fd', 'request_id': 'req-a8495f1f-fdf1-4122-8539-1e981643345f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:38.229808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] The token cache is being invalidate because project 20136f897d1649ccad370794ffa229fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:15:38.230377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:38.231387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8495f1f-fdf1-4122-8539-1e981643345f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:38.244181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1515/3049] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:37 2022] DELETE /identity/v3/projects/20136f897d1649ccad370794ffa229fd => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:38.245611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.246280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.246280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.282336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:38.284538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:38.418627 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1535/3050] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:38.426520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.427286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.427687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.453779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:38.455520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:38.468682 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1516/3051] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:38.473228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:38.487437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652139f2-eeaa-4dd2-a0fc-5e70bfc0cf85 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:38.494139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:38.495547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.496102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.509132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.512121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:15:38.513292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:38.524766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:38.576765 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1536/3052] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:15:38.585118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:38.618004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc8c19-31ec-47d9-995e-794723dd1fc9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:38.649886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f214888-9b2a-4935-9eab-2c4bd49abbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:38.651035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214888-9b2a-4935-9eab-2c4bd49abbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.651498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214888-9b2a-4935-9eab-2c4bd49abbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.651962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f214888-9b2a-4935-9eab-2c4bd49abbe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.653733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f214888-9b2a-4935-9eab-2c4bd49abbe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:38.662048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f214888-9b2a-4935-9eab-2c4bd49abbe8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:38.773301 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1517/3053] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:15:38 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:38.774832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:38.782104 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:38.799149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41887038-37c6-4ad9-9f5d-3c1c1e9ccbbb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:38.963401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.963727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.964042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.964839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:38.965539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:38.965822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:38.968531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:38.969290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:38.974908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:39.006733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] MFA Rules not processed for user `b91e647e60714df193d94a2fbc4ee2e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:39.008104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:39.020896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1537/3054] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:15:38 2022] POST /identity/v3/users => generated 285 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:39.025393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:39.043731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9815f92-18d8-4d75-a08a-f9d2d4eec753 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:39.061181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:39.061930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:39.062218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:39.063110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:39.063569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:39.068874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:39.096055 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1538/3055] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:15:39.100368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:39.180377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f58c995-94d3-497a-a836-03389f523d74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:39.180954 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1518/3056] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:39.193753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d518a-ab43-4b55-9dd6-3a30168ca94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:39.196057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d518a-ab43-4b55-9dd6-3a30168ca94d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:39.196571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d518a-ab43-4b55-9dd6-3a30168ca94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:39.200156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d518a-ab43-4b55-9dd6-3a30168ca94d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:39.201194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d518a-ab43-4b55-9dd6-3a30168ca94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:39.203079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d518a-ab43-4b55-9dd6-3a30168ca94d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:39.222174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1539/3057] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:15:39.231824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:39.243876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7a658-5d68-4420-9b89-dc8d69eca4ca None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:39.249833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:39.250650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:39.250996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:39.251338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] PATH_INFO: `/v3/projects/9dc31a986d00473eb957dba59ccfcdee/users/05f10a88d61f4451856e358a07028d5a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:39.289199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc31a986d00473eb957dba59ccfcdee, user_id=05f10a88d61f4451856e358a07028d5a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:39.293440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:39.335076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1519/3058] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:39 2022] PUT /identity/v3/projects/9dc31a986d00473eb957dba59ccfcdee/users/05f10a88d61f4451856e358a07028d5a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:39.336539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4977-eb32-4411-a596-ebf6c253e3af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:39.337026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4977-eb32-4411-a596-ebf6c253e3af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:39.337131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f4977-eb32-4411-a596-ebf6c253e3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:39.379354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eb6f4977-eb32-4411-a596-ebf6c253e3af None None] MFA Rules not processed for user `05f10a88d61f4451856e358a07028d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:39.380651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eb6f4977-eb32-4411-a596-ebf6c253e3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:39.554960 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1540/3059] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:40.811738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:40.815162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:41.039565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5f0cf-c3dc-4c0d-bb02-42f6cde793d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:41.049667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a052b8-b572-434c-962f-631357b11e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:41.050347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a052b8-b572-434c-962f-631357b11e22 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:41.050632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a052b8-b572-434c-962f-631357b11e22 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:41.050916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a052b8-b572-434c-962f-631357b11e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:41.062260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a052b8-b572-434c-962f-631357b11e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:41.064401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a052b8-b572-434c-962f-631357b11e22 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:41.084522 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1520/3060] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:41.688253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccc092-491a-472f-ae84-470f7195d6a8 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:41.689197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccc092-491a-472f-ae84-470f7195d6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:41.690673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccc092-491a-472f-ae84-470f7195d6a8 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:41.692630 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1541/3061] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:15:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:15:41.700017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:41.700920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:41.701538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:41.749410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:41.753727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:41.801779 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:41.970774 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1521/3062] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:15:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:41.995217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccc092-491a-472f-ae84-470f7195d6a8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:41.997376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28ccc092-491a-472f-ae84-470f7195d6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:42.051663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccc092-491a-472f-ae84-470f7195d6a8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:42.058655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:42.060614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:42.060614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:42.060855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:42.094296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:42.106239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:42.146001 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1542/3063] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:44.258403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:44.264937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:44.584208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cf2b9-5d9f-43f2-8357-00046b6481b5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:44.595417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:44.596418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:44.596900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:44.597473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:44.600411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:44.634987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:44.637563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15339df1-8e08-4d1b-9fdb-a9c5d4534324 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:44.675141 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1522/3064] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:44.780038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:44.799262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7d97d-f098-4140-a653-b2d609872128 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:44.805925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:44.807833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:44.810491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:44.812756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:44.823988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:44.852487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:44.854622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:44.875711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1543/3065] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:15:47.872442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:47.872993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:47.872993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:47.930279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] MFA Rules not processed for user `0352ca03a9bd419b8a2ad6a4157421d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:47.933266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:48.126630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1523/3066] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:47 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:48.139215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:48.142787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:48.242445 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:48.314285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc85520b-0f16-4580-a37c-f7780470c4b2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:48.324682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c661cc-1a01-40d9-a472-15a4b063c55c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:48.345815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c661cc-1a01-40d9-a472-15a4b063c55c service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:48.346230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c661cc-1a01-40d9-a472-15a4b063c55c service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:48.346508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c661cc-1a01-40d9-a472-15a4b063c55c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:48.390816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c661cc-1a01-40d9-a472-15a4b063c55c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:48.397295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c661cc-1a01-40d9-a472-15a4b063c55c service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:48.431214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1544/3067] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:50.463924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:50.566590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216afce7-5920-43dc-903a-e0c3d384c6c6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:50.567164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216afce7-5920-43dc-903a-e0c3d384c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:50.567164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216afce7-5920-43dc-903a-e0c3d384c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:50.586813 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:50.668385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-216afce7-5920-43dc-903a-e0c3d384c6c6 None None] MFA Rules not processed for user `b57ca8171ff14c9e9161c3602ff69d34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:50.671798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-216afce7-5920-43dc-903a-e0c3d384c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:50.769969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd3e439-cb14-4dd8-bc4d-1fa49911c97a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:50.779355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:50.780898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:50.781369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:50.781824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] PATH_INFO: `/v3/users/05f10a88d61f4451856e358a07028d5a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:50.784296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f10a88d61f4451856e358a07028d5a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:50.800541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:50.881012 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1545/3068] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:50.927210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f10a88d61f4451856e358a07028d5a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:50.945618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f10a88d61f4451856e358a07028d5a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:51.025792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f10a88d61f4451856e358a07028d5a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:51.028325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f10a88d61f4451856e358a07028d5a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:51.077499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f10a88d61f4451856e358a07028d5a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:51.097693 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1524/3069] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:50 2022] DELETE /identity/v3/users/05f10a88d61f4451856e358a07028d5a => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:51.102265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc0aa-5714-4f82-bfae-938c9c9c32af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:51.102577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc0aa-5714-4f82-bfae-938c9c9c32af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:51.102826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bc0aa-5714-4f82-bfae-938c9c9c32af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:51.164821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d75bc0aa-5714-4f82-bfae-938c9c9c32af None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:51.168846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d75bc0aa-5714-4f82-bfae-938c9c9c32af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:51.440866 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1546/3070] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:51.449966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:51.452738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:51.526584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db6b2-e6d1-469f-823a-bafaf9379421 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:51.526584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db6b2-e6d1-469f-823a-bafaf9379421 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:51.526584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7db6b2-e6d1-469f-823a-bafaf9379421 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:51.529620 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1547/3071] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:15:51.547337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3a06-5849-4a30-8223-315e81ef7c64 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:51.548143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3a06-5849-4a30-8223-315e81ef7c64 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:51.548661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3a06-5849-4a30-8223-315e81ef7c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:51.717947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b81c27-4994-4a71-85c6-f92f24e049c3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:51.729676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:51.730522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:51.730872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:51.731784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:51.756572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:51.758184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:51.766364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba9c3a06-5849-4a30-8223-315e81ef7c64 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:51.768310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba9c3a06-5849-4a30-8223-315e81ef7c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:51.793322 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1525/3072] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:51.820753 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:51.912324 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1548/3073] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:15:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:51.969894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:51.971401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:52.010443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca59ba-24e8-414d-b693-24d629bdcce9 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:52.049562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f1f2d-666b-4dd2-8f9f-3dd54de7d841 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:52.051656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1f2d-666b-4dd2-8f9f-3dd54de7d841 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:52.058387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1f2d-666b-4dd2-8f9f-3dd54de7d841 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:52.058741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f1f2d-666b-4dd2-8f9f-3dd54de7d841 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:52.106544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f1f2d-666b-4dd2-8f9f-3dd54de7d841 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:52.112296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f1f2d-666b-4dd2-8f9f-3dd54de7d841 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:52.155979 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1526/3074] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:52.619670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994cfaa-fae7-4a53-8667-90b2160b904e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:52.620554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994cfaa-fae7-4a53-8667-90b2160b904e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:52.621106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994cfaa-fae7-4a53-8667-90b2160b904e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:52.624427 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1549/3075] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:15:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:15:52.664658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:52.665359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:52.665505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:52.708629 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:52.729933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:52.733104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:52.920866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994cfaa-fae7-4a53-8667-90b2160b904e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:52.923861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0994cfaa-fae7-4a53-8667-90b2160b904e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:52.973479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994cfaa-fae7-4a53-8667-90b2160b904e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:52.985384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:52.987569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:52.988205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:52.989073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] PATH_INFO: `/v3/projects/9dc31a986d00473eb957dba59ccfcdee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:52.992250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc31a986d00473eb957dba59ccfcdee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:52.998854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:53.007516 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1527/3076] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:15:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:53.009290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:53.024532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c960e-ff9f-4d8d-9b6d-ec32f2c6df58 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:53.029524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ede71-68eb-4513-9c6e-136ec75fe4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:53.030744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ede71-68eb-4513-9c6e-136ec75fe4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.031291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ede71-68eb-4513-9c6e-136ec75fe4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.031745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ede71-68eb-4513-9c6e-136ec75fe4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.064088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ede71-68eb-4513-9c6e-136ec75fe4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:53.070061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ede71-68eb-4513-9c6e-136ec75fe4ab service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:53.114248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1528/3077] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:53.115668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc31a986d00473eb957dba59ccfcdee', 'request_id': 'req-5ede2396-3a35-4028-94a6-120bb6f27b56'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:53.125714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc31a986d00473eb957dba59ccfcdee', 'request_id': 'req-5ede2396-3a35-4028-94a6-120bb6f27b56'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:53.141100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc31a986d00473eb957dba59ccfcdee', 'request_id': 'req-5ede2396-3a35-4028-94a6-120bb6f27b56'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:53.164515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] The token cache is being invalidate because project 9dc31a986d00473eb957dba59ccfcdee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:15:53.165570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:53.166887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ede2396-3a35-4028-94a6-120bb6f27b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:53.170233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1550/3078] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:52 2022] DELETE /identity/v3/projects/9dc31a986d00473eb957dba59ccfcdee => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:53.176133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.176459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.176728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.210192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:53.211933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:53.350123 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1529/3079] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:53.360198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.360670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.361048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.392065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:53.394015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:53.413733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:53.415112 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1551/3080] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:53.425740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822ecaac-a2ea-4c2f-8a2d-3cb4ce6704b1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:53.440922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:53.441646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.442043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.442231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.442999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:15:53.443341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:53.445066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:53.480218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1530/3081] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:15:53.482942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:53.501454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b478ec-db9e-4281-9abe-8a2792476151 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:53.523657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:53.525189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.529750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.530514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.532520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:53.535840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:53.616510 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1552/3082] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:15:53 2022] POST /identity/v3/projects => generated 395 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:53.622258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:53.636642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7999a-3a42-4f23-a4d1-60e4ecab684a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:53.810049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:53.810791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.811010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.811469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.812363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:53.820677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:53.873728 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1531/3083] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:15:53 2022] POST /identity/v3/users => generated 298 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:15:53.878821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:53.898899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c5fc2a-13fa-4c19-81be-d36e94cfe81e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:53.961248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:53.961951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:53.962232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:53.962506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:53.963267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:53.964896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:54.032539 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1553/3084] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:54.036979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:54.050105 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:54.057210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3c4c0-4ebf-4ab0-a029-1686f46b3fe7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:54.089458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad04b592-e4ee-43eb-8382-b1321e1cd0e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:54.090199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b592-e4ee-43eb-8382-b1321e1cd0e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:54.090713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b592-e4ee-43eb-8382-b1321e1cd0e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:54.091811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad04b592-e4ee-43eb-8382-b1321e1cd0e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:54.092779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b592-e4ee-43eb-8382-b1321e1cd0e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:54.095632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad04b592-e4ee-43eb-8382-b1321e1cd0e9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:54.143594 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1532/3085] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:15:54.147892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:54.162722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e086431-7ed9-4e35-9dc0-a03a153a71a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:54.169046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:54.170324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:54.170819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:54.171249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] PATH_INFO: `/v3/projects/041809b4f7b442a4aefa3fa41582e388/users/aef268f440874068b2cf2aaaf21e6114/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:54.196178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] RBAC: Authorizing `identity:create_grant(project_id=041809b4f7b442a4aefa3fa41582e388, user_id=aef268f440874068b2cf2aaaf21e6114, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:54.201043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:54.258285 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1554/3086] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:15:54 2022] PUT /identity/v3/projects/041809b4f7b442a4aefa3fa41582e388/users/aef268f440874068b2cf2aaaf21e6114/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:15:54.275788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7699-fc27-4183-be05-59954a03fbbc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:54.276126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7699-fc27-4183-be05-59954a03fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:54.276331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9df7699-fc27-4183-be05-59954a03fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:54.407368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b9df7699-fc27-4183-be05-59954a03fbbc None None] MFA Rules not processed for user `aef268f440874068b2cf2aaaf21e6114`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:54.409817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9df7699-fc27-4183-be05-59954a03fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:54.648925 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1533/3087] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:15:54.849063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:54.853914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:55.003826 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:55.127217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d3163-ff60-4b85-a111-426b9ade255b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:55.151101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:55.155062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:55.155917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:55.156849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:55.187188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:55.197386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:55.249903 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1555/3088] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:55.481093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fcbb-7a81-434b-be40-4b69e7d67d57 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:55.481093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fcbb-7a81-434b-be40-4b69e7d67d57 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:55.481742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56fcbb-7a81-434b-be40-4b69e7d67d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:55.586746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4e56fcbb-7a81-434b-be40-4b69e7d67d57 None None] MFA Rules not processed for user `aef268f440874068b2cf2aaaf21e6114`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:55.587910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4e56fcbb-7a81-434b-be40-4b69e7d67d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:55.616646 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1534/3089] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:57.267622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:57.411242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e696a-cd38-4c03-a47f-4d806c2a5d91 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:57.418090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:57.419502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:57.420164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:57.420707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] PATH_INFO: `/v3/users/aef268f440874068b2cf2aaaf21e6114` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:57.422999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef268f440874068b2cf2aaaf21e6114)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:57.425930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:57.543827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef268f440874068b2cf2aaaf21e6114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:57.545673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef268f440874068b2cf2aaaf21e6114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:57.578586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef268f440874068b2cf2aaaf21e6114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:57.579937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef268f440874068b2cf2aaaf21e6114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:57.606914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef268f440874068b2cf2aaaf21e6114'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:15:57.668012 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1556/3090] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:15:57 2022] DELETE /identity/v3/users/aef268f440874068b2cf2aaaf21e6114 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:15:57.669575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:57.670193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:57.670433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:57.744881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:15:57.749113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:57.907223 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1535/3091] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:15:57.944832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:57.950917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:58.124870 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:15:58.167517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf3c54c-ccf7-41f5-b311-3a09a3c2f0d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:15:58.189337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb39c6b0-a369-4695-a49f-a7c7bcac30f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:15:58.190111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c6b0-a369-4695-a49f-a7c7bcac30f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:15:58.191331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c6b0-a369-4695-a49f-a7c7bcac30f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:15:58.191331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb39c6b0-a369-4695-a49f-a7c7bcac30f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:15:58.237050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39c6b0-a369-4695-a49f-a7c7bcac30f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:15:58.237050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb39c6b0-a369-4695-a49f-a7c7bcac30f4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:15:58.296362 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1557/3092] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:15:59.889104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:15:59.890832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:15:59.962451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839aa88-41ab-4abb-b920-0569708e2cae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:00.002774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:00.004117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:00.004658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:00.005106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] PATH_INFO: `/v3/projects/041809b4f7b442a4aefa3fa41582e388` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:00.012559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=041809b4f7b442a4aefa3fa41582e388)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:00.036780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:00.302396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '041809b4f7b442a4aefa3fa41582e388', 'request_id': 'req-0e7046fb-3868-4079-ac8e-880587e180ff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:00.328719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '041809b4f7b442a4aefa3fa41582e388', 'request_id': 'req-0e7046fb-3868-4079-ac8e-880587e180ff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:00.347799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '041809b4f7b442a4aefa3fa41582e388', 'request_id': 'req-0e7046fb-3868-4079-ac8e-880587e180ff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:00.375924 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:00.397661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] The token cache is being invalidate because project 041809b4f7b442a4aefa3fa41582e388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:16:00.431700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:00.436627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0e7046fb-3868-4079-ac8e-880587e180ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:00.443584 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1536/3093] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:15:59 2022] DELETE /identity/v3/projects/041809b4f7b442a4aefa3fa41582e388 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:16:00.449805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:00.450956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:00.451485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:00.522110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:00.523685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:00.731873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1558/3094] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:00.741162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:00.741796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:00.742239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:00.783747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:00.785677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:00.830441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:00.853372 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1537/3095] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:00.876682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed6748-2ac3-4122-9112-613933b66b1c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:00.894368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:00.896038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:00.896380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:00.896645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:00.897449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:16:00.897755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:00.902818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:00.961651 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1559/3096] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:16:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:16:00.964167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:00.977285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c9e38-e287-40b8-a5ed-299c946b4eff None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:01.013830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:01.023640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:01.024652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:01.025168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:01.026219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:01.044770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:01.214250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1538/3097] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:16:00 2022] POST /identity/v3/projects => generated 377 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:16:01.222680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:01.244771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b7ad3f-0f93-49eb-a57f-f0b058cc1275 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:01.544896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:01.546390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:01.547292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:01.548987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:01.553280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:01.557563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:01.609711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1560/3098] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:16:01 2022] POST /identity/v3/users => generated 289 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:16:01.613660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:01.632819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190fbd81-c18a-4ebd-b694-f7aa1f0b85e5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:01.647311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:01.647311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:01.651419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:01.651419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:01.656727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:01.660036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:01.689704 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1539/3099] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:16:01.691996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:01.713323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5237cd-de62-4f9f-a8d6-14a412b1cacd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:01.730417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe96840-fa7c-4471-b30b-8c58b14f844c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:01.732033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96840-fa7c-4471-b30b-8c58b14f844c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:01.783047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96840-fa7c-4471-b30b-8c58b14f844c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:01.784911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe96840-fa7c-4471-b30b-8c58b14f844c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:01.789414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96840-fa7c-4471-b30b-8c58b14f844c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:01.796305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe96840-fa7c-4471-b30b-8c58b14f844c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:01.855584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1561/3100] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:16:01 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:16:01.856188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:01.874573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86504501-88f2-4529-9dd1-1a3563d015b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:01.887587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db068b2f-958c-4139-92fc-83427ca3865c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:01.889002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068b2f-958c-4139-92fc-83427ca3865c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:01.890601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068b2f-958c-4139-92fc-83427ca3865c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:01.891643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db068b2f-958c-4139-92fc-83427ca3865c admin admin] PATH_INFO: `/v3/projects/e0230041bf3341c6935e6e6d92c133a1/users/f1f52adaa981474782575d1011271fbf/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:01.944932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068b2f-958c-4139-92fc-83427ca3865c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0230041bf3341c6935e6e6d92c133a1, user_id=f1f52adaa981474782575d1011271fbf, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:01.965323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db068b2f-958c-4139-92fc-83427ca3865c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:02.021714 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1540/3101] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:16:01 2022] PUT /identity/v3/projects/e0230041bf3341c6935e6e6d92c133a1/users/f1f52adaa981474782575d1011271fbf/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:16:02.025912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:02.026655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:02.027864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:02.108623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:02.111156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:02.264209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:02.264694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:02.265130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:02.322993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:02.326503 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:02.330886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:02.398506 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1562/3102] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:02.438196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:02.444615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:02.574754 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1541/3103] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:16:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:02.580946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:02.583438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:02.626486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626dc6f-e002-4224-b625-b6d9ecbd52ba None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:02.637135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0acc4-a123-4b48-b85b-a14c50a3692f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:02.638930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0acc4-a123-4b48-b85b-a14c50a3692f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:02.639523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0acc4-a123-4b48-b85b-a14c50a3692f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:02.640030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0acc4-a123-4b48-b85b-a14c50a3692f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:02.669629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0acc4-a123-4b48-b85b-a14c50a3692f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:02.672550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0acc4-a123-4b48-b85b-a14c50a3692f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:02.702528 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1563/3104] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:02.778261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae80dee-a80c-4cca-93d9-ad06be711833 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:02.802939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:02.803948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:02.804256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:02.804590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:02.819677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:02.821823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:02.856122 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1542/3105] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:16:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:16:04.071049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f5ba7-a3eb-4984-9621-16396bd88d68 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:04.072025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f5ba7-a3eb-4984-9621-16396bd88d68 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:04.072724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901f5ba7-a3eb-4984-9621-16396bd88d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:04.097132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-901f5ba7-a3eb-4984-9621-16396bd88d68 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:04.099152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-901f5ba7-a3eb-4984-9621-16396bd88d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:04.116120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1564/3106] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:04.128502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:04.164245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdf3b08-8e91-4afa-b2d8-142bf82257b3 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:04.171551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:04.173135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:04.174959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:04.175539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:04.189337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:04.191799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:04.205145 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1543/3107] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:16:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:16:14.089942 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=33 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:14.199676 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:14.336909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:14.337554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:14.338510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:14.489521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] MFA Rules not processed for user `f1f52adaa981474782575d1011271fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:14.493473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:14.700589 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1565/3108] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:16.008231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:16.012828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:16.187901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54faf7b3-aba2-434a-aa22-7bc4052dee78 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:16.193919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c35eb7-ac70-433a-967a-1c9c4cf682ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:16.194682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35eb7-ac70-433a-967a-1c9c4cf682ae service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:16.194967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35eb7-ac70-433a-967a-1c9c4cf682ae service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:16.195245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c35eb7-ac70-433a-967a-1c9c4cf682ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:16.204478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35eb7-ac70-433a-967a-1c9c4cf682ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:16.206256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c35eb7-ac70-433a-967a-1c9c4cf682ae service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:16.218231 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1544/3109] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:17.240326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:17.246789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:17.425481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94e08f5-2848-4670-a3e7-4c5d69fea286 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:17.431577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:17.432806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:17.433496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:17.433933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:17.441670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:17.456701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:17.458947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:17.483425 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1566/3110] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:21.181696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20300a-7336-45be-9940-cd10c6066479 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:21.182186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20300a-7336-45be-9940-cd10c6066479 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:21.182303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d20300a-7336-45be-9940-cd10c6066479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:21.216066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9d20300a-7336-45be-9940-cd10c6066479 None None] MFA Rules not processed for user `f1f52adaa981474782575d1011271fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:21.219482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d20300a-7336-45be-9940-cd10c6066479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:21.238613 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1545/3111] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:24.691349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:24.742074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8b26f-7309-4537-b419-ddaa59594934 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:24.749899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:24.751556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:24.752017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:24.752543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:24.754877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:24.831441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:24.833761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:24.865814 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1567/3112] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:25.351837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e89ef3-794f-4177-9663-734f355a0c9b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:25.352946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e89ef3-794f-4177-9663-734f355a0c9b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:25.353420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e89ef3-794f-4177-9663-734f355a0c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:25.402309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b3e89ef3-794f-4177-9663-734f355a0c9b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:25.407013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b3e89ef3-794f-4177-9663-734f355a0c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:25.427980 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1546/3113] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:16:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:25.451480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:25.459623 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:25.477346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ff3362-b551-4702-bd87-ab9f82184dff service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:25.496070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5237d9cc-169e-4365-a0f6-108f5b58f84f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:25.497236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d9cc-169e-4365-a0f6-108f5b58f84f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:25.498107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d9cc-169e-4365-a0f6-108f5b58f84f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:25.499244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5237d9cc-169e-4365-a0f6-108f5b58f84f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:25.554175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237d9cc-169e-4365-a0f6-108f5b58f84f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:25.563236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5237d9cc-169e-4365-a0f6-108f5b58f84f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:25.594047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1568/3114] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:16:26.797761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:26.798481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:26.798876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:26.846175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] MFA Rules not processed for user `7c11c0d82ccf4472b35194fcc5a8ea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:26.847694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:26.954404 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1547/3115] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:27.323593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc2a7-021b-4391-ba0c-2e084d3e17e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:27.324094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc2a7-021b-4391-ba0c-2e084d3e17e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:27.324186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8fc2a7-021b-4391-ba0c-2e084d3e17e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:27.343805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a8fc2a7-021b-4391-ba0c-2e084d3e17e1 None None] MFA Rules not processed for user `d7b0ccca5d874cd995c0ec0cc2ef545d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:27.345521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a8fc2a7-021b-4391-ba0c-2e084d3e17e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:27.357937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1569/3116] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:28.697245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:28.698673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:28.719551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092c997-9f49-4212-a29b-1ff9ea8afcce None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:28.727832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:28.728796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:28.729283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:28.729737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:28.734143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:28.766340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:28.770063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:28.804579 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1548/3117] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:32.400262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:32.400805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:32.400924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:32.432854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:32.438320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:32.460494 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1570/3118] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:16:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:32.477070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:32.502153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86952c4-f94a-4033-abc4-7327b287397a service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:32.511191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:32.512257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:32.512616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:32.512954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:32.595410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:32.600687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:32.625416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1549/3119] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:16:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:16:33.772148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:33.774432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:33.851868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029d5a9-5718-4f29-87fd-3f6757214a25 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:33.884535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:33.885254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:33.885541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:33.885999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:33.888312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:34.120754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:34.132251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6619a0-c43b-4c4d-823a-6f699fa402bb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:34.174996 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1571/3120] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:42.616681 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=77 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:44.158602 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=44 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:45.266401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:45.268870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:45.469880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d1c28-98f8-4a4a-9058-14c55eb0e204 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:45.490706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:45.491947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:45.492442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:45.492908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] PATH_INFO: `/v3/users/b91e647e60714df193d94a2fbc4ee2e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:45.495209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b91e647e60714df193d94a2fbc4ee2e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:45.497502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:45.653269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b91e647e60714df193d94a2fbc4ee2e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:45.681406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b91e647e60714df193d94a2fbc4ee2e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:45.716540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b91e647e60714df193d94a2fbc4ee2e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:45.717857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b91e647e60714df193d94a2fbc4ee2e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:45.744159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b91e647e60714df193d94a2fbc4ee2e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:45.763109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1550/3121] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:16:45 2022] DELETE /identity/v3/users/b91e647e60714df193d94a2fbc4ee2e8 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:16:45.765859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:45.766834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:45.767306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:45.846941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:45.851104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:45.963790 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1572/3122] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:46.038008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:46.040370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:46.203651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e119fa-5732-48fd-8b4a-3c31652b8883 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:46.210261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:46.211737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:46.212507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:46.212868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:46.224672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:46.227839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:46.247090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1551/3123] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:46.921485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:46.923881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:46.983936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86193bc9-d565-4d27-a9d6-8aa20e27c78d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:47.010390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:47.011859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:47.014143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:47.014544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] PATH_INFO: `/v3/users/b57ca8171ff14c9e9161c3602ff69d34` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:47.020923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57ca8171ff14c9e9161c3602ff69d34)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:47.024255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:47.143888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57ca8171ff14c9e9161c3602ff69d34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:47.145716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57ca8171ff14c9e9161c3602ff69d34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:47.158724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57ca8171ff14c9e9161c3602ff69d34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:47.159508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57ca8171ff14c9e9161c3602ff69d34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:47.171585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57ca8171ff14c9e9161c3602ff69d34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:47.211779 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1573/3124] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:16:46 2022] DELETE /identity/v3/users/b57ca8171ff14c9e9161c3602ff69d34 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:16:48.133096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:48.135685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:48.143430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:48.144935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:48.176972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179747d-97f1-4ede-8ab2-d7cc78e2781f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:48.244919 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:48.298411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1f4d-b717-406b-9910-3ab591cc4ea4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:48.317257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:48.318397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.318850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.319299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] PATH_INFO: `/v3/projects/c16ae9a2e0994d528daa61b267d88020` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.320083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:48.320973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16ae9a2e0994d528daa61b267d88020)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:48.321647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.322104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.323512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] PATH_INFO: `/v3/projects/1780d718638f4a1882754f2adcd50fb5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.323958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:48.326247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=1780d718638f4a1882754f2adcd50fb5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:48.329924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:48.347521 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:48.467655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16ae9a2e0994d528daa61b267d88020', 'request_id': 'req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.473056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1780d718638f4a1882754f2adcd50fb5', 'request_id': 'req-5113f4e6-34d0-4787-8c33-0b493b2237ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.487495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1780d718638f4a1882754f2adcd50fb5', 'request_id': 'req-5113f4e6-34d0-4787-8c33-0b493b2237ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.492520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16ae9a2e0994d528daa61b267d88020', 'request_id': 'req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.501616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16ae9a2e0994d528daa61b267d88020', 'request_id': 'req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.504883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1780d718638f4a1882754f2adcd50fb5', 'request_id': 'req-5113f4e6-34d0-4787-8c33-0b493b2237ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.527922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] The token cache is being invalidate because project 1780d718638f4a1882754f2adcd50fb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:16:48.528224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.540318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5113f4e6-34d0-4787-8c33-0b493b2237ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.544189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1552/3125] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:16:48 2022] DELETE /identity/v3/projects/1780d718638f4a1882754f2adcd50fb5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:16:48.550694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] The token cache is being invalidate because project c16ae9a2e0994d528daa61b267d88020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:16:48.550809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.554148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b069f3c-24ce-40b4-834b-e2d11de7e9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:16:48.555990 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1574/3126] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:16:48 2022] DELETE /identity/v3/projects/c16ae9a2e0994d528daa61b267d88020 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:16:48.558139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887e2b-e539-475d-8bc4-867bff230ab0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.558481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887e2b-e539-475d-8bc4-867bff230ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.558707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887e2b-e539-475d-8bc4-867bff230ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.561297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273919d-3f77-409b-9c10-59451f299754 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.561632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273919d-3f77-409b-9c10-59451f299754 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.561851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6273919d-3f77-409b-9c10-59451f299754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.617674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6273919d-3f77-409b-9c10-59451f299754 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:48.620288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6273919d-3f77-409b-9c10-59451f299754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:48.645544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ed887e2b-e539-475d-8bc4-867bff230ab0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:48.647549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed887e2b-e539-475d-8bc4-867bff230ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:48.720752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1575/3127] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:48.724516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.724808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.725083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.747670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:48.748922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:48.751771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1553/3128] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:48.760397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.760892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.761406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.767591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1576/3129] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:16:48.772670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:48.794519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7d3f-6bad-4f14-b5d7-984f4fa5f348 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:48.806442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:48.807758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.809357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.809691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.811366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:16:48.812491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:48.817610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:48.822651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:48.828922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:48.839506 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1577/3130] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:16:48.843631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:48.854154 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1554/3131] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:48.858336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:48.863684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a458d-7615-479f-aeb7-76025849417a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:48.870613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c289f-0f88-4448-8e12-353d77a95722 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:48.875484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:48.876187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.876508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.876783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.877476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:48.896547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:48.905354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:48.906259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:48.906393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:48.906615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:48.907385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:16:48.907690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:48.918677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:48.963272 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1555/3132] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:16:48.966419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:48.982040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb8553f-eba9-4a17-b27f-a1d5c1be5db3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:48.988193 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1578/3133] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:16:48.989825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.061383 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:49.112955 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:49.161067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e619a45a-3c85-46a2-a5a3-55619dffd3c1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.172512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.172512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.172512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.172512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.173223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.173223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.178472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.179392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.179845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.180299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.181266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.184162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.231839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1556/3134] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/projects => generated 367 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:16:49.236827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.236959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1579/3135] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:16:48 2022] POST /identity/v3/users => generated 296 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:16:49.238524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.270970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406161e-99c7-4b42-bfe3-0e17084c4ec9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.417877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0b585-7261-4192-bbf2-12b2821bb208 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.437986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.438810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.439106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.440148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.440885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.441172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.441465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.442550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.443298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.461517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.466340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.473551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.502088 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1580/3136] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:16:49.506191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.527330 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1557/3137] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:16:49 2022] POST /identity/v3/users => generated 284 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:16:49.532555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.533437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533cb0e5-7b3a-4975-87b6-cb18e8965ab8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.546395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddedea55-a29b-455b-9c90-9163d975618b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.547700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.548547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.549206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.549206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.549872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.553227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.555981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.556788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.557414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.557764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.558596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.560564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.567909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1581/3138] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:16:49.571992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.580299 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1558/3139] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:16:49.581297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.586735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792007bd-d4a2-49c8-a47b-42bf1f4bbd9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.592937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb497a-652a-4ae4-86fb-7740e012f0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.593860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb497a-652a-4ae4-86fb-7740e012f0da admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.594195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb497a-652a-4ae4-86fb-7740e012f0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.594479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb497a-652a-4ae4-86fb-7740e012f0da admin admin] PATH_INFO: `/v3/projects/f4d9cafac76a452689f65dc3a4290b65/users/cec6a5157b6e4d289a1d7ac1e71ff2fc/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.597018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18567568-142e-4f1e-9562-0d9c0d2213e0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.603403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.604165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.604745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.605028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.605790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.608472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.615627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb497a-652a-4ae4-86fb-7740e012f0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d9cafac76a452689f65dc3a4290b65, user_id=cec6a5157b6e4d289a1d7ac1e71ff2fc, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.618541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb497a-652a-4ae4-86fb-7740e012f0da admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.626403 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1559/3140] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:16:49.629274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.642216 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1582/3141] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:16:49 2022] PUT /identity/v3/projects/f4d9cafac76a452689f65dc3a4290b65/users/cec6a5157b6e4d289a1d7ac1e71ff2fc/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:16:49.643423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b730a-1d0b-497d-a696-bbe9100d95ec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:49.650605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.652756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.653577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.676541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:49.678928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:49.733046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c54c4-9773-4032-88ea-f5cb5f81a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:49.734209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c54c4-9773-4032-88ea-f5cb5f81a274 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.734749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c54c4-9773-4032-88ea-f5cb5f81a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.735270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c54c4-9773-4032-88ea-f5cb5f81a274 admin admin] PATH_INFO: `/v3/projects/32a799d27c634bd38a48cf668ea0a2ee/users/70dd4df198264571978250f31b491cae/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.769650 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1583/3142] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:49.784455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c54c4-9773-4032-88ea-f5cb5f81a274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a799d27c634bd38a48cf668ea0a2ee, user_id=70dd4df198264571978250f31b491cae, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:49.787198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c54c4-9773-4032-88ea-f5cb5f81a274 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:49.791960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:49.793443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:49.802435 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:49.819114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1560/3143] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:16:49 2022] PUT /identity/v3/projects/32a799d27c634bd38a48cf668ea0a2ee/users/70dd4df198264571978250f31b491cae/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:16:49.819114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:49.819114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:49.819114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:49.861078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:49.862311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:49.935514 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:16:49.982778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db68f-6afd-4717-97f2-7742660c6b00 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:50.049297 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1561/3144] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:16:50.122995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4517f-3040-497c-971e-7705dcc0b2b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:50.123679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4517f-3040-497c-971e-7705dcc0b2b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:50.123956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4517f-3040-497c-971e-7705dcc0b2b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:50.124226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4517f-3040-497c-971e-7705dcc0b2b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:50.128395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:16:50.141657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fecae4-3b16-4fb0-9123-d5c0c452d052 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:16:50.155280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc9180-129c-4738-a05f-45ac12b64e37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:16:50.156101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9180-129c-4738-a05f-45ac12b64e37 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:50.156720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9180-129c-4738-a05f-45ac12b64e37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:50.157424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc9180-129c-4738-a05f-45ac12b64e37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:50.165439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4517f-3040-497c-971e-7705dcc0b2b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:50.167053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4517f-3040-497c-971e-7705dcc0b2b7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:50.180477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc9180-129c-4738-a05f-45ac12b64e37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:16:50.181789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc9180-129c-4738-a05f-45ac12b64e37 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:16:50.196707 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1584/3145] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:50.209625 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1562/3146] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:16:59.598619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1699b4-c85f-4496-a60c-243b40454011 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:16:59.599246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1699b4-c85f-4496-a60c-243b40454011 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:16:59.599246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1699b4-c85f-4496-a60c-243b40454011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:16:59.665298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9f1699b4-c85f-4496-a60c-243b40454011 None None] MFA Rules not processed for user `f61221659eee4c57ab0c7817c73e9ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:16:59.672746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f1699b4-c85f-4496-a60c-243b40454011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:16:59.874793 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1585/3147] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:16:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:00.198957 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=34 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:03.758925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:03.760004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:03.760499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:03.835664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] MFA Rules not processed for user `cec6a5157b6e4d289a1d7ac1e71ff2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:03.836524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:03.977420 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1563/3148] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:03.993974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:03.998573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:03.998937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:04.044909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] MFA Rules not processed for user `cec6a5157b6e4d289a1d7ac1e71ff2fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:04.046627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:04.071077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1586/3149] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:04.909640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:04.911525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:05.143821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0422c-3d2e-4a4d-abbb-dda11596d1a8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:05.163342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:05.164038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:05.164331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:05.164640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:05.186293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:05.191803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:05.228047 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1564/3150] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:11.761060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:11.763475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:11.782707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68731c-6d93-4600-8a5e-39e5b65cadf7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:11.840973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:11.848897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:11.861723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:11.866831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:11.887433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:12.122958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:12.124957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5949645-9d52-4df3-adb9-a1d501bf7e4a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:12.154227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1587/3151] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:15.210044 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=66 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:15.624587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:15.640463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ff14e-8cce-4e89-bbf4-a703b9a5cb7e service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:15.654308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:15.656527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:15.657296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:15.657851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:15.668720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:15.688696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:15.692004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5941d7-348f-4850-b41c-4e0d7917f2bc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:15.719173 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1565/3152] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:18.337626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:18.338259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:18.338259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:18.398628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:18.399866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:18.419899 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:18.559474 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1588/3153] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:18.570823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598a0d-f3d2-4124-abca-99b7ce2f22e7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:18.572113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598a0d-f3d2-4124-abca-99b7ce2f22e7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:18.572596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56598a0d-f3d2-4124-abca-99b7ce2f22e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:18.617368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-56598a0d-f3d2-4124-abca-99b7ce2f22e7 None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:18.619350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56598a0d-f3d2-4124-abca-99b7ce2f22e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:18.637369 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1566/3154] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:18.864200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:18.866894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:18.909706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391fe9b-edfa-4e41-85cf-2ca7e7d6ecce None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:18.920819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b1314-1d9b-4cd0-a57e-af379fe05196 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:18.921927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1314-1d9b-4cd0-a57e-af379fe05196 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:18.922493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1314-1d9b-4cd0-a57e-af379fe05196 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:18.923068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b1314-1d9b-4cd0-a57e-af379fe05196 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:18.933731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b1314-1d9b-4cd0-a57e-af379fe05196 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:18.936285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86b1314-1d9b-4cd0-a57e-af379fe05196 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:18.963246 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1589/3155] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:18 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:22.538305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a623a-0799-4b80-ae5c-26ca69a497b6 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:22.539218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a623a-0799-4b80-ae5c-26ca69a497b6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:22.539659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0a623a-0799-4b80-ae5c-26ca69a497b6 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:22.542093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1567/3156] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:17:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:17:22.548621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51f57-235a-4489-b5d1-e1c10a23a0b2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:22.549542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51f57-235a-4489-b5d1-e1c10a23a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:22.549993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd51f57-235a-4489-b5d1-e1c10a23a0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:22.609911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8fd51f57-235a-4489-b5d1-e1c10a23a0b2 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:22.611333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8fd51f57-235a-4489-b5d1-e1c10a23a0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:22.772974 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1590/3157] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:17:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:22.802060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a623a-0799-4b80-ae5c-26ca69a497b6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:22.804447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2e0a623a-0799-4b80-ae5c-26ca69a497b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:22.827817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0a623a-0799-4b80-ae5c-26ca69a497b6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:22.840120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b3386c-cb78-4c83-95f7-82b75aa2c57b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:22.841006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3386c-cb78-4c83-95f7-82b75aa2c57b service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:22.841395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3386c-cb78-4c83-95f7-82b75aa2c57b service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:22.841787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b3386c-cb78-4c83-95f7-82b75aa2c57b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:22.852002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3386c-cb78-4c83-95f7-82b75aa2c57b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:22.855848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b3386c-cb78-4c83-95f7-82b75aa2c57b service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:22.899438 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1568/3158] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:24.080649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fc70-ef66-4cb9-97d3-63877f7a5b45 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:24.081331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fc70-ef66-4cb9-97d3-63877f7a5b45 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:24.081331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f6fc70-ef66-4cb9-97d3-63877f7a5b45 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:24.083284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1591/3159] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:17:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:17:24.092278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722a9e-a267-4d6e-90fb-a499a8399ef7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:24.093288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722a9e-a267-4d6e-90fb-a499a8399ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:24.094074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34722a9e-a267-4d6e-90fb-a499a8399ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:24.139982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-34722a9e-a267-4d6e-90fb-a499a8399ef7 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:24.141919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-34722a9e-a267-4d6e-90fb-a499a8399ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:24.172829 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1569/3160] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:17:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:24.211163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6fc70-ef66-4cb9-97d3-63877f7a5b45 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:24.235051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f6fc70-ef66-4cb9-97d3-63877f7a5b45 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:24.241705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:24.243015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:24.243622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:24.244128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:24.261767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:24.264083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:24.279666 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1592/3161] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:27.600723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:27.601298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:27.601298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:27.630410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] MFA Rules not processed for user `2b2950eec4754c328f600d770a8860d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:27.631838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:27.719781 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1570/3162] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:30.024527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:30.048256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4525179-6072-49ef-821d-7948dfdf9491 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:30.055864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:30.056633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:30.057205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:30.057803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:30.060912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:30.076433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:30.078229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:30.094828 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1593/3163] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:30.173509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:30.180597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:30.237802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cd8e0-dbc3-46a7-8202-3d6f594e0978 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:30.251036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:30.257237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:30.257540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:30.257796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] PATH_INFO: `/v3/users/7c11c0d82ccf4472b35194fcc5a8ea1c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:30.262821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c11c0d82ccf4472b35194fcc5a8ea1c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:30.268635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:30.392080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c11c0d82ccf4472b35194fcc5a8ea1c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:30.411280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c11c0d82ccf4472b35194fcc5a8ea1c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:30.448921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c11c0d82ccf4472b35194fcc5a8ea1c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:30.450051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c11c0d82ccf4472b35194fcc5a8ea1c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:30.478174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9e06898-96ee-475c-bfc1-11aa7e71a595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c11c0d82ccf4472b35194fcc5a8ea1c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:30.498121 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1571/3164] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:17:30 2022] DELETE /identity/v3/users/7c11c0d82ccf4472b35194fcc5a8ea1c => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:31.220574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:31.241355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8318da8-1153-41a1-9469-20582377e435 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:31.349187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:31.350300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:31.350589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:31.350859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] PATH_INFO: `/v3/projects/5a65e78bb995464996fe313201392b95` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:31.352981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a65e78bb995464996fe313201392b95)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:31.355818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:31.372261 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:31.423801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a65e78bb995464996fe313201392b95', 'request_id': 'req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:31.431611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a65e78bb995464996fe313201392b95', 'request_id': 'req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:31.441464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a65e78bb995464996fe313201392b95', 'request_id': 'req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:31.466031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] The token cache is being invalidate because project 5a65e78bb995464996fe313201392b95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:17:31.466519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:31.468046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a1b9c191-4e9a-4c41-803b-7f392c5a7dec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:31.473952 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1594/3165] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:17:31 2022] DELETE /identity/v3/projects/5a65e78bb995464996fe313201392b95 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:31.476386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:31.476934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:31.476934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:31.507290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:31.508808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:31.576551 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:31.648612 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1572/3166] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:31.656807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:31.657444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:31.657900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:31.697132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:31.701554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:31.732523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1595/3167] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:31.734418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:31.753442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5336b539-759b-4073-bec4-d136ed6c295e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:31.780867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:31.781720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:31.782075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:31.782419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:31.783310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:17:31.783698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:31.785539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:31.815210 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1573/3168] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:17:31.820614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:31.838949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c8f76e-94ba-4f2f-9911-8c0bc5b0da6b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:31.861944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:31.867190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:31.868274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:31.871925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:31.874148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:31.879898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:31.956562 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1596/3169] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:17:31 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:17:31.959208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:31.976756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af5bc7-1598-4e5b-9cf6-abaea9778c83 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:32.115308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:32.116030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:32.116335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:32.116638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:32.117355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:32.119336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:32.174200 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1574/3170] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:17:31 2022] POST /identity/v3/users => generated 292 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:17:32.180786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:32.202668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ed273b-defd-45a2-a428-bf21b44cdaaa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:32.212171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:32.213808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:32.214459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:32.214959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:32.216373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:32.219653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:32.237599 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1597/3171] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:17:32.242374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:32.256631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7a3a0-8425-4611-9057-6066725b2457 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:32.264740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee7e86b-1e40-447d-b763-a3e25509e95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:32.265629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7e86b-1e40-447d-b763-a3e25509e95c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:32.265924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7e86b-1e40-447d-b763-a3e25509e95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:32.266204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee7e86b-1e40-447d-b763-a3e25509e95c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:32.266994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7e86b-1e40-447d-b763-a3e25509e95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:32.268774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee7e86b-1e40-447d-b763-a3e25509e95c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:32.291533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1575/3172] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:32 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:32.292890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:32.326508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54768e8-e0c6-4bfc-98a4-544b4d8b3719 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:32.333644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:32.334829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:32.335268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:32.335697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] PATH_INFO: `/v3/projects/d3a92811069d4b799c532d88d41ce911/users/53ef6977196f432b9176e3a86c5cb189/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:32.362732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a92811069d4b799c532d88d41ce911, user_id=53ef6977196f432b9176e3a86c5cb189, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:32.370884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:32.397702 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1598/3173] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:17:32 2022] PUT /identity/v3/projects/d3a92811069d4b799c532d88d41ce911/users/53ef6977196f432b9176e3a86c5cb189/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:32.402741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991417bd-5549-4413-9654-996c2370369a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:32.403314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991417bd-5549-4413-9654-996c2370369a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:32.403660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991417bd-5549-4413-9654-996c2370369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:32.453483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-991417bd-5549-4413-9654-996c2370369a None None] MFA Rules not processed for user `53ef6977196f432b9176e3a86c5cb189`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:32.455389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-991417bd-5549-4413-9654-996c2370369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:32.635023 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1576/3174] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:32.653756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:32.657992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:32.767122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b42e3-d7f0-4c6b-ae29-e28aeb6d5b59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:32.772763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:32.773556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:32.773909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:32.774257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:32.786154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:32.788285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:32.800370 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1599/3175] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:34.005682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:34.006604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:34.007042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:34.036777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:34.038992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:34.101811 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:34.178431 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1577/3176] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:34.236546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:34.239099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:34.322996 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:34.385358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10f9de-d4d5-4b0b-b079-438776d21360 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:34.392316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de1c317-986f-4605-a8ec-9011a0f7411d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:34.393399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c317-986f-4605-a8ec-9011a0f7411d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:34.394080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c317-986f-4605-a8ec-9011a0f7411d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:34.394549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de1c317-986f-4605-a8ec-9011a0f7411d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:34.415856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c317-986f-4605-a8ec-9011a0f7411d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:34.420821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de1c317-986f-4605-a8ec-9011a0f7411d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:34.445795 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1600/3177] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:17:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:17:36.188020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:36.190960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:36.350559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de998c44-e865-4884-941b-9d97d6ce6f99 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:36.358429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:36.359409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:36.359878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:36.360326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] PATH_INFO: `/v3/users/6f034d6e3a874e9892df5c3188235e7e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:36.361907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f034d6e3a874e9892df5c3188235e7e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:36.364539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:36.493057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f034d6e3a874e9892df5c3188235e7e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:36.521175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f034d6e3a874e9892df5c3188235e7e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:36.521576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:36.522373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:36.523069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:36.542797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f034d6e3a874e9892df5c3188235e7e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:36.543860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f034d6e3a874e9892df5c3188235e7e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:36.556383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:36.559384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:36.583524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f034d6e3a874e9892df5c3188235e7e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:36.597755 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1601/3178] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:17:36.604131 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1578/3179] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:17:36 2022] DELETE /identity/v3/users/6f034d6e3a874e9892df5c3188235e7e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:36.609342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:36.612846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:36.651591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099c786-4d29-45b5-99c1-9e4f888d83ac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:36.809527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:36.810609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:36.811883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:36.812551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:36.955651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:36.958777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:36.974072 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1602/3180] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:17:37.526905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:37.529008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:37.697253 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:37.702796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2194b2-a718-4382-98c3-eee20c96c8fb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:37.720950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:37.723837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:37.724705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:37.726579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] PATH_INFO: `/v3/projects/6edf36048bec47f7a94a089b0f1e63ca` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:37.729085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6edf36048bec47f7a94a089b0f1e63ca)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:37.731071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:37.833818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6edf36048bec47f7a94a089b0f1e63ca', 'request_id': 'req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:37.845367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6edf36048bec47f7a94a089b0f1e63ca', 'request_id': 'req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:37.854555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6edf36048bec47f7a94a089b0f1e63ca', 'request_id': 'req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:37.870334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] The token cache is being invalidate because project 6edf36048bec47f7a94a089b0f1e63ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:17:37.871039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:37.872015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:37.874411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1579/3181] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:17:37 2022] DELETE /identity/v3/projects/6edf36048bec47f7a94a089b0f1e63ca => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:37.879365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:37.900328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a50d7-38e4-4295-83a8-86e303fe03c6 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:38.050392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:38.051929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:38.052924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:38.053552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] PATH_INFO: `/v3/users/871b812913b44c129b7d09272a42a278` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:38.055757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871b812913b44c129b7d09272a42a278)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:38.059553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:38.064629 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:38.132407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871b812913b44c129b7d09272a42a278'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.133149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871b812913b44c129b7d09272a42a278'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.144832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871b812913b44c129b7d09272a42a278'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.147231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871b812913b44c129b7d09272a42a278'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.158863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9116477-dd60-47d7-862b-fb25323086b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871b812913b44c129b7d09272a42a278'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.187615 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1603/3182] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:17:37 2022] DELETE /identity/v3/users/871b812913b44c129b7d09272a42a278 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:38.577030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:38.580000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:38.615139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f71f7-ba59-45a5-93e3-d8225e02f4e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:38.637297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:38.637727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:38.638106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:38.673463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:38.675059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:38.737362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:38.739027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:38.739533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:38.739987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] PATH_INFO: `/v3/projects/a83fb3943f4c4189a2a4df88e0850f12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:38.741657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a83fb3943f4c4189a2a4df88e0850f12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:38.744046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:38.812412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a83fb3943f4c4189a2a4df88e0850f12', 'request_id': 'req-de94eea6-ce21-442b-901d-481411fe5c88'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.814788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1604/3183] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:38.829555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:38.832882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:38.844020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a83fb3943f4c4189a2a4df88e0850f12', 'request_id': 'req-de94eea6-ce21-442b-901d-481411fe5c88'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.862665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a83fb3943f4c4189a2a4df88e0850f12', 'request_id': 'req-de94eea6-ce21-442b-901d-481411fe5c88'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.896938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] The token cache is being invalidate because project a83fb3943f4c4189a2a4df88e0850f12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:17:38.898450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.902273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de94eea6-ce21-442b-901d-481411fe5c88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:38.909179 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1580/3184] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:17:38 2022] DELETE /identity/v3/projects/a83fb3943f4c4189a2a4df88e0850f12 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:38.914532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48799-6260-4d39-84eb-f337732696a8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:38.915086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48799-6260-4d39-84eb-f337732696a8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:38.915514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc48799-6260-4d39-84eb-f337732696a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:38.967012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3cc48799-6260-4d39-84eb-f337732696a8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:38.972614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3cc48799-6260-4d39-84eb-f337732696a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:39.006274 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:39.030647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70432e08-fc72-46a9-85a9-e636a6baa878 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.078153 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:39.134055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1581/3185] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:39.142913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.143827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.144538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.161430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.163741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.164131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.164902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.182903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:39.184051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:39.185599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:39.198067 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1582/3186] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:17:39.209143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:39.226103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cf1bf-c819-4267-91d9-64ce8f9db902 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.248992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.250905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.253661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.254029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.255713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:17:39.256034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:39.257864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:39.298014 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1583/3187] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:17:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:17:39.301903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:39.328024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640edf2-a527-4281-8a1e-425033f7f293 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.340491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.342017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.342388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.342671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.343669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:39.346901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:39.353281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:39.355060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:39.380733 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1605/3188] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:17:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:17:39.420159 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1584/3189] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:17:39 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:17:39.423623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:39.455772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc129b5-dedc-40b9-8b9e-c4a4bdae75d1 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.687088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540cf27-09e4-444c-be15-768d0ac311bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.688535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cf27-09e4-444c-be15-768d0ac311bf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.689056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cf27-09e4-444c-be15-768d0ac311bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.689936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540cf27-09e4-444c-be15-768d0ac311bf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.691649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540cf27-09e4-444c-be15-768d0ac311bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:39.699462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540cf27-09e4-444c-be15-768d0ac311bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:39.763703 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1606/3190] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:17:39 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:17:39.769007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:39.808772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab622-c554-4c7e-b38a-455dd2caffa6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.819193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.819582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.819912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.831525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.833059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.834728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.836171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.841533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] MFA Rules not processed for user `53ef6977196f432b9176e3a86c5cb189`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:39.842924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:39.846855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:39.854760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:39.901526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1585/3191] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:39.905298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:39.918037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ec4fe-53fc-4a9d-9e29-231e67c38e71 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.924917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013e9fda-8cbb-4336-a597-9986bb8c5bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.925929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9fda-8cbb-4336-a597-9986bb8c5bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.926608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9fda-8cbb-4336-a597-9986bb8c5bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.927149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013e9fda-8cbb-4336-a597-9986bb8c5bf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:39.928092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9fda-8cbb-4336-a597-9986bb8c5bf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:39.929968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013e9fda-8cbb-4336-a597-9986bb8c5bf1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:39.946015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1607/3192] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:17:39.950567 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1586/3193] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:39.955050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:39.965574 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:39.976556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3466e5-e42f-4eff-be77-abd11a9ce1a1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:39.989679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:39.992806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:39.993367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:39.995048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] PATH_INFO: `/v3/projects/d0168f6d8fd04fbe8ccb4588e037bf9f/users/8f0372c9e382406487fa8002f2e7517c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.021007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0168f6d8fd04fbe8ccb4588e037bf9f, user_id=8f0372c9e382406487fa8002f2e7517c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:40.025245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:40.056825 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1608/3194] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:17:39 2022] PUT /identity/v3/projects/d0168f6d8fd04fbe8ccb4588e037bf9f/users/8f0372c9e382406487fa8002f2e7517c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:40.071018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:40.071474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:40.071877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.138026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] MFA Rules not processed for user `8f0372c9e382406487fa8002f2e7517c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:40.140056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:40.267674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1587/3195] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:17:40.269892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:40.367190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a6fc6-8390-438c-891a-716b01e9c3b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:40.379539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:40.380942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:40.381230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:40.381607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.382872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:40.385102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:40.436184 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1609/3196] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:17:40 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:17:40.440699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:40.455271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc29c4-4901-40bd-83f2-8ebba62cd4c9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:40.568842 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:40.677335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8469b19-98c1-462f-b0cb-d22522fa9f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:40.678064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469b19-98c1-462f-b0cb-d22522fa9f30 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:40.678344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469b19-98c1-462f-b0cb-d22522fa9f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:40.684473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8469b19-98c1-462f-b0cb-d22522fa9f30 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.685661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8469b19-98c1-462f-b0cb-d22522fa9f30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:40.687718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8469b19-98c1-462f-b0cb-d22522fa9f30 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:40.755545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1588/3197] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:17:40 2022] POST /identity/v3/users => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:17:40.760843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:40.782781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4cd22a-cfee-4010-8c55-f9bcd42d1569 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:40.817416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:40.817416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:40.817416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.822154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:40.823001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:40.823332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:40.823662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.844879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:40.856097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:40.887048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] MFA Rules not processed for user `53ef6977196f432b9176e3a86c5cb189`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:40.888316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:40.898316 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1610/3198] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:40 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:40.899519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:40.934896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6eb3b-dbca-413d-a2ee-0c92aa925c17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:40.950452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:40.951796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:40.952239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:40.952716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] PATH_INFO: `/v3/projects/b10c8feb8512423a815c254843a921e4/users/25df8a8d48e4423ab7163c634df2e1dd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:40.994495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10c8feb8512423a815c254843a921e4, user_id=25df8a8d48e4423ab7163c634df2e1dd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:40.997473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:41.027856 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1611/3199] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:17:40 2022] PUT /identity/v3/projects/b10c8feb8512423a815c254843a921e4/users/25df8a8d48e4423ab7163c634df2e1dd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:41.033565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:41.050398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1589/3200] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:17:41.223047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930e18f-fcee-416b-a3ed-f06353354233 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:41.237293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa93d610-c5e1-4541-a9ba-34bdbebe2ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:41.238000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93d610-c5e1-4541-a9ba-34bdbebe2ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:41.238286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93d610-c5e1-4541-a9ba-34bdbebe2ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:41.238936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa93d610-c5e1-4541-a9ba-34bdbebe2ab6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:41.239832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93d610-c5e1-4541-a9ba-34bdbebe2ab6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:41.241936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa93d610-c5e1-4541-a9ba-34bdbebe2ab6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:41.287276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:41.291179 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1612/3201] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:41.312897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e15933-2991-457c-bb03-96702f973b4f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:41.346532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4341c0-0ddc-4a90-b36a-506b29d3da15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:41.349318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4341c0-0ddc-4a90-b36a-506b29d3da15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:41.350120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4341c0-0ddc-4a90-b36a-506b29d3da15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:41.350500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4341c0-0ddc-4a90-b36a-506b29d3da15 admin admin] PATH_INFO: `/v3/projects/b10c8feb8512423a815c254843a921e4/users/25df8a8d48e4423ab7163c634df2e1dd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:41.360919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4341c0-0ddc-4a90-b36a-506b29d3da15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b10c8feb8512423a815c254843a921e4, user_id=25df8a8d48e4423ab7163c634df2e1dd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:41.371955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4341c0-0ddc-4a90-b36a-506b29d3da15 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:41.436019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1590/3202] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:17:41 2022] PUT /identity/v3/projects/b10c8feb8512423a815c254843a921e4/users/25df8a8d48e4423ab7163c634df2e1dd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:17:41.448955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00095d-4702-43e6-a271-eeb11ca2bf93 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:41.449368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00095d-4702-43e6-a271-eeb11ca2bf93 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:41.449659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00095d-4702-43e6-a271-eeb11ca2bf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:41.494466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:41.495241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:41.495633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:41.547623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8f00095d-4702-43e6-a271-eeb11ca2bf93 None None] MFA Rules not processed for user `25df8a8d48e4423ab7163c634df2e1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:41.549015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f00095d-4702-43e6-a271-eeb11ca2bf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:41.579818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:41.585735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:41.586367 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:41.734514 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1613/3203] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:41.754533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:41.755897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:41.756194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:41.801244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] MFA Rules not processed for user `8f0372c9e382406487fa8002f2e7517c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:41.802565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:41.806265 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1591/3204] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:42.054830 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1614/3205] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:42.891762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:42.893633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:43.171658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe59451-f54f-4cd5-b8a2-fe2a8e7c8982 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:43.186730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dba089-4fc9-4f04-a6dc-f7ab23e7b461 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:43.187578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba089-4fc9-4f04-a6dc-f7ab23e7b461 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:43.187824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba089-4fc9-4f04-a6dc-f7ab23e7b461 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:43.188102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dba089-4fc9-4f04-a6dc-f7ab23e7b461 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:43.201610 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:43.211151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dba089-4fc9-4f04-a6dc-f7ab23e7b461 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:43.215226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dba089-4fc9-4f04-a6dc-f7ab23e7b461 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:43.246923 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1592/3206] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:48.092374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:48.118794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8096791-e0df-44eb-9b66-2c583a37a64c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:48.126974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:48.126974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:48.126974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:48.126974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:48.132027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:48.309430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:48.315345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:48.336891 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1615/3207] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:17:49.641895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:49.642554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:49.642929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:49.702271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:49.704373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:49.733089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1593/3208] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:53.236053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:53.237933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:53.396873 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:53.419108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e88b3-ad1d-4a4a-978c-e505eca30c17 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:53.432754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:53.434843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:53.435520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:53.436040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] PATH_INFO: `/v3/users/f1f52adaa981474782575d1011271fbf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:53.438055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1f52adaa981474782575d1011271fbf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:53.441381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:53.558570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1f52adaa981474782575d1011271fbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:53.559361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1f52adaa981474782575d1011271fbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:53.585013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1f52adaa981474782575d1011271fbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:53.587923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1f52adaa981474782575d1011271fbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:53.612004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee2cb5a2-6f23-4c99-89d8-8eb6c8522b7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1f52adaa981474782575d1011271fbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:53.671584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1616/3209] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:17:53 2022] DELETE /identity/v3/users/f1f52adaa981474782575d1011271fbf => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:55.014221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:55.035090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf0c41-fb62-477f-b453-af6a5a385c26 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:55.159432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:55.160676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:55.161152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:55.161607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] PATH_INFO: `/v3/projects/e0230041bf3341c6935e6e6d92c133a1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:55.163987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0230041bf3341c6935e6e6d92c133a1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:55.166258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:55.250266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0230041bf3341c6935e6e6d92c133a1', 'request_id': 'req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:55.263155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0230041bf3341c6935e6e6d92c133a1', 'request_id': 'req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:55.274962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0230041bf3341c6935e6e6d92c133a1', 'request_id': 'req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:55.291381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] The token cache is being invalidate because project e0230041bf3341c6935e6e6d92c133a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:17:55.291730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:55.292573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4a1e4ffd-3320-45b9-aaea-e3b8f86e79d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:17:55.294943 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1594/3210] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:17:55 2022] DELETE /identity/v3/projects/e0230041bf3341c6935e6e6d92c133a1 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:17:55.300476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:55.301563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:55.302093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:55.368157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:55.374936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:55.593760 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1617/3211] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:55.603186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:55.603475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:55.603756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:55.641612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:55.642877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:55.659045 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1595/3212] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:55.663352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:55.681201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ee076a-1f18-4b76-94e6-500fa7d14765 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:55.695670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:55.696658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:55.696947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:55.697232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:55.701965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:17:55.702807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:55.703922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:55.743885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1618/3213] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:17:55.748146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:55.758777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a09b3d4-751e-426a-8e76-e5852fa88d3f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:55.778025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:55.778759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:55.779138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:55.779424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:55.780218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:55.782698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:55.850053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1596/3214] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:17:55 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:17:55.854139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:55.895155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efc33a-2901-4c1d-8fa9-123c8fb17f2a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:56.057285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:56.058042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:56.058332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:56.058617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:56.059370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:56.061461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:56.076313 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:56.106116 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1619/3215] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:17:55 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:17:56.110587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:56.128755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900f604-5f0e-4d71-b37e-8c52a5b9fb6b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:56.147916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:56.156253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:56.157602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:56.158584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:56.160262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:56.164764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:56.203267 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1597/3216] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:56.208435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:56.222728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ca066-ff17-4425-a74c-42bb4b6dcab2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:56.246699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb6a993-36a2-4a19-a675-af5c814eca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:56.247496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6a993-36a2-4a19-a675-af5c814eca43 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:56.248410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6a993-36a2-4a19-a675-af5c814eca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:56.248410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb6a993-36a2-4a19-a675-af5c814eca43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:56.249124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6a993-36a2-4a19-a675-af5c814eca43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:56.250880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb6a993-36a2-4a19-a675-af5c814eca43 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:56.280996 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1620/3217] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:17:56.282235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:56.317461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db87615-79ca-4160-9b2d-639ae7c18dd6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:56.344557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:56.349768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:56.350406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:56.351942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] PATH_INFO: `/v3/projects/1cf4306c8181421b92daea5dbd2d5466/users/e00ef38262cc4f7895e3f6b8380d469e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:56.393323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cf4306c8181421b92daea5dbd2d5466, user_id=e00ef38262cc4f7895e3f6b8380d469e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:56.396779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:56.424846 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1598/3218] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:17:56 2022] PUT /identity/v3/projects/1cf4306c8181421b92daea5dbd2d5466/users/e00ef38262cc4f7895e3f6b8380d469e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:17:56.430264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:56.431324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:56.431830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:56.459297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:17:56.461012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:56.605868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1621/3219] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:17:56.636094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:17:56.645474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:17:56.706002 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:17:56.845225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff41590-1ad5-4a74-936b-e36d0c460d0d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:17:56.858369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:17:56.859220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:17:56.859893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:17:56.860322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:17:56.886406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:17:56.888289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:17:56.910561 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1599/3220] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:06.587346 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=34 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:06.904257 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=19 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:13.539746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:13.543032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:13.571195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575d10f6-6b76-44ae-88ef-69e24eecf03c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:13.578426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:13.579601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:13.579998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:13.580424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] PATH_INFO: `/v3/users/cec6a5157b6e4d289a1d7ac1e71ff2fc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:13.582451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cec6a5157b6e4d289a1d7ac1e71ff2fc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:13.586200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:13.676034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cec6a5157b6e4d289a1d7ac1e71ff2fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:13.676918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cec6a5157b6e4d289a1d7ac1e71ff2fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:13.695189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cec6a5157b6e4d289a1d7ac1e71ff2fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:13.696692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cec6a5157b6e4d289a1d7ac1e71ff2fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:13.708034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cec6a5157b6e4d289a1d7ac1e71ff2fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:13.735779 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1622/3221] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:13 2022] DELETE /identity/v3/users/cec6a5157b6e4d289a1d7ac1e71ff2fc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:14.522124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:14.525209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:14.694833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602abf78-ff18-4eca-bf8d-a6f3c3b1d936 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:14.905287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:14.906684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:14.907189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:14.907975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:14.910373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:15.036806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:15.038613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f2a857-19b5-45bd-af54-b12a804c01ad service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:15.055637 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1600/3222] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:15.807255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:15.809478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:15.937176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e6682-4c4d-40dd-8bf0-67d990a088a4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:15.945318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:15.946633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:15.947161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:15.948034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] PATH_INFO: `/v3/projects/f4d9cafac76a452689f65dc3a4290b65` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:15.949935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d9cafac76a452689f65dc3a4290b65)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:15.953629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:16.082087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d9cafac76a452689f65dc3a4290b65', 'request_id': 'req-30d7fad6-0b5b-49f9-a469-f2626da600d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:16.100268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d9cafac76a452689f65dc3a4290b65', 'request_id': 'req-30d7fad6-0b5b-49f9-a469-f2626da600d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:16.107306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d9cafac76a452689f65dc3a4290b65', 'request_id': 'req-30d7fad6-0b5b-49f9-a469-f2626da600d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:16.130152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] The token cache is being invalidate because project f4d9cafac76a452689f65dc3a4290b65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:16.130582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:16.131980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30d7fad6-0b5b-49f9-a469-f2626da600d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:16.135055 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1623/3223] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:15 2022] DELETE /identity/v3/projects/f4d9cafac76a452689f65dc3a4290b65 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:16.140092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.140678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.140678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.171267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:16.172516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:16.256441 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:16.313332 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1601/3224] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:16.321781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.322090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.322441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.330766 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:16.356060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:16.357623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:16.374287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1624/3225] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:16.375985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:16.394103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5beddf1-e1d1-4e4f-a7d5-dea43ac23a09 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:16.402116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:16.404295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.404664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.405687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.406479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:18:16.406793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:16.410430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48da638-6e97-449f-840f-717c2a84429e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:16.436570 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1602/3226] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:18:16.441121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:16.456302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54699b7-e647-43d9-bba4-3aed031d2c61 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:16.463611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:16.464820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.465332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.466132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.467176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:16.470136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:16.496598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.497293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.497749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.533889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] MFA Rules not processed for user `8f0372c9e382406487fa8002f2e7517c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:16.535350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:16.557957 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1625/3227] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:18:16 2022] POST /identity/v3/projects => generated 379 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:18:16.566052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:16.663754 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1603/3228] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:18:16.750086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeb6087-a12d-4013-951f-1f8d4cb06660 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:16.756754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd744224-7cec-4151-90e4-89520283936d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:16.757649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd744224-7cec-4151-90e4-89520283936d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.757996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd744224-7cec-4151-90e4-89520283936d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.758546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd744224-7cec-4151-90e4-89520283936d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.759361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd744224-7cec-4151-90e4-89520283936d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:16.762134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd744224-7cec-4151-90e4-89520283936d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:16.794591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1626/3229] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:18:16 2022] POST /identity/v3/users => generated 290 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:18:16.796223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:16.817448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187f7e4-9f77-46a6-889e-72fd45deafed None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:16.829095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:16.832459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.834160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.834160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.835092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:16.846430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:16.854575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.855017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.855132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.884281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1604/3230] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:18:16.887028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:16.906624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c70e7-539a-4edc-a178-cc3264bfe0fd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:16.913333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] MFA Rules not processed for user `e00ef38262cc4f7895e3f6b8380d469e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:16.914631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:16.921404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:16.922018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.922273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.922554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:16.923279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:16.925022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:16.940390 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1605/3231] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:18:16.944512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:16.964003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d46494-b09e-44d1-8121-a4f45bd5d0b4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:16.976824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e00968-007c-40e0-9b66-f0374dd4521b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:16.978029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00968-007c-40e0-9b66-f0374dd4521b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:16.978329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00968-007c-40e0-9b66-f0374dd4521b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:16.978635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e00968-007c-40e0-9b66-f0374dd4521b admin admin] PATH_INFO: `/v3/projects/77dbc3f73c61442b8ffa7219c01243c0/users/70628393aac8485fae89e5d50eac92f0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:17.012236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00968-007c-40e0-9b66-f0374dd4521b admin admin] RBAC: Authorizing `identity:create_grant(project_id=77dbc3f73c61442b8ffa7219c01243c0, user_id=70628393aac8485fae89e5d50eac92f0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:17.015089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e00968-007c-40e0-9b66-f0374dd4521b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:17.045169 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1606/3232] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:18:16 2022] PUT /identity/v3/projects/77dbc3f73c61442b8ffa7219c01243c0/users/70628393aac8485fae89e5d50eac92f0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:17.057396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:17.060982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:17.061343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:17.071312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1627/3233] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:17.091176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:17.092603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:17.121705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:17.123337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:17.184074 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:17.207927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e1e1e-c1c9-43d3-87c8-7c2bd87946f6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:17.238533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1607/3234] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:17.249288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:17.250755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:17.282763 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:17.323601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:17.324988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:17.325616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:17.326387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:17.379351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4ae6b-28ba-4141-a6c8-013668de9512 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:17.384176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bda26-b69f-4547-b59e-b91e4e120bd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:17.385344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bda26-b69f-4547-b59e-b91e4e120bd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:17.385635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bda26-b69f-4547-b59e-b91e4e120bd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:17.385907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bda26-b69f-4547-b59e-b91e4e120bd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:17.400094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bda26-b69f-4547-b59e-b91e4e120bd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:17.402632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bda26-b69f-4547-b59e-b91e4e120bd2 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:17.430221 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1608/3235] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:18:17.432222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:17.433738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:17.445890 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1628/3236] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:18.261239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:18.263138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:18.263653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:18.312867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:18.315801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:18.477926 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1609/3237] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:18:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:18.501622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:18.511421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:18.696535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a833aa-c045-46d8-8678-ed250511a7c5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:18.703242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3980341b-4d30-4658-b6d2-dc7edd3a0f9e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:18.703977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980341b-4d30-4658-b6d2-dc7edd3a0f9e service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:18.704293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980341b-4d30-4658-b6d2-dc7edd3a0f9e service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:18.705962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3980341b-4d30-4658-b6d2-dc7edd3a0f9e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:18.720710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980341b-4d30-4658-b6d2-dc7edd3a0f9e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:18.724746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3980341b-4d30-4658-b6d2-dc7edd3a0f9e service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:18.741845 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1629/3238] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:18:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:18:19.219818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:19.233389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd80a572-56b5-41e4-ab89-94582e37793f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:19.240970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:19.241880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:19.242159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:19.242750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:19.248325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:19.414480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:19.416119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:19.451154 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1610/3239] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:21.798888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f9168-dc11-429d-80d5-53b7a28b70ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:21.799502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f9168-dc11-429d-80d5-53b7a28b70ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:21.799502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f9168-dc11-429d-80d5-53b7a28b70ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:21.829777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-493f9168-dc11-429d-80d5-53b7a28b70ac None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:21.831186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-493f9168-dc11-429d-80d5-53b7a28b70ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:21.855525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1630/3240] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:21.856588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:21.875767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc80c7e8-f3b1-491e-8865-b6309e6bf2a0 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:21.892799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:21.893694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:21.894122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:21.894574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:21.957651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:21.961816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:21.982337 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1611/3241] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:18:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:18:22.302046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6df69-e97a-4970-896a-ec2f2ff15371 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:22.303594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6df69-e97a-4970-896a-ec2f2ff15371 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:22.303992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6df69-e97a-4970-896a-ec2f2ff15371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:22.368357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-06f6df69-e97a-4970-896a-ec2f2ff15371 None None] MFA Rules not processed for user `e00ef38262cc4f7895e3f6b8380d469e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:22.373775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06f6df69-e97a-4970-896a-ec2f2ff15371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:22.414460 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1631/3242] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:24.200486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:24.202023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:24.308106 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:24.405437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91673cc-8974-4037-a164-cfead5fd6a1f service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:24.412063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:24.414188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:24.414509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:24.414790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:24.420437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:24.461932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:24.463455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:24.495158 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1612/3243] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:27.390061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08a16e-eb39-4fb0-8a21-5859675b63ce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:27.391171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08a16e-eb39-4fb0-8a21-5859675b63ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:27.391613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c08a16e-eb39-4fb0-8a21-5859675b63ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:27.425659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7c08a16e-eb39-4fb0-8a21-5859675b63ce None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:27.430184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c08a16e-eb39-4fb0-8a21-5859675b63ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:27.510722 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:27.614810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1632/3244] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:27.750098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:27.752205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:27.904286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a34ab4f-dcd8-4c19-86f7-2809094810b2 service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:27.913756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:27.914444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:27.914729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:27.915008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:27.916902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:27.946222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:27.947874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:27.973096 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1613/3245] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:33.406157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:33.406962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:33.407406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:33.497161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] MFA Rules not processed for user `70628393aac8485fae89e5d50eac92f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:33.505940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:33.695532 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1633/3246] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:34.099888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:34.102566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:34.123064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d74cf-9ca6-4020-9500-235347b260be service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:34.139231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6c4c1-5d43-45d0-bfc2-4261bfa0810c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:34.140116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6c4c1-5d43-45d0-bfc2-4261bfa0810c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:34.140552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6c4c1-5d43-45d0-bfc2-4261bfa0810c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:34.140951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6c4c1-5d43-45d0-bfc2-4261bfa0810c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:34.160217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6c4c1-5d43-45d0-bfc2-4261bfa0810c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:34.164987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6c4c1-5d43-45d0-bfc2-4261bfa0810c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:34.180700 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1614/3247] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:42.817887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:42.822596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:42.894990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f22a48-8db9-4235-b981-ad84a3e65f6a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:42.915434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:42.916440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:42.916689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:42.916971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:42.924521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:42.960269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:42.962217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:42.996982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1634/3248] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:44.172396 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=56 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:44.537981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bec70-7075-46c4-a625-9e7e5184fde1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:44.538274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bec70-7075-46c4-a625-9e7e5184fde1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:44.538856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8bec70-7075-46c4-a625-9e7e5184fde1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:44.617124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4a8bec70-7075-46c4-a625-9e7e5184fde1 None None] MFA Rules not processed for user `70628393aac8485fae89e5d50eac92f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:44.625141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4a8bec70-7075-46c4-a625-9e7e5184fde1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:44.644499 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1615/3249] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:45.361217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:45.375347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543fbb0a-80b2-4c59-8467-66065530d0a2 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:45.389815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:45.393855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:45.399145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:45.399518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:45.405273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:45.443641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:45.460939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c1365-c997-47c1-9698-d32d8e7f0b3f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:45.514033 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1635/3250] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:18:48.742834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439532-9b8a-47b8-9be8-1361117ede8d None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:48.743356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439532-9b8a-47b8-9be8-1361117ede8d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:48.743356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25439532-9b8a-47b8-9be8-1361117ede8d None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:48.745501 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1616/3251] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:18:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:18:48.754231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:48.754797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:48.754952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:48.802718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:48.805297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:48.832851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1636/3252] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:18:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:48.873754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439532-9b8a-47b8-9be8-1361117ede8d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:48.876122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25439532-9b8a-47b8-9be8-1361117ede8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:48.916832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25439532-9b8a-47b8-9be8-1361117ede8d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:48.930085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79898e40-66d0-454b-a6e5-b6986904d5e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:48.930765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898e40-66d0-454b-a6e5-b6986904d5e9 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:48.931040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898e40-66d0-454b-a6e5-b6986904d5e9 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:48.931309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79898e40-66d0-454b-a6e5-b6986904d5e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:48.975254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79898e40-66d0-454b-a6e5-b6986904d5e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:48.980972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79898e40-66d0-454b-a6e5-b6986904d5e9 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:49.012703 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1617/3253] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:50.812328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:50.814119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:50.848980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff608c26-ebfb-4fc6-a1de-71a515d1f922 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:50.869095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:50.870020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:50.870353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:50.870644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] PATH_INFO: `/v3/users/f61221659eee4c57ab0c7817c73e9ffc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:50.881280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f61221659eee4c57ab0c7817c73e9ffc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:50.883369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:51.169300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f61221659eee4c57ab0c7817c73e9ffc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:51.171353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f61221659eee4c57ab0c7817c73e9ffc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:51.193269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f61221659eee4c57ab0c7817c73e9ffc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:51.194317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f61221659eee4c57ab0c7817c73e9ffc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:51.231941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f61221659eee4c57ab0c7817c73e9ffc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:51.303043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1637/3254] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:50 2022] DELETE /identity/v3/users/f61221659eee4c57ab0c7817c73e9ffc => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:51.308149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:51.308744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:51.308744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:51.431288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:51.440187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:51.693539 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1618/3255] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:51.714735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:51.716912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:51.730143 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:51.881217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affda6a-cbcc-4e53-a225-bc1ee15b1570 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:51.888134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:51.891232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:51.891689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:51.892094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:51.916187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:51.919691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:51.942003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1638/3256] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:18:52.421977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:52.428875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:52.470839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d5740e-02af-4661-b128-eba673c32b33 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:52.480334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:52.481291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:52.481729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:52.482371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] PATH_INFO: `/v3/projects/97bbb2285db74c32b2bf09941c4d1fb8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:52.485148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=97bbb2285db74c32b2bf09941c4d1fb8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:52.488278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:52.601910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97bbb2285db74c32b2bf09941c4d1fb8', 'request_id': 'req-880dd49c-a31e-4a99-ba7a-38b538f725bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.617025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97bbb2285db74c32b2bf09941c4d1fb8', 'request_id': 'req-880dd49c-a31e-4a99-ba7a-38b538f725bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.627754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97bbb2285db74c32b2bf09941c4d1fb8', 'request_id': 'req-880dd49c-a31e-4a99-ba7a-38b538f725bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.691994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] The token cache is being invalidate because project 97bbb2285db74c32b2bf09941c4d1fb8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:52.692261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.693309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.695780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1619/3257] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:52 2022] DELETE /identity/v3/projects/97bbb2285db74c32b2bf09941c4d1fb8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:52.702253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:52.720226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead4b36-bcbd-4b5d-86f2-12ccba7edbfe service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:52.814587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:52.815893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:52.816749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:52.817168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] PATH_INFO: `/v3/users/94f536047e90441b91a2efc06d133045` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:52.818935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f536047e90441b91a2efc06d133045)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:52.821945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:52.902933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f536047e90441b91a2efc06d133045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.905252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f536047e90441b91a2efc06d133045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.916336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f536047e90441b91a2efc06d133045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.917309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f536047e90441b91a2efc06d133045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:52.945009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aad99765-5f77-40d2-9085-efc3f1bb1cdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f536047e90441b91a2efc06d133045'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:53.026482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1639/3258] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:52 2022] DELETE /identity/v3/users/94f536047e90441b91a2efc06d133045 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:53.766446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:53.769569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:53.796014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880dd49c-a31e-4a99-ba7a-38b538f725bd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:53.999096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:54.000448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.000917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.001368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] PATH_INFO: `/v3/projects/53b6bd3e082f4527b32a68f772b26c85` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.003297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=53b6bd3e082f4527b32a68f772b26c85)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:54.008105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:54.023388 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:54.106834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53b6bd3e082f4527b32a68f772b26c85', 'request_id': 'req-7254559d-2bf9-4aa7-8572-f585a53a7dbd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:54.122399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53b6bd3e082f4527b32a68f772b26c85', 'request_id': 'req-7254559d-2bf9-4aa7-8572-f585a53a7dbd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:54.134984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53b6bd3e082f4527b32a68f772b26c85', 'request_id': 'req-7254559d-2bf9-4aa7-8572-f585a53a7dbd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:54.168978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] The token cache is being invalidate because project 53b6bd3e082f4527b32a68f772b26c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:54.169473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:54.170968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7254559d-2bf9-4aa7-8572-f585a53a7dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:54.177199 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1620/3259] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:53 2022] DELETE /identity/v3/projects/53b6bd3e082f4527b32a68f772b26c85 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:54.197454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.198303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.198836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.272732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:54.281479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:54.346530 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:54.555377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1640/3260] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:54.566198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.566838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.567474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.613094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:54.615303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:54.636679 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1621/3261] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:54.646485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:54.664081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b36af-23c3-419f-abe5-fcdad6fe7fff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:54.671014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:54.673737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.680932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.681872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.683186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:18:54.683738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:54.686507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:54.709487 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1641/3262] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:18:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:18:54.710693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:54.723055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13357afa-4b2c-4bbf-83f1-746c04739545 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:54.733183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:54.733404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.733882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.734242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.735532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:54.737946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:54.785288 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1622/3263] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:18:54 2022] POST /identity/v3/projects => generated 391 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:18:54.790455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:54.812055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f3b62b-1276-4855-86ce-d9aaffb4bf16 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:54.915838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:54.916754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.917153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.917491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.918407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:54.920696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:54.950848 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1642/3264] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:18:54 2022] POST /identity/v3/users => generated 296 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:18:54.954981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:54.979950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6c0ac-b1ff-48b0-b935-055ccbb6f305 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:54.979950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:54.979950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:54.980412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:54.980553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:54.981412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:54.985744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.025209 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1623/3265] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:18:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:18:55.030984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.060858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b10060-ff3a-4cc9-bed0-70dceab37f0a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.073795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.076474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.077482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.077977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.078796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.080868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.093945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1643/3266] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:18:55.098474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.110413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645dc9c-1c26-4386-ae4c-c4ba0e21d3fe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.119331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10686a-b759-4121-a2ad-7b46844153e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.120455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10686a-b759-4121-a2ad-7b46844153e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.120852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10686a-b759-4121-a2ad-7b46844153e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.121159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10686a-b759-4121-a2ad-7b46844153e3 admin admin] PATH_INFO: `/v3/projects/9245c7f9e7af4369affb6a9f4c2a2330/users/b84f93495cef4a68bf1e93d08af3fd98/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.134567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.137188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:55.158368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10686a-b759-4121-a2ad-7b46844153e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9245c7f9e7af4369affb6a9f4c2a2330, user_id=b84f93495cef4a68bf1e93d08af3fd98, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.164732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10686a-b759-4121-a2ad-7b46844153e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.195086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1624/3267] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:18:55 2022] PUT /identity/v3/projects/9245c7f9e7af4369affb6a9f4c2a2330/users/b84f93495cef4a68bf1e93d08af3fd98/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:55.211412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.211981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.212445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.248002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] MFA Rules not processed for user `b84f93495cef4a68bf1e93d08af3fd98`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:55.256305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:55.257707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e9cb6a-3336-4c77-97ac-ec5114d1d48f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.331821 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:55.339641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.340593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.341074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.341535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.343931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:55.358230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.360279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.371990 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1625/3268] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:55.377432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.380279 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1644/3269] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:55.405300 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:55.494656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fe922-d643-4fc6-a2b9-7b80900a3d9e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.501260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.509015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.509321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.509597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.510377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.515052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.579897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.607132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ced0e-d26e-4062-a0c3-01190713d2ce service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.617296 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1626/3270] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:18:55 2022] POST /identity/v3/projects => generated 393 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:18:55.714585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.716502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.716897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.717252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.718201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.721857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.766701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.767387 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1645/3271] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:18:55 2022] POST /identity/v3/users => generated 303 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:18:55.786168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77e8ab-8a88-467a-b2c1-6a0cd195be34 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.799899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.800847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.801274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.801690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.802596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.804636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.832863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1627/3272] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:18:55.837456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:55.855085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656693b-8600-4816-83e3-19a5bbb8423d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:55.893435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:55.894713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:55.896518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:55.897534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] PATH_INFO: `/v3/projects/4c6bf9e3bf804fcda4fb573f040eec67/users/4b968e87645740beaa25cca1e66e57f1/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:55.926265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6bf9e3bf804fcda4fb573f040eec67, user_id=4b968e87645740beaa25cca1e66e57f1, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:55.929442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:55.960935 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1646/3273] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:18:55 2022] PUT /identity/v3/projects/4c6bf9e3bf804fcda4fb573f040eec67/users/4b968e87645740beaa25cca1e66e57f1/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:55.965837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:56.000920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd4ea3-be3c-4141-9d59-354b9b18f637 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:56.122554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3042119-be4b-4df4-93e4-8a97a362e0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:56.124078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3042119-be4b-4df4-93e4-8a97a362e0ed admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:56.124372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3042119-be4b-4df4-93e4-8a97a362e0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:56.124655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3042119-be4b-4df4-93e4-8a97a362e0ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:56.125719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3042119-be4b-4df4-93e4-8a97a362e0ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:56.128985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3042119-be4b-4df4-93e4-8a97a362e0ed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:56.166806 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1628/3274] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:18:55 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:18:56.170884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:56.205259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c6c98-6e4e-44da-b895-af0b4a2911d4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:56.223312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:56.224553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:56.225028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:56.225370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] PATH_INFO: `/v3/projects/4c6bf9e3bf804fcda4fb573f040eec67/users/4b968e87645740beaa25cca1e66e57f1/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:56.228834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c6bf9e3bf804fcda4fb573f040eec67, user_id=4b968e87645740beaa25cca1e66e57f1, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:56.231630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:56.250448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1647/3275] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:18:56 2022] PUT /identity/v3/projects/4c6bf9e3bf804fcda4fb573f040eec67/users/4b968e87645740beaa25cca1e66e57f1/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:56.258625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:56.258979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:56.259192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:56.296488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] MFA Rules not processed for user `4b968e87645740beaa25cca1e66e57f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:56.298045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:56.388118 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1629/3276] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:56.399802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:56.408827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:56.513847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7551d-6e11-44df-b2ed-6a54277367de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:56.520382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:56.521401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:56.521401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:56.522110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:56.538531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:56.541311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:56.575718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1648/3277] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:57.300060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:57.317746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5ee91-72b0-4cd6-b62a-a1bcc723520e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:57.325556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b36be-d890-4755-a6fa-96372449ab31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:57.326679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b36be-d890-4755-a6fa-96372449ab31 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:57.326962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b36be-d890-4755-a6fa-96372449ab31 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:57.327244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b36be-d890-4755-a6fa-96372449ab31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:57.348867 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:57.425807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b36be-d890-4755-a6fa-96372449ab31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:57.427972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b36be-d890-4755-a6fa-96372449ab31 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:57.446010 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1630/3278] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:57.469711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:57.512929 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:57.552501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6504506-1f0f-44f6-8673-14f9821bd3ff service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:57.558584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:57.560232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:57.560672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:57.561047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] PATH_INFO: `/v3/users/b84f93495cef4a68bf1e93d08af3fd98` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:57.562674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b84f93495cef4a68bf1e93d08af3fd98)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:57.565332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:57.649984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b84f93495cef4a68bf1e93d08af3fd98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:57.650916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b84f93495cef4a68bf1e93d08af3fd98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:57.678893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b84f93495cef4a68bf1e93d08af3fd98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:57.679812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b84f93495cef4a68bf1e93d08af3fd98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:57.691438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b84f93495cef4a68bf1e93d08af3fd98'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:57.736416 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1649/3279] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:57 2022] DELETE /identity/v3/users/b84f93495cef4a68bf1e93d08af3fd98 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:57.740011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:57.741272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:57.741790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:57.777409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:18:57.780310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:57.990418 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1631/3280] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:18:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:18:57.999784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:58.001240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:58.153761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9af5681-c5b8-42e6-9961-a588f9471e5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:58.162953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:58.163635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:58.163919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:58.164202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:58.188242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:58.190829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:58.215705 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1650/3281] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:18:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:18:58.418308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:58.421461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:58.445534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e10192-3559-49b7-ba87-2b9c1de52382 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:58.466198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:58.468550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:58.468871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:58.469169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] PATH_INFO: `/v3/users/d7b0ccca5d874cd995c0ec0cc2ef545d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:58.473508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b0ccca5d874cd995c0ec0cc2ef545d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:58.477326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:58.602187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b0ccca5d874cd995c0ec0cc2ef545d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:58.624466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b0ccca5d874cd995c0ec0cc2ef545d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:58.657103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b0ccca5d874cd995c0ec0cc2ef545d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:58.660936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b0ccca5d874cd995c0ec0cc2ef545d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:58.697690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b0ccca5d874cd995c0ec0cc2ef545d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:58.718112 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1632/3282] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:58 2022] DELETE /identity/v3/users/d7b0ccca5d874cd995c0ec0cc2ef545d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:59.189518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:59.193253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:59.195024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:59.206985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e3deab-f2f8-4458-90e0-332fd9cd037d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:59.270555 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:59.347210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46726045-fe6d-4848-94a4-9bb8de7e5913 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:59.362510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:59.363367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:59.363643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:59.363992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] PATH_INFO: `/v3/projects/9245c7f9e7af4369affb6a9f4c2a2330` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:59.365353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9245c7f9e7af4369affb6a9f4c2a2330)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:59.367416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:59.373141 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:18:59.400886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:59.403569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:59.403872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:59.405218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] PATH_INFO: `/v3/projects/884c06b615404d9c884550a4c0a0d7f4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:59.407427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] RBAC: Authorizing `identity:delete_project(project_id=884c06b615404d9c884550a4c0a0d7f4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:59.411135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:59.491596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9245c7f9e7af4369affb6a9f4c2a2330', 'request_id': 'req-41f58013-6fa2-4544-bae4-edb9606bb322'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.516670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9245c7f9e7af4369affb6a9f4c2a2330', 'request_id': 'req-41f58013-6fa2-4544-bae4-edb9606bb322'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.530391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9245c7f9e7af4369affb6a9f4c2a2330', 'request_id': 'req-41f58013-6fa2-4544-bae4-edb9606bb322'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.541208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '884c06b615404d9c884550a4c0a0d7f4', 'request_id': 'req-f7b9d988-c176-4d75-b56a-3be0b52f790e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.561478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '884c06b615404d9c884550a4c0a0d7f4', 'request_id': 'req-f7b9d988-c176-4d75-b56a-3be0b52f790e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.562573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] The token cache is being invalidate because project 9245c7f9e7af4369affb6a9f4c2a2330 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:59.562867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.563594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.565664 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1633/3283] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:59 2022] DELETE /identity/v3/projects/9245c7f9e7af4369affb6a9f4c2a2330 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:18:59.569419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:59.570874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:59.578634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '884c06b615404d9c884550a4c0a0d7f4', 'request_id': 'req-f7b9d988-c176-4d75-b56a-3be0b52f790e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.615602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] The token cache is being invalidate because project 884c06b615404d9c884550a4c0a0d7f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:18:59.615863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.617876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:18:59.625811 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1651/3284] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:18:59 2022] DELETE /identity/v3/projects/884c06b615404d9c884550a4c0a0d7f4 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:18:59.629745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:18:59.632805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:18:59.697839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f58013-6fa2-4544-bae4-edb9606bb322 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:59.822248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b9d988-c176-4d75-b56a-3be0b52f790e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:18:59.835475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:59.836684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:59.838518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:59.842223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] PATH_INFO: `/v3/users/0352ca03a9bd419b8a2ad6a4157421d0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:59.846440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0352ca03a9bd419b8a2ad6a4157421d0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:59.857140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:59.894129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:18:59.896125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:18:59.897137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:18:59.897696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] PATH_INFO: `/v3/users/4b968e87645740beaa25cca1e66e57f1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:18:59.900226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b968e87645740beaa25cca1e66e57f1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:18:59.906403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:18:59.922334 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:00.027869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0352ca03a9bd419b8a2ad6a4157421d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.029008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0352ca03a9bd419b8a2ad6a4157421d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.044328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0352ca03a9bd419b8a2ad6a4157421d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.045320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0352ca03a9bd419b8a2ad6a4157421d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.082086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0352ca03a9bd419b8a2ad6a4157421d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.104803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b968e87645740beaa25cca1e66e57f1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.117672 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:00.124631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b968e87645740beaa25cca1e66e57f1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.132841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1652/3285] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:59 2022] DELETE /identity/v3/users/0352ca03a9bd419b8a2ad6a4157421d0 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:19:00.142982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b968e87645740beaa25cca1e66e57f1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.143860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b968e87645740beaa25cca1e66e57f1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.154440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b968e87645740beaa25cca1e66e57f1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:00.162260 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1634/3286] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:18:59 2022] DELETE /identity/v3/users/4b968e87645740beaa25cca1e66e57f1 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:00.587746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:00.589797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:00.720466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7fac4c-d46d-420a-8b3f-6ee9263f1203 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:00.808330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:00.809575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:00.810075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:00.810713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:00.813174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:00.835465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:00.837755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349053fe-b86c-4d8f-aa0f-f720f25cd800 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:00.875311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:00.877148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:00.919015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1653/3287] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:01.129064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.129745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.129745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.145100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c425f2d-7f5f-4b69-a2ae-0d2bb6702d67 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:01.159360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:01.161106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.164791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.165388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] PATH_INFO: `/v3/projects/d46df6075c964d6d8fb1b07b9d86041f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.167364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46df6075c964d6d8fb1b07b9d86041f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:01.183020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:01.213225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:01.215621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:01.349760 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:01.367799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1654/3288] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:19:01.369713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:01.372216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:01.394834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf7257-1c6e-4ead-8ac6-2f702f5bfdf2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:01.416075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46df6075c964d6d8fb1b07b9d86041f', 'request_id': 'req-e799b05b-818e-411c-8771-2c3c317d0490'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.426323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46df6075c964d6d8fb1b07b9d86041f', 'request_id': 'req-e799b05b-818e-411c-8771-2c3c317d0490'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.440812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46df6075c964d6d8fb1b07b9d86041f', 'request_id': 'req-e799b05b-818e-411c-8771-2c3c317d0490'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.455246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] The token cache is being invalidate because project d46df6075c964d6d8fb1b07b9d86041f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:19:01.455892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.456646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.464230 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1635/3289] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:19:00 2022] DELETE /identity/v3/projects/d46df6075c964d6d8fb1b07b9d86041f => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:19:01.465480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:01.466978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:01.491991 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:01.513805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:01.516470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.517618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.518160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] PATH_INFO: `/v3/projects/4c6bf9e3bf804fcda4fb573f040eec67` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.521102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c6bf9e3bf804fcda4fb573f040eec67)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:01.523835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:01.602667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c6bf9e3bf804fcda4fb573f040eec67', 'request_id': 'req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.612030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c6bf9e3bf804fcda4fb573f040eec67', 'request_id': 'req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.620567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c6bf9e3bf804fcda4fb573f040eec67', 'request_id': 'req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.643494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] The token cache is being invalidate because project 4c6bf9e3bf804fcda4fb573f040eec67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:19:01.643883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.644904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-428966f5-5a7a-4aeb-b1ba-2d12089e1f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:01.648736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1655/3290] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:19:01 2022] DELETE /identity/v3/projects/4c6bf9e3bf804fcda4fb573f040eec67 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:01.650923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311b4b-1490-4d55-9558-aba3a1c2f4d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.651364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311b4b-1490-4d55-9558-aba3a1c2f4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.651994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d311b4b-1490-4d55-9558-aba3a1c2f4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.679628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7d311b4b-1490-4d55-9558-aba3a1c2f4d7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:01.681266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d311b4b-1490-4d55-9558-aba3a1c2f4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:01.687703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799b05b-818e-411c-8771-2c3c317d0490 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:01.811929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1656/3291] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:01.817224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4efb7-8705-4d54-aa84-4acb2bcad810 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.817539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4efb7-8705-4d54-aa84-4acb2bcad810 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.817821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4efb7-8705-4d54-aa84-4acb2bcad810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.829215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:01.830235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.831090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.831659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.836329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:01.879317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a1b4efb7-8705-4d54-aa84-4acb2bcad810 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:01.888482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1b4efb7-8705-4d54-aa84-4acb2bcad810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:01.928167 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1657/3292] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:01.928167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.928167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.928167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.940238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:01.943755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37215b3-b0e2-4d2a-bc2b-00d3c9e50b60 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:01.956004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1636/3293] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:19:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:19:01.967355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:01.970733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:01.971370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:01.988473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:01.989808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:02.001632 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1658/3294] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:02.010008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.023940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28399a5b-e3c6-445e-aee8-d4534cdff119 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.026138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:02.027625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:02.036899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.041824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.042372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.043411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.045395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:19:02.047364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.053823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.082788 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1637/3295] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:02.087522 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:02.089991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.103554 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1659/3296] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:19:02.106248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.121988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c06ad-1aa6-469b-9758-f23c2e5852f1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.145649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.146393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.146682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.146970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.152558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:19:02.152901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.154655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.159283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81237d6-dd83-433e-8460-ea63af2b5ef8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.183083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.186760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.187123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.187433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.192904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.199645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.215277 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1638/3297] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:19:02.216402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.258577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa7f546-cdd0-4cf2-8880-6af6505c7b1c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.285137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.285881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.286177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.286461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.287194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.289521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.327265 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1660/3298] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:02 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:02.333503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.358999 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:02.388528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1639/3299] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:02 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:02.393478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.589858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333252d4-ba51-4029-8e17-216fcbf5f33c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.685079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd1ebab-00f3-40fb-be9e-d6f5e0ce0a07 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.698171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.699226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.699666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.699946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.700744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.704961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.734661 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1640/3300] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:02 2022] POST /identity/v3/users => generated 293 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:02.741063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.770943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4e325-19cd-4d29-9b9b-21ff7016e7aa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.780033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.780939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.781323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.781700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.784720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.789581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.797987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.798690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.799039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.799235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.799997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.801714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.852175 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1641/3301] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:02.863958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.879114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1661/3302] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:02 2022] POST /identity/v3/users => generated 287 bytes in 544 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:02.884153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.893216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b2e-f9ad-45c9-8ef0-f32fe495ceac admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.919721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c9e6e3-74d2-47d9-82d5-d77bf76bd994 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.921240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.921892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.922171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.922451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.923412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.925249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.931649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.932561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.932949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.934518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:02.935425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:02.940231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:02.954549 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1642/3303] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:19:02.959686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.977923 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1662/3304] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:02.980677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:02.981193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ab4b5a-c2c5-472e-ab65-79f38287cccd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:02.993371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c013f30f-beb9-4668-b7bd-17d16fc099f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:02.994405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013f30f-beb9-4668-b7bd-17d16fc099f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:02.994716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013f30f-beb9-4668-b7bd-17d16fc099f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:02.995022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c013f30f-beb9-4668-b7bd-17d16fc099f9 admin admin] PATH_INFO: `/v3/projects/54b0f89e932d4603a351f8296bed784d/users/9c4ef65e911a45aa847ad4db8fb70b40/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.008788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d42e07-99ff-478f-bc59-526c430459f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:03.023641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:03.024538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:03.024944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:03.025336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.026247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:03.028135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:03.066596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013f30f-beb9-4668-b7bd-17d16fc099f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54b0f89e932d4603a351f8296bed784d, user_id=9c4ef65e911a45aa847ad4db8fb70b40, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:03.069874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c013f30f-beb9-4668-b7bd-17d16fc099f9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:03.076884 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1663/3305] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:03.078052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:03.097743 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1643/3306] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:02 2022] PUT /identity/v3/projects/54b0f89e932d4603a351f8296bed784d/users/9c4ef65e911a45aa847ad4db8fb70b40/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:19:03.103110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:03.103625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:03.103836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.124566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af170022-58e2-489a-8892-8869acfb6e68 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:03.125449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:03.127098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:03.259745 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:03.280597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272c015-d5c7-45d3-9c34-7fdf6b404776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:03.282024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272c015-d5c7-45d3-9c34-7fdf6b404776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:03.282595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272c015-d5c7-45d3-9c34-7fdf6b404776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:03.283068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272c015-d5c7-45d3-9c34-7fdf6b404776 admin admin] PATH_INFO: `/v3/projects/d468eea47a0d43c79882b780ebacfbc9/users/8dab4d351eae4841a680831a86f6bf9f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.290682 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1644/3307] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:03.315052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272c015-d5c7-45d3-9c34-7fdf6b404776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d468eea47a0d43c79882b780ebacfbc9, user_id=8dab4d351eae4841a680831a86f6bf9f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:03.318630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272c015-d5c7-45d3-9c34-7fdf6b404776 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:03.345234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:03.347942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:03.352890 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1664/3308] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:03 2022] PUT /identity/v3/projects/d468eea47a0d43c79882b780ebacfbc9/users/8dab4d351eae4841a680831a86f6bf9f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:03.358190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:03.358788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:03.359317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.411356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:03.413198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:03.524791 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:03.602571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8b6a1-1415-453f-9d7f-d1e8f630b0e2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:03.622235 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1665/3309] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:19:03.649391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:03.651716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:03.783433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33656e-82f6-4ebf-b817-316846330b81 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:03.793134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc0f93-7d19-44d8-89d2-bac5cbbbdbdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:03.794042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc0f93-7d19-44d8-89d2-bac5cbbbdbdb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:03.794428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc0f93-7d19-44d8-89d2-bac5cbbbdbdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:03.794820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc0f93-7d19-44d8-89d2-bac5cbbbdbdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.837803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc0f93-7d19-44d8-89d2-bac5cbbbdbdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:03.841427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc0f93-7d19-44d8-89d2-bac5cbbbdbdb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:03.841710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:03.842712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:03.843263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:03.843720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:03.862917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:03.865393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:03.881983 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1645/3310] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:03.884698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1666/3311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:19:04.579941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:04.582310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:04.625887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2e6cde-2169-4acc-b770-84e159ba61f3 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:04.642900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:04.644227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:04.645087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:04.646620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] PATH_INFO: `/v3/users/8f0372c9e382406487fa8002f2e7517c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:04.649238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f0372c9e382406487fa8002f2e7517c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:04.656118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:04.793442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f0372c9e382406487fa8002f2e7517c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:04.836205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f0372c9e382406487fa8002f2e7517c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:04.894475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f0372c9e382406487fa8002f2e7517c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:04.900596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f0372c9e382406487fa8002f2e7517c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:04.934411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f0372c9e382406487fa8002f2e7517c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:04.964984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1646/3312] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:19:04 2022] DELETE /identity/v3/users/8f0372c9e382406487fa8002f2e7517c => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:04.970561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:04.971027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:04.971576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:05.095809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:05.097576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:05.260124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1667/3313] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:05.311365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:05.313159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:05.440200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a9063-1d0a-4d54-bc33-009724ef4e86 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:05.448926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:05.449630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:05.449974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:05.450254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:05.473963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:05.475540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:05.500398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1647/3314] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:19:05.976998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:05.980690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:06.004282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b27aa-a17b-4d47-bd76-3f35ad70c88b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:06.010909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:06.011865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:06.012318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:06.013038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] PATH_INFO: `/v3/projects/d0168f6d8fd04fbe8ccb4588e037bf9f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:06.015398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0168f6d8fd04fbe8ccb4588e037bf9f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:06.017949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:06.045248 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:06.122164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0168f6d8fd04fbe8ccb4588e037bf9f', 'request_id': 'req-7d92e586-b6af-44bf-89cb-9de2151120dc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.139717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0168f6d8fd04fbe8ccb4588e037bf9f', 'request_id': 'req-7d92e586-b6af-44bf-89cb-9de2151120dc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.157580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0168f6d8fd04fbe8ccb4588e037bf9f', 'request_id': 'req-7d92e586-b6af-44bf-89cb-9de2151120dc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.181876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] The token cache is being invalidate because project d0168f6d8fd04fbe8ccb4588e037bf9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:19:06.182391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.184899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.194815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:06.202015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1668/3315] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:19:05 2022] DELETE /identity/v3/projects/d0168f6d8fd04fbe8ccb4588e037bf9f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:06.216672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbb537-c60a-47bd-aef9-6dd579cea05a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:06.271869 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:06.422819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:06.423889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:06.424180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:06.426258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] PATH_INFO: `/v3/users/25df8a8d48e4423ab7163c634df2e1dd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:06.429309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25df8a8d48e4423ab7163c634df2e1dd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:06.431435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:06.543058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25df8a8d48e4423ab7163c634df2e1dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.560591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25df8a8d48e4423ab7163c634df2e1dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.596878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25df8a8d48e4423ab7163c634df2e1dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.598289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25df8a8d48e4423ab7163c634df2e1dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.617201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0a647fe3-ded7-4d0d-b93f-611cd2d7de95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25df8a8d48e4423ab7163c634df2e1dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:06.656512 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1648/3316] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:19:06 2022] DELETE /identity/v3/users/25df8a8d48e4423ab7163c634df2e1dd => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:06.933371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:06.935916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:06.967571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92e586-b6af-44bf-89cb-9de2151120dc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:07.104367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:07.105305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:07.105589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:07.105865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] PATH_INFO: `/v3/projects/b10c8feb8512423a815c254843a921e4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:07.109034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b10c8feb8512423a815c254843a921e4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:07.114598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:07.261685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b10c8feb8512423a815c254843a921e4', 'request_id': 'req-eff1e99a-fe2f-46ef-8693-878f21b56397'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:07.282466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b10c8feb8512423a815c254843a921e4', 'request_id': 'req-eff1e99a-fe2f-46ef-8693-878f21b56397'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:07.293875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b10c8feb8512423a815c254843a921e4', 'request_id': 'req-eff1e99a-fe2f-46ef-8693-878f21b56397'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:07.322522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] The token cache is being invalidate because project b10c8feb8512423a815c254843a921e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:19:07.322887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:07.326411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eff1e99a-fe2f-46ef-8693-878f21b56397 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:07.329665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1669/3317] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:19:06 2022] DELETE /identity/v3/projects/b10c8feb8512423a815c254843a921e4 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:07.336875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c30ec-9a43-4ab3-a005-e59df1f785a6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:07.337576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c30ec-9a43-4ab3-a005-e59df1f785a6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:07.341061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c30ec-9a43-4ab3-a005-e59df1f785a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:07.398415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-604c30ec-9a43-4ab3-a005-e59df1f785a6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:07.402702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-604c30ec-9a43-4ab3-a005-e59df1f785a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:07.574638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:07.575062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:07.575415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:07.608431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:07.609270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1649/3318] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:07.610982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:07.611417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:07.611994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:07.612463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:07.648901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:07.651619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:07.665094 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1650/3319] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:07.667057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:07.679652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f0c09-298c-4096-bd5d-e54fc5b9f5f8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:07.687607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:07.688887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:07.689432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:07.690082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:07.691686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:19:07.692254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:07.694200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:07.708170 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:07.724451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1651/3320] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:19:07.725603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:07.743672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a485cb7e-a7b6-4418-83ed-8d182cb3beef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:07.763602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:07.764645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:07.765285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:07.765680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:07.767343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:07.769511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:07.800241 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:07.813453 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1670/3321] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:07.851313 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1652/3322] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:07 2022] POST /identity/v3/projects => generated 391 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:07.856427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:07.878967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a214bee-37af-464a-8780-9ae8ccad12e8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:08.048810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:08.049597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:08.049890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:08.050152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:08.050885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:08.059949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:08.112135 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1671/3323] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:07 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:08.116777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:08.135560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a99e3-35fb-4953-88db-b17576352fc2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:08.148739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:08.162263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:08.163276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:08.168268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:08.169278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:08.176749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:08.210643 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1653/3324] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:08.212601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:08.229844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a299271-0650-4c73-bcec-7fbdcb383dd5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:08.255947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e631c5fe-9642-47b4-8e9f-4b021e33fd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:08.256879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c5fe-9642-47b4-8e9f-4b021e33fd45 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:08.257170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c5fe-9642-47b4-8e9f-4b021e33fd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:08.257453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e631c5fe-9642-47b4-8e9f-4b021e33fd45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:08.258612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631c5fe-9642-47b4-8e9f-4b021e33fd45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:08.260730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e631c5fe-9642-47b4-8e9f-4b021e33fd45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:08.296004 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1672/3325] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:08.301607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:08.327400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea45854-2159-4c9e-b69d-4875f5b9cb6c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:08.343335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:08.344301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:08.346557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:08.349326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] PATH_INFO: `/v3/projects/bdac28f4e2fc49599900e1894b68e76a/users/8c64f7573c144ffaad8493dfca175514/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:08.392203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdac28f4e2fc49599900e1894b68e76a, user_id=8c64f7573c144ffaad8493dfca175514, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:08.399503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:08.432015 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1654/3326] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:08 2022] PUT /identity/v3/projects/bdac28f4e2fc49599900e1894b68e76a/users/8c64f7573c144ffaad8493dfca175514/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:08.521301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:08.521596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:08.521884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:08.601888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] MFA Rules not processed for user `8c64f7573c144ffaad8493dfca175514`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:08.603464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:08.756677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:08.757121 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1673/3327] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:08.874371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef604d21-d7bb-4f69-ab2b-891718ee3a03 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:08.886584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:08.887799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:08.888088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:08.888401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:08.889916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:08.892006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:08.945021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:08.953341 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1655/3328] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:08 2022] POST /identity/v3/projects => generated 389 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:08.959012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef4b249-fd0e-42a9-9165-a2f78f2c0a11 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:09.084991 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:09.122180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:09.123548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:09.124003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:09.124461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:09.125344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:09.127494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:09.205106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:09.216150 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1674/3329] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:08 2022] POST /identity/v3/users => generated 301 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:09.225772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeac24d-eadb-48b3-a3c4-339a96b7fdff admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:09.231737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:09.232599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:09.232987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:09.233371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:09.234582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:09.236592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:09.249520 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1656/3330] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:09.254621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:09.268512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86c444-e970-4feb-8474-03e74e6ee63d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:09.274737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:09.276687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:09.276687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:09.277081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] PATH_INFO: `/v3/projects/a570b0b7fca54c65a3dbf50c327f49c8/users/e46184f27b2a497681968d422a2e8aa2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:09.295895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a570b0b7fca54c65a3dbf50c327f49c8, user_id=e46184f27b2a497681968d422a2e8aa2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:09.299349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:09.333136 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1675/3331] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:09 2022] PUT /identity/v3/projects/a570b0b7fca54c65a3dbf50c327f49c8/users/e46184f27b2a497681968d422a2e8aa2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:09.333737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:09.358713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101d72d-d830-4f8c-8f53-5cd75fd6c543 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:09.460154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e6cc81-2ed4-414c-a022-604525c34796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:09.462280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cc81-2ed4-414c-a022-604525c34796 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:09.468761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cc81-2ed4-414c-a022-604525c34796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:09.469291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e6cc81-2ed4-414c-a022-604525c34796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:09.470379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cc81-2ed4-414c-a022-604525c34796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:09.472077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e6cc81-2ed4-414c-a022-604525c34796 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:09.503105 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1657/3332] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:09.507713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:09.522065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b3a81-ac54-449d-ae0a-f84fa7600098 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:09.544493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:09.545580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:09.545747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:09.545995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] PATH_INFO: `/v3/projects/a570b0b7fca54c65a3dbf50c327f49c8/users/e46184f27b2a497681968d422a2e8aa2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:09.558727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a570b0b7fca54c65a3dbf50c327f49c8, user_id=e46184f27b2a497681968d422a2e8aa2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:09.569260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:09.600665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1676/3333] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:09 2022] PUT /identity/v3/projects/a570b0b7fca54c65a3dbf50c327f49c8/users/e46184f27b2a497681968d422a2e8aa2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:09.610653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:09.610944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:09.611232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:09.653904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] MFA Rules not processed for user `e46184f27b2a497681968d422a2e8aa2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:09.655380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:09.674038 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:09.750515 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1658/3334] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:09 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:10.200442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:10.203397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:10.352264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8532c30f-1f84-495a-882b-50470902373d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:10.359169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9eb7e1-ccf2-4f7f-989f-36e9a8774e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:10.360033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eb7e1-ccf2-4f7f-989f-36e9a8774e97 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:10.360431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eb7e1-ccf2-4f7f-989f-36e9a8774e97 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:10.360715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9eb7e1-ccf2-4f7f-989f-36e9a8774e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:10.449752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eb7e1-ccf2-4f7f-989f-36e9a8774e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:10.451788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9eb7e1-ccf2-4f7f-989f-36e9a8774e97 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:10.484054 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1677/3335] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:16.659968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:16.662321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:16.718022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8150d4a0-1662-48fc-9ba6-17cb1ba7fe22 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:16.775484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:16.782320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:16.782622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:16.782912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:16.826192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:16.832054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:16.862344 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1659/3336] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:17.208499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:17.209581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:17.209870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:17.325630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] MFA Rules not processed for user `9c4ef65e911a45aa847ad4db8fb70b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:17.338330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:17.495105 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:17.671885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1678/3337] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:17.676765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:17.678287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:17.886877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8c2b29-6901-47bc-b041-78466e91a328 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:17.904218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:17.905729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:17.908302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:17.908759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:17.910972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:17.917225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:17.983011 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1660/3338] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:17 2022] POST /identity/v3/projects => generated 385 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:17.987110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:18.007620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e172c5f-89ba-4005-ba95-aa9b461d82d9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:18.359462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:18.364749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:18.364749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:18.364749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:18.367033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:18.375817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:18.456572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1679/3339] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:17 2022] POST /identity/v3/users => generated 299 bytes in 466 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:18.457716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:18.520534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e684a590-c18e-413e-ad27-753e2cf16d16 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:18.533672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:18.534585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:18.540886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:18.545330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:18.546998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:18.562382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:18.588305 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1661/3340] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:19:18.592768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:18.614844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c758c-3980-4898-8af0-8d13a50f3b01 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:18.638018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:18.638966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:18.639244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:18.639516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] PATH_INFO: `/v3/projects/7817e96b07464928a74c94f1e3610ca7/users/f2be54d258da4095a41edbdd04313c42/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:18.701318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7817e96b07464928a74c94f1e3610ca7, user_id=f2be54d258da4095a41edbdd04313c42, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:18.710435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:18.771361 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1680/3341] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:18 2022] PUT /identity/v3/projects/7817e96b07464928a74c94f1e3610ca7/users/f2be54d258da4095a41edbdd04313c42/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:18.776572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:18.791084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd0da0-ffd1-4f32-b59d-f844b2621c22 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:18.930164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:18.932400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:18.932982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:18.933499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:18.934528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:18.936497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:18.956552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1662/3342] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:18.960587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:18.980093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea4557e-8cc9-4c2a-9e1d-af51ebf95256 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:18.994531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bce5607-d63b-4aca-96bd-e8c58e826c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:18.995491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce5607-d63b-4aca-96bd-e8c58e826c66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:18.995770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce5607-d63b-4aca-96bd-e8c58e826c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:18.996044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce5607-d63b-4aca-96bd-e8c58e826c66 admin admin] PATH_INFO: `/v3/projects/7817e96b07464928a74c94f1e3610ca7/users/f2be54d258da4095a41edbdd04313c42/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:19.007350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce5607-d63b-4aca-96bd-e8c58e826c66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7817e96b07464928a74c94f1e3610ca7, user_id=f2be54d258da4095a41edbdd04313c42, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:19.016059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bce5607-d63b-4aca-96bd-e8c58e826c66 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:19.082664 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1681/3343] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:18 2022] PUT /identity/v3/projects/7817e96b07464928a74c94f1e3610ca7/users/f2be54d258da4095a41edbdd04313c42/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:21.554811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:21.578729 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:21.855194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f144b96-6085-4436-838d-08e4b8f04de3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:22.190063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:22.194318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:22.194721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:22.195010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:22.205177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:22.249116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:22.254351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:22.290007 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1663/3344] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:22.410583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d78e9c-24f9-454f-afc3-1a8b2cf079ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:22.411203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d78e9c-24f9-454f-afc3-1a8b2cf079ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:22.411203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d78e9c-24f9-454f-afc3-1a8b2cf079ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:22.513726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-78d78e9c-24f9-454f-afc3-1a8b2cf079ad None None] MFA Rules not processed for user `8dab4d351eae4841a680831a86f6bf9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:22.514634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78d78e9c-24f9-454f-afc3-1a8b2cf079ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:22.728707 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1682/3345] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:23.557988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:23.578029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba23ae3-69e0-4aee-86ab-e1711023f1a6 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:23.593608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:23.595552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:23.597327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:23.597823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:23.626117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:23.629361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:23.658060 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1664/3346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:32.712826 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:33.408212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fdc19-2679-4b8d-a6bc-9d2c74bdb76b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:33.408714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fdc19-2679-4b8d-a6bc-9d2c74bdb76b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:33.409108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4fdc19-2679-4b8d-a6bc-9d2c74bdb76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:33.476780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd4fdc19-2679-4b8d-a6bc-9d2c74bdb76b None None] MFA Rules not processed for user `f2be54d258da4095a41edbdd04313c42`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:33.478113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd4fdc19-2679-4b8d-a6bc-9d2c74bdb76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:33.642345 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=64 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:33.654720 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1683/3347] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:34.895871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:34.916809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f1c02-c2e5-4a7b-9f88-3c4bf1190093 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:34.928983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9dbb42-761d-4a43-ba99-5cfe43927255 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:34.929665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dbb42-761d-4a43-ba99-5cfe43927255 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:34.929947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dbb42-761d-4a43-ba99-5cfe43927255 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:34.930237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9dbb42-761d-4a43-ba99-5cfe43927255 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:35.045263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dbb42-761d-4a43-ba99-5cfe43927255 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:35.047298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9dbb42-761d-4a43-ba99-5cfe43927255 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:35.074762 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1665/3348] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:37.744230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:37.744790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:37.744877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:37.776712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] MFA Rules not processed for user `9c4ef65e911a45aa847ad4db8fb70b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:37.780127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:37.801030 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1684/3349] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:38.236457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:38.236993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:38.236993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:38.258150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:38.259811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:38.365755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1666/3350] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:38.992788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:38.994924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:39.099298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba08d9-6068-476e-a9a1-db6552572a85 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:39.103798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:39.107040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:39.107443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:39.107809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:39.110627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:39.128111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:39.133617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210ff93-4e62-44d1-81ab-4f8e8068402a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:39.146513 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1685/3351] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:39.895592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:40.136228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd3a4e-62db-4c85-bd5a-ec8f3c7dee0f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:40.144034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:40.145106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:40.145588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:40.145996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] PATH_INFO: `/v3/users/8c64f7573c144ffaad8493dfca175514` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:40.147488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c64f7573c144ffaad8493dfca175514)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:40.152267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:40.298165 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:40.300623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c64f7573c144ffaad8493dfca175514'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:40.316838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c64f7573c144ffaad8493dfca175514'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:40.355213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c64f7573c144ffaad8493dfca175514'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:40.356212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c64f7573c144ffaad8493dfca175514'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:40.385361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c64f7573c144ffaad8493dfca175514'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:40.401052 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1667/3352] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:19:39 2022] DELETE /identity/v3/users/8c64f7573c144ffaad8493dfca175514 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:40.402738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4a50-8409-4f41-ad2a-f5ff8e5ea8aa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:40.403180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4a50-8409-4f41-ad2a-f5ff8e5ea8aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:40.403295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e4a50-8409-4f41-ad2a-f5ff8e5ea8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:40.439349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-889e4a50-8409-4f41-ad2a-f5ff8e5ea8aa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:40.440674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-889e4a50-8409-4f41-ad2a-f5ff8e5ea8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:40.612172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1686/3353] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:40.636442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:40.638287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:40.750584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671159fa-c9a6-4398-b91b-de51dfd7bfe2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:40.757311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:40.758204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:40.758725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:40.759023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:40.773389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:40.776276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:40.791575 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1668/3354] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:41.823845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:41.825772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:41.826211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:41.845228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:41.846709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:41.856018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:41.858680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:41.875071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea8855f-323a-432d-b2e1-75ef678e661a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:41.898562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:41.899879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:41.902364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:41.902842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] PATH_INFO: `/v3/projects/bdac28f4e2fc49599900e1894b68e76a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:41.907507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdac28f4e2fc49599900e1894b68e76a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:41.911649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:41.932032 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:42.025953 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1687/3355] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:19:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:42.081316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdac28f4e2fc49599900e1894b68e76a', 'request_id': 'req-3f0987a4-8a4d-407a-ab39-087093c3eb35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.082598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:42.085084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:42.099158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdac28f4e2fc49599900e1894b68e76a', 'request_id': 'req-3f0987a4-8a4d-407a-ab39-087093c3eb35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.108828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdac28f4e2fc49599900e1894b68e76a', 'request_id': 'req-3f0987a4-8a4d-407a-ab39-087093c3eb35'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.122123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] The token cache is being invalidate because project bdac28f4e2fc49599900e1894b68e76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:19:42.122449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.123073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.128185 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1669/3356] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:19:41 2022] DELETE /identity/v3/projects/bdac28f4e2fc49599900e1894b68e76a => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:19:42.129267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:42.131041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:42.275167 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:42.314144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0987a4-8a4d-407a-ab39-087093c3eb35 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:42.316213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3072046-d348-43d4-95ca-a26312d564c6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:42.325299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:42.326211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:42.326489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:42.326824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] PATH_INFO: `/v3/users/e46184f27b2a497681968d422a2e8aa2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:42.333309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46184f27b2a497681968d422a2e8aa2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:42.337645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:42.439730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46184f27b2a497681968d422a2e8aa2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.455581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46184f27b2a497681968d422a2e8aa2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.478016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46184f27b2a497681968d422a2e8aa2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.478885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46184f27b2a497681968d422a2e8aa2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.494034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46184f27b2a497681968d422a2e8aa2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:42.498379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:42.499059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:42.499343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:42.499621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:42.503657 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1670/3357] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:19:42 2022] DELETE /identity/v3/users/e46184f27b2a497681968d422a2e8aa2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:42.505050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:42.640149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:42.643253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418877d-acab-4f7f-91ab-fbc46d9a7d17 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:42.665527 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1688/3358] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:19:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:19:43.445086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:43.446906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:43.642554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259228ba-fdc5-4814-bf28-93006e4cc825 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:43.650410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:43.654358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:43.654358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:43.654358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] PATH_INFO: `/v3/projects/a570b0b7fca54c65a3dbf50c327f49c8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:43.656607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a570b0b7fca54c65a3dbf50c327f49c8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:43.659417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:43.750311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a570b0b7fca54c65a3dbf50c327f49c8', 'request_id': 'req-7bdaac09-76f3-477f-a908-3c71c4aeefa5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:43.762745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a570b0b7fca54c65a3dbf50c327f49c8', 'request_id': 'req-7bdaac09-76f3-477f-a908-3c71c4aeefa5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:43.787475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a570b0b7fca54c65a3dbf50c327f49c8', 'request_id': 'req-7bdaac09-76f3-477f-a908-3c71c4aeefa5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:43.798795 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:43.806032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] The token cache is being invalidate because project a570b0b7fca54c65a3dbf50c327f49c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:19:43.806930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:43.809837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bdaac09-76f3-477f-a908-3c71c4aeefa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:19:43.812944 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1671/3359] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:19:43 2022] DELETE /identity/v3/projects/a570b0b7fca54c65a3dbf50c327f49c8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:43.818415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:43.818932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:43.819039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:43.912600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:43.919524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:43.957267 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:44.228868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1689/3360] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:44.237264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:44.237571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:44.237851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:44.313618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:44.315049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:44.352941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:44.356446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1672/3361] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:44.371855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166686c-ccfa-49aa-b65c-987377b8a8bb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:44.389149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:44.398100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:44.401609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:44.402154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:44.403118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:19:44.403613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:44.406927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:44.462736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1690/3362] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:19:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:19:44.467651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:44.484269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c2879-8bdd-4da0-9b9a-5ba4be05d9ee None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:44.524249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:44.525005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:44.525291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:44.525567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:44.526284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:44.528256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:44.639809 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1673/3363] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:44 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:19:44.644738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:44.661817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b33cb1-f159-4619-a172-e49bb3b0ee14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:44.857104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:44.859836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:44.861356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:44.861814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:44.862997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:44.867646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:44.913607 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1691/3364] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:44 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:44.914954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:44.947442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3441b567-8b35-45d3-8690-17f1897bfd4d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:44.971029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:44.972200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:44.974095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:44.975562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:44.976555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:44.980430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:45.005451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1674/3365] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:44 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:45.008493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:45.021381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a975c-c647-4093-92b9-dd1e862f416f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:45.039736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70eb899-48b9-45b3-8782-7bc2710cf316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:45.043436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eb899-48b9-45b3-8782-7bc2710cf316 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.043645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eb899-48b9-45b3-8782-7bc2710cf316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.044581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70eb899-48b9-45b3-8782-7bc2710cf316 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:45.044699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eb899-48b9-45b3-8782-7bc2710cf316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:45.046520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70eb899-48b9-45b3-8782-7bc2710cf316 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:45.100560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:45.107290 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1692/3366] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:45.120571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c120cc0-45f5-45f8-ba70-627d64b9e202 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:45.146470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:45.151005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.155137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.155438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] PATH_INFO: `/v3/projects/59393c333eb3424a9cb978944371c7b3/users/9f971aae812d42f69b5ba2caa8d32172/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:45.178269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59393c333eb3424a9cb978944371c7b3, user_id=9f971aae812d42f69b5ba2caa8d32172, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:45.181616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:45.218234 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1675/3367] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:45 2022] PUT /identity/v3/projects/59393c333eb3424a9cb978944371c7b3/users/9f971aae812d42f69b5ba2caa8d32172/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:19:45.219098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e653a-baa8-4e18-a589-18107442de05 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.219536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e653a-baa8-4e18-a589-18107442de05 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.219828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e653a-baa8-4e18-a589-18107442de05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:45.330954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-157e653a-baa8-4e18-a589-18107442de05 None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:45.332500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-157e653a-baa8-4e18-a589-18107442de05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:45.464185 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1693/3368] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:45.465477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:45.551085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa3d26-1f3a-4655-b47d-0b3b207f6c88 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:45.558089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:45.559575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.559862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.560138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:45.560895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:45.562863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:45.607273 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1676/3369] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:19:45 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:19:45.610954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e653a-baa8-4e18-a589-18107442de05 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:45.644790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e653a-baa8-4e18-a589-18107442de05 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:45.656929 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:45.810296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:45.813810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.815791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.816392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:45.817651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:45.824191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:45.875997 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1694/3370] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:19:45 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:19:45.880622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:45.900158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3487d7e-b9a6-4a94-9b52-0c7c3b8bf8c1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:45.916955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:45.918081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.918511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.919086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:45.920226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:45.922081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:45.940387 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1677/3371] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:45.944071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:45.970260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328fad45-f2ee-4656-a541-5d8fad82d9ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:45.975720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:45.978367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:45.979100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:45.979418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] PATH_INFO: `/v3/projects/e4e2c6d7e802491d9d2e8cfadcee9e5d/users/5561ee7e7e134953ac387e8f7392f8f5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:46.019139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2c6d7e802491d9d2e8cfadcee9e5d, user_id=5561ee7e7e134953ac387e8f7392f8f5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:46.022224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:46.059557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:46.060335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1695/3372] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:45 2022] PUT /identity/v3/projects/e4e2c6d7e802491d9d2e8cfadcee9e5d/users/5561ee7e7e134953ac387e8f7392f8f5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:19:46.077117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ba5c2-87e5-4515-b462-9821b43e7cc2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:46.206990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118e000-376d-4d7e-b579-1ee3366b12af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:46.207706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118e000-376d-4d7e-b579-1ee3366b12af admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:46.228887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118e000-376d-4d7e-b579-1ee3366b12af admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:46.229246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118e000-376d-4d7e-b579-1ee3366b12af admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:46.246680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118e000-376d-4d7e-b579-1ee3366b12af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:46.262587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118e000-376d-4d7e-b579-1ee3366b12af admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:46.308429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1678/3373] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:19:46 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:19:46.312766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:46.328714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847bcf8-d892-419b-b3f3-415d7aef8979 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:46.346162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2a29c-eee7-43e5-8099-d227cd7ebaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:46.349259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a29c-eee7-43e5-8099-d227cd7ebaf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:46.350695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a29c-eee7-43e5-8099-d227cd7ebaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:46.350981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2a29c-eee7-43e5-8099-d227cd7ebaf9 admin admin] PATH_INFO: `/v3/projects/e4e2c6d7e802491d9d2e8cfadcee9e5d/users/5561ee7e7e134953ac387e8f7392f8f5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:46.358093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2a29c-eee7-43e5-8099-d227cd7ebaf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4e2c6d7e802491d9d2e8cfadcee9e5d, user_id=5561ee7e7e134953ac387e8f7392f8f5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:46.364596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed2a29c-eee7-43e5-8099-d227cd7ebaf9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:46.409194 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1696/3374] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:19:46 2022] PUT /identity/v3/projects/e4e2c6d7e802491d9d2e8cfadcee9e5d/users/5561ee7e7e134953ac387e8f7392f8f5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:19:46.421453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:46.421937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:46.422833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:46.436908 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:19:46.478518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] MFA Rules not processed for user `5561ee7e7e134953ac387e8f7392f8f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:46.479477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:46.711454 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1679/3375] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:46.714615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535659ba-7253-438d-bdd7-c97566a0b19f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:46.715013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535659ba-7253-438d-bdd7-c97566a0b19f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:46.715380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535659ba-7253-438d-bdd7-c97566a0b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:46.745822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-535659ba-7253-438d-bdd7-c97566a0b19f None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:46.747698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-535659ba-7253-438d-bdd7-c97566a0b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:46.840640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1697/3376] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:46.850225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:19:46.851964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:47.041633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65444d-916a-4e87-a73b-55f90ea3f628 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:19:47.087504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:19:47.088043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:47.088275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:47.091406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:47.116117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:19:47.119927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:19:47.151418 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1680/3377] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:19:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:19:52.629699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:19:52.630191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:19:52.630269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:19:52.684222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] MFA Rules not processed for user `e00ef38262cc4f7895e3f6b8380d469e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:19:52.691601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:19:52.992171 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1698/3378] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:19:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:19:57.140086 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=66 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:00.407294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:00.408988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:00.539580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180be38a-dbfd-4ea7-bff9-9f7a2b9243b2 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:00.565841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:00.567939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:00.571566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:00.574477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] PATH_INFO: `/v3/users/8dab4d351eae4841a680831a86f6bf9f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:00.576058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dab4d351eae4841a680831a86f6bf9f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:00.584462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:00.698754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dab4d351eae4841a680831a86f6bf9f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:00.720310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dab4d351eae4841a680831a86f6bf9f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:00.755142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dab4d351eae4841a680831a86f6bf9f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:00.757185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dab4d351eae4841a680831a86f6bf9f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:00.796852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3150256b-b04a-4d53-ace9-4777561eee92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dab4d351eae4841a680831a86f6bf9f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:00.841553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1681/3379] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:20:00 2022] DELETE /identity/v3/users/8dab4d351eae4841a680831a86f6bf9f => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:01.668924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:01.682839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c7ca85-1332-4ceb-83be-cb2005d8e7bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:01.694987 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:01.844137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:01.845353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:01.845931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:01.846491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] PATH_INFO: `/v3/projects/d468eea47a0d43c79882b780ebacfbc9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:01.848024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=d468eea47a0d43c79882b780ebacfbc9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:01.850210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:01.946425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd468eea47a0d43c79882b780ebacfbc9', 'request_id': 'req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:01.957859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd468eea47a0d43c79882b780ebacfbc9', 'request_id': 'req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:01.971197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd468eea47a0d43c79882b780ebacfbc9', 'request_id': 'req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:01.999415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] The token cache is being invalidate because project d468eea47a0d43c79882b780ebacfbc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:20:02.000379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:02.001355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-69e67e2b-e1d7-42d4-918b-6950c4f5fcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:02.019472 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1699/3380] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:20:01 2022] DELETE /identity/v3/projects/d468eea47a0d43c79882b780ebacfbc9 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:02.020904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.021358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.021475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.050865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:02.052036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:02.143256 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1682/3381] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:20:02.145966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.146551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.146969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.168465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:02.169989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:02.180724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1700/3382] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:02.185188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:02.197982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb473f-c912-4242-95e4-e96b4b79e1ac None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:02.203163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:02.205285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.205685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.206226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.207112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:20:02.207533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:02.209345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:02.239461 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1683/3383] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:20:02.241032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:02.255659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645fd83-8b6f-455e-8192-dbe0f15c24aa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:02.266914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:02.269163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.269592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.270010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.271865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:02.276868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:02.358333 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1701/3384] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:20:02 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:20:02.362673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:02.380248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2ea74-2aac-4bb6-b85c-b006771d055b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:02.393041 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:02.587761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:02.588817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.588951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.592250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.593065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:02.598018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:02.649487 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1684/3385] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:20:02 2022] POST /identity/v3/users => generated 284 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:20:02.653702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:02.665040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3533794-58cd-4778-b2fb-3afc2738621a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:02.671249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:02.673263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.673840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.674337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.675622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:02.678612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:02.701784 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1702/3386] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:02.707097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:02.721917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3099fc-d30c-4a70-a0f3-c0e0d9fdecd9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:02.735088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27249993-a0f4-44f1-8497-9de461c70879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:02.736409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27249993-a0f4-44f1-8497-9de461c70879 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.736941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27249993-a0f4-44f1-8497-9de461c70879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.737444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27249993-a0f4-44f1-8497-9de461c70879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.739651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27249993-a0f4-44f1-8497-9de461c70879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:02.741737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27249993-a0f4-44f1-8497-9de461c70879 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:02.778090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1685/3387] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:02.782107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:02.795652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a6ca6-32cc-42b5-b405-9ea924de159d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:02.802227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:02.804518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.805089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.805593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] PATH_INFO: `/v3/projects/05e8fedd339e4d98a324a16f952a2b59/users/fa5407ea26874d8598159f0bfedfd427/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.843650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e8fedd339e4d98a324a16f952a2b59, user_id=fa5407ea26874d8598159f0bfedfd427, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:02.847610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:02.875151 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1703/3388] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:20:02 2022] PUT /identity/v3/projects/05e8fedd339e4d98a324a16f952a2b59/users/fa5407ea26874d8598159f0bfedfd427/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:02.881700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5768-70fa-480e-b7c2-993c10397071 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:02.883195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5768-70fa-480e-b7c2-993c10397071 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:02.883778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158b5768-70fa-480e-b7c2-993c10397071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:02.925819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-158b5768-70fa-480e-b7c2-993c10397071 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:02.928064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-158b5768-70fa-480e-b7c2-993c10397071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:03.069090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1686/3389] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:03.079320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:03.081244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:03.146073 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:03.198877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58092d-cef7-491c-ba18-3115d35ea145 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:03.209194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:03.210965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:03.212862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:03.213435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:03.240307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:03.247936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:03.261304 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1704/3390] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:07.599951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:07.600603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:07.600603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:07.636473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:07.642348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:07.728891 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1687/3391] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:20:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:07.758936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:07.761297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:07.951424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7f362-80ef-4f68-8f6b-b468efc9ac39 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:07.964859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411b9d39-0022-4347-85d9-41417f7d1f34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:07.965863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b9d39-0022-4347-85d9-41417f7d1f34 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:07.967446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b9d39-0022-4347-85d9-41417f7d1f34 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:07.968284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411b9d39-0022-4347-85d9-41417f7d1f34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:07.996810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b9d39-0022-4347-85d9-41417f7d1f34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:08.005914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411b9d39-0022-4347-85d9-41417f7d1f34 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:08.035113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1705/3392] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:20:17.425143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:17.426814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:17.612460 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:17.784839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433bc25-9121-4217-ac16-e4e37c15f4b6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:17.811197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:17.811197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:17.811553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:17.811816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:17.815650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:17.994550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:17.996548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e7abb6-21a7-4ceb-9d97-6afb77d24e7c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:18.008667 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1688/3393] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 584 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:18.025144 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=42 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:18.607214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:18.607534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:18.607784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:18.701666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] MFA Rules not processed for user `fa5407ea26874d8598159f0bfedfd427`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:18.714651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:19.000408 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1706/3394] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:18 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:19.147271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10d3c9-179a-4673-aaa1-bff870560412 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:19.147848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10d3c9-179a-4673-aaa1-bff870560412 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:19.148209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10d3c9-179a-4673-aaa1-bff870560412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:19.195309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1f10d3c9-179a-4673-aaa1-bff870560412 None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:19.202912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1f10d3c9-179a-4673-aaa1-bff870560412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:19.248689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:19.250687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:19.290633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a223e-8a86-4007-84d8-519a8ad1f756 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:19.319912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443c4ba1-8cbe-4761-b2d1-aa738c1e6c58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:19.320635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4ba1-8cbe-4761-b2d1-aa738c1e6c58 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:19.321120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4ba1-8cbe-4761-b2d1-aa738c1e6c58 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:19.321202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443c4ba1-8cbe-4761-b2d1-aa738c1e6c58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:19.354920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1689/3395] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:19.363022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4ba1-8cbe-4761-b2d1-aa738c1e6c58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:19.365857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443c4ba1-8cbe-4761-b2d1-aa738c1e6c58 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:19.410060 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1707/3396] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:19 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:21.417144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338ef4b-0535-4634-8658-039f308639e9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:21.417713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338ef4b-0535-4634-8658-039f308639e9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:21.418070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4338ef4b-0535-4634-8658-039f308639e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:21.520092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4338ef4b-0535-4634-8658-039f308639e9 None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:21.521424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4338ef4b-0535-4634-8658-039f308639e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:21.592942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:21.593928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:21.594507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:21.628954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:21.644849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:21.673806 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1708/3397] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:20:21.712756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:21.732068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca8c2-6c2d-418f-8e7b-c265e6200347 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:21.735519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1690/3398] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:21.746927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:21.747904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:21.748333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:21.748774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:21.786330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:21.788579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:21.815297 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1709/3399] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:20:24.234630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:24.235227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:24.235524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:24.282588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:24.294939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:24.313365 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1691/3400] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:20:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:24.339745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:24.354831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4225-6879-414a-b1d2-5bc18bcdeead service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:24.365915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7043189-4d5d-4217-a3ec-15f2df39718d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:24.366930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7043189-4d5d-4217-a3ec-15f2df39718d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:24.367410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7043189-4d5d-4217-a3ec-15f2df39718d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:24.380646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7043189-4d5d-4217-a3ec-15f2df39718d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:24.405428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7043189-4d5d-4217-a3ec-15f2df39718d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:24.408237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7043189-4d5d-4217-a3ec-15f2df39718d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:24.459302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1710/3401] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:20:25.313221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:25.318446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:25.360851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fe8d5-bc38-40fd-bc37-fe07890fb979 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:25.395596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:25.397032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:25.397622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:25.401175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:25.403269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:25.403482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:25.403764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:25.406311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:25.436107 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:25.442767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:25.444335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ed1c6-0cde-4594-bfdb-c68d07241196 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:25.459346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] MFA Rules not processed for user `fa5407ea26874d8598159f0bfedfd427`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:25.462668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:25.474497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1692/3402] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:25.489906 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1711/3403] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:25.845416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:25.845711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:25.845989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:25.890083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:25.892898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:25.919516 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1693/3404] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:20:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:25.942567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:25.959425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085f716-29aa-442c-ad98-151daa9cdaaf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:25.965292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe499dc-1dfe-42b3-9401-072698acbab2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:25.966895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe499dc-1dfe-42b3-9401-072698acbab2 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:25.967470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe499dc-1dfe-42b3-9401-072698acbab2 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:25.967959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe499dc-1dfe-42b3-9401-072698acbab2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:25.981706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe499dc-1dfe-42b3-9401-072698acbab2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:25.983773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe499dc-1dfe-42b3-9401-072698acbab2 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:25.996289 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1712/3405] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:20:35.875238 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:35.990915 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=62 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:36.760506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:36.765234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:36.942848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163c14e-2cf9-403f-9f43-86a179b13ff2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:36.949799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:36.959720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:36.960133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:36.960862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:36.964273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:36.987911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:36.990084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:37.032486 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1694/3406] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:41.950935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d1dc6-9219-4ba3-8c75-f8501514022c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:41.951413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d1dc6-9219-4ba3-8c75-f8501514022c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:41.951530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d1dc6-9219-4ba3-8c75-f8501514022c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:41.971451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c43d1dc6-9219-4ba3-8c75-f8501514022c None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:41.972914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c43d1dc6-9219-4ba3-8c75-f8501514022c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:41.981048 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1713/3407] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:20:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:42.012296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:42.025106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdecf96-3aa9-4bce-9c1e-b9dac6ea7dba service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:42.031700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:42.032404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:42.032696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:42.032985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:42.046440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:42.048077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:42.059914 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1695/3408] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:20:42.479766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbe15-2b43-45a4-b2bd-c4667d7af283 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:42.480084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbe15-2b43-45a4-b2bd-c4667d7af283 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:42.483006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dbe15-2b43-45a4-b2bd-c4667d7af283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:42.536555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-313dbe15-2b43-45a4-b2bd-c4667d7af283 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:42.538804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-313dbe15-2b43-45a4-b2bd-c4667d7af283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:42.557799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1714/3409] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:42.571425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:42.592795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a78342-8e15-4f18-92bb-97a2021fbd7e service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:42.604919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:42.605693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:42.606168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:42.606614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:42.624763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:42.626781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:42.646417 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1696/3410] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:20:42.887567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:42.888059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:42.888647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:42.941484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:42.943944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:42.963584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1715/3411] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:20:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:42.979572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:43.008368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3c9aa-4494-46db-81a0-824102ca5fc3 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:43.019431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f5c72-2c76-42b6-96ff-21eff76f3073 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:43.021084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f5c72-2c76-42b6-96ff-21eff76f3073 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:43.021613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f5c72-2c76-42b6-96ff-21eff76f3073 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:43.022110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f5c72-2c76-42b6-96ff-21eff76f3073 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:43.046111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f5c72-2c76-42b6-96ff-21eff76f3073 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:43.052853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f5c72-2c76-42b6-96ff-21eff76f3073 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:43.078891 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1697/3412] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:20:43.205875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:43.207687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:43.228291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b85a2ec-ae77-494f-a552-70fdc856acb1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:43.256143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:43.259325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:43.259874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:43.260991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] PATH_INFO: `/v3/users/53ef6977196f432b9176e3a86c5cb189` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:43.264199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53ef6977196f432b9176e3a86c5cb189)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:43.269044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:43.351355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53ef6977196f432b9176e3a86c5cb189'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:43.352610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53ef6977196f432b9176e3a86c5cb189'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:43.362874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53ef6977196f432b9176e3a86c5cb189'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:43.364229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53ef6977196f432b9176e3a86c5cb189'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:43.374594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53ef6977196f432b9176e3a86c5cb189'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:43.404603 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1716/3413] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:20:43 2022] DELETE /identity/v3/users/53ef6977196f432b9176e3a86c5cb189 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:43.408857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:43.409150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:43.409430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:43.428967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:43.430649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:43.516003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1698/3414] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:43.526042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:43.528173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:43.631124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc43b0c-8ae0-4398-aced-933219423df7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:43.635352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa6a49-6dfb-4a71-ae33-d49ca5852073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:43.636178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa6a49-6dfb-4a71-ae33-d49ca5852073 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:43.636953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa6a49-6dfb-4a71-ae33-d49ca5852073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:43.638438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa6a49-6dfb-4a71-ae33-d49ca5852073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:43.677609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa6a49-6dfb-4a71-ae33-d49ca5852073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:43.685095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa6a49-6dfb-4a71-ae33-d49ca5852073 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:43.705325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1717/3415] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:44.174024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:44.175567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:44.197712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a37b00e-3681-49a7-9464-afab93c16529 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:44.220535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:44.221507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:44.221790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:44.222067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] PATH_INFO: `/v3/users/2b2950eec4754c328f600d770a8860d1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:44.230735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b2950eec4754c328f600d770a8860d1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:44.233323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:44.276499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:44.277405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:44.277688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:44.314058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:44.316264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:44.353362 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:44.357956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b2950eec4754c328f600d770a8860d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.376772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b2950eec4754c328f600d770a8860d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.405443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b2950eec4754c328f600d770a8860d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.407425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b2950eec4754c328f600d770a8860d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.425198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b2950eec4754c328f600d770a8860d1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.440766 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:44.441473 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1699/3416] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:20:44 2022] DELETE /identity/v3/users/2b2950eec4754c328f600d770a8860d1 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:44.442461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:44.445253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:44.462403 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1718/3417] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:44.480557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:44.482225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:44.618421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacc7617-b58c-4116-9838-b2e0b095aa7c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:44.634910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:44.635817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:44.636191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:44.636386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] PATH_INFO: `/v3/projects/d3a92811069d4b799c532d88d41ce911` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:44.639792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a92811069d4b799c532d88d41ce911)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:44.641978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:44.673507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d7d94-e7bd-44d2-95f3-cd7868be5db6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:44.780372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a92811069d4b799c532d88d41ce911', 'request_id': 'req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.799640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a92811069d4b799c532d88d41ce911', 'request_id': 'req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.809965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a92811069d4b799c532d88d41ce911', 'request_id': 'req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.830708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:44.831804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:44.832225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:44.832666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:44.840286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] The token cache is being invalidate because project d3a92811069d4b799c532d88d41ce911 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:20:44.840651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.842849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8ceaec4-b30e-4d53-9a28-c7e984610cd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:44.850055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1700/3418] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:20:44 2022] DELETE /identity/v3/projects/d3a92811069d4b799c532d88d41ce911 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:44.855289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5c2a-50c7-4736-b064-37eddc2b1a6b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:44.855578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5c2a-50c7-4736-b064-37eddc2b1a6b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:44.855856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee5c2a-50c7-4736-b064-37eddc2b1a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:44.919720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:44.922120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:44.923266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4fee5c2a-50c7-4736-b064-37eddc2b1a6b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:44.927677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4fee5c2a-50c7-4736-b064-37eddc2b1a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:44.935988 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1719/3419] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:20:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:20:45.121631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:45.123813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:45.142408 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:45.166970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1701/3420] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:45.174413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.175045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.175045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.175363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bcf1f7-8d93-4b03-bcdc-4b8d7a6febec service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:45.192309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:45.193550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.193908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.194445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] PATH_INFO: `/v3/projects/1e01f70c403347b38dd0dd88e44be953` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.195611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e01f70c403347b38dd0dd88e44be953)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:45.197669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:45.211911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:45.219897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:45.236825 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1702/3421] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:20:45.238083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:45.259529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d392d6-e289-466f-bc82-62b115693fc0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:45.268151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:45.270293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.276231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.276793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.277744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:20:45.278259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:45.283907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:45.291395 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:45.308708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e01f70c403347b38dd0dd88e44be953', 'request_id': 'req-d5e5424a-c6c3-474a-b05d-043e0205a33d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.316196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1703/3422] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:20:45.317630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:45.335778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e01f70c403347b38dd0dd88e44be953', 'request_id': 'req-d5e5424a-c6c3-474a-b05d-043e0205a33d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.351215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881902cd-e3ac-4976-bfdf-16170e96eb53 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:45.355535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e01f70c403347b38dd0dd88e44be953', 'request_id': 'req-d5e5424a-c6c3-474a-b05d-043e0205a33d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.392177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] The token cache is being invalidate because project 1e01f70c403347b38dd0dd88e44be953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:20:45.413466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.415832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.423482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1720/3423] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:20:45 2022] DELETE /identity/v3/projects/1e01f70c403347b38dd0dd88e44be953 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:45.427453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:45.429824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:45.508553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:45.509966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.510255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.510615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.511357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:45.513352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:45.592289 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1704/3424] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:20:45 2022] POST /identity/v3/projects => generated 387 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:20:45.593593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:45.596530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:45.618401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5424a-c6c3-474a-b05d-043e0205a33d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:45.775660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:45.776899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.777365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.777783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] PATH_INFO: `/v3/users/f1bddd8631c54897a8bb41b2703f4e47` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.780117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bddd8631c54897a8bb41b2703f4e47)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:45.783368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:45.791214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da5a78-42f6-44c8-accc-be2f4b8a5561 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:45.821689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:45.825855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.828147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.829042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.831209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:45.837948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:45.894245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bddd8631c54897a8bb41b2703f4e47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.897378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bddd8631c54897a8bb41b2703f4e47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.912846 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1705/3425] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:20:45 2022] POST /identity/v3/users => generated 294 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:20:45.915934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:45.918599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:45.924894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bddd8631c54897a8bb41b2703f4e47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.938387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bddd8631c54897a8bb41b2703f4e47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.958843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bddd8631c54897a8bb41b2703f4e47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:45.961836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92bec16-6c0f-4609-9694-e13b647acc7e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:45.976543 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:45.983447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:45.984320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:45.984632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:45.985918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:45.988642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:45.993291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:46.001383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1721/3426] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:20:45 2022] DELETE /identity/v3/users/f1bddd8631c54897a8bb41b2703f4e47 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:46.038141 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1706/3427] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:20:46.048567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:46.253611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4f784c-e7e9-46dc-a87e-df67f5f7fc1a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:46.278306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923d6cf-dc14-4649-b927-e21f3bc755d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:46.279029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923d6cf-dc14-4649-b927-e21f3bc755d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:46.279313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923d6cf-dc14-4649-b927-e21f3bc755d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:46.279594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923d6cf-dc14-4649-b927-e21f3bc755d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:46.280389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923d6cf-dc14-4649-b927-e21f3bc755d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:46.282285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923d6cf-dc14-4649-b927-e21f3bc755d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:46.316952 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1722/3428] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:46.321079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:46.339231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc53ba-0edf-49c4-9dd3-7c35db218e91 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:46.362632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:46.363825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:46.367379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:46.367881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] PATH_INFO: `/v3/projects/669b7648b3b54ba0bbe125e112e63275/users/d7502387eb6e46c6ad6937409de820b9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:46.415118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=669b7648b3b54ba0bbe125e112e63275, user_id=d7502387eb6e46c6ad6937409de820b9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:46.421617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:46.476038 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1707/3429] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:20:46 2022] PUT /identity/v3/projects/669b7648b3b54ba0bbe125e112e63275/users/d7502387eb6e46c6ad6937409de820b9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:46.481639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:46.482002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:46.482262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:46.533704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:46.534949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:46.612032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:46.616287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:46.665607 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:46.683749 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1723/3430] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:46.698882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:46.700634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:46.811809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472a951-6f08-46da-acac-2ecfd8469f63 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:46.838406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:46.841549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:46.842008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:46.842293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] PATH_INFO: `/v3/projects/444aa6f96abe47ce81c74f15a23e94bd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:46.848914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=444aa6f96abe47ce81c74f15a23e94bd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:46.850867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:46.854591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bebc04-bf86-4d9e-be90-c4eeeaf3d616 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:46.863779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2a1d8f-df5e-48f4-a633-f701ccc5b698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:46.866534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1d8f-df5e-48f4-a633-f701ccc5b698 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:46.867076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1d8f-df5e-48f4-a633-f701ccc5b698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:46.869311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2a1d8f-df5e-48f4-a633-f701ccc5b698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:46.924306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a1d8f-df5e-48f4-a633-f701ccc5b698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:46.939506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2a1d8f-df5e-48f4-a633-f701ccc5b698 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:46.961686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1724/3431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:20:46.974602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444aa6f96abe47ce81c74f15a23e94bd', 'request_id': 'req-5ce371c7-1fdc-4501-b852-c87e1bdfea55'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:46.995202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444aa6f96abe47ce81c74f15a23e94bd', 'request_id': 'req-5ce371c7-1fdc-4501-b852-c87e1bdfea55'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:47.010972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444aa6f96abe47ce81c74f15a23e94bd', 'request_id': 'req-5ce371c7-1fdc-4501-b852-c87e1bdfea55'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:47.051907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] The token cache is being invalidate because project 444aa6f96abe47ce81c74f15a23e94bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:20:47.052239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:47.064963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5ce371c7-1fdc-4501-b852-c87e1bdfea55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:20:47.068092 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1708/3432] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:20:46 2022] DELETE /identity/v3/projects/444aa6f96abe47ce81c74f15a23e94bd => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:20:47.074106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:47.075724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:47.076267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:47.123675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:47.127109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:47.226343 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:47.365874 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1725/3433] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:47.377039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717fa3c-cc76-4ebc-93b4-8f41fb0c5096 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:47.377490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717fa3c-cc76-4ebc-93b4-8f41fb0c5096 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:47.377601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717fa3c-cc76-4ebc-93b4-8f41fb0c5096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:47.411848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5717fa3c-cc76-4ebc-93b4-8f41fb0c5096 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:47.415576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5717fa3c-cc76-4ebc-93b4-8f41fb0c5096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:47.438037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1709/3434] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:47.442368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:47.467182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20bcd79-cf51-4c0f-ac87-ceaf05a47c1f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:47.483663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:47.484812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:47.485303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:47.485785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:47.486970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:20:47.487535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:47.490572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:47.539378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1726/3435] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:20:47.541570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:47.541968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:47.543321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:47.550723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:47.588191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5fd167-b66f-49f3-88c9-1603fb87e307 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:47.589502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:47.591418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:47.604382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:47.605257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:47.605728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:47.606174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:47.607141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:47.610418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:47.678228 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1727/3436] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:20:47 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:20:47.680694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:47.752280 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1710/3437] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:47.953723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91f3bc-fa38-4ca5-bfb8-ecc243b4259d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:47.972082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:47.973030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:47.974532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:47.975621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:47.976542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:47.995031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:48.031023 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1728/3438] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:20:47 2022] POST /identity/v3/users => generated 287 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:20:48.035270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:48.056112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77456190-c5b8-4baa-a95a-9786bb2736ee None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:48.072658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:48.073366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:48.074262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:48.074262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:48.074666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:48.076442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:48.124753 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1711/3439] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:48.128795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:48.140592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91681261-7c2b-40ff-aa7f-55530041b0a4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:48.160491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc192aea-bc9a-475e-8692-4748a4f1a521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:48.161773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192aea-bc9a-475e-8692-4748a4f1a521 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:48.161773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192aea-bc9a-475e-8692-4748a4f1a521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:48.162014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc192aea-bc9a-475e-8692-4748a4f1a521 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:48.166451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192aea-bc9a-475e-8692-4748a4f1a521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:48.168622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc192aea-bc9a-475e-8692-4748a4f1a521 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:48.209270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:48.209480 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1729/3440] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:48.226319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd6ac2-dc52-4cb5-a7bb-6b01df611a12 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:48.248386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:48.249343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:48.249620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:48.249893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] PATH_INFO: `/v3/projects/c16618ac18b84de7a6a54c1eb62a3e2c/users/4352654fca824bd6aaffe1de76490b6d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:48.327935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16618ac18b84de7a6a54c1eb62a3e2c, user_id=4352654fca824bd6aaffe1de76490b6d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:48.347183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:48.398071 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1712/3441] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:20:48 2022] PUT /identity/v3/projects/c16618ac18b84de7a6a54c1eb62a3e2c/users/4352654fca824bd6aaffe1de76490b6d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:20:48.410085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:48.410675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:48.410675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:48.487140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] MFA Rules not processed for user `4352654fca824bd6aaffe1de76490b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:48.488648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:48.681968 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1730/3442] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:48.682235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:48.694984 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:48.881538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1f533-6e1e-4918-acd0-45c42eddbf94 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:48.904423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:48.905415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:48.905807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:48.906188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:48.907021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:48.909282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:48.980539 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1713/3443] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:20:48 2022] POST /identity/v3/projects => generated 373 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:20:48.985871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:49.022226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6529a969-97e1-41a1-bc29-7cbcdfc4d724 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:49.066573 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:49.227065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:49.227650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:49.227936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:49.228271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:49.229199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:49.231257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:49.286653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:49.286927 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1731/3444] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:20:48 2022] POST /identity/v3/users => generated 293 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:20:49.299668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13124bc-6cc0-443c-9e32-75b9018dd0a2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:49.310324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:49.311274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:49.312605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:49.313005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:49.314566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:49.317237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:49.333614 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1714/3445] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:49.343865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:49.363539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ab34f-0baf-49fc-8021-13fbd653c028 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:49.391832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:49.393363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:49.393793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:49.394177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] PATH_INFO: `/v3/projects/99956d6ed20342dc886b6ea0dd1fa04f/users/573fd5c70daa4d9a8346dcb22bd99001/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:49.458994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99956d6ed20342dc886b6ea0dd1fa04f, user_id=573fd5c70daa4d9a8346dcb22bd99001, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:49.463467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:49.505219 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1732/3446] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:20:49 2022] PUT /identity/v3/projects/99956d6ed20342dc886b6ea0dd1fa04f/users/573fd5c70daa4d9a8346dcb22bd99001/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:49.506123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:49.540882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac4095-e89c-419e-9666-effe2475cfde admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:49.708914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc891c-52e2-4f26-b00a-b1eae92ec18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:49.709618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc891c-52e2-4f26-b00a-b1eae92ec18d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:49.709900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc891c-52e2-4f26-b00a-b1eae92ec18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:49.710928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc891c-52e2-4f26-b00a-b1eae92ec18d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:49.711748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc891c-52e2-4f26-b00a-b1eae92ec18d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:49.713419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc891c-52e2-4f26-b00a-b1eae92ec18d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:49.739110 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1715/3447] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:20:49.743624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:49.773270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ab33b-e7ed-45a8-ab3d-6724eaa45498 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:49.788037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e69cad-8730-4259-bdf2-7026fa6a5637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:49.790641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69cad-8730-4259-bdf2-7026fa6a5637 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:49.790926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69cad-8730-4259-bdf2-7026fa6a5637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:49.791217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e69cad-8730-4259-bdf2-7026fa6a5637 admin admin] PATH_INFO: `/v3/projects/99956d6ed20342dc886b6ea0dd1fa04f/users/573fd5c70daa4d9a8346dcb22bd99001/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:49.797426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69cad-8730-4259-bdf2-7026fa6a5637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99956d6ed20342dc886b6ea0dd1fa04f, user_id=573fd5c70daa4d9a8346dcb22bd99001, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:49.806146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e69cad-8730-4259-bdf2-7026fa6a5637 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:49.837293 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1733/3448] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:20:49 2022] PUT /identity/v3/projects/99956d6ed20342dc886b6ea0dd1fa04f/users/573fd5c70daa4d9a8346dcb22bd99001/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:20:49.848358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:49.848972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:49.849251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:49.909468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] MFA Rules not processed for user `573fd5c70daa4d9a8346dcb22bd99001`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:49.910990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:50.148150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd379-be90-4668-8b0a-d154111b5d79 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:50.148841 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1716/3449] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:50.149067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd379-be90-4668-8b0a-d154111b5d79 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:50.150706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddffd379-be90-4668-8b0a-d154111b5d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:50.231766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ddffd379-be90-4668-8b0a-d154111b5d79 None None] MFA Rules not processed for user `4352654fca824bd6aaffe1de76490b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:50.236542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ddffd379-be90-4668-8b0a-d154111b5d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:50.461874 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1734/3450] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:50.600130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:50.601661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:50.607413 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:20:50.905273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a76e036-9c66-4a41-9225-ea8c0ba4f779 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:50.916436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:50.917364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:50.919244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:50.919681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:50.946688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:50.948327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:50.994718 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1717/3451] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:20:53.297926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:53.298595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:53.298595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:53.401135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] MFA Rules not processed for user `70dd4df198264571978250f31b491cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:20:53.402379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:53.555683 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1735/3452] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:20:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:20:54.763749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:20:54.768502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:54.938773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bd90e9-f710-4637-a550-528c31e8d837 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:20:54.946895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:20:54.946895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:20:54.946895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:20:54.946895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:20:54.949537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:20:54.964204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:20:54.966133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:20:54.986709 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1718/3453] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:20:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:21:03.538561 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:04.975954 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=59 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:06.068665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:06.098286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5424442-4b16-437e-bb6c-99d613ed9dda None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:06.126979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:06.127923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:06.128575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:06.129056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:06.131159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:06.313783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:06.315644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:06.349482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1736/3454] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:21:06.972590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:06.974139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:07.226072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a20f73-ce17-45da-9723-bd9665b3b47e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:07.239483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:07.240459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:07.240740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:07.241015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] PATH_INFO: `/v3/users/e00ef38262cc4f7895e3f6b8380d469e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:07.242574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00ef38262cc4f7895e3f6b8380d469e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:07.244687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:07.349554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00ef38262cc4f7895e3f6b8380d469e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:07.373138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00ef38262cc4f7895e3f6b8380d469e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:07.398874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00ef38262cc4f7895e3f6b8380d469e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:07.404278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00ef38262cc4f7895e3f6b8380d469e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:07.422944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c713af3c-5265-4e81-aa84-27cf3e348ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00ef38262cc4f7895e3f6b8380d469e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:07.440593 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1719/3455] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:21:06 2022] DELETE /identity/v3/users/e00ef38262cc4f7895e3f6b8380d469e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:08.075321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:08.098507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9631b6a7-54b9-4c79-a393-628fd1f1d2ed service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:08.199617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:08.201059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:08.201546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:08.202446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] PATH_INFO: `/v3/projects/1cf4306c8181421b92daea5dbd2d5466` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:08.216991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cf4306c8181421b92daea5dbd2d5466)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:08.222143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:08.329196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cf4306c8181421b92daea5dbd2d5466', 'request_id': 'req-2e540309-3204-42a1-ae73-f778b4c67baf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:08.338253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cf4306c8181421b92daea5dbd2d5466', 'request_id': 'req-2e540309-3204-42a1-ae73-f778b4c67baf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:08.348766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cf4306c8181421b92daea5dbd2d5466', 'request_id': 'req-2e540309-3204-42a1-ae73-f778b4c67baf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:08.382477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] The token cache is being invalidate because project 1cf4306c8181421b92daea5dbd2d5466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:21:08.383018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:08.383901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e540309-3204-42a1-ae73-f778b4c67baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:08.386801 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1737/3456] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:21:08 2022] DELETE /identity/v3/projects/1cf4306c8181421b92daea5dbd2d5466 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:08.392290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:08.393184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:08.393621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:08.431105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:08.435486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:08.579618 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1720/3457] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:08.587216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:08.587502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:08.588833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:08.672659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:08.675296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:08.716948 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1738/3458] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:08.721487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:08.742852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678866c-2117-4524-a926-fbc9f7b6cd61 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:08.757155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:08.758089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:08.758458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:08.758734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:08.759509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:21:08.760112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:08.761973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:08.805665 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1721/3459] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:21:08.808002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:08.821941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3dd21-6d36-4327-9d4b-c386d8e5166c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:08.839278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:08.840725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:08.841230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:08.841707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:08.842668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:08.849247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:08.889912 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:08.922813 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1739/3460] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:21:08 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:21:08.923470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:08.941169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383ab6d-fd9b-457b-9d6c-950e48d13b9e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:08.957329 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:09.149831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:09.150472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:09.150755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:09.151034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:09.151744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:09.153745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:09.217757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1722/3461] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:21:08 2022] POST /identity/v3/users => generated 294 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:21:09.219390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:09.252132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb613d8-014b-4660-b1bb-8cd2078eec78 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:09.266166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:09.267362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:09.267888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:09.268393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:09.270298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:09.273808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:09.303187 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1740/3462] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:21:09.309176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:09.330808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c17da32-62a5-48ee-b2fb-dec6b4b69340 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:09.344814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1776b6d3-507a-48dc-8e7b-8d64fb9d416c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:09.345635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b6d3-507a-48dc-8e7b-8d64fb9d416c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:09.345883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b6d3-507a-48dc-8e7b-8d64fb9d416c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:09.346182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1776b6d3-507a-48dc-8e7b-8d64fb9d416c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:09.347037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776b6d3-507a-48dc-8e7b-8d64fb9d416c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:09.349006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1776b6d3-507a-48dc-8e7b-8d64fb9d416c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:09.385347 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1723/3463] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:21:09.390459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:09.403186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef99c32-c274-49f6-8550-2f0820fc5816 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:09.420085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:09.421164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:09.421676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:09.422168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] PATH_INFO: `/v3/projects/6b871fb24ca54c2a97666083e9b5eaac/users/da0bfcb32bea448eb22f4aab2b99d796/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:09.452277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b871fb24ca54c2a97666083e9b5eaac, user_id=da0bfcb32bea448eb22f4aab2b99d796, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:09.455361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:09.480056 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1741/3464] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:21:09 2022] PUT /identity/v3/projects/6b871fb24ca54c2a97666083e9b5eaac/users/da0bfcb32bea448eb22f4aab2b99d796/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:09.485482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4807b-d924-4287-a14c-9d4be401fd3b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:09.486315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4807b-d924-4287-a14c-9d4be401fd3b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:09.486748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4807b-d924-4287-a14c-9d4be401fd3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:09.515558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fed4807b-d924-4287-a14c-9d4be401fd3b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:09.517484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fed4807b-d924-4287-a14c-9d4be401fd3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:09.620830 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1724/3465] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:09.630362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:09.632675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:09.760657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b95c91-2b76-4dd0-87e4-28f64da41271 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:09.769938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:09.771935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:09.773775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:09.774175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:09.795335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:09.797358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:09.830446 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1742/3466] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:21:12.929269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724585-bbbb-48b0-ba00-b908f5caf923 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:12.929846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724585-bbbb-48b0-ba00-b908f5caf923 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:12.929961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b724585-bbbb-48b0-ba00-b908f5caf923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:12.991129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7b724585-bbbb-48b0-ba00-b908f5caf923 None None] MFA Rules not processed for user `d7502387eb6e46c6ad6937409de820b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:12.992103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b724585-bbbb-48b0-ba00-b908f5caf923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:13.173067 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1725/3467] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:13.271670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:13.273089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:13.449652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0399b9-bd43-4c87-8bd4-7955772b1883 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:13.459198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:13.460378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:13.460824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:13.461205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:13.472989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:13.475906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:13.489264 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1743/3468] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:21:17.236301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5b47-c708-4fb1-b5d1-f554c1a14277 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:17.236836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5b47-c708-4fb1-b5d1-f554c1a14277 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:17.236916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f5b47-c708-4fb1-b5d1-f554c1a14277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:17.264161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a76f5b47-c708-4fb1-b5d1-f554c1a14277 None None] MFA Rules not processed for user `9c4ef65e911a45aa847ad4db8fb70b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:17.265490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a76f5b47-c708-4fb1-b5d1-f554c1a14277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:17.290863 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:17.401844 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1726/3469] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:19.343188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:19.347601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:19.529947 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:19.570692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608045d-b605-4ff4-bdf8-086e0bdcb605 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:19.580461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:19.586402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:19.588105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:19.588692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:19.594284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:19.624394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:19.627097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af235269-8a05-4699-8525-e97d21a996f4 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:19.649993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1744/3470] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:21:21.730716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:21.731874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:21.732158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:21.768730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:21.770232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:21.801482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:21.802737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:21.803185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:21.848275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] MFA Rules not processed for user `da0bfcb32bea448eb22f4aab2b99d796`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:21.849634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:21.929726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1727/3471] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:21.942909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:21.947961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:22.001703 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1745/3472] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:22.003340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:22.029131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4754102-cb3f-4b01-ae16-393f7286453d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:22.040034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:22.046635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.046635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.046635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.046635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:22.046635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:22.118510 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1746/3473] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:21:22 2022] POST /identity/v3/projects => generated 389 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:21:22.121841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:22.122951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c0d92-4560-4d74-a263-7d6b58cff487 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:22.257981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a698abe7-4a74-4015-ba23-6a4f74a2f481 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:22.259814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:22.260603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.261565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.261928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.264263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a847654-53c5-4081-92ff-44c6de6d727f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:22.265340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a847654-53c5-4081-92ff-44c6de6d727f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.265987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a847654-53c5-4081-92ff-44c6de6d727f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.266554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a847654-53c5-4081-92ff-44c6de6d727f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.267525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a847654-53c5-4081-92ff-44c6de6d727f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:22.270141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a847654-53c5-4081-92ff-44c6de6d727f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:22.280658 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:22.352440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1747/3474] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:21:22 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:21:22.354456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.355151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.355677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.409097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:22.411570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:22.422463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:22.424135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:22.458149 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:22.463437 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1728/3475] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:21:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:21:22.464521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:22.509556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1748/3476] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:22.535244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fdbb23-aa86-4a3f-a8aa-369b68a6892e service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:22.545798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:22.550013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.550254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.550507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.551279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:22.555828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:22.585866 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1729/3477] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:21:22.590792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:22.606058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad42909-8087-4881-b7ab-f144e0c43146 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:22.619074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:22.619995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.620275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.624053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] PATH_INFO: `/v3/projects/1eb277d104fe4947a074dd88206af05a/users/c46794bb84504b8283ee36bac032ac80/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.693072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb277d104fe4947a074dd88206af05a, user_id=c46794bb84504b8283ee36bac032ac80, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:22.695783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:22.763010 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1749/3478] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:21:22 2022] PUT /identity/v3/projects/1eb277d104fe4947a074dd88206af05a/users/c46794bb84504b8283ee36bac032ac80/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:22.763947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:22.793246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0cd76-846e-4720-be25-ddf85c315081 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:22.947160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:22.948050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:22.948495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:22.948869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:22.950284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:22.952846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:23.006621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:23.017289 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1730/3479] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:21:23.031525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120088a-0855-421c-a28e-c6c770960489 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:23.073698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a7ede-f707-4575-a2ab-d20637c97c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:23.077088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7ede-f707-4575-a2ab-d20637c97c8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:23.077452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7ede-f707-4575-a2ab-d20637c97c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:23.077732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a7ede-f707-4575-a2ab-d20637c97c8f admin admin] PATH_INFO: `/v3/projects/1eb277d104fe4947a074dd88206af05a/users/c46794bb84504b8283ee36bac032ac80/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:23.080359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a7ede-f707-4575-a2ab-d20637c97c8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eb277d104fe4947a074dd88206af05a, user_id=c46794bb84504b8283ee36bac032ac80, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:23.086924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a7ede-f707-4575-a2ab-d20637c97c8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:23.104756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1750/3480] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:21:23 2022] PUT /identity/v3/projects/1eb277d104fe4947a074dd88206af05a/users/c46794bb84504b8283ee36bac032ac80/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:32.991793 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=57 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:33.095660 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=24,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:35.625555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:35.885636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3de202-7a11-4601-8137-6126a4ddcc19 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:36.034332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:36.035542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:36.035542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:36.035542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:36.051621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:36.209195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:36.209195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:36.242466 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1731/3481] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:35 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:21:37.843782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:37.844427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:37.844427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:37.860192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:37.861851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:37.912125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] MFA Rules not processed for user `c46794bb84504b8283ee36bac032ac80`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:37.916611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:37.956047 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:38.090847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af419dc9-dce6-44c9-9dd1-a9ceaf93950d service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:38.103447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:38.105439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:38.106720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:38.109107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:38.116405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:38.138052 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1751/3482] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:37 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:38.144793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:38.147793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:38.160213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:38.162276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12b063-8233-44e0-9c6e-241ff73978fd service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:38.201075 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1732/3483] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:21:38.315321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc29f776-ee2f-449b-a31b-ebc4683a576f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:38.338542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:38.339360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:38.342266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:38.342706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:38.503348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:38.505264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:38.532590 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1752/3484] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:21:46.258814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:46.259859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:46.260299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:46.314393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:46.314737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:46.508265 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1733/3485] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:47.434574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:47.436097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:47.629513 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:47.717884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3983d0d-ad7c-47ed-9070-90957b113f98 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:47.730214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:47.735217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:47.736411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:47.737876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] PATH_INFO: `/v3/users/d7502387eb6e46c6ad6937409de820b9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:47.742667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7502387eb6e46c6ad6937409de820b9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:47.744020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:47.878124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7502387eb6e46c6ad6937409de820b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:47.878860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7502387eb6e46c6ad6937409de820b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:47.902785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7502387eb6e46c6ad6937409de820b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:47.904012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7502387eb6e46c6ad6937409de820b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:47.918802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-14b0ca6a-ef7d-4ebb-89fb-8528de159793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7502387eb6e46c6ad6937409de820b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:47.983927 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1753/3486] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:21:47 2022] DELETE /identity/v3/users/d7502387eb6e46c6ad6937409de820b9 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:48.517603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:48.543650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65621bd-4d1c-47f5-9b0c-2d8e0eb611bf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:48.732569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:48.733730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:48.734870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:48.735239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] PATH_INFO: `/v3/projects/669b7648b3b54ba0bbe125e112e63275` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:48.737186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] RBAC: Authorizing `identity:delete_project(project_id=669b7648b3b54ba0bbe125e112e63275)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:48.739900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:48.843772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '669b7648b3b54ba0bbe125e112e63275', 'request_id': 'req-21ff740b-b2de-43dc-9780-770fdcac2621'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:48.866247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '669b7648b3b54ba0bbe125e112e63275', 'request_id': 'req-21ff740b-b2de-43dc-9780-770fdcac2621'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:48.876642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '669b7648b3b54ba0bbe125e112e63275', 'request_id': 'req-21ff740b-b2de-43dc-9780-770fdcac2621'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:48.885474 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:48.900217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] The token cache is being invalidate because project 669b7648b3b54ba0bbe125e112e63275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:21:48.901045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:48.902115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-21ff740b-b2de-43dc-9780-770fdcac2621 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:21:48.910568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1734/3487] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:21:48 2022] DELETE /identity/v3/projects/669b7648b3b54ba0bbe125e112e63275 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:48.917133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:48.917697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:48.917697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:48.938978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:48.940585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:49.068624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1754/3488] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:49.085171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.088071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.089061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.144710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:49.147532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:49.171469 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1735/3489] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:49.176234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.190537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72978d-fba5-4836-bf15-3ee2df538066 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.199792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.201179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.201642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.202075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.203243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:21:49.204527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.206473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:49.231789 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1755/3490] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:21:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:21:49.234008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.246378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1febfaa9-d5a2-4c67-98bc-ce957920074c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.255005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f6cb9-6133-47a3-acf2-1b70fe45f876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.256723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f6cb9-6133-47a3-acf2-1b70fe45f876 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.257012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f6cb9-6133-47a3-acf2-1b70fe45f876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.257283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f6cb9-6133-47a3-acf2-1b70fe45f876 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.257985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f6cb9-6133-47a3-acf2-1b70fe45f876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.259952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f6cb9-6133-47a3-acf2-1b70fe45f876 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:49.315601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1736/3491] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:21:49 2022] POST /identity/v3/projects => generated 371 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:21:49.330716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.345540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40571851-a811-4746-85ba-7a548040f431 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.441130 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:49.464900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.465889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.466175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.466707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.468853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.498371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:49.546663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.547607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.548119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.558700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1756/3492] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:21:49 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:21:49.560914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.590991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:49.594876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:49.634976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b0f436-bd50-4b50-a8c4-d60b854fd495 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.654954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.656912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.657267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.657639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.658592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.660923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:49.729941 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1757/3493] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:21:49.732807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.763279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c17916-6e21-494b-a9cc-45e58d27ca79 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.781828 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1737/3494] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:21:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:49.782435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.782890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.783665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.783968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.784245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.784822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:49.785037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.788400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:49.819326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1758/3495] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:21:49.823282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:49.869665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5786c9eb-61f7-46ca-90c9-bf298cc5d415 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.885495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7767ea-9c4f-4e9a-acf1-d1c86c799b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.887372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7767ea-9c4f-4e9a-acf1-d1c86c799b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.887845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7767ea-9c4f-4e9a-acf1-d1c86c799b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.888884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7767ea-9c4f-4e9a-acf1-d1c86c799b76 admin admin] PATH_INFO: `/v3/projects/599536f2f5294ee3b50d2dea9e92f775/users/b1df83a1e36c4ad5b215d6964e1585e7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.936516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a06e2e-b97b-4464-853f-4cd13d9b3c1b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:49.946603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7767ea-9c4f-4e9a-acf1-d1c86c799b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=599536f2f5294ee3b50d2dea9e92f775, user_id=b1df83a1e36c4ad5b215d6964e1585e7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.949931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7767ea-9c4f-4e9a-acf1-d1c86c799b76 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:49.966315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:49.969400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:49.969791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:49.971617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:49.997098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:49.999119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:50.007893 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1759/3496] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:21:49 2022] PUT /identity/v3/projects/599536f2f5294ee3b50d2dea9e92f775/users/b1df83a1e36c4ad5b215d6964e1585e7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:21:50.014463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634f99-6899-489a-bb88-e3f025164b3a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:50.014935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634f99-6899-489a-bb88-e3f025164b3a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:50.015608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e634f99-6899-489a-bb88-e3f025164b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:50.031700 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1738/3497] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:21:50.057689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e634f99-6899-489a-bb88-e3f025164b3a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:50.059213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e634f99-6899-489a-bb88-e3f025164b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:50.198407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1760/3498] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:50.290495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:50.292292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:50.458807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d78afd-f2f5-4940-b9b9-0c9f8fab1054 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:50.496072 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:21:50.623895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:50.624641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:50.626274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:50.627643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:50.649853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:50.653256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:50.669683 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1739/3499] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:21:51.589341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bcb7e-fedd-42db-8d4d-53a44fc3adf6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:51.589871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bcb7e-fedd-42db-8d4d-53a44fc3adf6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:51.590084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bcb7e-fedd-42db-8d4d-53a44fc3adf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:51.632662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b16bcb7e-fedd-42db-8d4d-53a44fc3adf6 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:51.634749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b16bcb7e-fedd-42db-8d4d-53a44fc3adf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:51.900627 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1761/3500] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:21:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:21:51.915669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:52.118061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb2c3e-2c88-4372-b14f-43e108734bc4 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:52.137531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:52.138424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:52.138709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:52.140961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:52.165871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:52.167863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:52.187540 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1740/3501] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:21:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:21:52.855478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:52.856049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:52.856049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:52.903131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:21:52.904410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:21:52.923204 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1762/3502] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:21:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:21:52.934649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:21:52.974413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625499c-49cb-464a-b7a2-be396a67a9ab service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:21:53.002235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:21:53.009949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:21:53.010563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:21:53.011880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:21:53.073138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:21:53.077317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:21:53.125407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1741/3503] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:21:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:22:00.735132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:00.736803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:00.774980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9d04fe-47da-4dee-a513-94e29e1e4ee2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:00.790757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:00.791708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:00.791988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:00.792260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] PATH_INFO: `/v3/users/fa5407ea26874d8598159f0bfedfd427` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:00.801616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5407ea26874d8598159f0bfedfd427)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:00.803666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:00.891106 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:00.952811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5407ea26874d8598159f0bfedfd427'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:00.953761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5407ea26874d8598159f0bfedfd427'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:00.970094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5407ea26874d8598159f0bfedfd427'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:00.970920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5407ea26874d8598159f0bfedfd427'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:00.983507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f865ac6-817d-435d-93b0-016c916d35f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5407ea26874d8598159f0bfedfd427'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:01.028678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1763/3504] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:00 2022] DELETE /identity/v3/users/fa5407ea26874d8598159f0bfedfd427 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:02.315449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:02.352424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e1e183-4e03-49ff-a569-51dfb002d1e8 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:02.566562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:02.567768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:02.568229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:02.569040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] PATH_INFO: `/v3/projects/05e8fedd339e4d98a324a16f952a2b59` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:02.570943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e8fedd339e4d98a324a16f952a2b59)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:02.574644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:02.749119 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:02.774379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e8fedd339e4d98a324a16f952a2b59', 'request_id': 'req-d219063d-5f9c-450d-85e6-731a223b0d01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:02.800076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e8fedd339e4d98a324a16f952a2b59', 'request_id': 'req-d219063d-5f9c-450d-85e6-731a223b0d01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:02.833019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e8fedd339e4d98a324a16f952a2b59', 'request_id': 'req-d219063d-5f9c-450d-85e6-731a223b0d01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:02.901642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] The token cache is being invalidate because project 05e8fedd339e4d98a324a16f952a2b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:02.902163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:02.903587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d219063d-5f9c-450d-85e6-731a223b0d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:02.926245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:02.927082 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1742/3505] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:02 2022] DELETE /identity/v3/projects/05e8fedd339e4d98a324a16f952a2b59 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:02.927409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:02.927687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:02.973661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:02.975239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:03.061466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1764/3506] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:03.073689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:03.073982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:03.074343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:03.144049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:03.145480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:03.188125 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1743/3507] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:03.189473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:03.212627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563406e4-32a4-46e4-b63e-e69f590bfc12 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:03.217684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:03.218701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:03.219473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:03.219914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:03.220904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:22:03.221218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:03.222952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:03.247242 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1765/3508] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:22:03.257750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:03.274273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7df4a4-4372-4cbd-b394-94ddd1ea350a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:03.281878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:03.281878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:03.282374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:03.282718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:03.283555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:03.285717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:03.354159 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1744/3509] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:03 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:03.361236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:03.377187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8822e9af-7202-4b30-9c32-fbaaab9c3b08 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:03.601163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:03.602904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:03.604082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:03.605257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:03.606212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:03.611361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:03.685824 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1766/3510] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:03 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:03.691759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:03.757423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72016fa8-abd6-4376-9638-47538041aa91 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:03.778750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:03.786994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:03.786994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:03.786994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:03.788283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:03.797155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:03.888752 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1745/3511] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:03.893400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:03.907294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22132c-88a1-4a33-b231-7b725277c748 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:03.920246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e178a-7aee-448c-91e4-c776f15d7e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:03.922955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e178a-7aee-448c-91e4-c776f15d7e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:03.924151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e178a-7aee-448c-91e4-c776f15d7e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:03.926563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e178a-7aee-448c-91e4-c776f15d7e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:03.929277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e178a-7aee-448c-91e4-c776f15d7e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:03.934186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62e178a-7aee-448c-91e4-c776f15d7e44 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:03.988373 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1767/3512] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:22:03.994924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:04.025252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4065fb-11e9-4ac3-a130-3fa91ba648a3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:04.044518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:04.049560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:04.051697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:04.054166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] PATH_INFO: `/v3/projects/50976400d1f44ac5b513db26bc19ac60/users/b70a43fcc1af4115b466fb2c94ae2303/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:04.101235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50976400d1f44ac5b513db26bc19ac60, user_id=b70a43fcc1af4115b466fb2c94ae2303, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:04.107014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:04.156511 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1746/3513] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:03 2022] PUT /identity/v3/projects/50976400d1f44ac5b513db26bc19ac60/users/b70a43fcc1af4115b466fb2c94ae2303/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:04.161907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa058-8b6e-4d8e-81df-8b1093a11e26 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:04.162299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa058-8b6e-4d8e-81df-8b1093a11e26 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:04.162693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5aa058-8b6e-4d8e-81df-8b1093a11e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:04.177954 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:04.195406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0a5aa058-8b6e-4d8e-81df-8b1093a11e26 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:04.198472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a5aa058-8b6e-4d8e-81df-8b1093a11e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:04.398208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1768/3514] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:04.533369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:04.537616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:04.709398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bddfd-4015-45b2-aae6-4356daadba11 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:04.718990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77089fd1-b09c-4c60-a79f-76bfe6b1f39c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:04.720043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089fd1-b09c-4c60-a79f-76bfe6b1f39c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:04.720602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089fd1-b09c-4c60-a79f-76bfe6b1f39c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:04.721115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77089fd1-b09c-4c60-a79f-76bfe6b1f39c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:04.760453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77089fd1-b09c-4c60-a79f-76bfe6b1f39c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:04.762431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77089fd1-b09c-4c60-a79f-76bfe6b1f39c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:04.795818 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1747/3515] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:08.107340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:08.107827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:08.107956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:08.176810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] MFA Rules not processed for user `70628393aac8485fae89e5d50eac92f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:08.182654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:08.417086 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1769/3516] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:09.638193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e52d7-788a-4328-8bfe-4be434013a1e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:09.638946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e52d7-788a-4328-8bfe-4be434013a1e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:09.640667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e52d7-788a-4328-8bfe-4be434013a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:09.749529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b83e52d7-788a-4328-8bfe-4be434013a1e None None] MFA Rules not processed for user `b1df83a1e36c4ad5b215d6964e1585e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:09.751047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b83e52d7-788a-4328-8bfe-4be434013a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:09.957551 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:09.988944 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1748/3517] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:10.179680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:10.181214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:10.399680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab6d1fc-8280-4437-b336-9b17bfbc059d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:10.413789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfaeaed-6a53-4892-a6d5-ac6ea0deaf50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:10.426934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaeaed-6a53-4892-a6d5-ac6ea0deaf50 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:10.434837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaeaed-6a53-4892-a6d5-ac6ea0deaf50 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:10.435518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfaeaed-6a53-4892-a6d5-ac6ea0deaf50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:10.464167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaeaed-6a53-4892-a6d5-ac6ea0deaf50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:10.466498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfaeaed-6a53-4892-a6d5-ac6ea0deaf50 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:10.508462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1770/3518] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:13.099868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:13.101260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:13.101786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:13.123908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] MFA Rules not processed for user `9f971aae812d42f69b5ba2caa8d32172`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:13.125729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:13.198005 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1749/3519] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:16.658722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970d319-a4aa-4cd4-b191-79b80d9b35e6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:16.659406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970d319-a4aa-4cd4-b191-79b80d9b35e6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:16.659749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7970d319-a4aa-4cd4-b191-79b80d9b35e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:16.727291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7970d319-a4aa-4cd4-b191-79b80d9b35e6 None None] MFA Rules not processed for user `b1df83a1e36c4ad5b215d6964e1585e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:16.738323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7970d319-a4aa-4cd4-b191-79b80d9b35e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:16.765304 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1771/3520] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:17.236702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:17.238250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:17.279957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6df75-31d3-4e71-add9-d2263557fcee None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:17.288631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:17.289327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:17.289604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:17.291759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:17.297119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:17.335313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:17.337265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:17.357639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1750/3521] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:17.835840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:17.836811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:17.837265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:17.892064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] MFA Rules not processed for user `b70a43fcc1af4115b466fb2c94ae2303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:17.893371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:17.946360 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:18.047379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1772/3522] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:18.051873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:18.069876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8764d0-1de0-4f14-a3ac-e9bef40b9e90 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:18.090987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:18.092549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:18.094288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:18.094764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:18.096041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:18.098850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:18.165903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1751/3523] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:18 2022] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:18.168146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:18.193216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752dfb6-56b4-42c3-9c09-1a9a111a18da None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:18.382464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:18.383194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:18.383489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:18.383799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:18.384604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:18.386623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:18.442735 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1773/3524] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:18 2022] POST /identity/v3/users => generated 295 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:18.446732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:18.461470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce94526a-f0e3-4c7f-9f52-1b2c5d355781 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:18.472692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:18.487932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:18.488229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:18.492312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:18.495686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:18.497818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:18.544266 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1752/3525] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:18.546053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:18.601174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec4cf54-540b-40ec-bd5e-1ece2fade771 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:18.620217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:18.621789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:18.622359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:18.622940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] PATH_INFO: `/v3/projects/13b0cedfc7424b55ba495d5edb198758/users/6b55d40fdca647f6b71025469def6742/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:18.702647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b0cedfc7424b55ba495d5edb198758, user_id=6b55d40fdca647f6b71025469def6742, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:18.706549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:18.738018 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1774/3526] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:18 2022] PUT /identity/v3/projects/13b0cedfc7424b55ba495d5edb198758/users/6b55d40fdca647f6b71025469def6742/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:18.743587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:18.758875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12828ec8-1441-4786-b18e-dbceb02ce236 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:18.914608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:18.915649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:18.916155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:18.916685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:18.917659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:18.919555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:18.952599 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1753/3527] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:18.956773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:18.973651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df36a59c-b90a-4cd3-888d-ed2d94601395 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:18.980829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa106d6-004b-404f-8618-3e8b77c35b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:18.982200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa106d6-004b-404f-8618-3e8b77c35b18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:18.982673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa106d6-004b-404f-8618-3e8b77c35b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:18.983385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa106d6-004b-404f-8618-3e8b77c35b18 admin admin] PATH_INFO: `/v3/projects/13b0cedfc7424b55ba495d5edb198758/users/6b55d40fdca647f6b71025469def6742/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:18.986388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa106d6-004b-404f-8618-3e8b77c35b18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b0cedfc7424b55ba495d5edb198758, user_id=6b55d40fdca647f6b71025469def6742, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:18.993117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa106d6-004b-404f-8618-3e8b77c35b18 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:19.025058 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1775/3528] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:18 2022] PUT /identity/v3/projects/13b0cedfc7424b55ba495d5edb198758/users/6b55d40fdca647f6b71025469def6742/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:21.876792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:21.879796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:21.906120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4b183-46a2-45c3-857c-ce50c97e6a68 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:22.032965 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:22.063683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:22.066027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:22.066398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:22.067302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] PATH_INFO: `/v3/users/4352654fca824bd6aaffe1de76490b6d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:22.071353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4352654fca824bd6aaffe1de76490b6d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:22.078358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:22.173480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4352654fca824bd6aaffe1de76490b6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:22.183964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4352654fca824bd6aaffe1de76490b6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:22.202956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4352654fca824bd6aaffe1de76490b6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:22.204381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4352654fca824bd6aaffe1de76490b6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:22.220015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4352654fca824bd6aaffe1de76490b6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:22.231376 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1754/3529] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:21 2022] DELETE /identity/v3/users/4352654fca824bd6aaffe1de76490b6d => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:22.235849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:22.236579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:22.236579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:22.262898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:22.264556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:22.393018 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1776/3530] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:22.429332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:22.433845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:22.635737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7f1910-ed13-4435-84e9-59e368835b38 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:22.651335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:22.652177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:22.653016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:22.655047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:22.681610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:22.687293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:22.725129 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1755/3531] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:25.227793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:25.229841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:25.245743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a72cdc-6496-415e-9448-a220afabe268 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:25.255378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:25.256280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:25.256646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:25.256922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] PATH_INFO: `/v3/projects/c16618ac18b84de7a6a54c1eb62a3e2c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:25.258842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16618ac18b84de7a6a54c1eb62a3e2c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:25.261006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:25.282159 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:25.364089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16618ac18b84de7a6a54c1eb62a3e2c', 'request_id': 'req-313e2781-2015-494f-b487-fdab0aabff53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.374208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16618ac18b84de7a6a54c1eb62a3e2c', 'request_id': 'req-313e2781-2015-494f-b487-fdab0aabff53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.383388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16618ac18b84de7a6a54c1eb62a3e2c', 'request_id': 'req-313e2781-2015-494f-b487-fdab0aabff53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.413027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] The token cache is being invalidate because project c16618ac18b84de7a6a54c1eb62a3e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:25.413542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.415147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.425297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:25.425864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1777/3532] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:25 2022] DELETE /identity/v3/projects/c16618ac18b84de7a6a54c1eb62a3e2c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:25.439139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f050b-3a48-401e-b48f-c66f6953f42f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:25.658253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:25.660693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:25.661352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:25.662145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] PATH_INFO: `/v3/users/573fd5c70daa4d9a8346dcb22bd99001` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:25.664865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573fd5c70daa4d9a8346dcb22bd99001)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:25.672509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:25.736777 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:25.815109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573fd5c70daa4d9a8346dcb22bd99001'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.830468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573fd5c70daa4d9a8346dcb22bd99001'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.862398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573fd5c70daa4d9a8346dcb22bd99001'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.866319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573fd5c70daa4d9a8346dcb22bd99001'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.884283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4ac5ec81-f0bf-4109-8b37-e7a122e46de2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573fd5c70daa4d9a8346dcb22bd99001'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:25.898676 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1756/3533] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:25 2022] DELETE /identity/v3/users/573fd5c70daa4d9a8346dcb22bd99001 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:22:28.347798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:28.349325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:28.397322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313e2781-2015-494f-b487-fdab0aabff53 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:28.560757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:28.561788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:28.562078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:28.562356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] PATH_INFO: `/v3/projects/99956d6ed20342dc886b6ea0dd1fa04f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:28.564087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99956d6ed20342dc886b6ea0dd1fa04f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:28.566476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:28.663107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99956d6ed20342dc886b6ea0dd1fa04f', 'request_id': 'req-130dc451-d1c1-4494-b844-1c0c9879d607'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:28.680192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99956d6ed20342dc886b6ea0dd1fa04f', 'request_id': 'req-130dc451-d1c1-4494-b844-1c0c9879d607'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:28.690145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99956d6ed20342dc886b6ea0dd1fa04f', 'request_id': 'req-130dc451-d1c1-4494-b844-1c0c9879d607'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:28.725804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] The token cache is being invalidate because project 99956d6ed20342dc886b6ea0dd1fa04f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:28.726277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:28.728810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130dc451-d1c1-4494-b844-1c0c9879d607 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:28.736708 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1778/3534] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:28 2022] DELETE /identity/v3/projects/99956d6ed20342dc886b6ea0dd1fa04f => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:28.743920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:28.744834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:28.745304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:28.816915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:28.819661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:28.961805 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1757/3535] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:28.969431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:28.969716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:28.970006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.009778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:29.011056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:29.035592 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1779/3536] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:29.039527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:29.060607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038ecb73-fbe7-4b79-a52f-25fe270e3f4f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:29.071461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:29.072299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.074987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.075290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.076150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:22:29.076443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:29.083391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:29.121076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1758/3537] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:22:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:22:29.122298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:29.152039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23ec3-00f2-4068-bde7-20dece4beb32 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:29.179975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:29.182526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.184520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.185087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.189860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:29.196266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:29.232583 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:29.249005 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1780/3538] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:29 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:29.254695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:29.291413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404b634-7ed1-44c4-8a4a-26a34bdf0805 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:29.446563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:29.448206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.448633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.449381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.450735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:29.457412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:29.526795 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1759/3539] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:29 2022] POST /identity/v3/users => generated 288 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:29.530074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:29.549326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9162f-a97c-4db6-bea2-a0da7bfa1d1f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:29.562779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:29.563979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.564907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.565342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.567096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:29.576138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:29.625400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1781/3540] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:29.629835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:29.671945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b8ef3-c95a-427f-97ea-5c72c39f3397 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:29.703935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17482faf-a396-47f2-bf5f-c59b5fa30223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:29.704872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482faf-a396-47f2-bf5f-c59b5fa30223 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.705161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482faf-a396-47f2-bf5f-c59b5fa30223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.705434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17482faf-a396-47f2-bf5f-c59b5fa30223 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.706198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482faf-a396-47f2-bf5f-c59b5fa30223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:29.707878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17482faf-a396-47f2-bf5f-c59b5fa30223 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:29.715188 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:29.737015 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1760/3541] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:22:29.742233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:29.760041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13313e92-401b-4693-8eb4-998977019d60 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:29.769085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:29.770674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.770961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.771239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] PATH_INFO: `/v3/projects/bb5e7697fcc14bd9beb8c8a2485a2a42/users/7ea1fb740a4f4e2587eda5aeb77ebb1d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.810765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb5e7697fcc14bd9beb8c8a2485a2a42, user_id=7ea1fb740a4f4e2587eda5aeb77ebb1d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:29.820377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:29.855713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1782/3542] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:29 2022] PUT /identity/v3/projects/bb5e7697fcc14bd9beb8c8a2485a2a42/users/7ea1fb740a4f4e2587eda5aeb77ebb1d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:22:29.869040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:29.869916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:29.870352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:29.930412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] MFA Rules not processed for user `7ea1fb740a4f4e2587eda5aeb77ebb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:29.931688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:30.081849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:30.083011 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1761/3543] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:30.286327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e83a4-8d91-43fa-89ef-b8e7ca934182 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:30.300596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:30.301364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.301776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.301971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:30.302608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:30.304576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:30.374162 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1783/3544] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:30 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:22:30.378483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:30.393727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d57e2-1223-48dc-8446-e23f98286aa4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:30.570279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:30.572451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.572957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.573414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:30.576693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:30.578978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:30.620673 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1762/3545] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:30 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:30.624760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:30.641088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61423d1-1a8a-4adc-ad67-b2881c79b32c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:30.646862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:30.647856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.648535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.649012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:30.650001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:30.651921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:30.672523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1784/3546] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:30.676720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:30.691816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4dbbf-e5d1-44ab-8a81-0800976542ef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:30.708121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:30.709301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.709685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.710060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] PATH_INFO: `/v3/projects/24c71837f1bb49e58c9d227a3e6009da/users/989a06bb223c42cdbbb785804ad49529/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:30.740214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c71837f1bb49e58c9d227a3e6009da, user_id=989a06bb223c42cdbbb785804ad49529, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:30.757109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:30.778194 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1763/3547] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:30 2022] PUT /identity/v3/projects/24c71837f1bb49e58c9d227a3e6009da/users/989a06bb223c42cdbbb785804ad49529/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:30.779450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:30.791607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04c038-ac02-4dd6-8a75-e092c975f7cd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:30.880718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fedb78-0ae1-4bf0-823e-a4f58358fb5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:30.881814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedb78-0ae1-4bf0-823e-a4f58358fb5d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.882273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedb78-0ae1-4bf0-823e-a4f58358fb5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.882773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fedb78-0ae1-4bf0-823e-a4f58358fb5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:30.883741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedb78-0ae1-4bf0-823e-a4f58358fb5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:30.885847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fedb78-0ae1-4bf0-823e-a4f58358fb5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:30.898419 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1785/3548] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:22:30.904177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:30.920623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c503a65-c27c-4dd9-b72e-9a07f6f3c74d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:30.929334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b30956-96ed-4248-854a-4c5652e84073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:30.931164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b30956-96ed-4248-854a-4c5652e84073 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.931622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b30956-96ed-4248-854a-4c5652e84073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.932090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b30956-96ed-4248-854a-4c5652e84073 admin admin] PATH_INFO: `/v3/projects/24c71837f1bb49e58c9d227a3e6009da/users/989a06bb223c42cdbbb785804ad49529/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:30.935106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b30956-96ed-4248-854a-4c5652e84073 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24c71837f1bb49e58c9d227a3e6009da, user_id=989a06bb223c42cdbbb785804ad49529, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:30.938843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b30956-96ed-4248-854a-4c5652e84073 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:30.966529 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1764/3549] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:30 2022] PUT /identity/v3/projects/24c71837f1bb49e58c9d227a3e6009da/users/989a06bb223c42cdbbb785804ad49529/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:30.968402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:30.969001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:30.969547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:31.003962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] MFA Rules not processed for user `989a06bb223c42cdbbb785804ad49529`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:31.005811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:31.031040 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:31.141206 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1786/3550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:31.147733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:31.148050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:31.148307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:31.169339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] MFA Rules not processed for user `7ea1fb740a4f4e2587eda5aeb77ebb1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:31.170628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:31.211892 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:31.252305 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1765/3551] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:31.415333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:31.417027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:31.568906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f8d04-b7bb-44b6-be5d-765972534843 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:31.582760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:31.583456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:31.584235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:31.584553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:31.608314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:31.611386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:31.642909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1787/3552] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:31.672592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:31.674412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:31.796382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63440637-ae57-42c6-a25f-9c3c8f4216c6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:31.803116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:31.804526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:31.804884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:31.805234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] PATH_INFO: `/v3/users/70dd4df198264571978250f31b491cae` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:31.807878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] RBAC: Authorizing `identity:delete_user(user_id=70dd4df198264571978250f31b491cae)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:31.810285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:31.882918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70dd4df198264571978250f31b491cae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:31.896444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70dd4df198264571978250f31b491cae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:31.927970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70dd4df198264571978250f31b491cae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:31.928764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70dd4df198264571978250f31b491cae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:31.941144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ee89a76-7a47-47d3-9355-434c7c96393a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70dd4df198264571978250f31b491cae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:31.954597 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1766/3553] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:31 2022] DELETE /identity/v3/users/70dd4df198264571978250f31b491cae => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:32.884400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:32.897694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c251b43f-1734-4380-a5c9-f5db6ed550d4 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:33.029491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:33.030871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.031167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.031449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] PATH_INFO: `/v3/projects/32a799d27c634bd38a48cf668ea0a2ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.033651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a799d27c634bd38a48cf668ea0a2ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:33.036787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:33.110284 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:33.116199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a799d27c634bd38a48cf668ea0a2ee', 'request_id': 'req-3dc69198-d11e-4389-89d1-ea8291e5ffd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:33.127790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a799d27c634bd38a48cf668ea0a2ee', 'request_id': 'req-3dc69198-d11e-4389-89d1-ea8291e5ffd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:33.136572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a799d27c634bd38a48cf668ea0a2ee', 'request_id': 'req-3dc69198-d11e-4389-89d1-ea8291e5ffd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:33.181962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] The token cache is being invalidate because project 32a799d27c634bd38a48cf668ea0a2ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:33.182266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:33.184679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3dc69198-d11e-4389-89d1-ea8291e5ffd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:33.194999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1788/3554] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:32 2022] DELETE /identity/v3/projects/32a799d27c634bd38a48cf668ea0a2ee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:22:33.197772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.198259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.198359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.244554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:33.245807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:33.432821 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1767/3555] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:33.435501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.435869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.436921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.481917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:33.487323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:33.508899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1789/3556] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:33.510526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:33.517176 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:33.523961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9d9a5-34e7-4532-870f-a84c9c56c64c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:33.542706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:33.542989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.543276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.543460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.544215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:22:33.545121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:33.549459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:33.579830 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1768/3557] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:22:33.580088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:33.596590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e156efb-bd4c-4874-b293-7353c530698b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:33.608706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:33.609401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.609766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.609949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.610651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:33.612629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:33.666044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1790/3558] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:33 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:22:33.670158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:33.724112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a78df7-44a0-4cce-8bfc-2cc05a541578 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:33.856541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:33.858251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.858646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.859022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.860475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:33.862931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:33.941680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:33.944047 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1769/3559] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:33 2022] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:33.979234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5c8e0e-f76e-49c0-9d75-1f1fc213888b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:33.992989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:33.994401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:33.994899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:33.995371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:33.996404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:34.000829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:34.019834 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1791/3560] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:34.027418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:34.044750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fe232c-01fc-4c3f-8252-3db12ecb60bd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:34.062073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37e16f-3000-4312-8c86-fe9431443616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:34.064236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e16f-3000-4312-8c86-fe9431443616 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:34.064670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e16f-3000-4312-8c86-fe9431443616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:34.066592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37e16f-3000-4312-8c86-fe9431443616 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:34.067711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37e16f-3000-4312-8c86-fe9431443616 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:34.071570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37e16f-3000-4312-8c86-fe9431443616 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:34.105572 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1770/3561] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:34.110299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:34.140162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502b9ea-c8b9-4278-9f5f-2821fe9e801b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:34.155843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:34.157801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:34.158780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:34.159903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] PATH_INFO: `/v3/projects/d582e674a2074ba2bc77e76f9bb78fe9/users/853162e1868045b4b5e6af9c03c461bf/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:34.198326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d582e674a2074ba2bc77e76f9bb78fe9, user_id=853162e1868045b4b5e6af9c03c461bf, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:34.220487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:34.252623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1792/3562] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:34 2022] PUT /identity/v3/projects/d582e674a2074ba2bc77e76f9bb78fe9/users/853162e1868045b4b5e6af9c03c461bf/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:34.254510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:34.254977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:34.255100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:34.287381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:34.288669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:34.427731 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1771/3563] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:34.464209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:34.467673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:34.576759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dcfa9e-91fe-4866-9d70-7fa8fdc1d3cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:34.584704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:34.584973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:34.585201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:34.585485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:34.613796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:34.615419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:34.645982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1793/3564] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:36.706934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:36.709060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:36.877978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f27cc-828f-4e8f-9285-0a723b86b596 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:36.894180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:36.894963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:36.895304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:36.897533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:36.902517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:36.945844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:36.950076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:36.966537 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:36.992982 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1772/3565] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:37.243020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:37.245041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:37.269671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a074d780-bf89-41ac-8e6d-6e948cf193ab service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:37.301017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:37.302737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:37.303666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:37.305768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] PATH_INFO: `/v3/users/9c4ef65e911a45aa847ad4db8fb70b40` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:37.309616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c4ef65e911a45aa847ad4db8fb70b40)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:37.316528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:37.418613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c4ef65e911a45aa847ad4db8fb70b40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:37.419733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c4ef65e911a45aa847ad4db8fb70b40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:37.429452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c4ef65e911a45aa847ad4db8fb70b40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:37.430648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c4ef65e911a45aa847ad4db8fb70b40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:37.443791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c4ef65e911a45aa847ad4db8fb70b40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:37.465685 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=84,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:37.522464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1794/3566] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:37 2022] DELETE /identity/v3/users/9c4ef65e911a45aa847ad4db8fb70b40 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:22:38.904760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:38.921891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f2757-9ae2-4e80-b13c-897812bf6afb service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:39.105092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:39.105996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:39.106270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:39.106595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] PATH_INFO: `/v3/projects/54b0f89e932d4603a351f8296bed784d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:39.122710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] RBAC: Authorizing `identity:delete_project(project_id=54b0f89e932d4603a351f8296bed784d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:39.125323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:39.341401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54b0f89e932d4603a351f8296bed784d', 'request_id': 'req-0429c2ec-5031-42db-8427-e4965e73016b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.358258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54b0f89e932d4603a351f8296bed784d', 'request_id': 'req-0429c2ec-5031-42db-8427-e4965e73016b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.376091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54b0f89e932d4603a351f8296bed784d', 'request_id': 'req-0429c2ec-5031-42db-8427-e4965e73016b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.418975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] The token cache is being invalidate because project 54b0f89e932d4603a351f8296bed784d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:39.418975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.421007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.430501 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1773/3567] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:38 2022] DELETE /identity/v3/projects/54b0f89e932d4603a351f8296bed784d => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:39.431816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:39.433614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:39.465716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3706417f-c135-477a-b9f5-f19f882dfaa7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:39.626599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:39.627514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:39.627797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:39.628119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] PATH_INFO: `/v3/users/f2be54d258da4095a41edbdd04313c42` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:39.633070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2be54d258da4095a41edbdd04313c42)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:39.635228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:39.749194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2be54d258da4095a41edbdd04313c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.749859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2be54d258da4095a41edbdd04313c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.762493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2be54d258da4095a41edbdd04313c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.763568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2be54d258da4095a41edbdd04313c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.774728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0eb559ec-51d6-4e66-b369-a034f77e4c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2be54d258da4095a41edbdd04313c42'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:39.810279 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1795/3568] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:39 2022] DELETE /identity/v3/users/f2be54d258da4095a41edbdd04313c42 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:41.162982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:41.165156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:41.187251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429c2ec-5031-42db-8427-e4965e73016b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:41.349667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:41.350768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:41.351163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:41.351537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] PATH_INFO: `/v3/projects/7817e96b07464928a74c94f1e3610ca7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:41.354629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7817e96b07464928a74c94f1e3610ca7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:41.365504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:41.442284 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:41.462445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7817e96b07464928a74c94f1e3610ca7', 'request_id': 'req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:41.475339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7817e96b07464928a74c94f1e3610ca7', 'request_id': 'req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:41.488675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7817e96b07464928a74c94f1e3610ca7', 'request_id': 'req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:41.508747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] The token cache is being invalidate because project 7817e96b07464928a74c94f1e3610ca7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:41.509270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:41.510820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b7561e8d-f2d1-4ddf-9f07-ff1576c8f53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:41.520218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:41.521369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:41.521935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:41.524796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1774/3569] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:41 2022] DELETE /identity/v3/projects/7817e96b07464928a74c94f1e3610ca7 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:41.555254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:41.557424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:41.703490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:41.703805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:41.704082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:41.710882 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1796/3570] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:41.732158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:41.734847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:41.746717 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1775/3571] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:41.752248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:41.759460 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:41.775400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f22c-6b97-42a7-bda9-26241aefc2a2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:41.791365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:41.792377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:41.792892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:41.793172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:41.793955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:22:41.794488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:41.797904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:41.833731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:41.846515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1797/3572] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:22:41.851361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5293b8-3912-4dc9-854f-0b45e94e703c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:41.875213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:41.876525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:41.877213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:41.877604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:41.878958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:41.883790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:41.975882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1776/3573] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:41 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:41.983293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:42.025888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538acb8-39d4-4c55-a1b6-56b0b757b3ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:42.272382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:42.274030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:42.274937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:42.275546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:42.276996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:42.287632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:42.365431 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1798/3574] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:41 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:42.369317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:42.390138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7b5fc7-3df5-4b97-bcf2-a03d24b68a3a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:42.406115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:42.406823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:42.412739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:42.413092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:42.420940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:42.422704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:42.444280 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1777/3575] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:42.448909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:42.468321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87007df-872d-488c-a78c-94bc07270030 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:42.474356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55dba0-b448-41d8-9cc9-efc1ae8bcaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:42.475054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55dba0-b448-41d8-9cc9-efc1ae8bcaa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:42.475339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55dba0-b448-41d8-9cc9-efc1ae8bcaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:42.475615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55dba0-b448-41d8-9cc9-efc1ae8bcaa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:42.476681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55dba0-b448-41d8-9cc9-efc1ae8bcaa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:42.478357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55dba0-b448-41d8-9cc9-efc1ae8bcaa7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:42.509954 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1799/3576] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:42.510686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:42.524815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d4cf91-7bb6-4a42-ad13-8417f90021df admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:42.545719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:42.546928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:42.547214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:42.547491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] PATH_INFO: `/v3/projects/f18db72acebd4977b4c125f4a86b7fea/users/9f00e393175d41d0b808428c219bed25/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:42.578565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18db72acebd4977b4c125f4a86b7fea, user_id=9f00e393175d41d0b808428c219bed25, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:42.582047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:42.614728 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1778/3577] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:42 2022] PUT /identity/v3/projects/f18db72acebd4977b4c125f4a86b7fea/users/9f00e393175d41d0b808428c219bed25/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:42.616204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4b8dd-03b2-449a-9435-c302aceb64d3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:42.616773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4b8dd-03b2-449a-9435-c302aceb64d3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:42.616773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4b8dd-03b2-449a-9435-c302aceb64d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:42.670276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-51d4b8dd-03b2-449a-9435-c302aceb64d3 None None] MFA Rules not processed for user `9f00e393175d41d0b808428c219bed25`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:42.671939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51d4b8dd-03b2-449a-9435-c302aceb64d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:42.873598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1800/3578] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:43.001135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:43.003527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:43.206285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf36128-ce2a-4b8b-9fe2-ddc7f1cbcd6c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:43.219902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:43.220632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:43.220914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:43.221186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:43.236326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:43.238248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:43.261003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1779/3579] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:43.592961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e096-16ea-4bf2-89e3-cb95e877cc87 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:43.593278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e096-16ea-4bf2-89e3-cb95e877cc87 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:43.593567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299e096-16ea-4bf2-89e3-cb95e877cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:43.638643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0299e096-16ea-4bf2-89e3-cb95e877cc87 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:43.640115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0299e096-16ea-4bf2-89e3-cb95e877cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:43.906975 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1801/3580] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:22:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:43.924063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:43.931395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:44.141059 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:44.241611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0935bc-137b-4119-b086-b16c13552e3b service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:44.270847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d444de-28b0-40d6-95da-6955e22659ca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:44.272703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d444de-28b0-40d6-95da-6955e22659ca service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:44.272703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d444de-28b0-40d6-95da-6955e22659ca service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:44.272703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d444de-28b0-40d6-95da-6955e22659ca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:44.312413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d444de-28b0-40d6-95da-6955e22659ca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:44.314350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d444de-28b0-40d6-95da-6955e22659ca service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:44.350135 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1780/3581] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:22:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:22:44.628917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:44.629113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:44.629387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:44.645892 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:44.673237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] MFA Rules not processed for user `9f00e393175d41d0b808428c219bed25`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:44.674497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:44.700153 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1802/3582] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:44 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:45.527773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:45.530774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:45.531118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:45.565222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:45.567410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:45.582900 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1781/3583] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:22:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:45.601043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:45.619877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ddbfb-55c7-4782-a409-dddbc3c3e5e9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:45.628198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb86fd-fdf3-4f69-9195-26ab2cfa702d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:45.629336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb86fd-fdf3-4f69-9195-26ab2cfa702d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:45.629662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb86fd-fdf3-4f69-9195-26ab2cfa702d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:45.630003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb86fd-fdf3-4f69-9195-26ab2cfa702d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:45.640117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb86fd-fdf3-4f69-9195-26ab2cfa702d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:45.642052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb86fd-fdf3-4f69-9195-26ab2cfa702d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:45.659507 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1803/3584] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:22:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:22:45.808013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:46.185027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b97dba-f098-4ed8-ac46-e4ee124044ce None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:46.194167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:46.196741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:46.206140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:46.206829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] PATH_INFO: `/v3/users/9f00e393175d41d0b808428c219bed25` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:46.208746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f00e393175d41d0b808428c219bed25)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:46.212312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:46.303020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f00e393175d41d0b808428c219bed25'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:46.318830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f00e393175d41d0b808428c219bed25'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:46.350910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f00e393175d41d0b808428c219bed25'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:46.352948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f00e393175d41d0b808428c219bed25'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:46.403721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f00e393175d41d0b808428c219bed25'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:46.417815 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1782/3585] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:45 2022] DELETE /identity/v3/users/9f00e393175d41d0b808428c219bed25 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:46.429551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7453d3-e76f-431b-be54-e86faee71161 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:46.429986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7453d3-e76f-431b-be54-e86faee71161 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:46.430323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7453d3-e76f-431b-be54-e86faee71161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:46.480136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1b7453d3-e76f-431b-be54-e86faee71161 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:46.491698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b7453d3-e76f-431b-be54-e86faee71161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:46.652994 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1804/3586] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:46.704993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:46.709802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:46.876151 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:46.899205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bfc9c-3f6c-4dd1-b018-43df19944e18 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:46.903125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:46.903819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:46.904101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:46.904455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:46.920438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:46.922450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:46.939104 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1783/3587] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:47.100266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:47.101401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:47.102040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:47.144466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] MFA Rules not processed for user `6b55d40fdca647f6b71025469def6742`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:47.146113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:47.436262 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1805/3588] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:47.453905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:47.455718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:47.582237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263f51a-ac04-42e6-b957-5fc547de7d58 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:47.595101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:47.595921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:47.596397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:47.596851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:47.600981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:47.751802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:47.753438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a0026-236d-469e-b085-09fd92ff34fd service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:47.779939 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1784/3589] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:48.108234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:48.110337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:48.139438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2fa1b0-1c9c-43f0-b5b1-f089554e7657 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:48.160706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:48.166645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:48.176915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:48.177196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] PATH_INFO: `/v3/projects/f18db72acebd4977b4c125f4a86b7fea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:48.178859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18db72acebd4977b4c125f4a86b7fea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:48.181095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:48.287564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18db72acebd4977b4c125f4a86b7fea', 'request_id': 'req-71b3c7cf-9e3d-4b87-9253-b1745be08c25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:48.308277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18db72acebd4977b4c125f4a86b7fea', 'request_id': 'req-71b3c7cf-9e3d-4b87-9253-b1745be08c25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:48.318771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18db72acebd4977b4c125f4a86b7fea', 'request_id': 'req-71b3c7cf-9e3d-4b87-9253-b1745be08c25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:48.322568 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:48.347121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] The token cache is being invalidate because project f18db72acebd4977b4c125f4a86b7fea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:48.347721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:48.348680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-71b3c7cf-9e3d-4b87-9253-b1745be08c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:48.352513 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1806/3590] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:48 2022] DELETE /identity/v3/projects/f18db72acebd4977b4c125f4a86b7fea => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:48.358864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:48.359278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:48.359610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:48.397847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:48.399123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:48.619063 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1785/3591] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:48.628968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:48.629443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:48.629798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:48.697310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:48.703427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:48.733047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1807/3592] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:48.734562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:48.763543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ec6d1-7f8c-4b58-82cd-c1f08891e5d1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:48.775548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:48.776264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:48.776574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:48.777954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:48.780694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:22:48.781459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:48.786561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:48.826416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1786/3593] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:22:48.829364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:48.852137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d29b70-c6c6-492d-82d3-810834612fca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:48.866180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:48.871659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:48.871970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:48.872646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:48.878199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:48.883722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:48.955033 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1808/3594] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:48 2022] POST /identity/v3/projects => generated 379 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:48.956370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:48.972577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c68c13-d6c2-42d5-a201-28c6ef61a5a0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:49.035031 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:49.067489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:49.068596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:49.069066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:49.069717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:49.070699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:49.073631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:49.123166 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1787/3595] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:48 2022] POST /identity/v3/users => generated 290 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:49.125296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:49.145708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350e2691-a930-4003-bed1-018a75cad3c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:49.158703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:49.159551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:49.159840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:49.160118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:49.163384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:49.165191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:49.197343 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1809/3596] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:49.202609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:49.230701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7ce996-ebf3-4352-8d43-2e59fc8e9667 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:49.257867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854d524d-7755-4ee5-8166-725cb273e415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:49.258694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d524d-7755-4ee5-8166-725cb273e415 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:49.258975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d524d-7755-4ee5-8166-725cb273e415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:49.259265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854d524d-7755-4ee5-8166-725cb273e415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:49.260113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d524d-7755-4ee5-8166-725cb273e415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:49.262390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854d524d-7755-4ee5-8166-725cb273e415 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:49.309550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:49.312326 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1788/3597] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:49.329663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b065088-be46-48fc-be93-c4fb6ccccc84 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:49.359455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:49.360457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:49.360744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:49.361021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] PATH_INFO: `/v3/projects/7b3bb3567486491da3ff49ebf35175ef/users/536470cc9f3947c7bcda32830d75370c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:49.424666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b3bb3567486491da3ff49ebf35175ef, user_id=536470cc9f3947c7bcda32830d75370c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:49.427525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:49.460061 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1810/3598] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:49 2022] PUT /identity/v3/projects/7b3bb3567486491da3ff49ebf35175ef/users/536470cc9f3947c7bcda32830d75370c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:22:49.471989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:49.472531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:49.473014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:49.515860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] MFA Rules not processed for user `536470cc9f3947c7bcda32830d75370c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:49.517268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:49.644233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1789/3599] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:49.676770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:49.678634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:49.869636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9131d-3a5b-4e3a-9331-d8c6bb193743 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:49.886577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b98612-adb3-4b91-b09a-9b3b43b5a4c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:49.887599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98612-adb3-4b91-b09a-9b3b43b5a4c1 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:49.887909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98612-adb3-4b91-b09a-9b3b43b5a4c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:49.888225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b98612-adb3-4b91-b09a-9b3b43b5a4c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:49.911256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98612-adb3-4b91-b09a-9b3b43b5a4c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:49.920863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b98612-adb3-4b91-b09a-9b3b43b5a4c1 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:49.963885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1811/3600] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:50.064598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:50.341737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787387bb-9beb-4e67-8326-908de4ad9dec None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:50.365475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:50.367067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:50.367577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:50.368140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] PATH_INFO: `/v3/users/536470cc9f3947c7bcda32830d75370c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:50.374045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] RBAC: Authorizing `identity:delete_user(user_id=536470cc9f3947c7bcda32830d75370c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:50.378003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:50.513770 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:50.531557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536470cc9f3947c7bcda32830d75370c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:50.554760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536470cc9f3947c7bcda32830d75370c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:50.632481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536470cc9f3947c7bcda32830d75370c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:50.636294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536470cc9f3947c7bcda32830d75370c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:50.676035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536470cc9f3947c7bcda32830d75370c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:50.691777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1790/3601] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:22:50 2022] DELETE /identity/v3/users/536470cc9f3947c7bcda32830d75370c => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:50.694712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701c80b-faa7-415e-b266-3b814bdecbd7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:50.695260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701c80b-faa7-415e-b266-3b814bdecbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:50.695472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701c80b-faa7-415e-b266-3b814bdecbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:50.729183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0701c80b-faa7-415e-b266-3b814bdecbd7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:50.732645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0701c80b-faa7-415e-b266-3b814bdecbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:51.020314 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1812/3602] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:51.074222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:51.075779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:51.240759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fbc5d-204b-41c1-b447-1bd893f5351f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:51.250965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d373a5e-f32e-4d6c-8025-d4b231fbce1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:51.254797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d373a5e-f32e-4d6c-8025-d4b231fbce1a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:51.255995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d373a5e-f32e-4d6c-8025-d4b231fbce1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:51.256649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d373a5e-f32e-4d6c-8025-d4b231fbce1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:51.298925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d373a5e-f32e-4d6c-8025-d4b231fbce1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:51.301212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d373a5e-f32e-4d6c-8025-d4b231fbce1a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:51.326090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1791/3603] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:52.134528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414862da-f49b-4371-bf4a-a1d73a8a49ea None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:52.135576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414862da-f49b-4371-bf4a-a1d73a8a49ea None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:52.136079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414862da-f49b-4371-bf4a-a1d73a8a49ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:52.255015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-414862da-f49b-4371-bf4a-a1d73a8a49ea None None] MFA Rules not processed for user `853162e1868045b4b5e6af9c03c461bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:52.257551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-414862da-f49b-4371-bf4a-a1d73a8a49ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:52.275854 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:52.516409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:52.517534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:52.518093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:52.524640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1813/3604] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:52.563242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] MFA Rules not processed for user `da0bfcb32bea448eb22f4aab2b99d796`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:52.565360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:52.791820 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1792/3605] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:52.805586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:52.805970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:52.806186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:52.860326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] MFA Rules not processed for user `da0bfcb32bea448eb22f4aab2b99d796`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:52.864267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:52.899640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1814/3606] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:52.966343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:52.970980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:52.994296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:52.996219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:53.014361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156bb37d-0c99-4fb4-871d-5bde84689545 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:53.026619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:53.029544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:53.030395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:53.032879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] PATH_INFO: `/v3/projects/7b3bb3567486491da3ff49ebf35175ef` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:53.037967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b3bb3567486491da3ff49ebf35175ef)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:53.040462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:53.202840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5882bc-17d9-4f06-87e7-f6bb3d6eb7da None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:53.226685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b3bb3567486491da3ff49ebf35175ef', 'request_id': 'req-eb1b1420-70e8-4fc3-a291-8f198b200a51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:53.243091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b3bb3567486491da3ff49ebf35175ef', 'request_id': 'req-eb1b1420-70e8-4fc3-a291-8f198b200a51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:53.249326 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:53.277917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b3bb3567486491da3ff49ebf35175ef', 'request_id': 'req-eb1b1420-70e8-4fc3-a291-8f198b200a51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:53.313632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] The token cache is being invalidate because project 7b3bb3567486491da3ff49ebf35175ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:22:53.313832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:53.319126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb1b1420-70e8-4fc3-a291-8f198b200a51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:22:53.324630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1793/3607] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:22:52 2022] DELETE /identity/v3/projects/7b3bb3567486491da3ff49ebf35175ef => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:22:53.329991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a1db-802e-464c-bcea-8c0eaef2a1aa None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:53.330319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a1db-802e-464c-bcea-8c0eaef2a1aa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:53.330553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a1db-802e-464c-bcea-8c0eaef2a1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:53.404601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7582a1db-802e-464c-bcea-8c0eaef2a1aa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:53.411530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7582a1db-802e-464c-bcea-8c0eaef2a1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:53.526640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:53.527490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:53.531184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:53.531184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:53.561710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:53.677206 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1794/3608] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:53.697258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:53.697548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:53.699117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:53.748278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:53.752013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:53.801687 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1795/3609] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:22:53.809110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:53.846443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da97e07-f308-49f1-aecd-351f97057374 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:53.875177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:53.876380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:53.880236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:53.881750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:53.882863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:22:53.886968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:53.891508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:53.945307 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1796/3610] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:22:53.953305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:53.997030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd35bbf-a6eb-4718-8b21-f799a22d2755 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:54.027354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:54.029618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:54.032172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:54.034483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:54.035420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:54.047207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:54.071939 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:54.136046 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1797/3611] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:22:53 2022] POST /identity/v3/projects => generated 395 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:54.139517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:54.228263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:54.232383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:54.264638 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1815/3612] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:52 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 1270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:54.352718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a686500-1cde-4b00-82c1-a2ff1e5c5fd9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:54.361450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:54.362680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:54.363134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:54.363592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:54.364727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:54.367192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:54.414076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:54.415853 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1798/3613] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:22:54 2022] POST /identity/v3/users => generated 298 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:22:54.432301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778e0bf-e7d0-4cdb-a792-9fd14f0a7fab service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:54.448784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:54.459041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:54.459536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:54.462216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:54.463232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:54.466597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:54.516475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1816/3614] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:54.516726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:54.545717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732043d4-fd73-4063-8805-8a866eda9e10 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:54.592526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a9c1fc-4c65-4c87-8d03-9bfe0f510725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:54.596213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c1fc-4c65-4c87-8d03-9bfe0f510725 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:54.602553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c1fc-4c65-4c87-8d03-9bfe0f510725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:54.603314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a9c1fc-4c65-4c87-8d03-9bfe0f510725 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:54.608860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9c1fc-4c65-4c87-8d03-9bfe0f510725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:54.623636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a9c1fc-4c65-4c87-8d03-9bfe0f510725 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:54.701272 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1799/3615] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:22:54.704775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:54.716447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aecfa4-b509-413b-8802-6dfceb25bcfd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:54.733105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:54.734572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:54.734938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:54.735215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] PATH_INFO: `/v3/projects/1fdaaa6f4dec4ac48754893a83526bda/users/9878057539cd4f8ea0221739404019a5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:54.759864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fdaaa6f4dec4ac48754893a83526bda, user_id=9878057539cd4f8ea0221739404019a5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:54.762910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:54.791979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:54.792407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:54.792587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:54.794598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1817/3616] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:22:54 2022] PUT /identity/v3/projects/1fdaaa6f4dec4ac48754893a83526bda/users/9878057539cd4f8ea0221739404019a5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:22:54.815959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:22:54.821556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:54.849174 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:22:54.916922 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1800/3617] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:22:54.990670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:54.993324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:55.146567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f72a13-20c8-45b7-b05d-80fba095575c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:55.155158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac3546-5621-42b5-bc07-387a448e9410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:55.156141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac3546-5621-42b5-bc07-387a448e9410 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:55.158071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac3546-5621-42b5-bc07-387a448e9410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:55.158548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac3546-5621-42b5-bc07-387a448e9410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:55.196115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac3546-5621-42b5-bc07-387a448e9410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:55.207856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac3546-5621-42b5-bc07-387a448e9410 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:55.258294 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1818/3618] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:22:58.137139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:22:58.139037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:58.348437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329b3f-9430-4358-8fa0-c8622b3efd2e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:22:58.364573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:22:58.365392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:22:58.365774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:22:58.367116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:22:58.376504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:22:58.524810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:22:58.529104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:22:58.555344 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1801/3619] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:22:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:00.191802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d745bb-700a-4a23-bc70-28c752c51451 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:00.195643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d745bb-700a-4a23-bc70-28c752c51451 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:00.199675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d745bb-700a-4a23-bc70-28c752c51451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:00.268300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-28d745bb-700a-4a23-bc70-28c752c51451 None None] MFA Rules not processed for user `853162e1868045b4b5e6af9c03c461bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:00.269574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-28d745bb-700a-4a23-bc70-28c752c51451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:00.490925 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1819/3620] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:04.759396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:04.795787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46675d62-8818-402a-93b0-d188b8d144ec service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:04.827445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:04.832166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:04.832699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:04.841290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:04.853268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:04.898324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:04.900960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:04.929585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1802/3621] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:05.206895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:05.207399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:05.207490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:05.290196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] MFA Rules not processed for user `9878057539cd4f8ea0221739404019a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:05.291959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:05.421119 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:05.591911 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1820/3622] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:05.812829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:05.815355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:05.849569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60f969-be2a-42c4-9196-429fb507f1ca service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:05.874740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853b5d6-8c77-401c-8293-0c367000315d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:05.876643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b5d6-8c77-401c-8293-0c367000315d service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:05.877101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b5d6-8c77-401c-8293-0c367000315d service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:05.877733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853b5d6-8c77-401c-8293-0c367000315d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:05.894503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853b5d6-8c77-401c-8293-0c367000315d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:05.897726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853b5d6-8c77-401c-8293-0c367000315d service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:05.912876 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1803/3623] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:09.698706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:09.700237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:09.734893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29eb48-d366-4eae-9942-3b4e710919de None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:09.741394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:09.743003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:09.743692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:09.744752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] PATH_INFO: `/v3/users/7ea1fb740a4f4e2587eda5aeb77ebb1d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:09.746541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ea1fb740a4f4e2587eda5aeb77ebb1d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:09.749612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:09.899157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ea1fb740a4f4e2587eda5aeb77ebb1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:09.899786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ea1fb740a4f4e2587eda5aeb77ebb1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:09.927500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ea1fb740a4f4e2587eda5aeb77ebb1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:09.928207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ea1fb740a4f4e2587eda5aeb77ebb1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:09.948786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ea1fb740a4f4e2587eda5aeb77ebb1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:10.022754 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1821/3624] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:09 2022] DELETE /identity/v3/users/7ea1fb740a4f4e2587eda5aeb77ebb1d => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:10.029038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:10.029601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:10.029601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:10.076292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:10.079996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:10.121506 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:10.259419 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1804/3625] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:10.296669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:10.299356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:10.579013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b991e3-efe3-485c-9cc0-ac5895a30adc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:10.588184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:10.590200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:10.591012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:10.591721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:10.677037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:10.680708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:10.724441 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1822/3626] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:15.141511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:15.143933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:15.160983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8770be-00f2-448b-bf7a-72272dac204e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:15.168901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:15.170403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:15.170940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:15.171491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] PATH_INFO: `/v3/projects/bb5e7697fcc14bd9beb8c8a2485a2a42` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:15.173540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb5e7697fcc14bd9beb8c8a2485a2a42)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:15.178638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:15.331374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb5e7697fcc14bd9beb8c8a2485a2a42', 'request_id': 'req-bb203e07-1725-4e7a-9e4e-31be86b9af70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.366967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb5e7697fcc14bd9beb8c8a2485a2a42', 'request_id': 'req-bb203e07-1725-4e7a-9e4e-31be86b9af70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.388122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb5e7697fcc14bd9beb8c8a2485a2a42', 'request_id': 'req-bb203e07-1725-4e7a-9e4e-31be86b9af70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.444166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] The token cache is being invalidate because project bb5e7697fcc14bd9beb8c8a2485a2a42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:15.444491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.450415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.457823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:15.459033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1805/3627] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:15 2022] DELETE /identity/v3/projects/bb5e7697fcc14bd9beb8c8a2485a2a42 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:15.476783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4219ee9-d0cc-4ee8-9637-4fe78c8cf044 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:15.612654 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:15.634833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:15.636166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:15.636697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:15.637265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] PATH_INFO: `/v3/users/989a06bb223c42cdbbb785804ad49529` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:15.641085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] RBAC: Authorizing `identity:delete_user(user_id=989a06bb223c42cdbbb785804ad49529)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:15.643407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:15.808005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989a06bb223c42cdbbb785804ad49529'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.808794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989a06bb223c42cdbbb785804ad49529'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.830550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989a06bb223c42cdbbb785804ad49529'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.831240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989a06bb223c42cdbbb785804ad49529'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.862123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-623e21af-2eb5-4bd7-bd57-0653164fe83d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989a06bb223c42cdbbb785804ad49529'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:15.906062 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1823/3628] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:15 2022] DELETE /identity/v3/users/989a06bb223c42cdbbb785804ad49529 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:18.367290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:18.370582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:18.408009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb203e07-1725-4e7a-9e4e-31be86b9af70 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:18.592919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:18.594186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:18.594954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:18.595725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] PATH_INFO: `/v3/projects/24c71837f1bb49e58c9d227a3e6009da` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:18.599429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=24c71837f1bb49e58c9d227a3e6009da)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:18.612147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:18.705106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24c71837f1bb49e58c9d227a3e6009da', 'request_id': 'req-7a4d3890-558c-4954-8d50-555f2129b6cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:18.718094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24c71837f1bb49e58c9d227a3e6009da', 'request_id': 'req-7a4d3890-558c-4954-8d50-555f2129b6cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:18.723479 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:18.734548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24c71837f1bb49e58c9d227a3e6009da', 'request_id': 'req-7a4d3890-558c-4954-8d50-555f2129b6cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:18.755238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] The token cache is being invalidate because project 24c71837f1bb49e58c9d227a3e6009da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:18.756176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:18.757227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a4d3890-558c-4954-8d50-555f2129b6cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:18.764911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1806/3629] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:18 2022] DELETE /identity/v3/projects/24c71837f1bb49e58c9d227a3e6009da => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:18.766207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:18.766695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:18.766795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:18.825520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:18.827053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:19.000486 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1824/3630] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:19.008419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:19.008741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:19.009025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:19.077364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:19.078865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:19.110868 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1807/3631] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:19.115029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:19.139033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c303b8-31c9-41a0-aa13-f8a133399049 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:19.173243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:19.174155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:19.174555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:19.176802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:19.177904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:19.184874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:19.195824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:19.285075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:19.285469 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1825/3632] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:19.310491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf74a-0a87-4cc3-9766-73477ffb06f5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:19.325084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:19.325887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:19.326253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:19.326610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:19.327634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:19.335517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:19.410127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1808/3633] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:19 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:19.414423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:19.441410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d0999-a525-4c39-852c-8997cb2c2174 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:19.450869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:19.452652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:19.594600 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:19.604650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:19.611675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:19.612203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:19.612788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:19.613743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:19.617458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:19.622683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14593736-555d-42c5-bac7-792450a3b5d7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:19.635514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:19.636551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:19.636965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:19.637315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] PATH_INFO: `/v3/users/9f971aae812d42f69b5ba2caa8d32172` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:19.643437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f971aae812d42f69b5ba2caa8d32172)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:19.645818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:19.665064 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1826/3634] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:19 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:19.665948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:19.669872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:19.738966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f971aae812d42f69b5ba2caa8d32172'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:19.758078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f971aae812d42f69b5ba2caa8d32172'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:19.779518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f971aae812d42f69b5ba2caa8d32172'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:19.780482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f971aae812d42f69b5ba2caa8d32172'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:19.796666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f971aae812d42f69b5ba2caa8d32172'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:19.809957 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1809/3635] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:19 2022] DELETE /identity/v3/users/9f971aae812d42f69b5ba2caa8d32172 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:23:19.810815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:19.812240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:19.825621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b8089-c601-4107-a129-7356fdaaac59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:19.896251 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:19.985740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:19.986472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:19.986764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:19.987069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:19.991941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d1503-07a0-40e6-99b8-e0a103e81e6f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:19.995933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:20.019736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d9119-a9b8-41a5-a4e1-78a9059b4065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:20.020162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9119-a9b8-41a5-a4e1-78a9059b4065 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:20.020599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9119-a9b8-41a5-a4e1-78a9059b4065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:20.020958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d9119-a9b8-41a5-a4e1-78a9059b4065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:20.021911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d9119-a9b8-41a5-a4e1-78a9059b4065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:20.025117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d9119-a9b8-41a5-a4e1-78a9059b4065 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:20.072535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1810/3636] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:19 2022] GET /identity/v3/roles => generated 1420 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:20.074206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:20.092842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:20.093342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:20.151015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:20.152853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:20.169530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:20.177212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:20.180764 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1811/3637] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:20.184180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:20.203075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662bfd3-8b64-4919-a433-6a3ed33b6f9b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:20.223437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1827/3638] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:20.224537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:20.225123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:20.225506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:20.225889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:20.226846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:20.234086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:20.274074 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1812/3639] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:20.278711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:20.291739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:20.296867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:20.304478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd36a22-8b50-429e-b426-7bccd14cf3c8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:20.319186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd53f5-3d08-48b5-9cc6-6dd38a8c635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:20.321159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd53f5-3d08-48b5-9cc6-6dd38a8c635f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:20.321454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd53f5-3d08-48b5-9cc6-6dd38a8c635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:20.321733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd53f5-3d08-48b5-9cc6-6dd38a8c635f admin admin] PATH_INFO: `/v3/projects/69b7f95a9b654717af2277dcba7bc907/users/ecf0794c9fc9455a9605f1f6d30064f7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:20.328680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ac92b-1725-4878-80da-6c99fdd853f8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:20.342102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:20.342791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:20.343102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:20.343394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:20.364557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd53f5-3d08-48b5-9cc6-6dd38a8c635f admin admin] RBAC: Authorizing `identity:create_grant(project_id=69b7f95a9b654717af2277dcba7bc907, user_id=ecf0794c9fc9455a9605f1f6d30064f7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:20.367276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd53f5-3d08-48b5-9cc6-6dd38a8c635f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:20.377268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:20.378863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:20.401673 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1828/3640] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:20 2022] PUT /identity/v3/projects/69b7f95a9b654717af2277dcba7bc907/users/ecf0794c9fc9455a9605f1f6d30064f7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:20.402040 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1813/3641] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:20.411932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:20.412321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:20.412735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:20.464333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] MFA Rules not processed for user `ecf0794c9fc9455a9605f1f6d30064f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:20.465682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:20.483488 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:20.574281 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1829/3642] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:20.941363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:20.942914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:20.986390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4181d026-3fe1-4201-92e8-dbcd8f8c6bc6 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:21.093201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:21.100524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:21.237268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5a198-f63f-4ef2-b389-7ffc6bce9d3d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:21.244614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:21.245780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:21.246709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:21.247198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] PATH_INFO: `/v3/projects/59393c333eb3424a9cb978944371c7b3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:21.250118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=59393c333eb3424a9cb978944371c7b3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:21.253562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:21.324631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:21.325937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:21.329361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:21.329803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:21.333492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59393c333eb3424a9cb978944371c7b3', 'request_id': 'req-080ab3ee-68cf-411c-af1e-fd5a0d249aed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.343369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59393c333eb3424a9cb978944371c7b3', 'request_id': 'req-080ab3ee-68cf-411c-af1e-fd5a0d249aed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.352631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59393c333eb3424a9cb978944371c7b3', 'request_id': 'req-080ab3ee-68cf-411c-af1e-fd5a0d249aed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.353919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:21.360418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:21.380943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] The token cache is being invalidate because project 59393c333eb3424a9cb978944371c7b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:21.381182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.384211 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1814/3643] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:21.384700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.388931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1830/3644] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:21 2022] DELETE /identity/v3/projects/59393c333eb3424a9cb978944371c7b3 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:21.392889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:21.414520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b58860-18bd-43e0-b380-134bbdc19921 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:21.589289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:21.590404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:21.590692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:21.590971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] PATH_INFO: `/v3/users/5561ee7e7e134953ac387e8f7392f8f5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:21.593693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5561ee7e7e134953ac387e8f7392f8f5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:21.599139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:21.683221 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:21.757308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5561ee7e7e134953ac387e8f7392f8f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.792760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5561ee7e7e134953ac387e8f7392f8f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.845602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5561ee7e7e134953ac387e8f7392f8f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.848677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5561ee7e7e134953ac387e8f7392f8f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.876826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5561ee7e7e134953ac387e8f7392f8f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:21.932818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:21.935151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:21.939572 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1815/3645] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:21 2022] DELETE /identity/v3/users/5561ee7e7e134953ac387e8f7392f8f5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:21.965426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ab3ee-68cf-411c-af1e-fd5a0d249aed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:22.061277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:22.064709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:22.094746 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:22.151856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:22.152362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:22.152901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:22.155760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] PATH_INFO: `/v3/users/b1df83a1e36c4ad5b215d6964e1585e7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:22.166224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1df83a1e36c4ad5b215d6964e1585e7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:22.170825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:22.290802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1df83a1e36c4ad5b215d6964e1585e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.292229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1df83a1e36c4ad5b215d6964e1585e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.311015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1df83a1e36c4ad5b215d6964e1585e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.312196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1df83a1e36c4ad5b215d6964e1585e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.317129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa4dd4-71ad-43f3-a826-3587d0d300ef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:22.328286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:22.328939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a7e890d-c057-4a2d-a8c6-1231efad8ed1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1df83a1e36c4ad5b215d6964e1585e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.329241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:22.329526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:22.329804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] PATH_INFO: `/v3/users/9878057539cd4f8ea0221739404019a5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:22.335272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9878057539cd4f8ea0221739404019a5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:22.338331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:22.382250 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1831/3646] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:21 2022] DELETE /identity/v3/users/b1df83a1e36c4ad5b215d6964e1585e7 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:22.387896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:22.388185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:22.388665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:22.415852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] MFA Rules not processed for user `70628393aac8485fae89e5d50eac92f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:22.417833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:22.468155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9878057539cd4f8ea0221739404019a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.484955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9878057539cd4f8ea0221739404019a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.507726 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1832/3647] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:22.525833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9878057539cd4f8ea0221739404019a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.529249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9878057539cd4f8ea0221739404019a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.549579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9878057539cd4f8ea0221739404019a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:22.567691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1816/3648] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:22 2022] DELETE /identity/v3/users/9878057539cd4f8ea0221739404019a5 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:22.673598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:22.675378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:22.875244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:22.878106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:22.898039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36947d94-ab61-4b12-b3c7-27f6cefedcfd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:22.934812 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:22.991671 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:23.017778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.019443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.019914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.020413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] PATH_INFO: `/v3/projects/e4e2c6d7e802491d9d2e8cfadcee9e5d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.023956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4e2c6d7e802491d9d2e8cfadcee9e5d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.026342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.107896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f110f5-92d3-44e5-a870-803e14d197b3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.120668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4e2c6d7e802491d9d2e8cfadcee9e5d', 'request_id': 'req-f3a735a0-f604-46c6-b04a-de495aea2bb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.128703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4e2c6d7e802491d9d2e8cfadcee9e5d', 'request_id': 'req-f3a735a0-f604-46c6-b04a-de495aea2bb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.141072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4e2c6d7e802491d9d2e8cfadcee9e5d', 'request_id': 'req-f3a735a0-f604-46c6-b04a-de495aea2bb4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.166115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] The token cache is being invalidate because project e4e2c6d7e802491d9d2e8cfadcee9e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:23.166461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.167308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.170349 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1833/3649] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:22 2022] DELETE /identity/v3/projects/e4e2c6d7e802491d9d2e8cfadcee9e5d => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:23.171204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.173074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.225285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.226201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.226486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.226762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] PATH_INFO: `/v3/users/ecf0794c9fc9455a9605f1f6d30064f7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.228008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf0794c9fc9455a9605f1f6d30064f7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.230363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.265928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a735a0-f604-46c6-b04a-de495aea2bb4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.273240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.274377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.274744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.275022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] PATH_INFO: `/v3/projects/1fdaaa6f4dec4ac48754893a83526bda` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.276562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fdaaa6f4dec4ac48754893a83526bda)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.279213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.304216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf0794c9fc9455a9605f1f6d30064f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.319142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf0794c9fc9455a9605f1f6d30064f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.339827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf0794c9fc9455a9605f1f6d30064f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.340603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf0794c9fc9455a9605f1f6d30064f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.343822 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:23.348528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fdaaa6f4dec4ac48754893a83526bda', 'request_id': 'req-41599c14-6987-4b91-90c3-750a02b8b9f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.357665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec34bac3-aa90-4221-a6fe-143fcff3b46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf0794c9fc9455a9605f1f6d30064f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.359157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fdaaa6f4dec4ac48754893a83526bda', 'request_id': 'req-41599c14-6987-4b91-90c3-750a02b8b9f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.368306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fdaaa6f4dec4ac48754893a83526bda', 'request_id': 'req-41599c14-6987-4b91-90c3-750a02b8b9f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.376015 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1817/3650] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:22 2022] DELETE /identity/v3/users/ecf0794c9fc9455a9605f1f6d30064f7 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:23.377471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0aa2-cbb9-4dce-98ba-fea2b2db8369 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.377759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0aa2-cbb9-4dce-98ba-fea2b2db8369 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.378042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7a0aa2-cbb9-4dce-98ba-fea2b2db8369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.402268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] The token cache is being invalidate because project 1fdaaa6f4dec4ac48754893a83526bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:23.402860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.404783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-41599c14-6987-4b91-90c3-750a02b8b9f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:23.410256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1834/3651] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:23 2022] DELETE /identity/v3/projects/1fdaaa6f4dec4ac48754893a83526bda => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:23.414254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3a0c4-ed48-4b90-9d59-8d3eb171abf5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.418195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3a0c4-ed48-4b90-9d59-8d3eb171abf5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.418669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3a0c4-ed48-4b90-9d59-8d3eb171abf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.422950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1a7a0aa2-cbb9-4dce-98ba-fea2b2db8369 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:23.428116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a7a0aa2-cbb9-4dce-98ba-fea2b2db8369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.462801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-feb3a0c4-ed48-4b90-9d59-8d3eb171abf5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:23.464391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-feb3a0c4-ed48-4b90-9d59-8d3eb171abf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.548835 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:23.585793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1818/3652] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:23.591716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.591956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.592283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.599889 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1835/3653] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:23.602180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.611546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.612315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.636772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:23.638324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:23.639549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.639861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.650693 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1836/3654] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:23.652238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.654215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.657503 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1819/3655] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:23.658697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.669713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad50f6cf-8eed-4338-a40a-c15912f1f0e0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.675211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.675947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.676188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.676634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.677479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:23.677822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.679807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7a1ebd-1dc4-4161-b08a-2968f6d205bb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.719002 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1820/3656] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:23.720779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.721084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.722485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.758389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:23.760183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:23.776390 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1821/3657] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:23.781814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.801745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf13639-d4e0-4719-b2a0-4f10f877acc6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.804703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968c0341-af80-4ec7-8d97-e3699618d808 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.810550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.810803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.811475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.811762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.812043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.812372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.812793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.813067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.813866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.815094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.828137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.834689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.854560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1822/3658] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:23.854560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.869549 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1837/3659] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:23.870902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.897282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7e321-43db-4dc0-9cdf-dc909bff712d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.942336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc97c75-0bda-4526-b05c-19dc0a95e5b5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:23.949378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:23.950391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:23.950700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:23.951001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:23.951828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:23.952139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:23.954374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:23.974746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1823/3660] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:23.976096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:23.992992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab93456-80a4-474a-8914-0f670c3213dc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.010574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.012821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.013034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.015601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.018616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.024296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.077618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.078353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.078688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.083686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.084600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.091466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.097219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1824/3661] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/projects => generated 361 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:24.098540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.134379 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:24.149157 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1838/3662] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:23 2022] POST /identity/v3/users => generated 285 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:24.150720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.173452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1476bcc4-a6c6-4601-8242-086aa62e061d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.250856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.251695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.251980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.252394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.259306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.261774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.264543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e62ac6-5c32-43c4-b8a3-579642b81f4a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.273737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.274781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.275064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.275342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.276056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.278786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.279165 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1839/3663] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:24.280153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.310826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b09399-da7f-4d67-89ad-85aa47395823 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.323417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.324202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.324504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.324814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.325550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.327222 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1825/3664] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:24 2022] POST /identity/v3/users => generated 281 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:24.331458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.337811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.342214 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:24.359147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda7ccc-80b3-4fc6-8fb6-7a1805bc397f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.363108 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1840/3665] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:24.369269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.375740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:24.378050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.378882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.379332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.379668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.381068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.385276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.398547 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1826/3666] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:24.399762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.415689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077edcaf-1eea-4b44-86b0-54b0369b6c0f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.415856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da663ea5-8649-4192-bf5a-6393fa3061fa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.430578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.432193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.432864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.433158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] PATH_INFO: `/v3/projects/599536f2f5294ee3b50d2dea9e92f775` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.433365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.434750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.435035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.435311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] PATH_INFO: `/v3/projects/7600cf11293e47608037ed75f756076b/users/728a360b3fe04b5da276f9f63d2ddb7b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.439356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] RBAC: Authorizing `identity:delete_project(project_id=599536f2f5294ee3b50d2dea9e92f775)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.441341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.457534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7600cf11293e47608037ed75f756076b, user_id=728a360b3fe04b5da276f9f63d2ddb7b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.461913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.517895 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1827/3667] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:24 2022] PUT /identity/v3/projects/7600cf11293e47608037ed75f756076b/users/728a360b3fe04b5da276f9f63d2ddb7b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:24.532180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.532180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:24.547633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '599536f2f5294ee3b50d2dea9e92f775', 'request_id': 'req-12cea647-fd07-498d-b57b-daeeed39d330'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:24.583198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '599536f2f5294ee3b50d2dea9e92f775', 'request_id': 'req-12cea647-fd07-498d-b57b-daeeed39d330'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:24.606455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '599536f2f5294ee3b50d2dea9e92f775', 'request_id': 'req-12cea647-fd07-498d-b57b-daeeed39d330'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:24.634749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] The token cache is being invalidate because project 599536f2f5294ee3b50d2dea9e92f775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:24.635045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:24.636668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:24.645167 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1841/3668] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:24 2022] DELETE /identity/v3/projects/599536f2f5294ee3b50d2dea9e92f775 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:24.646757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:24.650784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:24.694347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74ae281-ef34-4f23-947d-ea01700fde64 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.813831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea647-fd07-498d-b57b-daeeed39d330 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:24.824976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a946f-9610-4d03-98ca-de18fd4a692b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.841681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a946f-9610-4d03-98ca-de18fd4a692b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.841681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a946f-9610-4d03-98ca-de18fd4a692b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.841681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a946f-9610-4d03-98ca-de18fd4a692b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.842682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a946f-9610-4d03-98ca-de18fd4a692b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.844014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35a946f-9610-4d03-98ca-de18fd4a692b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.863076 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1842/3669] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:24.865230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.865709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.866300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.868374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:24.873744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:24.874136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:24.874617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] PATH_INFO: `/v3/projects/69b7f95a9b654717af2277dcba7bc907` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:24.876308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69b7f95a9b654717af2277dcba7bc907)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:24.885366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:24.895482 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:24.987117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] MFA Rules not processed for user `728a360b3fe04b5da276f9f63d2ddb7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:24.992505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.006313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69b7f95a9b654717af2277dcba7bc907', 'request_id': 'req-daaf693a-c914-4418-8523-311cb2a0c281'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:25.027815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69b7f95a9b654717af2277dcba7bc907', 'request_id': 'req-daaf693a-c914-4418-8523-311cb2a0c281'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:25.038546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69b7f95a9b654717af2277dcba7bc907', 'request_id': 'req-daaf693a-c914-4418-8523-311cb2a0c281'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:25.071168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] The token cache is being invalidate because project 69b7f95a9b654717af2277dcba7bc907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:25.072213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:25.073197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-daaf693a-c914-4418-8523-311cb2a0c281 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:25.077165 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1828/3670] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:24 2022] DELETE /identity/v3/projects/69b7f95a9b654717af2277dcba7bc907 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:25.079073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b470-a693-4251-9f04-4d1dfc1e2fbe None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.079646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b470-a693-4251-9f04-4d1dfc1e2fbe None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.080128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5b470-a693-4251-9f04-4d1dfc1e2fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.111042 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:25.138913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-02c5b470-a693-4251-9f04-4d1dfc1e2fbe None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:25.145398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-02c5b470-a693-4251-9f04-4d1dfc1e2fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.194662 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1843/3671] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:25.195976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:25.198069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.281758 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1829/3672] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:25.283762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.284056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.285064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.341662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:25.351367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.374354 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1830/3673] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:25.375317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:25.381091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.411176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a565729-b997-45b6-ae8f-36b10289ac6b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:25.424759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:25.425791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.426074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.426349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] PATH_INFO: `/v3/projects/ff699851c1554646acd325bea241af1b/users/9f9e2995b25d4124adefeafac4f0aba6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.447226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff699851c1554646acd325bea241af1b, user_id=9f9e2995b25d4124adefeafac4f0aba6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:25.450129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:25.468171 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1844/3674] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:25 2022] PUT /identity/v3/projects/ff699851c1554646acd325bea241af1b/users/9f9e2995b25d4124adefeafac4f0aba6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:25.469177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:25.484790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.577534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431294b-7f42-4825-8472-cc5911d1c48f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:25.582952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abb7aa-716a-49d5-9d0e-4b51e91944b4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:25.594563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:25.595236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.595525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.595803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.600038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.681325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf5f64-a1eb-4741-8f37-bbba05a4d7a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:25.682012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5f64-a1eb-4741-8f37-bbba05a4d7a6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.682296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5f64-a1eb-4741-8f37-bbba05a4d7a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.682572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf5f64-a1eb-4741-8f37-bbba05a4d7a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.688100 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:25.751334 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:25.781329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:25.782822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7f810-f963-48b7-9031-ef2aa4556e79 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:25.801800 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1845/3675] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:25.803540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.803832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.804109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.804232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf5f64-a1eb-4741-8f37-bbba05a4d7a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:25.806216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf5f64-a1eb-4741-8f37-bbba05a4d7a6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:25.821484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1831/3676] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:25.823385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d95b12-f506-4c65-8f4d-86669fb08b62 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.823714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d95b12-f506-4c65-8f4d-86669fb08b62 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.824140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d95b12-f506-4c65-8f4d-86669fb08b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.854899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b9d95b12-f506-4c65-8f4d-86669fb08b62 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:25.856275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9d95b12-f506-4c65-8f4d-86669fb08b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.873480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:25.880907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:25.989035 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1832/3677] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:25.990944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:25.992551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:25.992836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:25.999711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1846/3678] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:26.002705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.028814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1806d84c-5570-4b5b-8040-5102484850ee None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.045226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.045814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.046103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.046537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.048554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:26.048951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.055699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] MFA Rules not processed for user `9f9e2995b25d4124adefeafac4f0aba6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:26.057096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:26.064695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.098795 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1847/3679] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:26.112230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.139197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf869b07-075f-4137-af3d-6fb0bde53344 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.146205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1833/3680] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:26.146205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.152047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.152771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.153074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.153407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.154062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:26.154365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.155990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.160488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e28aad7-b3ab-4f3c-9bfe-2fbfc3d22f4a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.165919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.166843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.167316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.167857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.168930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.171066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.194095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1848/3681] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:26.195713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.212866 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1834/3682] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:26 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:26.214200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.218529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e88f9bc-7624-467a-87c2-89a795d85156 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.289991 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:26.350684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363bc800-6b06-4f5d-af95-df309c64c060 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.368068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.369976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.370262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.370538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.371294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.374021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.385456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.386183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.386561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.386838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.389982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.395263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.430886 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1835/3683] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:26 2022] POST /identity/v3/users => generated 287 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:26.461427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.470143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:26.474380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1849/3684] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:26 2022] POST /identity/v3/projects => generated 397 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:23:26.474380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.516868 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:26.650500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704d955f-0565-4874-9499-75c2b4bf9b3f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.666741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.668187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.668660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.669095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.671682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.673555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.706711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1850/3685] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:26.708702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.711910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c03ab-68ac-4deb-9f03-cee7f9ceb087 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.734870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9996e-3db4-4fcb-ae9a-55036f01f14c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.750553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.751927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.752453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.752930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.753855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.763261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.818248 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1851/3686] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:26 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:26.822260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.848950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a0dd8-b543-4e97-a852-654b568f6bcd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.859621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.860540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.861338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.862366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.874004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.874004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:26.909269 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1852/3687] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:26.909269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:26.935515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb70abaf-ae04-4cdc-9f84-8daa9705772a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:26.948807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.949847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449cf301-5a78-442b-8c37-e1ee0b00efb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:26.953338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.953338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.953338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.953338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:26.954974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cf301-5a78-442b-8c37-e1ee0b00efb7 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:26.955497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cf301-5a78-442b-8c37-e1ee0b00efb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:26.956796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449cf301-5a78-442b-8c37-e1ee0b00efb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:26.958238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.025873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1853/3688] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:26 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:27.025873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.043673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff452504-76f4-4524-b753-8d1a56d90035 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:27.052457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:27.058857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.058857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.058857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] PATH_INFO: `/v3/projects/2a637307d7fa43cb976744db1bced7b1/users/84a32ab882cb4a2fab13ae92367c7ad7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.095863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a637307d7fa43cb976744db1bced7b1, user_id=84a32ab882cb4a2fab13ae92367c7ad7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:27.101665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.125014 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1854/3689] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:27 2022] PUT /identity/v3/projects/2a637307d7fa43cb976744db1bced7b1/users/84a32ab882cb4a2fab13ae92367c7ad7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:27.125915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.143070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cf301-5a78-442b-8c37-e1ee0b00efb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:27.146212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449cf301-5a78-442b-8c37-e1ee0b00efb7 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.158546 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1836/3690] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 730 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:27.159983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.160202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.162910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.222392 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:27.249818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] MFA Rules not processed for user `84a32ab882cb4a2fab13ae92367c7ad7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:27.251509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:27.349501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e94e23-89cf-4cf5-92be-43a0a0bd9899 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:27.361627 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1837/3691] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:27.362291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.369700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:27.370423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.370799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.371077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.377625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed560331-3c9a-4603-b6fe-806a099cd494 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:27.378463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:27.384474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:27.385653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.386083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.386504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.386623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] PATH_INFO: `/v3/users/9f9e2995b25d4124adefeafac4f0aba6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.388447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f9e2995b25d4124adefeafac4f0aba6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:27.391231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.443947 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1855/3692] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:27 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:27.447796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.463805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ac531-d6ed-4885-975d-1427e8fcaf7c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:27.470359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5469ab-b31f-4046-882f-8f8dfc3df184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:27.471488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5469ab-b31f-4046-882f-8f8dfc3df184 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.471834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5469ab-b31f-4046-882f-8f8dfc3df184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.472120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5469ab-b31f-4046-882f-8f8dfc3df184 admin admin] PATH_INFO: `/v3/projects/33f74c29f6a54c7ab728e87c512a26dd/users/4afb43090cf943538345b1814e138fb9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.490098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5469ab-b31f-4046-882f-8f8dfc3df184 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33f74c29f6a54c7ab728e87c512a26dd, user_id=4afb43090cf943538345b1814e138fb9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:27.493610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5469ab-b31f-4046-882f-8f8dfc3df184 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.505054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f9e2995b25d4124adefeafac4f0aba6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:27.516176 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1856/3693] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:27 2022] PUT /identity/v3/projects/33f74c29f6a54c7ab728e87c512a26dd/users/4afb43090cf943538345b1814e138fb9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:27.522638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cf6e-8d1c-4012-9164-3eec854d323b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.523231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cf6e-8d1c-4012-9164-3eec854d323b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.523925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014cf6e-8d1c-4012-9164-3eec854d323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.526208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f9e2995b25d4124adefeafac4f0aba6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:27.551708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8014cf6e-8d1c-4012-9164-3eec854d323b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:27.553305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8014cf6e-8d1c-4012-9164-3eec854d323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:27.557831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f9e2995b25d4124adefeafac4f0aba6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:27.558839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f9e2995b25d4124adefeafac4f0aba6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:27.575857 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:27.584956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f9e2995b25d4124adefeafac4f0aba6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:27.595823 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1838/3694] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:27 2022] DELETE /identity/v3/users/9f9e2995b25d4124adefeafac4f0aba6 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:27.599553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.601174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:27.707995 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1857/3695] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:27.709623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd081058-410b-47df-8873-61862e01a6db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.710221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd081058-410b-47df-8873-61862e01a6db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.710747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd081058-410b-47df-8873-61862e01a6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.746230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39673647-7342-4f22-8ae8-57d2a24b52d6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:27.748285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd081058-410b-47df-8873-61862e01a6db None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:27.751935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd081058-410b-47df-8873-61862e01a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:27.758493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:27.759446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:27.760018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:27.764532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:27.768222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:27.787629 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:27.906606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:27.908624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:27.922990 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1839/3696] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:27.923872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.925422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:27.929880 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1858/3697] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:27.957730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd081058-410b-47df-8873-61862e01a6db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:27.961667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd081058-410b-47df-8873-61862e01a6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:28.091564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8329a-fee3-4f5a-aebd-0e73ebcd4286 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:28.104132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:28.105334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:28.105624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:28.107360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:28.111396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd081058-410b-47df-8873-61862e01a6db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:28.117355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3e40f-79ac-41fd-8b27-1dd6ac1520dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:28.118526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e40f-79ac-41fd-8b27-1dd6ac1520dd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:28.124617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e40f-79ac-41fd-8b27-1dd6ac1520dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:28.124913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3e40f-79ac-41fd-8b27-1dd6ac1520dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:28.136784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:28.140546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:28.163613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3e40f-79ac-41fd-8b27-1dd6ac1520dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:28.165249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3e40f-79ac-41fd-8b27-1dd6ac1520dd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:28.168561 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1840/3698] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:28.205482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1859/3699] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:23:28.494542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:28.496545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:28.524461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409cf35-0696-48df-a47f-eb65f5b85f6c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:28.535668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:28.538450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:28.542818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:28.543101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] PATH_INFO: `/v3/users/728a360b3fe04b5da276f9f63d2ddb7b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:28.544745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=728a360b3fe04b5da276f9f63d2ddb7b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:28.548256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:28.657640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728a360b3fe04b5da276f9f63d2ddb7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:28.670362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728a360b3fe04b5da276f9f63d2ddb7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:28.713451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728a360b3fe04b5da276f9f63d2ddb7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:28.715428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728a360b3fe04b5da276f9f63d2ddb7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:28.744686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728a360b3fe04b5da276f9f63d2ddb7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:28.776335 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1841/3700] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:28 2022] DELETE /identity/v3/users/728a360b3fe04b5da276f9f63d2ddb7b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:28.780864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:28.781363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:28.781449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:28.826264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:28.828494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:28.961044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1860/3701] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:23:29.493970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:29.496178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:29.585460 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:29.669591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a709cc2-c2d7-4676-84f0-57607b7c6bdb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:29.678191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d76bc65-7bfd-492e-b6c4-58af36bba6f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:29.679300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76bc65-7bfd-492e-b6c4-58af36bba6f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:29.680714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76bc65-7bfd-492e-b6c4-58af36bba6f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:29.681728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76bc65-7bfd-492e-b6c4-58af36bba6f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:29.708154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76bc65-7bfd-492e-b6c4-58af36bba6f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:29.710305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d76bc65-7bfd-492e-b6c4-58af36bba6f8 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:29.737323 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1842/3702] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:30.402087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:30.404256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:30.420895 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:30.435225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a196ef83-9188-400d-8410-2728f451ed11 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:30.464920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:30.474553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:30.477838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:30.478745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] PATH_INFO: `/v3/projects/ff699851c1554646acd325bea241af1b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:30.482764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff699851c1554646acd325bea241af1b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:30.489867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:30.632185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff699851c1554646acd325bea241af1b', 'request_id': 'req-747270fa-c719-4851-8f0f-1350c9117857'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:30.648240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff699851c1554646acd325bea241af1b', 'request_id': 'req-747270fa-c719-4851-8f0f-1350c9117857'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:30.660766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff699851c1554646acd325bea241af1b', 'request_id': 'req-747270fa-c719-4851-8f0f-1350c9117857'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:30.681071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] The token cache is being invalidate because project ff699851c1554646acd325bea241af1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:30.681830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:30.684592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-747270fa-c719-4851-8f0f-1350c9117857 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:30.690881 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1861/3703] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:30 2022] DELETE /identity/v3/projects/ff699851c1554646acd325bea241af1b => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:30.694932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:30.695490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:30.695760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:30.742132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:30.744597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:30.935391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1843/3704] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:30.936606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:30.937119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:30.937637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:30.962031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:30.964080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:30.977692 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1862/3705] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:23:30.979591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:30.993130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0d74d-a038-4772-919a-b7510ffa7b32 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:30.999412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.000644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.001877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.002419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.003395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:31.003928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.006256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.025701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1844/3706] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:31.026620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.045598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3830c89d-c771-45a0-afd4-1e4d867c74fe None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.065516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.066288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.066943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.066943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.067552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.073994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.138549 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1863/3707] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:31 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:23:31.142700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.160048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efdbff-d459-4dba-a78f-46b899cb724e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.227690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.228607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.228907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.229190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.230096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.232059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.266635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.269285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:31.278994 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1845/3708] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:31 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:31.279900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.291727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a575670-e3bb-4d16-8208-74e2bdbdc9d1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.298248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cadd1fa-1c19-4f22-a0f5-cfe464fe98fc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.298493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.299715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.299715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.299934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.300660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.306182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.314759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.315665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.315954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.316234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] PATH_INFO: `/v3/projects/7600cf11293e47608037ed75f756076b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.323975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1846/3709] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:31.324407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7600cf11293e47608037ed75f756076b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.325217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.326509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.337197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d1f8e-a44c-496e-9ab5-92f232570101 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.342813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.343599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.343961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.344456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.345542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.348013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.365710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1847/3710] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:31.369607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.387193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8ae7f-cf80-4bd0-b6b6-62d1141f87fb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.399004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757e951-1c3d-49c2-82ee-12f885662daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.400248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e951-1c3d-49c2-82ee-12f885662daa admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.400765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e951-1c3d-49c2-82ee-12f885662daa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.401255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757e951-1c3d-49c2-82ee-12f885662daa admin admin] PATH_INFO: `/v3/projects/64876a82548845c39c3770e7c6701bda/users/6ab2e0f3e7d9441181f29c1278438ab6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.434661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e951-1c3d-49c2-82ee-12f885662daa admin admin] RBAC: Authorizing `identity:create_grant(project_id=64876a82548845c39c3770e7c6701bda, user_id=6ab2e0f3e7d9441181f29c1278438ab6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.437493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6757e951-1c3d-49c2-82ee-12f885662daa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.442820 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:31.464943 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1848/3711] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:31 2022] PUT /identity/v3/projects/64876a82548845c39c3770e7c6701bda/users/6ab2e0f3e7d9441181f29c1278438ab6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:31.470945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2eddc-0c12-43a5-8ada-6f434ada4fb1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.471678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2eddc-0c12-43a5-8ada-6f434ada4fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.472409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd2eddc-0c12-43a5-8ada-6f434ada4fb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.490257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7600cf11293e47608037ed75f756076b', 'request_id': 'req-19f8643e-9974-44f1-a25d-5dd09a23c0f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:31.500101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7600cf11293e47608037ed75f756076b', 'request_id': 'req-19f8643e-9974-44f1-a25d-5dd09a23c0f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:31.504661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cbd2eddc-0c12-43a5-8ada-6f434ada4fb1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:31.506967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cbd2eddc-0c12-43a5-8ada-6f434ada4fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:31.507352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7600cf11293e47608037ed75f756076b', 'request_id': 'req-19f8643e-9974-44f1-a25d-5dd09a23c0f3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:31.528475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] The token cache is being invalidate because project 7600cf11293e47608037ed75f756076b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:31.528769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:31.532165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19f8643e-9974-44f1-a25d-5dd09a23c0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:31.533941 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1864/3712] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:31 2022] DELETE /identity/v3/projects/7600cf11293e47608037ed75f756076b => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:31.544065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.544728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.545796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.598106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:31.599589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:31.627020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1849/3713] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:31.715834 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:31.780496 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1865/3714] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:31.784066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.785091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.785515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.805494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.807137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:31.842861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:31.846762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:31.891566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1850/3715] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:31.893884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.926863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74185db4-9676-4dc4-8369-031fec74f996 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.941819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.942515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.942800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.943079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.943909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:31.944193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.945850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.952767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c1798b-27d2-42dd-b9a3-3eb7617499aa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:31.964770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:31.965767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:31.966092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:31.966939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:31.985238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:31.986721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:31.987315 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1851/3716] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:23:31.988375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:31.990208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:32.005129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df384a34-5328-4c3e-b7cb-371501bfd4d7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.010645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.012211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.012730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.013068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] PATH_INFO: `/v3/users/84a32ab882cb4a2fab13ae92367c7ad7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.014412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1866/3717] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:32.014741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] RBAC: Authorizing `identity:delete_user(user_id=84a32ab882cb4a2fab13ae92367c7ad7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.017359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.017509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.040303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46000649-aa74-453a-8d80-a58bcf43f301 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.054405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.055445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.056121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.056658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.057646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.062799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.088528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84a32ab882cb4a2fab13ae92367c7ad7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:32.099947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84a32ab882cb4a2fab13ae92367c7ad7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:32.120871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84a32ab882cb4a2fab13ae92367c7ad7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:32.122970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84a32ab882cb4a2fab13ae92367c7ad7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:32.129946 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1867/3718] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:32 2022] POST /identity/v3/projects => generated 403 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:32.131578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.135594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:32.139871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6632fbca-f195-48a3-baf5-924c9cb2656d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84a32ab882cb4a2fab13ae92367c7ad7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:32.154397 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1852/3719] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:23:31 2022] DELETE /identity/v3/users/84a32ab882cb4a2fab13ae92367c7ad7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:32.156722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.157251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.157821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.182045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:32.183737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:32.244491 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:32.273170 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1853/3720] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:32.281908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59914e5-2e60-4c6b-9f6e-3491d111c71c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.288805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.289575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.290204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.290204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.290878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.293207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.304212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.306008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:32.322878 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1868/3721] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:32 2022] POST /identity/v3/users => generated 302 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:23:32.327608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.342866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687e77c0-7530-4874-b77d-5ed19c5e2053 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.354401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.355723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.358581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.359157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.360270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.365505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.408239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd3e4c1-a22c-4e5c-b705-fb915c9c0799 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.410843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1869/3722] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:32.414972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.425009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.428337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.429588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.430110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.448400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530c091-73a5-46b3-80e5-b9cff3755dd4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.469021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.471481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332ac8d-b596-444c-a3a4-47618de3092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.475763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ac8d-b596-444c-a3a4-47618de3092c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.476385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ac8d-b596-444c-a3a4-47618de3092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.477826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.479283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332ac8d-b596-444c-a3a4-47618de3092c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.482144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332ac8d-b596-444c-a3a4-47618de3092c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.486846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332ac8d-b596-444c-a3a4-47618de3092c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.513073 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1854/3723] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:23:32.517197 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1870/3724] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:32 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:32.521206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.537349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32d6aba-cf99-4cc4-9e8f-870989946851 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:32.545494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:32.562206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.563144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.563550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] PATH_INFO: `/v3/projects/76170075d0de43f78812b00db138ba37/users/c008c7700e6e49dc95794947f0a3e913/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.608719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=76170075d0de43f78812b00db138ba37, user_id=c008c7700e6e49dc95794947f0a3e913, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:32.613172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:32.664388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1855/3725] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:32 2022] PUT /identity/v3/projects/76170075d0de43f78812b00db138ba37/users/c008c7700e6e49dc95794947f0a3e913/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:32.667371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:32.667659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:32.668105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:32.721745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:32.723207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:32.810684 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:32.915220 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1871/3726] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:32.942528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:32.947469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:33.121534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac839098-08d9-4d6f-bda8-cf7e97e619ef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:33.128245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ba866-b216-4aee-a436-8408b28d652c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:33.129417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ba866-b216-4aee-a436-8408b28d652c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:33.132048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ba866-b216-4aee-a436-8408b28d652c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:33.132649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ba866-b216-4aee-a436-8408b28d652c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:33.149279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ba866-b216-4aee-a436-8408b28d652c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:33.154109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764ba866-b216-4aee-a436-8408b28d652c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:33.169055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1856/3727] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:34.922420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:34.924236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:34.950141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ea8e0-9ca1-4eba-9751-0b010c55ec99 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:34.964412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:34.965334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:34.965620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:34.965897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] PATH_INFO: `/v3/projects/2a637307d7fa43cb976744db1bced7b1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:34.973584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a637307d7fa43cb976744db1bced7b1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:34.976434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:35.111176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a637307d7fa43cb976744db1bced7b1', 'request_id': 'req-09952bec-03a4-4732-a65a-c2eaeec868ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:35.124495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a637307d7fa43cb976744db1bced7b1', 'request_id': 'req-09952bec-03a4-4732-a65a-c2eaeec868ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:35.142879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a637307d7fa43cb976744db1bced7b1', 'request_id': 'req-09952bec-03a4-4732-a65a-c2eaeec868ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:35.172013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] The token cache is being invalidate because project 2a637307d7fa43cb976744db1bced7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:23:35.172374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:35.173837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09952bec-03a4-4732-a65a-c2eaeec868ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:23:35.176078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1872/3728] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:23:34 2022] DELETE /identity/v3/projects/2a637307d7fa43cb976744db1bced7b1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:35.182930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.183873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.184298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.230386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:35.233400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:35.339295 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1857/3729] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:35.348505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.349189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.349624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.352836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:35.364697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:35.405608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:35.408589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:35.411148 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:35.437430 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1873/3730] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:35.441949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:35.462645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d95185-51ec-44d9-8a78-eb5904d5b43a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:35.475406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:35.480465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.481325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.481768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.482750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:23:35.483394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:35.487018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:35.526515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1874/3731] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:23:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:23:35.529340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:35.556924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d3f5ef-5331-4c58-9ebe-853becde155c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:35.570916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:35.572733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.573898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.574810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.578970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:35.585830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:35.593824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553a461-f78b-4543-8e20-4f52bdb216ec None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:35.612746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:35.613880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.614306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.614717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.620827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:35.698546 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1875/3732] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:23:35 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:35.699675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:35.779640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:35.786616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:35.805511 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1858/3733] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:35.834894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bdf866-b86a-48ef-88d5-210368f901de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:35.845976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:35.847022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.847246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.847448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.848149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:35.853789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:35.909181 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1876/3734] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:23:35 2022] POST /identity/v3/users => generated 302 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:23:35.914176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:35.931729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e66d34-85d4-4f3c-8b44-f9370755f217 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:35.951970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:35.955581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:35.955581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:35.956554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:35.971758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:35.972115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:36.009962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1859/3735] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:36.018278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:36.028241 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:36.043396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505eb6f1-2c20-4f38-bf21-1ce39e7e1eb9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:36.064552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87619894-1f5d-4a0b-8b1c-62f39d740287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:36.065672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619894-1f5d-4a0b-8b1c-62f39d740287 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:36.065951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619894-1f5d-4a0b-8b1c-62f39d740287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:36.066263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87619894-1f5d-4a0b-8b1c-62f39d740287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:36.067539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619894-1f5d-4a0b-8b1c-62f39d740287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:36.069233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87619894-1f5d-4a0b-8b1c-62f39d740287 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:36.094299 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1877/3736] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:23:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:23:36.098699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:36.115516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321a036c-b180-4729-8ece-c455b4a19b33 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:36.130762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:36.131696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:36.132199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:36.132771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] PATH_INFO: `/v3/projects/374da4bd4c664f2d830d09edf9fb97e9/users/aff67a082d7d4b4a9301eaf2e6674f87/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:36.210042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=374da4bd4c664f2d830d09edf9fb97e9, user_id=aff67a082d7d4b4a9301eaf2e6674f87, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:36.212832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:36.278732 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1860/3737] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:23:36 2022] PUT /identity/v3/projects/374da4bd4c664f2d830d09edf9fb97e9/users/aff67a082d7d4b4a9301eaf2e6674f87/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:23:36.284985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:36.285299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:36.285583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:36.311166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:36.312787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:36.555926 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1878/3738] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:36.577820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:36.581177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:36.685069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6290a2a1-2029-4c29-b75d-cf4df6510a16 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:36.690081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:36.691011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:36.691449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:36.691879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:36.705070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:36.706807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:36.720458 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1861/3739] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:45.395899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:45.400222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:45.443570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0302e-83c2-4f6a-8d68-32a99d6b2d7a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:45.452168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:45.453052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:45.453653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:45.454030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:45.456168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:45.484164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:45.485931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd700-829f-4ae9-a389-115a879f8b25 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:45.506877 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1879/3740] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:45.559838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:45.582758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2577bb5-5081-471e-8f7f-883be78006ec service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:45.630352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:45.633556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:45.634311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:45.635719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:45.694992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:45.698429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:45.761377 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1862/3741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:52.146735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e4c9-0ec9-4b47-a049-8d49226c7f03 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:52.147203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e4c9-0ec9-4b47-a049-8d49226c7f03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:52.147311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d28e4c9-0ec9-4b47-a049-8d49226c7f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:52.217348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5d28e4c9-0ec9-4b47-a049-8d49226c7f03 None None] MFA Rules not processed for user `6ab2e0f3e7d9441181f29c1278438ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:52.218602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d28e4c9-0ec9-4b47-a049-8d49226c7f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:52.404682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1880/3742] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:52.411567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:52.418731 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:52.571997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:52.572741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:52.573933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:52.655920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:52.660619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:52.691662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c22d0-17d0-4aae-9b8f-3c1580826b6e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:52.706427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11696b7b-eeb0-4bd9-befd-305d1547f54c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:52.707522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696b7b-eeb0-4bd9-befd-305d1547f54c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:52.708017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696b7b-eeb0-4bd9-befd-305d1547f54c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:52.708534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11696b7b-eeb0-4bd9-befd-305d1547f54c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:52.740987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696b7b-eeb0-4bd9-befd-305d1547f54c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:52.742802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11696b7b-eeb0-4bd9-befd-305d1547f54c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:52.776813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1863/3743] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:52.879997 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:52.900670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1881/3744] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:23:52.907025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46591-7deb-4f29-8761-875386db5828 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:52.907454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46591-7deb-4f29-8761-875386db5828 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:52.907821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b46591-7deb-4f29-8761-875386db5828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:52.957081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-63b46591-7deb-4f29-8761-875386db5828 None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:52.963386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-63b46591-7deb-4f29-8761-875386db5828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:52.986553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1864/3745] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:52.999258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:53.018918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68b2d7-ffed-492a-b186-6c49cfd36609 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:53.033044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:53.034608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:53.034809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:53.035097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:53.061818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:53.067504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:53.094010 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1882/3746] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:54.290143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:54.290629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:54.290868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:54.359676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] MFA Rules not processed for user `c008c7700e6e49dc95794947f0a3e913`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:54.361902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:54.570841 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1865/3747] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:55.396528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:55.398832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:55.434515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9d09d-de0f-4608-a747-675ce8b976a1 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:55.446525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042af20c-f3b9-44cc-936e-d64cc635e1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:55.448152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042af20c-f3b9-44cc-936e-d64cc635e1b4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:55.450312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042af20c-f3b9-44cc-936e-d64cc635e1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:55.451867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042af20c-f3b9-44cc-936e-d64cc635e1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:55.488763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042af20c-f3b9-44cc-936e-d64cc635e1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:55.490342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042af20c-f3b9-44cc-936e-d64cc635e1b4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:55.526406 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1883/3748] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:56.389560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:23:56.391663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:56.598024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49025052-e6ab-4d71-9292-816a7d49d9c5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:23:56.609761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:23:56.611191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:56.611649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:56.612062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:56.614252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:56.633757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:23:56.635608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec76a9a-31c9-4c8e-ad1e-8a7d1220d6e5 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:23:56.660292 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:23:56.672769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1866/3749] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:23:57.037229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ed24-d3cf-4055-829b-a7fdbefcc82d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:57.038338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ed24-d3cf-4055-829b-a7fdbefcc82d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:57.038772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852ed24-d3cf-4055-829b-a7fdbefcc82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:57.073207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c852ed24-d3cf-4055-829b-a7fdbefcc82d None None] MFA Rules not processed for user `6ab2e0f3e7d9441181f29c1278438ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:57.076146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c852ed24-d3cf-4055-829b-a7fdbefcc82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:57.097479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1884/3750] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:59.533509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d0e0-66ba-4234-994b-70076b49209e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:59.534067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d0e0-66ba-4234-994b-70076b49209e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:59.534067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589d0e0-66ba-4234-994b-70076b49209e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:59.604719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f589d0e0-66ba-4234-994b-70076b49209e None None] MFA Rules not processed for user `b70a43fcc1af4115b466fb2c94ae2303`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:59.606309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f589d0e0-66ba-4234-994b-70076b49209e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:59.779059 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1867/3751] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:23:59.789532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:23:59.790110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:23:59.790110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:23:59.831842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] MFA Rules not processed for user `b70a43fcc1af4115b466fb2c94ae2303`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:23:59.833196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:23:59.861436 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1885/3752] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:23:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:01.270163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:01.271058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:01.271337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:01.333085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] MFA Rules not processed for user `aff67a082d7d4b4a9301eaf2e6674f87`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:01.335707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:01.490474 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1868/3753] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:01 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:02.925135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:02.941098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6340b783-b7a6-4bc3-b806-30f09e40b291 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:02.964934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:02.966304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:02.966847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:02.967358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:02.978983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:02.981291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:03.013898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1886/3754] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:24:03.598440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:03.623516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec1707-1c64-44c6-bf7b-fad1a4593a82 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:03.635883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:03.637482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:03.637956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:03.638404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:03.641057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:03.667854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:03.673129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:03.717788 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1869/3755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:12.077274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:12.079197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:12.101095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240700c6-c58c-472a-939a-1c65c98d0190 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:12.111095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:12.111997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:12.112506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:12.112786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] PATH_INFO: `/v3/users/c008c7700e6e49dc95794947f0a3e913` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:12.115454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c008c7700e6e49dc95794947f0a3e913)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:12.117439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:12.223226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c008c7700e6e49dc95794947f0a3e913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.224723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c008c7700e6e49dc95794947f0a3e913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.239994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c008c7700e6e49dc95794947f0a3e913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.240908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c008c7700e6e49dc95794947f0a3e913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.252612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c008c7700e6e49dc95794947f0a3e913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.293047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1887/3756] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:24:12 2022] DELETE /identity/v3/users/c008c7700e6e49dc95794947f0a3e913 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:12.560798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:12.573386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311ab64c-ad4d-4082-b0de-98334113eeb0 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:12.603012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:12.604646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:12.726337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bbba3-4848-4f98-b791-99f317c8b6c5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:12.735160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:12.736334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:12.736500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:12.736785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:12.737182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] PATH_INFO: `/v3/projects/76170075d0de43f78812b00db138ba37` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:12.737306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:12.737493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:12.737970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:12.738881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=76170075d0de43f78812b00db138ba37)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:12.740898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:12.742042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:12.796804 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:12.814012 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:12.839256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76170075d0de43f78812b00db138ba37', 'request_id': 'req-625e0808-7243-49fe-96f6-8be7b71a3edb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.847917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76170075d0de43f78812b00db138ba37', 'request_id': 'req-625e0808-7243-49fe-96f6-8be7b71a3edb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.854925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76170075d0de43f78812b00db138ba37', 'request_id': 'req-625e0808-7243-49fe-96f6-8be7b71a3edb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.884394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:12.886479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] The token cache is being invalidate because project 76170075d0de43f78812b00db138ba37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:24:12.886824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.887668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29462743-bacd-40fa-ad76-94c775974c7f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:12.888306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-625e0808-7243-49fe-96f6-8be7b71a3edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:12.892400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1888/3757] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:24:12 2022] DELETE /identity/v3/projects/76170075d0de43f78812b00db138ba37 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:24:12.895400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:12.895679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:12.895985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:12.914822 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1870/3758] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:12.934052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:12.935300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:13.026960 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1889/3759] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:13.028882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.029242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.031606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.073292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:13.076302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:13.096898 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1871/3760] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:13.102964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:13.119493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f6031-2721-4bb3-950c-9516a03ea654 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:13.126685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:13.127507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.127855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.128103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.129263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:24:13.136367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:13.136367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:13.152915 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1890/3761] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:24:13.159018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:13.168708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7e5f7-4101-489b-a795-c851decc23b6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:13.174746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:13.175434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.175720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.175996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.176766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:13.178777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:13.228279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1872/3762] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:24:13 2022] POST /identity/v3/projects => generated 395 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:13.232603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:13.247979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6dd5d2-96e3-44ff-9743-7532c2898290 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:13.336255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:13.337323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.337678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.338021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.338755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:13.340777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:13.375226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1891/3763] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:24:13 2022] POST /identity/v3/users => generated 298 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:13.376066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:13.398384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f7847-b12f-4b48-b8c3-66c7761478a0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:13.407506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:13.408905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.409435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.409723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.411086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:13.413008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:13.434085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:13.434937 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1873/3764] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:24:13.449348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab187d-b40b-448c-b049-5dd2e28b6905 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:13.455496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07306768-7120-4560-aa16-48b7c1fc1ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:13.456193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07306768-7120-4560-aa16-48b7c1fc1ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.456509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07306768-7120-4560-aa16-48b7c1fc1ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.456786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07306768-7120-4560-aa16-48b7c1fc1ba6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.458517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07306768-7120-4560-aa16-48b7c1fc1ba6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:13.460199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07306768-7120-4560-aa16-48b7c1fc1ba6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:13.477864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:13.489014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc1de93-ca2f-4965-8f9f-008e0e28d483 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:13.489985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1892/3765] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:13 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:13.494462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:13.496433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.497141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.497861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] PATH_INFO: `/v3/projects/c2a0856dedf94750b9cd0c11945f5272/users/5df9d32f1da9456782ff01ac203eaf1b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.517262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a0856dedf94750b9cd0c11945f5272, user_id=5df9d32f1da9456782ff01ac203eaf1b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:13.522025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:13.542128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1874/3766] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:24:13 2022] PUT /identity/v3/projects/c2a0856dedf94750b9cd0c11945f5272/users/5df9d32f1da9456782ff01ac203eaf1b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:13.555485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:13.555785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:13.556046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:13.588397 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:13.592506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] MFA Rules not processed for user `5df9d32f1da9456782ff01ac203eaf1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:13.594562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:13.680340 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1893/3767] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:14.157192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:14.159085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:14.255824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b9868-9cb0-474e-b2eb-fbaf7be509a4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:14.267322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940fe14-3b6f-487a-aea5-a8c83692d443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:14.268647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940fe14-3b6f-487a-aea5-a8c83692d443 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:14.270111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940fe14-3b6f-487a-aea5-a8c83692d443 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:14.270327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940fe14-3b6f-487a-aea5-a8c83692d443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:14.284890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940fe14-3b6f-487a-aea5-a8c83692d443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:14.286787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940fe14-3b6f-487a-aea5-a8c83692d443 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:14.316583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1875/3768] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:24:15.311378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:15.445905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779994eb-2138-44d3-bb7a-852b94cff127 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:15.452991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:15.455017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:15.455300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:15.455572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] PATH_INFO: `/v3/users/5df9d32f1da9456782ff01ac203eaf1b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:15.457193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5df9d32f1da9456782ff01ac203eaf1b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:15.459629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:15.599240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5df9d32f1da9456782ff01ac203eaf1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:15.600860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5df9d32f1da9456782ff01ac203eaf1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:15.628897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5df9d32f1da9456782ff01ac203eaf1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:15.629670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5df9d32f1da9456782ff01ac203eaf1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:15.641378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5df9d32f1da9456782ff01ac203eaf1b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:15.665474 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1894/3769] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:24:15 2022] DELETE /identity/v3/users/5df9d32f1da9456782ff01ac203eaf1b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:15.669849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:15.670355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:15.670459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:15.691557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:15.693212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:15.750836 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:15.796555 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1876/3770] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:15.807859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:15.809396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:15.855290 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:15.904302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b22c87-d988-44a2-95d8-d5f85cf0c97b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:15.909709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:15.910759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:15.911136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:15.911474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:15.937369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:15.940572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:15.960905 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1895/3771] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:16.226421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:16.234184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:16.396130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:16.398290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:16.434755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0ab11-099c-4368-a297-bcb1eb09572c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:16.508816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:16.509728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:16.510014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:16.514642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] PATH_INFO: `/v3/projects/c2a0856dedf94750b9cd0c11945f5272` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:16.518051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a0856dedf94750b9cd0c11945f5272)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:16.520015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:16.533732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653afa6-962c-4556-9dc6-82c837d6969d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:16.560764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:16.562266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:16.562971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:16.564670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:16.572117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:16.621627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:16.625240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdfa2e9-d632-48ac-8284-1bee463f45b9 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:16.655523 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1877/3772] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:16.680538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a0856dedf94750b9cd0c11945f5272', 'request_id': 'req-b648689a-b974-48f1-915d-2cc995abf880'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:16.706742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a0856dedf94750b9cd0c11945f5272', 'request_id': 'req-b648689a-b974-48f1-915d-2cc995abf880'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:16.725584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a0856dedf94750b9cd0c11945f5272', 'request_id': 'req-b648689a-b974-48f1-915d-2cc995abf880'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:16.770031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] The token cache is being invalidate because project c2a0856dedf94750b9cd0c11945f5272 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:24:16.770326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:16.771217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b648689a-b974-48f1-915d-2cc995abf880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:16.778210 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1896/3773] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:24:16 2022] DELETE /identity/v3/projects/c2a0856dedf94750b9cd0c11945f5272 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:24:16.785474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:16.786052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:16.786052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:16.870252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:16.871790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:17.116742 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1878/3774] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:17.126317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.126610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.126874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.152537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:17.154079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:17.163519 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1897/3775] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:17.168039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:17.179501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f35a4-ee1f-4780-9096-d314da5d2964 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:17.184808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:17.185712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.186147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.186746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.188007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:24:17.188317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:17.190156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:17.203633 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1879/3776] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:24:17.208261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:17.218842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9d10d-327b-439f-b7ca-0ee26120d38c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:17.224407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:17.225218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.225576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.225920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.226814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:17.229166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:17.268689 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1898/3777] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:24:17 2022] POST /identity/v3/projects => generated 399 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:24:17.273325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:17.287725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9c4dc8-8072-483e-a8ac-a9398ce4047c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:17.394233 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:17.413404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:17.415311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.415906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.417124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.419228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:17.424877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:17.477832 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1880/3778] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:24:17 2022] POST /identity/v3/users => generated 300 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:17.481996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:17.495067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dbfc14-551c-4292-b0f1-d60113f127d1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:17.502152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:17.503117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.503411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.503690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.504541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:17.506450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:17.524432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1899/3779] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:17.527315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:17.542730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389bbc7d-35b1-46ff-9a01-83062d3f8ed0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:17.563166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e89f85-eab2-4ae6-baca-f3a3161ccc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:17.564303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e89f85-eab2-4ae6-baca-f3a3161ccc82 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.564851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e89f85-eab2-4ae6-baca-f3a3161ccc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.565354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e89f85-eab2-4ae6-baca-f3a3161ccc82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.566797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e89f85-eab2-4ae6-baca-f3a3161ccc82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:17.568867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e89f85-eab2-4ae6-baca-f3a3161ccc82 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:17.587028 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1881/3780] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:24:17.591108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:17.601853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb74dc-c089-4e56-a88f-d28db27cc1a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:17.607178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:17.608230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.608643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.609000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] PATH_INFO: `/v3/projects/03f807af701245c393f200917b2079c9/users/960c5db906e24b869bcd7e9ff8b1d386/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.627260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f807af701245c393f200917b2079c9, user_id=960c5db906e24b869bcd7e9ff8b1d386, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:17.630314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:17.659631 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1900/3781] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:24:17 2022] PUT /identity/v3/projects/03f807af701245c393f200917b2079c9/users/960c5db906e24b869bcd7e9ff8b1d386/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:17.676486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:17.676906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:17.677302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:17.734339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] MFA Rules not processed for user `960c5db906e24b869bcd7e9ff8b1d386`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:17.735843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:17.824496 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1882/3782] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:18.612759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:18.615524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:18.838212 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:18.891200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92600449-717a-4d28-8b0e-69b6040687fd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:18.906389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4ee43-13f1-4ca0-b435-cbc1ea05eaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:18.907292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4ee43-13f1-4ca0-b435-cbc1ea05eaa2 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:18.907624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4ee43-13f1-4ca0-b435-cbc1ea05eaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:18.907903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4ee43-13f1-4ca0-b435-cbc1ea05eaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:18.928042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4ee43-13f1-4ca0-b435-cbc1ea05eaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:18.931044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4ee43-13f1-4ca0-b435-cbc1ea05eaa2 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:18.951291 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1901/3783] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:19.022679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:19.151735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a244e44-33dd-438b-bfc5-72e7fe3c76d8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:19.164206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:19.165632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:19.166002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:19.166487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] PATH_INFO: `/v3/users/960c5db906e24b869bcd7e9ff8b1d386` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:19.168301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=960c5db906e24b869bcd7e9ff8b1d386)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:19.171498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:19.249858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '960c5db906e24b869bcd7e9ff8b1d386'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:19.264654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '960c5db906e24b869bcd7e9ff8b1d386'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:19.291792 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:19.294670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '960c5db906e24b869bcd7e9ff8b1d386'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:19.296316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '960c5db906e24b869bcd7e9ff8b1d386'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:19.316615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '960c5db906e24b869bcd7e9ff8b1d386'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:19.325243 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1883/3784] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:24:19 2022] DELETE /identity/v3/users/960c5db906e24b869bcd7e9ff8b1d386 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:19.329991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:19.330282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:19.330825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:19.352877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:19.355637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:19.443542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1902/3785] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:19.451776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:19.453565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:19.520184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbb2f2-3a9d-4dc9-806f-e52c77819ae2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:19.524537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250f3e53-23b0-4478-a97a-67d996f37969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:19.525392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3e53-23b0-4478-a97a-67d996f37969 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:19.525859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3e53-23b0-4478-a97a-67d996f37969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:19.526496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250f3e53-23b0-4478-a97a-67d996f37969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:19.538353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f3e53-23b0-4478-a97a-67d996f37969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:19.540310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250f3e53-23b0-4478-a97a-67d996f37969 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:19.552776 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1884/3786] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:24:19.935475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:19.938246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:19.973824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d05a6-30c4-47b8-999d-1c09c0f0e857 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:19.995739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:19.997793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:19.998317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:19.998752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] PATH_INFO: `/v3/projects/03f807af701245c393f200917b2079c9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.001377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f807af701245c393f200917b2079c9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:20.004588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:20.145590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f807af701245c393f200917b2079c9', 'request_id': 'req-dedda7f2-89dc-4071-ba99-c851bc29bd34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:20.155363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f807af701245c393f200917b2079c9', 'request_id': 'req-dedda7f2-89dc-4071-ba99-c851bc29bd34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:20.164211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f807af701245c393f200917b2079c9', 'request_id': 'req-dedda7f2-89dc-4071-ba99-c851bc29bd34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:20.193088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] The token cache is being invalidate because project 03f807af701245c393f200917b2079c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:24:20.193536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:20.195590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dedda7f2-89dc-4071-ba99-c851bc29bd34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:20.203858 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1903/3787] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:24:19 2022] DELETE /identity/v3/projects/03f807af701245c393f200917b2079c9 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:20.205845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e6dc7-6982-4f75-8a8b-e936f9df8854 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.206306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e6dc7-6982-4f75-8a8b-e936f9df8854 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.206401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e6dc7-6982-4f75-8a8b-e936f9df8854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.229478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f48e6dc7-6982-4f75-8a8b-e936f9df8854 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:20.231081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f48e6dc7-6982-4f75-8a8b-e936f9df8854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:20.266465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.266758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.267038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.303539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:20.306128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:20.383519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1885/3788] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:20.390085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.390593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.391176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.419734 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:20.429318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:20.433468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:20.438796 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1904/3789] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:24:20.447177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1886/3790] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:20.451467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:20.464920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ac95f-92ba-494a-a294-15814d53d9a5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:20.479046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:20.479759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.480122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.480508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.481293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:24:20.481620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:20.483707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:20.509687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:20.520449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78ee22f-f77c-45b6-9688-7bdfd6a8befb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:20.521125 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1905/3791] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:24:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:24:20.526893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:20.527634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.527916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.528187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.528984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:20.530931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:20.590694 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1887/3792] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:24:20 2022] POST /identity/v3/projects => generated 369 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:24:20.593909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:20.647294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a3543-0eb6-423a-a8c1-83629d6432c5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:20.755394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb19b6-ab7e-4290-894f-a32196b1e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:20.756538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb19b6-ab7e-4290-894f-a32196b1e01c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.758407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb19b6-ab7e-4290-894f-a32196b1e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.758927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb19b6-ab7e-4290-894f-a32196b1e01c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.759907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb19b6-ab7e-4290-894f-a32196b1e01c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:20.761995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb19b6-ab7e-4290-894f-a32196b1e01c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:20.792503 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1906/3793] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:24:20 2022] POST /identity/v3/users => generated 285 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:20.795384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:20.806705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb060a-c7fd-4849-a23e-0d23dce1fe7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.807343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb060a-c7fd-4849-a23e-0d23dce1fe7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.808126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb060a-c7fd-4849-a23e-0d23dce1fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.829811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b91d9-070c-47c7-b900-beedca45cfd5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:20.844128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:20.845413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.845950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.846435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.847443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:20.850378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:20.860874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4abb060a-c7fd-4849-a23e-0d23dce1fe7a None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:20.862126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4abb060a-c7fd-4849-a23e-0d23dce1fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:20.879987 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1888/3794] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:20.884898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:20.907630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdaf28-a4eb-414f-9062-691faa44fbfa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:20.914134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:20.915277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.915770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.916264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.917301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:20.920014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:20.941909 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1889/3795] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:20 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:20.945046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:20.963710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461223a1-9961-4a02-9282-c0100a66628f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:20.971126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf608a-1ded-4993-b8bf-8e565db19cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:20.971126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf608a-1ded-4993-b8bf-8e565db19cdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:20.971126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf608a-1ded-4993-b8bf-8e565db19cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:20.971887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf608a-1ded-4993-b8bf-8e565db19cdd admin admin] PATH_INFO: `/v3/projects/40722fd846074a348ff8df1ada898924/users/453c6f4bc0b74f13a9a4db92b78f200f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:20.989801 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1907/3796] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:21.008612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf608a-1ded-4993-b8bf-8e565db19cdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=40722fd846074a348ff8df1ada898924, user_id=453c6f4bc0b74f13a9a4db92b78f200f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:21.011537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf608a-1ded-4993-b8bf-8e565db19cdd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:21.056382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1890/3797] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:24:20 2022] PUT /identity/v3/projects/40722fd846074a348ff8df1ada898924/users/453c6f4bc0b74f13a9a4db92b78f200f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:21.069224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:21.070631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:21.071421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:21.125355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] MFA Rules not processed for user `453c6f4bc0b74f13a9a4db92b78f200f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:21.126646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:21.237655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1908/3798] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:21.387328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101b92-25eb-4b66-a927-844b09b9380b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:21.387803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101b92-25eb-4b66-a927-844b09b9380b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:21.387916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8101b92-25eb-4b66-a927-844b09b9380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:21.407149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a8101b92-25eb-4b66-a927-844b09b9380b None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:21.408452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a8101b92-25eb-4b66-a927-844b09b9380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:21.418187 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:21.478290 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1891/3799] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:21.665509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:21.667886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:21.685663 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:21.856740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2430601a-84bc-4705-9dcd-410816391ab0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:21.876130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68fec-703a-4794-bb5c-f130b97fb45b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:21.876531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68fec-703a-4794-bb5c-f130b97fb45b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:21.877020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68fec-703a-4794-bb5c-f130b97fb45b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:21.878427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68fec-703a-4794-bb5c-f130b97fb45b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:21.901568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68fec-703a-4794-bb5c-f130b97fb45b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:21.912370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae68fec-703a-4794-bb5c-f130b97fb45b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:21.942117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1909/3800] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:21 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:22.076290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:22.076717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:22.076904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:22.122205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:22.131127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:22.152025 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1892/3801] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:22.785981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5724-ac9e-498d-bcdb-494a9433d9bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:22.786580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5724-ac9e-498d-bcdb-494a9433d9bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:22.786580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b5724-ac9e-498d-bcdb-494a9433d9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:22.809986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b0b5724-ac9e-498d-bcdb-494a9433d9bd None None] MFA Rules not processed for user `4afb43090cf943538345b1814e138fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:22.811266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b0b5724-ac9e-498d-bcdb-494a9433d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:22.824395 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1910/3802] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:22 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:23.416257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:23.605280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c252fc1-d39c-406a-af7e-ffff9491763e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:23.611847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:23.613233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:23.613404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:23.613769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] PATH_INFO: `/v3/users/453c6f4bc0b74f13a9a4db92b78f200f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:23.615221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=453c6f4bc0b74f13a9a4db92b78f200f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:23.618292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:23.693032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '453c6f4bc0b74f13a9a4db92b78f200f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:23.705156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '453c6f4bc0b74f13a9a4db92b78f200f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:23.724776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '453c6f4bc0b74f13a9a4db92b78f200f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:23.725254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '453c6f4bc0b74f13a9a4db92b78f200f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:23.734239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '453c6f4bc0b74f13a9a4db92b78f200f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:23.743183 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1893/3803] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:24:23 2022] DELETE /identity/v3/users/453c6f4bc0b74f13a9a4db92b78f200f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:23.749292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:23.749869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:23.750428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:23.794977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:23.800568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:23.896673 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1911/3804] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:23.908694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:23.911658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:23.981790 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:24.023598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3953d66-fa57-4598-af94-219a51542a6e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:24.029836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9584f5ca-3ca2-4e47-9bf5-856657582518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:24.030669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f5ca-3ca2-4e47-9bf5-856657582518 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:24.030869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f5ca-3ca2-4e47-9bf5-856657582518 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:24.031794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9584f5ca-3ca2-4e47-9bf5-856657582518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:24.042054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584f5ca-3ca2-4e47-9bf5-856657582518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:24.045958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9584f5ca-3ca2-4e47-9bf5-856657582518 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:24.060470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1894/3805] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:24.546581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:24.548585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:24.572187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf6deef-8bba-42de-bb26-2b9b11ccd452 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:24.584382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:24.586341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:24.586800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:24.587350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] PATH_INFO: `/v3/projects/40722fd846074a348ff8df1ada898924` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:24.588847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40722fd846074a348ff8df1ada898924)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:24.592206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:24.721591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40722fd846074a348ff8df1ada898924', 'request_id': 'req-5102b174-3316-4488-97d6-9520a805095d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:24.756727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40722fd846074a348ff8df1ada898924', 'request_id': 'req-5102b174-3316-4488-97d6-9520a805095d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:24.772581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40722fd846074a348ff8df1ada898924', 'request_id': 'req-5102b174-3316-4488-97d6-9520a805095d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:24.819985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] The token cache is being invalidate because project 40722fd846074a348ff8df1ada898924 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:24:24.820753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:24.821767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5102b174-3316-4488-97d6-9520a805095d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:24.824759 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1912/3806] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:24:24 2022] DELETE /identity/v3/projects/40722fd846074a348ff8df1ada898924 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:24.831489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:24.832662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:24.833312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:24.863928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:24.865310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:24.955440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1895/3807] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:24.957240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:24.957710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:24.958002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:24.983526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:24.984788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:24.993165 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1913/3808] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:24.997690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.010077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772d3d3-1498-4cb7-8c1c-b68ac3891ccf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.015408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.016370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.017116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.017712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.018995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:24:25.019656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.022474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.051833 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1896/3809] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:24:25.056390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.064599 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:25.067061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47f4aef-6a84-4089-8e98-a8964893002c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.074068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.075956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.076647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.077097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.078093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.080790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.136005 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1914/3810] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:24:25 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:25.138712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.166382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29b5988-9107-4b56-ad09-5599b46d368a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.281631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.282641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.283080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.283520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.284418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.286588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.328497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1897/3811] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:24:25 2022] POST /identity/v3/users => generated 292 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:25.332774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.346490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb73109-16ef-4c6d-a9c7-3d61b1ac7cd1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.352416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.353342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.353809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.354261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.355169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.357016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.371962 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1915/3812] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:25.375867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.392054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db518aff-6db5-43ae-80a9-153d936b0f0d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.399305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76059942-7a9e-4500-93a4-eb4bddbc14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.400458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059942-7a9e-4500-93a4-eb4bddbc14f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.400964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059942-7a9e-4500-93a4-eb4bddbc14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.401389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76059942-7a9e-4500-93a4-eb4bddbc14f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.402297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059942-7a9e-4500-93a4-eb4bddbc14f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.404750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76059942-7a9e-4500-93a4-eb4bddbc14f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.425519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1898/3813] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:25.428892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.442887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cd24a5-ca42-41f2-bb96-46476aeacfd6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.449496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.450848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.451306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.451747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] PATH_INFO: `/v3/projects/e6d6c1457beb4171a95570a86c38b303/users/8749099df5fc4a7baa9cf069db90f3ed/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.471808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d6c1457beb4171a95570a86c38b303, user_id=8749099df5fc4a7baa9cf069db90f3ed, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.476704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.500411 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1916/3814] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:24:25 2022] PUT /identity/v3/projects/e6d6c1457beb4171a95570a86c38b303/users/8749099df5fc4a7baa9cf069db90f3ed/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:24:25.502045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.502463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.502756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.527095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:25.528287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:25.580902 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:25.621076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1899/3815] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:24:25.637084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:25.640197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:25.787616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c7ab80-726c-4c76-bcee-29bf294fc220 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:25.809683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:25.810937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:25.811455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:25.811964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:25.839899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:25.841727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:25.856226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1917/3816] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:30.241711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:30.244303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:30.457327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0b6dd9-734b-4699-8a68-d5ce3cc59d9b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:30.464951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:30.465840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:30.466247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:30.466619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:30.469116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:30.523753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:30.528659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:30.553515 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1900/3817] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:30.791222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:30.792892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:30.812836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c26ef46-61e7-41d2-9c7c-0bd5e9dc3c0b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:30.832366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:30.834263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:30.834766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:30.835217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] PATH_INFO: `/v3/users/aff67a082d7d4b4a9301eaf2e6674f87` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:30.837529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff67a082d7d4b4a9301eaf2e6674f87)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:30.839689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:31.004996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff67a082d7d4b4a9301eaf2e6674f87'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:31.006106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff67a082d7d4b4a9301eaf2e6674f87'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:31.021770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff67a082d7d4b4a9301eaf2e6674f87'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:31.023061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff67a082d7d4b4a9301eaf2e6674f87'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:31.048560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f944f1f1-f61a-45f7-8426-c6d723edecdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff67a082d7d4b4a9301eaf2e6674f87'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:31.103230 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1918/3818] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:24:30 2022] DELETE /identity/v3/users/aff67a082d7d4b4a9301eaf2e6674f87 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:32.534191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:32.551689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91920c1-7968-4002-954b-07eafb8214e3 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:32.706381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:32.707327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:32.707613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:32.707912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] PATH_INFO: `/v3/projects/374da4bd4c664f2d830d09edf9fb97e9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:32.709286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=374da4bd4c664f2d830d09edf9fb97e9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:32.711391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:32.825269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '374da4bd4c664f2d830d09edf9fb97e9', 'request_id': 'req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:32.846190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '374da4bd4c664f2d830d09edf9fb97e9', 'request_id': 'req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:32.859388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '374da4bd4c664f2d830d09edf9fb97e9', 'request_id': 'req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:32.876639 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:32.893060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] The token cache is being invalidate because project 374da4bd4c664f2d830d09edf9fb97e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:24:32.895017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:32.897823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-11b0cab5-7b39-4bd0-9c53-66e09e4a85e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:32.907983 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1901/3819] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:24:32 2022] DELETE /identity/v3/projects/374da4bd4c664f2d830d09edf9fb97e9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:32.913151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:32.914081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:32.914538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:32.951809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:32.953679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:33.007399 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:33.134132 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1919/3820] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:33.141906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.142260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.142460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.190931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:33.197608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:33.223383 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1902/3821] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:33.227567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:33.246518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aae4e6-b884-453d-a2ba-ce3669f62cb6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:33.279604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:33.280622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.281059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.281490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.282411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:24:33.282905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:33.284817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:33.312334 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1920/3822] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:24:33.313672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:33.324229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea4360-1747-4c26-922f-e4a6401e003b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:33.341612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:33.342320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.342600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.342933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.343580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:33.345860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:33.404965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1903/3823] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:24:33 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:24:33.409070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:33.421567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f41e7b-ab08-42ce-b7a9-7635246b52f5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:33.599905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:33.600665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.601023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.601291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.601989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:33.604071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:33.644184 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1921/3824] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:24:33 2022] POST /identity/v3/users => generated 290 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:33.648384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:33.664772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a78b8-2c5f-4409-8a14-0ebbb714fbf9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:33.682135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:33.682866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.683201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.683527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.684308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:33.686085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:33.717442 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1904/3825] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:33.720881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:33.735638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff38323-9a13-4952-9935-c4cf31d29271 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:33.754263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d3e19-1629-4994-9241-9ef8989ffd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:33.754959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3e19-1629-4994-9241-9ef8989ffd5f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.755286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3e19-1629-4994-9241-9ef8989ffd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.755621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d3e19-1629-4994-9241-9ef8989ffd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.756467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3e19-1629-4994-9241-9ef8989ffd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:33.758653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d3e19-1629-4994-9241-9ef8989ffd5f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:33.784565 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1922/3826] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:33.786088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:33.803121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa68a4c-7f2a-40f3-b86e-671615ec0aa8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:33.812965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:33.814400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.814685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.814961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] PATH_INFO: `/v3/projects/b4a5e53472b245abb7c8c36267cd3040/users/0a194df9dbe7498da99bcfadd85d7f1b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.864690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4a5e53472b245abb7c8c36267cd3040, user_id=0a194df9dbe7498da99bcfadd85d7f1b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:33.867564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:33.908589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1905/3827] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:24:33 2022] PUT /identity/v3/projects/b4a5e53472b245abb7c8c36267cd3040/users/0a194df9dbe7498da99bcfadd85d7f1b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:33.911041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585113e-b332-42ff-81fa-a3e46342193b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:33.911196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585113e-b332-42ff-81fa-a3e46342193b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:33.911477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4585113e-b332-42ff-81fa-a3e46342193b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:33.967531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4585113e-b332-42ff-81fa-a3e46342193b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:33.968957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4585113e-b332-42ff-81fa-a3e46342193b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:34.207464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1923/3828] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:34.398923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:34.400856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:34.655516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1997ee-cacc-4d79-b78a-3137af7ee722 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:34.670370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b5891-a57d-4528-8e6e-4a10ea99f166 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:34.670714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5891-a57d-4528-8e6e-4a10ea99f166 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:34.670997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5891-a57d-4528-8e6e-4a10ea99f166 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:34.671287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b5891-a57d-4528-8e6e-4a10ea99f166 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:34.688894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5891-a57d-4528-8e6e-4a10ea99f166 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:34.693342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983b5891-a57d-4528-8e6e-4a10ea99f166 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:34.741489 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1906/3829] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:44.177727 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:44.718549 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:48.106885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:48.107381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:48.107531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:48.189357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] MFA Rules not processed for user `8749099df5fc4a7baa9cf069db90f3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:48.191153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:48.440726 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1924/3830] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:48.454322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:48.455881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:48.456539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:48.484918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] MFA Rules not processed for user `8749099df5fc4a7baa9cf069db90f3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:48.488267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:48.519846 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1907/3831] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:48.682338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:48.687295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:48.877398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc016be-ff66-4ae5-bbde-8bd671edfa8b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:48.890650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:48.891563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:48.894239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:48.894655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:48.918701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:48.922303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:48.949096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1925/3832] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:49.903489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:49.922957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b89f9-c8e4-4c15-b9c5-4b539205a197 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:49.942045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:49.943164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:49.944075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:49.944617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:49.951415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:49.981408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:49.982898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:49.999140 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1908/3833] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:50.399505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:50.401045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:50.447412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea817b9-e3de-459b-9cb1-d253c0971e3b service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:50.470986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:50.475552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:50.476158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:50.477915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] PATH_INFO: `/v3/users/4afb43090cf943538345b1814e138fb9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:50.483537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4afb43090cf943538345b1814e138fb9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:50.491419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:50.628776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4afb43090cf943538345b1814e138fb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:50.629813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4afb43090cf943538345b1814e138fb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:50.653637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4afb43090cf943538345b1814e138fb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:50.655355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4afb43090cf943538345b1814e138fb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:50.681388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef2179b2-a66b-487f-95b3-009c51a9c96a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4afb43090cf943538345b1814e138fb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:50.694287 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:50.732193 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1926/3834] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:24:50 2022] DELETE /identity/v3/users/4afb43090cf943538345b1814e138fb9 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:51.274937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:51.290717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d7b198-9881-4983-8360-e24e43428fb0 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:51.467575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:51.469365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:51.484324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:51.484670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] PATH_INFO: `/v3/projects/33f74c29f6a54c7ab728e87c512a26dd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:51.490505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=33f74c29f6a54c7ab728e87c512a26dd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:51.494765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:51.676887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33f74c29f6a54c7ab728e87c512a26dd', 'request_id': 'req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:51.691413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33f74c29f6a54c7ab728e87c512a26dd', 'request_id': 'req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:51.727156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33f74c29f6a54c7ab728e87c512a26dd', 'request_id': 'req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:51.769804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] The token cache is being invalidate because project 33f74c29f6a54c7ab728e87c512a26dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:24:51.770105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:51.771377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9d9f205-ae47-46d7-be4a-c40e5f1c6b9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:24:51.782040 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1909/3835] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:24:51 2022] DELETE /identity/v3/projects/33f74c29f6a54c7ab728e87c512a26dd => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:51.782344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:51.782344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:51.782901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:51.826718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:51.828412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:52.013855 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1927/3836] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:52.020142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.020757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.020956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.081308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:52.084814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:52.106463 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1910/3837] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:52.112220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:52.135748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794205cb-07b0-4779-a62c-f8d866588bca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:52.146989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:52.147784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.153668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.160324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.161362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:24:52.161786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:52.163923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:52.223527 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1928/3838] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:24:52.228941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:52.248560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cdf7f-7c1c-4574-98d7-dd42d4f82604 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:52.270523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:52.271713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.272252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.272890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.273888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:52.276133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:52.333030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1911/3839] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:24:52 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:52.338169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:52.350795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ccb68-1167-4fa1-8072-b374aa5f65d4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:52.475494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:52.476487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.476979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.477616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.478594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:52.482714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:52.534324 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1929/3840] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:24:52 2022] POST /identity/v3/users => generated 286 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:24:52.536082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:52.554569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22383869-ef35-48db-b79b-a1780e0a5e17 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:52.566725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:52.567865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.568874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.569381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.573622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:52.575573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:52.589191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1912/3841] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:24:52.593399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:52.606691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c5d687-0ccf-4510-b1cd-970d1645770b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:52.625665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f0f03-697f-40d2-b5dd-b34fd90a605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:52.626817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f0f03-697f-40d2-b5dd-b34fd90a605b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.627337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f0f03-697f-40d2-b5dd-b34fd90a605b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.627881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f0f03-697f-40d2-b5dd-b34fd90a605b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.629289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f0f03-697f-40d2-b5dd-b34fd90a605b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:52.634815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f0f03-697f-40d2-b5dd-b34fd90a605b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:52.659736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1930/3842] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:24:52.663560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:52.683034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33fc583-649f-4c71-89f3-451a842dd165 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:52.691378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7727c223-06aa-422c-83ae-c543121c22d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:52.693073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c223-06aa-422c-83ae-c543121c22d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.694015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c223-06aa-422c-83ae-c543121c22d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.694788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7727c223-06aa-422c-83ae-c543121c22d9 admin admin] PATH_INFO: `/v3/projects/19234bc0038b46f7b054d3cd43ca1255/users/1fa8e1d078ce433980cff8ad48da65b9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.719208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727c223-06aa-422c-83ae-c543121c22d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19234bc0038b46f7b054d3cd43ca1255, user_id=1fa8e1d078ce433980cff8ad48da65b9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:52.723755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7727c223-06aa-422c-83ae-c543121c22d9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:52.749751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1913/3843] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:24:52 2022] PUT /identity/v3/projects/19234bc0038b46f7b054d3cd43ca1255/users/1fa8e1d078ce433980cff8ad48da65b9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:24:52.761769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:52.762060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:52.762363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:52.808516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] MFA Rules not processed for user `1fa8e1d078ce433980cff8ad48da65b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:52.812787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:52.963829 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:53.061233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1931/3844] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:53.077136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad2cb5-3039-45e6-a68d-356cb263a740 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:53.077693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad2cb5-3039-45e6-a68d-356cb263a740 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:53.078242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad2cb5-3039-45e6-a68d-356cb263a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:53.113373 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:24:53.132124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-16ad2cb5-3039-45e6-a68d-356cb263a740 None None] MFA Rules not processed for user `1fa8e1d078ce433980cff8ad48da65b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:53.133837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-16ad2cb5-3039-45e6-a68d-356cb263a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:53.149742 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1914/3845] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:53.157715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:53.159902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:53.323664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934ef635-cbfc-45da-873c-4135da27e358 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:53.342044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:53.342820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:53.343701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:53.343701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:53.393348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:53.395719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:53.429667 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1932/3846] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:55.191176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3285a-74b9-41bc-b0db-e53a7e05870b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:55.191704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3285a-74b9-41bc-b0db-e53a7e05870b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:55.191704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e3285a-74b9-41bc-b0db-e53a7e05870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:55.236885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c5e3285a-74b9-41bc-b0db-e53a7e05870b None None] MFA Rules not processed for user `0a194df9dbe7498da99bcfadd85d7f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:55.238046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c5e3285a-74b9-41bc-b0db-e53a7e05870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:55.325826 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1915/3847] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:55.534704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:55.536764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:55.555013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc0f42c-e5a5-4a9f-a097-8442414deb87 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:55.566993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:55.568621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:55.569111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:55.569754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:55.582364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:55.585188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:55.600104 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1933/3848] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:24:57.686839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b18c-d69a-4869-b687-849c2e92137c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:57.687985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b18c-d69a-4869-b687-849c2e92137c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:57.688444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633b18c-d69a-4869-b687-849c2e92137c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:57.733168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c633b18c-d69a-4869-b687-849c2e92137c None None] MFA Rules not processed for user `0a194df9dbe7498da99bcfadd85d7f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:24:57.734120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c633b18c-d69a-4869-b687-849c2e92137c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:57.746530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1916/3849] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:24:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:24:59.536625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:24:59.557579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d7dfe-7937-4d94-8c26-29f6303d4b1a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:24:59.579872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:24:59.580781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:24:59.581215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:24:59.581636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:24:59.585349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:24:59.617427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:24:59.619363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:24:59.648438 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1934/3850] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:24:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:07.702391 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=35 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:09.630261 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=54 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:19.652201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:19.652997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:19.652997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:19.689096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] MFA Rules not processed for user `0a194df9dbe7498da99bcfadd85d7f1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:19.690467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:19.718049 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1917/3851] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:22.065469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:22.067643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:22.157929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc02e789-2b42-46a1-8a81-98b786d36efa service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:22.162869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:22.171062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:22.171062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:22.171062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] PATH_INFO: `/v3/users/8749099df5fc4a7baa9cf069db90f3ed` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:22.171062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8749099df5fc4a7baa9cf069db90f3ed)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:22.171062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:22.228591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8749099df5fc4a7baa9cf069db90f3ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.229261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8749099df5fc4a7baa9cf069db90f3ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.238054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8749099df5fc4a7baa9cf069db90f3ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.238865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8749099df5fc4a7baa9cf069db90f3ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.248061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8dfe6ec-7c65-44ec-b83e-cee40ec82f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8749099df5fc4a7baa9cf069db90f3ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.276679 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1935/3852] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:25:22 2022] DELETE /identity/v3/users/8749099df5fc4a7baa9cf069db90f3ed => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:25:22.592507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:22.619779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c454b86-2890-4462-8745-682cd6f74d49 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:22.731672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:22.732799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:22.732984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:22.733447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] PATH_INFO: `/v3/projects/e6d6c1457beb4171a95570a86c38b303` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:22.735101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d6c1457beb4171a95570a86c38b303)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:22.738246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:22.801061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d6c1457beb4171a95570a86c38b303', 'request_id': 'req-eaed0c50-6b72-465e-a8c9-8a8f7df83734'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.810227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d6c1457beb4171a95570a86c38b303', 'request_id': 'req-eaed0c50-6b72-465e-a8c9-8a8f7df83734'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.819705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d6c1457beb4171a95570a86c38b303', 'request_id': 'req-eaed0c50-6b72-465e-a8c9-8a8f7df83734'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.834952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] The token cache is being invalidate because project e6d6c1457beb4171a95570a86c38b303 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:25:22.835058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.835727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eaed0c50-6b72-465e-a8c9-8a8f7df83734 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:22.837642 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1918/3853] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:25:22 2022] DELETE /identity/v3/projects/e6d6c1457beb4171a95570a86c38b303 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:25:22.842843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:22.843357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:22.844032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:22.865714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:22.867257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:22.954765 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1936/3854] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:22.956657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:22.956807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:22.957064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:22.987568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:22.989444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:23.025424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.026050 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1919/3855] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:25:23.040265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60d3445-495c-4c1b-a6b8-8372957cf740 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.061886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.062500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.062781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.063052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.063789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:25:23.064094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.066061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.093770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.100428 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1937/3856] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:25:23.105809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa97d3-1dcf-4732-8ddc-beb0728acb67 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.124242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.127008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.127533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.128138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.131063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.134863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.172589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1920/3857] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:25:23 2022] POST /identity/v3/projects => generated 399 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:25:23.176573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.188008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03ac922-9ee1-47f9-a0c0-bc4a60861d4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.195484 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:23.277753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.278539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.279600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.279896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.280737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.283255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.313875 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1938/3858] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:25:23 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:25:23.318382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.342569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79135b1-a978-4346-bb21-bcc4c8f0195e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.349842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.350639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.350925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.351456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.352543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.354721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.374029 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1921/3859] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:25:23.377863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.394611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27305ab1-ea6b-4bde-8fcd-c484cb2a04a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.402236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d577b-9ad6-410b-a69c-c7bc4cb17bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.403897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d577b-9ad6-410b-a69c-c7bc4cb17bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.404583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d577b-9ad6-410b-a69c-c7bc4cb17bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.405140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d577b-9ad6-410b-a69c-c7bc4cb17bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.408327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d577b-9ad6-410b-a69c-c7bc4cb17bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.411110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d577b-9ad6-410b-a69c-c7bc4cb17bc5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.438652 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1939/3860] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:25:23.439926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.460882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79090378-2b2f-4e96-9a97-3ad0bbdb4773 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.467364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.468526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.468915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.469289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] PATH_INFO: `/v3/projects/92401b33570c4cdda9c099534a47eb52/users/04fa831a24cf47608634a4bc1009ee3d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.498588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92401b33570c4cdda9c099534a47eb52, user_id=04fa831a24cf47608634a4bc1009ee3d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.503799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.534522 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1922/3861] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:25:23 2022] PUT /identity/v3/projects/92401b33570c4cdda9c099534a47eb52/users/04fa831a24cf47608634a4bc1009ee3d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:25:23.536368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf25f31-6120-4bda-ac31-28a42889d9ff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.536669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf25f31-6120-4bda-ac31-28a42889d9ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.536960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf25f31-6120-4bda-ac31-28a42889d9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.557604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3bf25f31-6120-4bda-ac31-28a42889d9ff None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:23.559350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bf25f31-6120-4bda-ac31-28a42889d9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:23.650730 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1940/3862] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:23.661937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:23.664205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:23.696300 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:23.743014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66e3b24-a3a7-4810-b1d2-9210681d45f2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:23.747315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4157770-e559-4651-bf6e-654f8f581391 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:23.747980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157770-e559-4651-bf6e-654f8f581391 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:23.748329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157770-e559-4651-bf6e-654f8f581391 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:23.748868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157770-e559-4651-bf6e-654f8f581391 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:23.761314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4157770-e559-4651-bf6e-654f8f581391 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:23.762927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4157770-e559-4651-bf6e-654f8f581391 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:23.792665 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1923/3863] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:30.154957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:30.154957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:30.154957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:30.197766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] MFA Rules not processed for user `04fa831a24cf47608634a4bc1009ee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:30.221310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:30.335492 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1941/3864] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:30.346369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:30.346369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:30.346369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:30.379461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] MFA Rules not processed for user `04fa831a24cf47608634a4bc1009ee3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:30.381461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:30.390255 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1924/3865] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:30.545691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:30.548245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:30.577885 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:30.675165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd933bc-cf63-4460-a543-de3c956f3502 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:30.682187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35bb81-947d-4a5d-a44f-79240e3d164b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:30.682863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35bb81-947d-4a5d-a44f-79240e3d164b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:30.683145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35bb81-947d-4a5d-a44f-79240e3d164b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:30.683418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35bb81-947d-4a5d-a44f-79240e3d164b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:30.693713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35bb81-947d-4a5d-a44f-79240e3d164b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:30.695408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac35bb81-947d-4a5d-a44f-79240e3d164b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:30.709596 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1942/3866] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:40.373580 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=20 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:40.702681 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=27 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:41.265387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:41.267068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:41.282470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735639c-77f0-4b17-92f5-01bfb725132b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:41.288186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:41.289365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:41.289752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:41.290459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] PATH_INFO: `/v3/users/1fa8e1d078ce433980cff8ad48da65b9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:41.291533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa8e1d078ce433980cff8ad48da65b9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:41.293583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:41.349611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa8e1d078ce433980cff8ad48da65b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:41.358532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa8e1d078ce433980cff8ad48da65b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:41.379270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa8e1d078ce433980cff8ad48da65b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:41.380480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa8e1d078ce433980cff8ad48da65b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:41.388284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa8e1d078ce433980cff8ad48da65b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:41.395028 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1925/3867] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:25:41 2022] DELETE /identity/v3/users/1fa8e1d078ce433980cff8ad48da65b9 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:25:41.399973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:41.400272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:41.400594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:41.419380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:41.420663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:41.483818 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1943/3868] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:41.493712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:41.495221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:41.563878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cb02b-bf24-43d0-8453-4703f15a8dfb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:41.570065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5cac3-bd4e-4239-8a0a-0c8d241197a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:41.570987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5cac3-bd4e-4239-8a0a-0c8d241197a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:41.571484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5cac3-bd4e-4239-8a0a-0c8d241197a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:41.572090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5cac3-bd4e-4239-8a0a-0c8d241197a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:41.583947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5cac3-bd4e-4239-8a0a-0c8d241197a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:41.585874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5cac3-bd4e-4239-8a0a-0c8d241197a5 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:41.600235 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1926/3869] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:41.918759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:41.927707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:41.957754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb47c7b-ac60-4a21-99ea-c9dc48854a90 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:41.973877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:41.974841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:41.975130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:41.975386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] PATH_INFO: `/v3/projects/19234bc0038b46f7b054d3cd43ca1255` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:41.977154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19234bc0038b46f7b054d3cd43ca1255)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:41.981130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.042225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19234bc0038b46f7b054d3cd43ca1255', 'request_id': 'req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:42.051043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19234bc0038b46f7b054d3cd43ca1255', 'request_id': 'req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:42.061240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19234bc0038b46f7b054d3cd43ca1255', 'request_id': 'req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:42.078526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] The token cache is being invalidate because project 19234bc0038b46f7b054d3cd43ca1255 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:25:42.079023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:42.079829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a7b50a7f-50f5-40f8-b9e9-00ad2ace8104 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:25:42.081865 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1944/3870] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:25:41 2022] DELETE /identity/v3/projects/19234bc0038b46f7b054d3cd43ca1255 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:25:42.087239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.087527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.087863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.106818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:42.108011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:42.173601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1927/3871] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:42.181757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.182497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.182497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.206197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:42.207526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:42.216583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1945/3872] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:42.220665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.230616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ec75c-1cfe-4333-ae95-a4bbb2f25cb1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.241661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.243418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.243927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.244543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.245903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:25:42.246942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.249310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.266409 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1928/3873] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:25:42.271131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.283890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77d8b-ae36-407b-a0ae-4b136191063c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.290068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.290738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.291012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.291691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.292074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.293958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.330172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1946/3874] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:25:42 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:25:42.337265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.343568 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:42.348255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ad5a53-cf12-428e-9542-91aa5fdc414c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.411706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.412442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.412736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.412995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.413720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.416227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.447873 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1929/3875] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:25:42 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:25:42.452178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.463641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421b523e-48af-4e22-a997-3c105485f0a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.470229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.471073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.472179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.472179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.472680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.474527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.486032 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1947/3876] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:25:42.490249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.503278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c634bce-e248-4f02-b91b-257ed39c3f1d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.509000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808c45d-cf59-4589-bea2-00d8b566bb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.509715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c45d-cf59-4589-bea2-00d8b566bb1c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.510176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c45d-cf59-4589-bea2-00d8b566bb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.510610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808c45d-cf59-4589-bea2-00d8b566bb1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.511542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808c45d-cf59-4589-bea2-00d8b566bb1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.513352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808c45d-cf59-4589-bea2-00d8b566bb1c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.526937 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1930/3877] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:25:42.532609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.544846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c76b9-2029-4f47-887f-8103669f4498 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.553242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.554386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.554725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.556432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] PATH_INFO: `/v3/projects/5c850546307343069da2291117c28f0c/users/d3277b161298479db5b7114cad011563/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.574876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c850546307343069da2291117c28f0c, user_id=d3277b161298479db5b7114cad011563, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.578249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.598120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1948/3878] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:25:42 2022] PUT /identity/v3/projects/5c850546307343069da2291117c28f0c/users/d3277b161298479db5b7114cad011563/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:25:42.603435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385ca6-09f6-4415-a86a-df9fc689f138 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.603724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385ca6-09f6-4415-a86a-df9fc689f138 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.604010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb385ca6-09f6-4415-a86a-df9fc689f138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.624446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fb385ca6-09f6-4415-a86a-df9fc689f138 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:42.626049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fb385ca6-09f6-4415-a86a-df9fc689f138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:42.734588 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1931/3879] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:42.750763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:42.753368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:42.782714 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:42.833648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f83ac74-2bd4-4349-90e4-4743bbd2b8bd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:42.837834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc0400-a9de-427d-9f51-804b7e7a1a9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:42.838738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0400-a9de-427d-9f51-804b7e7a1a9e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:42.839129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0400-a9de-427d-9f51-804b7e7a1a9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:42.839659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0400-a9de-427d-9f51-804b7e7a1a9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:42.850654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc0400-a9de-427d-9f51-804b7e7a1a9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:42.853792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc0400-a9de-427d-9f51-804b7e7a1a9e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:42.864500 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1949/3880] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:48.848370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:48.848947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:48.849301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:48.882525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:48.884305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:48.969177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1932/3881] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:48.981442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca270-e796-48c6-84ca-934c0edf578a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:48.982028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca270-e796-48c6-84ca-934c0edf578a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:48.982461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ca270-e796-48c6-84ca-934c0edf578a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:49.003699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bf5ca270-e796-48c6-84ca-934c0edf578a None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:49.005799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bf5ca270-e796-48c6-84ca-934c0edf578a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:49.015647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1950/3882] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:25:49.030210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:49.031940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:49.067209 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:25:49.155016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84126f81-11e9-4c68-b570-7d8c65318847 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:49.161181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1929b60-1240-439b-b51b-6a8321e2823a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:49.161857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1929b60-1240-439b-b51b-6a8321e2823a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:49.162245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1929b60-1240-439b-b51b-6a8321e2823a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:49.162407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1929b60-1240-439b-b51b-6a8321e2823a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:49.174257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1929b60-1240-439b-b51b-6a8321e2823a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:49.176522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1929b60-1240-439b-b51b-6a8321e2823a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:49.208252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1933/3883] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:54.405528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b38d-0fa7-44a4-a9d2-04318a076040 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:54.405976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b38d-0fa7-44a4-a9d2-04318a076040 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:54.406598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f2b38d-0fa7-44a4-a9d2-04318a076040 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:54.410296 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1951/3884] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:25:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:25:54.428077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624cfb9-09d1-4e8a-baef-2733a09ad68a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:54.429206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624cfb9-09d1-4e8a-baef-2733a09ad68a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:54.429760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624cfb9-09d1-4e8a-baef-2733a09ad68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:54.511999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7624cfb9-09d1-4e8a-baef-2733a09ad68a None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:54.513298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7624cfb9-09d1-4e8a-baef-2733a09ad68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:25:54.546852 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1934/3885] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:25:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:25:54.568722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b38d-0fa7-44a4-a9d2-04318a076040 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:25:54.608935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f2b38d-0fa7-44a4-a9d2-04318a076040 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:25:54.620236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:25:54.621815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:54.622301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:54.622777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:54.635059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:25:54.637223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:25:54.668690 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1952/3886] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:25:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:25:59.945793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:25:59.946476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:25:59.946619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:25:59.973490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] MFA Rules not processed for user `70628393aac8485fae89e5d50eac92f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:25:59.974796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:00.153510 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1935/3887] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:25:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:00.762624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:00.794089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d023c8d-2981-4061-9e40-04fbaf6bdfde service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:00.800468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:00.801503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:00.802162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:00.802885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:00.807047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:00.829108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:00.848191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:00.868240 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1953/3888] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:04.337121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:04.338638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:04.368779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba6974e-4d59-4fdf-b3cc-6926cdfbc284 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:04.373818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:04.374737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:04.375026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:04.375306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] PATH_INFO: `/v3/users/0a194df9dbe7498da99bcfadd85d7f1b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:04.376683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a194df9dbe7498da99bcfadd85d7f1b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:04.378656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:04.391323 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:04.464660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a194df9dbe7498da99bcfadd85d7f1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:04.480670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a194df9dbe7498da99bcfadd85d7f1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:04.509416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a194df9dbe7498da99bcfadd85d7f1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:04.511229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a194df9dbe7498da99bcfadd85d7f1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:04.523648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec66c1b2-10ea-4155-8228-889e8af0f0f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a194df9dbe7498da99bcfadd85d7f1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:04.539338 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1936/3889] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:26:04 2022] DELETE /identity/v3/users/0a194df9dbe7498da99bcfadd85d7f1b => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:05.180380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:05.205523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa6c191-b47c-425c-8ab9-e14b9921f2ba service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:05.298875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:05.299902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:05.300184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:05.300508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] PATH_INFO: `/v3/projects/b4a5e53472b245abb7c8c36267cd3040` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:05.301768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4a5e53472b245abb7c8c36267cd3040)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:05.303965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:05.402912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4a5e53472b245abb7c8c36267cd3040', 'request_id': 'req-561c5154-6a2b-4fff-b407-97832cd51180'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:05.410420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4a5e53472b245abb7c8c36267cd3040', 'request_id': 'req-561c5154-6a2b-4fff-b407-97832cd51180'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:05.437039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4a5e53472b245abb7c8c36267cd3040', 'request_id': 'req-561c5154-6a2b-4fff-b407-97832cd51180'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:05.469466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] The token cache is being invalidate because project b4a5e53472b245abb7c8c36267cd3040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:26:05.469981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:05.472437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-561c5154-6a2b-4fff-b407-97832cd51180 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:05.474976 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1954/3890] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:26:05 2022] DELETE /identity/v3/projects/b4a5e53472b245abb7c8c36267cd3040 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:05.481325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:05.481860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:05.482103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:05.552559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:05.556466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:05.645702 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1937/3891] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:05.655501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:05.656209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:05.656686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:05.678466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:05.680230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:05.689938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1955/3892] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:05.695937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:05.713080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf811102-1ff4-4606-a413-d546cab96f00 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:05.721593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:05.722738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:05.723192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:05.723625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:05.724687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:26:05.725176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:05.727418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:05.743950 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1938/3893] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:26:05.748554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:05.760990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b55a7-c3c6-4f05-ab91-7366b8b7a134 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:05.767520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:05.769769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:05.770332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:05.770764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:05.772138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:05.774843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:05.791430 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:05.841343 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1956/3894] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:05.845341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:05.863615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72224b3-cd09-4de7-99ea-f0727f0b749d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:05.970351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:05.972643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:05.972934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:05.973206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:05.974282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:05.976316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:06.009844 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1939/3895] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:26:05 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:06.013912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:06.026688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6844617b-7092-4101-9e19-d5ad92822858 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:06.032227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:06.033370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.033898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.034346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.035246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:06.038601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:06.052439 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1957/3896] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:06.059339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:06.079047 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:06.087993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2608602-7686-4f88-80fa-0aa3bcd528d7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:06.099085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:06.101297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.101763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.102629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.105001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:06.111183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:06.134123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:06.135698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1940/3897] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:06.149348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:06.150581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979468df-aeea-48d4-a1e9-a4b05b9858c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:06.153192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:06.163621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f5f86-b9db-4f33-8bcd-4eefa122a98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:06.166639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5f86-b9db-4f33-8bcd-4eefa122a98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.167134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5f86-b9db-4f33-8bcd-4eefa122a98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.167604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f5f86-b9db-4f33-8bcd-4eefa122a98f admin admin] PATH_INFO: `/v3/projects/0344445e5caf4c43a2e90fdb9eb18fcf/users/69ccdedb76464d99b56ff7308cf44cce/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.185973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dfee8e-9377-4dba-840f-f07d45ee69ae admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:06.200817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:06.203348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.204365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.204807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] PATH_INFO: `/v3/users/04fa831a24cf47608634a4bc1009ee3d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.205823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f5f86-b9db-4f33-8bcd-4eefa122a98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0344445e5caf4c43a2e90fdb9eb18fcf, user_id=69ccdedb76464d99b56ff7308cf44cce, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:06.209723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04fa831a24cf47608634a4bc1009ee3d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:06.214689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f5f86-b9db-4f33-8bcd-4eefa122a98f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:06.215530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:06.271668 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1958/3898] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:26:06 2022] PUT /identity/v3/projects/0344445e5caf4c43a2e90fdb9eb18fcf/users/69ccdedb76464d99b56ff7308cf44cce/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:06.277090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086324-8d23-4138-85d8-457a95e8dbd8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.277390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086324-8d23-4138-85d8-457a95e8dbd8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.277670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e086324-8d23-4138-85d8-457a95e8dbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.349416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e086324-8d23-4138-85d8-457a95e8dbd8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:06.351214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e086324-8d23-4138-85d8-457a95e8dbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:06.391649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04fa831a24cf47608634a4bc1009ee3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:06.410970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04fa831a24cf47608634a4bc1009ee3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:06.437101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04fa831a24cf47608634a4bc1009ee3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:06.437874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04fa831a24cf47608634a4bc1009ee3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:06.456063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04fa831a24cf47608634a4bc1009ee3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:06.474923 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1941/3899] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:26:06 2022] DELETE /identity/v3/users/04fa831a24cf47608634a4bc1009ee3d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:06.505967 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1959/3900] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:06.528857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:06.530699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:06.616048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.616516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.616887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.661094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:06.662413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:06.666411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f32525a-0811-45f2-9ba8-bb7183ad98d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:06.689156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c161faa-b4a9-4744-8088-5c36d52240d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:06.691857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161faa-b4a9-4744-8088-5c36d52240d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:06.693037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161faa-b4a9-4744-8088-5c36d52240d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:06.693322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c161faa-b4a9-4744-8088-5c36d52240d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:06.761999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1960/3901] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:06.810453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c161faa-b4a9-4744-8088-5c36d52240d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:06.815819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c161faa-b4a9-4744-8088-5c36d52240d8 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:06.840438 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1942/3902] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:26:07.203024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.204767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:07.223441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a36e13-2cc2-4702-8102-ff08112bc5b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.230480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.232224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.232836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.233413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] PATH_INFO: `/v3/projects/92401b33570c4cdda9c099534a47eb52` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.235324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92401b33570c4cdda9c099534a47eb52)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.239615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.325736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92401b33570c4cdda9c099534a47eb52', 'request_id': 'req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:07.333628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92401b33570c4cdda9c099534a47eb52', 'request_id': 'req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:07.339633 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:07.354087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92401b33570c4cdda9c099534a47eb52', 'request_id': 'req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:07.373687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] The token cache is being invalidate because project 92401b33570c4cdda9c099534a47eb52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:26:07.374337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:07.375248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-321eb6eb-a325-4b8a-b965-d2d8c92af8c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:07.377575 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1961/3903] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:26:07 2022] DELETE /identity/v3/projects/92401b33570c4cdda9c099534a47eb52 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:07.382645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.382935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.383429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.423883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:07.426032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:07.440826 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:07.543909 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1943/3904] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:07.552626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.553166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.553650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.575927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:07.577552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:07.587977 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1962/3905] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:07.592207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.604550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127868c3-0175-40a7-aa0f-cc1549c7c2e3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.610502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.611395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.611880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.612323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.613290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:26:07.613768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.615890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.631498 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1944/3906] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:26:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:26:07.636066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.648506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995aa9a6-d5ac-4c29-a8fc-07328e5c3075 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.657922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.658677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.658966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.659245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.659948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.662139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.696828 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1963/3907] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:26:07 2022] POST /identity/v3/projects => generated 397 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:07.701250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.712294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1f6d6-9b4a-4b42-bde1-7703c0158a1d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.787487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.788257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.788577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.788855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.789566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.791944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.817218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1945/3908] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:26:07 2022] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:26:07.822085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.835900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e30f98-e7b5-4ba0-897f-207fde706599 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.847202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.849350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.849642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.849928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.850726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.852456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.864870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1964/3909] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:07.869960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.882270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de4c58-ff7f-48c8-aeed-e9d0c562d4a4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.887697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc366b2-f5ec-4565-8628-026f3b702cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.888434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc366b2-f5ec-4565-8628-026f3b702cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.888878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc366b2-f5ec-4565-8628-026f3b702cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.889087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc366b2-f5ec-4565-8628-026f3b702cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.890246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc366b2-f5ec-4565-8628-026f3b702cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.891929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc366b2-f5ec-4565-8628-026f3b702cc3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.905331 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1946/3910] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:07 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:07.909801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:07.929113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbf3c4-eab8-490a-bdc3-884099d5c7eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:07.936069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a77ce-0ea8-4c2e-bfc9-11b11cb12dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:07.937272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a77ce-0ea8-4c2e-bfc9-11b11cb12dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.937656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a77ce-0ea8-4c2e-bfc9-11b11cb12dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.938134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a77ce-0ea8-4c2e-bfc9-11b11cb12dad admin admin] PATH_INFO: `/v3/projects/12a61aa647c04a0c8ab83115182a748d/users/0d182ca42f834a89bdfe3205362ec903/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:07.961501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a77ce-0ea8-4c2e-bfc9-11b11cb12dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=12a61aa647c04a0c8ab83115182a748d, user_id=0d182ca42f834a89bdfe3205362ec903, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:07.966868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68a77ce-0ea8-4c2e-bfc9-11b11cb12dad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:07.995868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1965/3911] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:26:07 2022] PUT /identity/v3/projects/12a61aa647c04a0c8ab83115182a748d/users/0d182ca42f834a89bdfe3205362ec903/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:26:07.997837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:07.998326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:07.998759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:08.034976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] MFA Rules not processed for user `0d182ca42f834a89bdfe3205362ec903`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:08.037244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:08.166666 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1947/3912] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:08.181743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2919f7-30c0-4b9f-8675-93f0a2eb196d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:08.182136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2919f7-30c0-4b9f-8675-93f0a2eb196d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:08.182484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2919f7-30c0-4b9f-8675-93f0a2eb196d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:08.204931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ca2919f7-30c0-4b9f-8675-93f0a2eb196d None None] MFA Rules not processed for user `0d182ca42f834a89bdfe3205362ec903`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:08.206263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ca2919f7-30c0-4b9f-8675-93f0a2eb196d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:08.222407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1966/3913] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:08.434658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:08.436672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:08.459237 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:08.672142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5043d6-c089-49c7-a113-a16f78e8e717 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:08.678254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f5036-5015-4bb7-bd8b-cb7f851c5327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:08.679554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5036-5015-4bb7-bd8b-cb7f851c5327 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:08.679952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5036-5015-4bb7-bd8b-cb7f851c5327 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:08.680576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f5036-5015-4bb7-bd8b-cb7f851c5327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:08.695092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f5036-5015-4bb7-bd8b-cb7f851c5327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:08.700286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966f5036-5015-4bb7-bd8b-cb7f851c5327 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:08.729889 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1948/3914] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:08 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:08.847846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d522e3b-1f3d-44d6-9d2f-dc67a1358cba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:08.848490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d522e3b-1f3d-44d6-9d2f-dc67a1358cba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:08.849159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d522e3b-1f3d-44d6-9d2f-dc67a1358cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:08.872138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8d522e3b-1f3d-44d6-9d2f-dc67a1358cba None None] MFA Rules not processed for user `0d182ca42f834a89bdfe3205362ec903`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:08.873866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d522e3b-1f3d-44d6-9d2f-dc67a1358cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:08.887863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1967/3915] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:08.957739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ba91-c079-4b6b-abf7-26a4f34ec297 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:08.958081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ba91-c079-4b6b-abf7-26a4f34ec297 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:08.958363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ba91-c079-4b6b-abf7-26a4f34ec297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:08.982220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-89e4ba91-c079-4b6b-abf7-26a4f34ec297 None None] MFA Rules not processed for user `0d182ca42f834a89bdfe3205362ec903`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:08.984220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89e4ba91-c079-4b6b-abf7-26a4f34ec297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:09.002084 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1949/3916] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:09.028247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:09.028802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:09.029209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:09.054856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] MFA Rules not processed for user `0d182ca42f834a89bdfe3205362ec903`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:09.056871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:09.065692 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1968/3917] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:09.102043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d60ad-15ea-4f45-8c86-4e16b90b7688 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:09.102336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d60ad-15ea-4f45-8c86-4e16b90b7688 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:09.102774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d60ad-15ea-4f45-8c86-4e16b90b7688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:09.131826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-012d60ad-15ea-4f45-8c86-4e16b90b7688 None None] MFA Rules not processed for user `0d182ca42f834a89bdfe3205362ec903`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:09.133590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-012d60ad-15ea-4f45-8c86-4e16b90b7688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:09.166378 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1950/3918] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:09.166501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:09.310200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0231c082-1130-4071-9a4c-caa5cc1b4005 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:09.325861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:09.327124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:09.328000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:09.328000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] PATH_INFO: `/v3/users/0d182ca42f834a89bdfe3205362ec903` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:09.340830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d182ca42f834a89bdfe3205362ec903)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:09.343214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:09.487854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d182ca42f834a89bdfe3205362ec903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:09.489348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d182ca42f834a89bdfe3205362ec903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:09.509129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d182ca42f834a89bdfe3205362ec903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:09.510377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d182ca42f834a89bdfe3205362ec903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:09.525877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d182ca42f834a89bdfe3205362ec903'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:09.527575 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:09.568693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:09.569221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:09.569864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:09.577845 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1969/3919] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:26:09 2022] DELETE /identity/v3/users/0d182ca42f834a89bdfe3205362ec903 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:09.594127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:09.595761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:09.693340 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1951/3920] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:09.749280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:09.752871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:09.893011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92c35cc-e728-4fdb-83b4-fa063054c62d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:09.901936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176d1123-6bd0-4f5b-9032-facb2027af9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:09.905541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1123-6bd0-4f5b-9032-facb2027af9f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:09.906010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1123-6bd0-4f5b-9032-facb2027af9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:09.906391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d1123-6bd0-4f5b-9032-facb2027af9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:09.926582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1123-6bd0-4f5b-9032-facb2027af9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:09.928459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176d1123-6bd0-4f5b-9032-facb2027af9f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:09.971899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1970/3921] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:11.396987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:11.401261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:11.436499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af3ab5-365a-41e6-8ccf-3f9192e0a89e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:11.443309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:11.444958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:11.445412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:11.445844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] PATH_INFO: `/v3/projects/12a61aa647c04a0c8ab83115182a748d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:11.447385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12a61aa647c04a0c8ab83115182a748d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:11.450780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:11.569097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12a61aa647c04a0c8ab83115182a748d', 'request_id': 'req-5572288d-dd65-4fa4-9945-1da446fdf132'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:11.582082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12a61aa647c04a0c8ab83115182a748d', 'request_id': 'req-5572288d-dd65-4fa4-9945-1da446fdf132'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:11.592253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12a61aa647c04a0c8ab83115182a748d', 'request_id': 'req-5572288d-dd65-4fa4-9945-1da446fdf132'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:11.619883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] The token cache is being invalidate because project 12a61aa647c04a0c8ab83115182a748d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:26:11.620586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:11.621504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:11.627241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1952/3922] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:26:11 2022] DELETE /identity/v3/projects/12a61aa647c04a0c8ab83115182a748d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:11.639452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed10c-e0e0-4de4-957d-a210a15443ed None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:11.640596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed10c-e0e0-4de4-957d-a210a15443ed None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:11.641322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ed10c-e0e0-4de4-957d-a210a15443ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:11.700425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-109ed10c-e0e0-4de4-957d-a210a15443ed None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:11.702226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-109ed10c-e0e0-4de4-957d-a210a15443ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:11.716431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:11.718431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:11.732715 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:11.823682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1971/3923] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:11.826035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:11.826627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:11.827064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:11.861845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:11.864277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:11.882656 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1972/3924] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:11.884981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:11.889990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572288d-dd65-4fa4-9945-1da446fdf132 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:11.904028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:11.905408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:11.907994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:11.908562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] PATH_INFO: `/v3/users/6ab2e0f3e7d9441181f29c1278438ab6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:11.910281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab2e0f3e7d9441181f29c1278438ab6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:11.910943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f32dc-084f-42c3-ae77-4b6cb2c7788c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:11.913198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:11.917804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:11.923976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:11.924818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:11.925217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:11.926211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:26:11.926612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:11.931587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:11.952739 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1973/3925] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:26:11.954421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:11.969090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a94c7-f4ec-4195-a5a6-329bf43d67e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:11.974607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:11.975584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:11.975867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:11.976144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:11.976917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:11.979041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:11.989202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab2e0f3e7d9441181f29c1278438ab6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:11.999321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab2e0f3e7d9441181f29c1278438ab6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:12.018480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab2e0f3e7d9441181f29c1278438ab6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:12.019573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab2e0f3e7d9441181f29c1278438ab6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:12.025589 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1974/3926] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:26:11 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:26:12.029989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:12.032134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab2e0f3e7d9441181f29c1278438ab6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:12.032674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:12.042548 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1953/3927] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:26:11 2022] DELETE /identity/v3/users/6ab2e0f3e7d9441181f29c1278438ab6 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:12.106055 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:12.159077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666b6a8-6b75-4d91-8cef-e19dbb27d8a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:12.271651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:12.273543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:12.273543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:12.274377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:12.275209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:12.277487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:12.329529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:12.350610 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1975/3928] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:26:12 2022] POST /identity/v3/users => generated 283 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:26:12.358126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c950af-b93b-489a-aa31-670a471b5cc9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:12.374822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:12.375453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:12.375728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:12.376007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:12.376793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:12.378444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:12.410371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1954/3929] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:12.415308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:12.437267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab91172-1e38-4e7c-922b-d25484b590cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:12.451298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb92ef-d2a3-4561-802e-3b392934269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:12.452161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb92ef-d2a3-4561-802e-3b392934269f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:12.452335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb92ef-d2a3-4561-802e-3b392934269f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:12.452646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb92ef-d2a3-4561-802e-3b392934269f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:12.453399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb92ef-d2a3-4561-802e-3b392934269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:12.457147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb92ef-d2a3-4561-802e-3b392934269f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:12.481200 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1976/3930] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:12.485591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:12.503569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf381f-6c69-47ff-9af7-0449b51c1bd2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:12.518980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:12.520202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:12.520533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:12.523096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] PATH_INFO: `/v3/projects/5e0c90d868d6416aa3401e0469c544a7/users/dead46ef34b54e4681793f8f89b489da/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:12.563962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0c90d868d6416aa3401e0469c544a7, user_id=dead46ef34b54e4681793f8f89b489da, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:12.572034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:12.602207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1955/3931] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:26:12 2022] PUT /identity/v3/projects/5e0c90d868d6416aa3401e0469c544a7/users/dead46ef34b54e4681793f8f89b489da/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:12.612700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:12.614437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:12.615074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:12.715534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] MFA Rules not processed for user `dead46ef34b54e4681793f8f89b489da`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:12.719159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:12.837039 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1977/3932] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:12 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:12.851938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:12.853924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:12.863037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:12.866408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:12.950494 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:12.982084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e99e9-15c2-4915-bf07-4447eaf55205 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:12.989937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:12.991387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:12.991757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:12.992103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] PATH_INFO: `/v3/projects/64876a82548845c39c3770e7c6701bda` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:12.993909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64876a82548845c39c3770e7c6701bda)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:12.997289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:13.042801 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:13.083460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64876a82548845c39c3770e7c6701bda', 'request_id': 'req-a8ff1181-0978-4fb4-971f-e817c6e724e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.091766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7604f02-a246-4846-9f52-02580ea5329e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:13.096677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64876a82548845c39c3770e7c6701bda', 'request_id': 'req-a8ff1181-0978-4fb4-971f-e817c6e724e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.114799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64876a82548845c39c3770e7c6701bda', 'request_id': 'req-a8ff1181-0978-4fb4-971f-e817c6e724e5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.149392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] The token cache is being invalidate because project 64876a82548845c39c3770e7c6701bda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:26:13.149795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.150700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8ff1181-0978-4fb4-971f-e817c6e724e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.155965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1956/3933] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:26:12 2022] DELETE /identity/v3/projects/64876a82548845c39c3770e7c6701bda => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:13.161491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1cd27-96aa-4f76-8425-59504173d2b4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.161861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1cd27-96aa-4f76-8425-59504173d2b4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.162211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1cd27-96aa-4f76-8425-59504173d2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.214589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8ca1cd27-96aa-4f76-8425-59504173d2b4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:13.218047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8ca1cd27-96aa-4f76-8425-59504173d2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:13.269292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:13.270152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.270612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.270984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.275465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:13.477568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1957/3934] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:13.489327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.491845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.491845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.529619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:13.532536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:13.535497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:13.543083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:13.566475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1978/3935] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 699 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:13.571570 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1958/3936] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:13.576894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:13.603633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdbf57-87b4-40db-a629-4db608c12678 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:13.614377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:13.614670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:13.615390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.615533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.615869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:13.616015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.617431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:26:13.617857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:13.620708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:13.639723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46f2b-e02d-45fd-99d1-ce7f891c4757 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:13.661364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:13.662289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.662641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.663530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1979/3937] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:26:13.668097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:13.672415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] PATH_INFO: `/v3/users/dead46ef34b54e4681793f8f89b489da` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.676819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dead46ef34b54e4681793f8f89b489da)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:13.678381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:13.694960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5753029b-04a8-4589-9b99-cd83aa10d31a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:13.702792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:13.704101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.704909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.705882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.707134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:13.710806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:13.755325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1980/3938] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:26:13 2022] POST /identity/v3/projects => generated 387 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:13.760254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:13.840201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dead46ef34b54e4681793f8f89b489da'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.854829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dead46ef34b54e4681793f8f89b489da'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.880773 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:13.884693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dead46ef34b54e4681793f8f89b489da'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.887404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dead46ef34b54e4681793f8f89b489da'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.926972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4e7a6fec-a838-48eb-95c7-16c48b64161b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dead46ef34b54e4681793f8f89b489da'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:13.930929 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:13.959043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1959/3939] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:26:13 2022] DELETE /identity/v3/users/dead46ef34b54e4681793f8f89b489da => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:13.960399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c859b-7f0d-4cd3-9f3c-a632cd492b14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:13.960796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:13.961088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:13.961377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:13.998679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:14.000381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:14.165322 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1960/3940] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:14.192139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:14.192961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.193320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.193710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.194760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:14.196748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:14.203281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:14.205339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:14.242407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1981/3941] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:26:13 2022] POST /identity/v3/users => generated 294 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:14.253819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:14.257272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:14.287552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9023d416-d6c1-4755-b41f-ffee49154789 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:14.300058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:14.301209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.303811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.304294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.305269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:14.307100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:14.347446 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1982/3942] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:14.351719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:14.363832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b29f1-f920-47a5-a330-f69b76e4b7b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:14.378511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97541923-c860-45f2-b7ee-b76d77086f74 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:14.384413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:14.385499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.386184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.387142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.387363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6718e8a-701b-441f-819c-befacfc0f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:14.389713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6718e8a-701b-441f-819c-befacfc0f1df admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.390004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6718e8a-701b-441f-819c-befacfc0f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.390290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6718e8a-701b-441f-819c-befacfc0f1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.392222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6718e8a-701b-441f-819c-befacfc0f1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:14.395312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6718e8a-701b-441f-819c-befacfc0f1df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:14.401289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:14.404877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:14.425405 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1961/3943] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:14.429052 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1983/3944] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:14.430323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:14.441567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242546e1-0c2e-4686-8c28-f1f8931d837e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:14.449125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:14.450807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.452465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.452956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] PATH_INFO: `/v3/projects/b934a6d0d9ac4a259a9bfb55778a223a/users/d821f2aafa4644edab1aeee30076595d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.473733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b934a6d0d9ac4a259a9bfb55778a223a, user_id=d821f2aafa4644edab1aeee30076595d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:14.477665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:14.503351 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1962/3945] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:26:14 2022] PUT /identity/v3/projects/b934a6d0d9ac4a259a9bfb55778a223a/users/d821f2aafa4644edab1aeee30076595d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:14.506240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.506803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.507383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.542057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:14.543681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:14.676878 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1984/3946] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:14.687907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:14.788783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12877a9-ec7c-4c92-b505-f9148485653c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:14.799437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152624d-12c2-444d-90a4-991d98dde23e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:14.801317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152624d-12c2-444d-90a4-991d98dde23e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:14.801731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152624d-12c2-444d-90a4-991d98dde23e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:14.801918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152624d-12c2-444d-90a4-991d98dde23e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:14.817833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152624d-12c2-444d-90a4-991d98dde23e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:14.820209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b152624d-12c2-444d-90a4-991d98dde23e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:14.834896 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1963/3947] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:15.180339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.182783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:15.204882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f783a3f3-ce02-4778-9589-80977d1a0cf8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.219842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.221007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.221294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.224714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] PATH_INFO: `/v3/projects/5e0c90d868d6416aa3401e0469c544a7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.226599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0c90d868d6416aa3401e0469c544a7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:15.228742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:15.289154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0c90d868d6416aa3401e0469c544a7', 'request_id': 'req-27df2e63-d3ec-4512-9a71-2df68516ade1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:15.297636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0c90d868d6416aa3401e0469c544a7', 'request_id': 'req-27df2e63-d3ec-4512-9a71-2df68516ade1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:15.305062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0c90d868d6416aa3401e0469c544a7', 'request_id': 'req-27df2e63-d3ec-4512-9a71-2df68516ade1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:15.310193 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:15.327875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] The token cache is being invalidate because project 5e0c90d868d6416aa3401e0469c544a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:26:15.328224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:15.329057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27df2e63-d3ec-4512-9a71-2df68516ade1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:26:15.335256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1985/3948] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:26:15 2022] DELETE /identity/v3/projects/5e0c90d868d6416aa3401e0469c544a7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:15.337167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.337429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.337710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.357254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:15.358507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:15.363496 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:15.460691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1964/3949] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:15.462106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.462398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.462685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.484918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:15.486015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:15.499516 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1986/3950] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:15.500909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.524600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8280dc-b470-48ff-bbab-8940a0c77500 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.536259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.537413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.537922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.538397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.539475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:26:15.540009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:15.541996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:15.574726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1965/3951] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:26:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:26:15.581068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.594590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b5dca-0a89-4523-998e-89f2e759c05f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.608120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398fa605-41fe-4b8c-a83e-c878aefa5d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.609050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa605-41fe-4b8c-a83e-c878aefa5d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.609340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa605-41fe-4b8c-a83e-c878aefa5d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.609614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398fa605-41fe-4b8c-a83e-c878aefa5d15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.610317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fa605-41fe-4b8c-a83e-c878aefa5d15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:15.612581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398fa605-41fe-4b8c-a83e-c878aefa5d15 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:15.651074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1987/3952] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:26:15 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:15.655730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.671108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddcf6d1-0638-454e-8ffc-98fa321e1943 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.768328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.769075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.769458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.769809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.771031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:15.773453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:15.782144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb9182-6b01-4d31-ac5c-e478b9b914e8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.782528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb9182-6b01-4d31-ac5c-e478b9b914e8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.782882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb9182-6b01-4d31-ac5c-e478b9b914e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.829545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1966/3953] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:26:15 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:26:15.831868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.832930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-abeb9182-6b01-4d31-ac5c-e478b9b914e8 None None] MFA Rules not processed for user `d821f2aafa4644edab1aeee30076595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:15.834408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-abeb9182-6b01-4d31-ac5c-e478b9b914e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:15.845080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52897245-271a-41ea-b207-a3ffb625bc86 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.850522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.851804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.852255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.852719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.853658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:15.855467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:15.880658 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1967/3954] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:15.882916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.900092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3903be02-b3c2-4bdb-9087-e35ce679476c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.905540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.906243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.906506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.906779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.907519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:15.909365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:15.926002 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1968/3955] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:26:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:26:15.927178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:15.932201 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1988/3956] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:15.940017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811fdf38-1af9-4cdd-bc28-bd9138c9f9e9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:15.942169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064627dc-65dd-44c7-b008-7562f0a03d7e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.942469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064627dc-65dd-44c7-b008-7562f0a03d7e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.942751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064627dc-65dd-44c7-b008-7562f0a03d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:15.950387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea856294-8e0d-486f-bd61-225b0d84fdcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:15.951430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856294-8e0d-486f-bd61-225b0d84fdcc admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:15.951845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856294-8e0d-486f-bd61-225b0d84fdcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:15.952226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea856294-8e0d-486f-bd61-225b0d84fdcc admin admin] PATH_INFO: `/v3/projects/670985e06d7d4850a50b8d851cc451cf/users/58785d156c0c4c76ab6c607f98d120d3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:16.007986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856294-8e0d-486f-bd61-225b0d84fdcc admin admin] RBAC: Authorizing `identity:create_grant(project_id=670985e06d7d4850a50b8d851cc451cf, user_id=58785d156c0c4c76ab6c607f98d120d3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:16.008182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-064627dc-65dd-44c7-b008-7562f0a03d7e None None] MFA Rules not processed for user `d821f2aafa4644edab1aeee30076595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:16.012571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-064627dc-65dd-44c7-b008-7562f0a03d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:16.013740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea856294-8e0d-486f-bd61-225b0d84fdcc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:16.025851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1989/3957] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:26:16.040896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:16.044552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:16.044552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:16.056433 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1969/3958] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:26:15 2022] PUT /identity/v3/projects/670985e06d7d4850a50b8d851cc451cf/users/58785d156c0c4c76ab6c607f98d120d3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:26:16.062002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:16.062288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:16.062569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:16.100088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:16.102418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:16.107735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] MFA Rules not processed for user `d821f2aafa4644edab1aeee30076595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:16.110652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:16.160460 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:16.202708 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1970/3959] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:16.205842 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1990/3960] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:16.210930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:16.212417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:16.278905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d95268-88e6-4e0a-8677-be22793709ec None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:16.283470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd65079-f6af-4199-9960-4e504cd0deed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:16.283764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd65079-f6af-4199-9960-4e504cd0deed service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:16.283892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd65079-f6af-4199-9960-4e504cd0deed service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:16.284816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd65079-f6af-4199-9960-4e504cd0deed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:16.295603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd65079-f6af-4199-9960-4e504cd0deed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:16.296870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd65079-f6af-4199-9960-4e504cd0deed service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:16.321614 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1971/3961] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:16.363719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:16.366423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:16.493891 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:16.547909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99461d26-5953-44ae-af7f-d4cc6b8e843e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:16.559342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:16.560004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:16.561417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:16.561707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:16.575053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:16.577002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:16.626537 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1991/3962] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:18.600050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3f3bc-9743-4d3f-a2cf-8488f50df2e5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:18.600586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3f3bc-9743-4d3f-a2cf-8488f50df2e5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:18.600687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3f3bc-9743-4d3f-a2cf-8488f50df2e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:18.683315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e9c3f3bc-9743-4d3f-a2cf-8488f50df2e5 None None] MFA Rules not processed for user `d821f2aafa4644edab1aeee30076595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:18.697589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e9c3f3bc-9743-4d3f-a2cf-8488f50df2e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:18.735576 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1972/3963] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:19.988888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:19.991450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:20.273459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659221c-a638-4183-be43-ee89fb6ba35c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:20.286493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:20.289561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:20.289970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:20.290306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:20.292712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:20.327369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:20.334173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922013db-6d3e-4f08-a194-77aad52080f4 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:20.382729 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1992/3964] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:21.772001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:21.772001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:21.772539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:21.827307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] MFA Rules not processed for user `69ccdedb76464d99b56ff7308cf44cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:21.829644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:22.008786 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1973/3965] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:23.514418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65233016-c627-40ab-80ab-f813fa145e76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:23.514937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65233016-c627-40ab-80ab-f813fa145e76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:23.515249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65233016-c627-40ab-80ab-f813fa145e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:23.529714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:23.531170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:23.565398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207c65a-77de-45b2-ba81-bd973371e5e9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:23.566243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65233016-c627-40ab-80ab-f813fa145e76 None None] MFA Rules not processed for user `d821f2aafa4644edab1aeee30076595d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:23.567926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65233016-c627-40ab-80ab-f813fa145e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:23.585780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488490d-4192-4ba7-85bc-6400b616797b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:23.586455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488490d-4192-4ba7-85bc-6400b616797b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:23.586731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488490d-4192-4ba7-85bc-6400b616797b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:23.587931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488490d-4192-4ba7-85bc-6400b616797b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:23.590580 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1993/3966] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:23.607913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488490d-4192-4ba7-85bc-6400b616797b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:23.609928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c488490d-4192-4ba7-85bc-6400b616797b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:23.652912 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1974/3967] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:28.497614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa866-dedf-4846-bd7f-3cd620821f44 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:28.499141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa866-dedf-4846-bd7f-3cd620821f44 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:28.500710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091aa866-dedf-4846-bd7f-3cd620821f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:28.534372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-091aa866-dedf-4846-bd7f-3cd620821f44 None None] MFA Rules not processed for user `70628393aac8485fae89e5d50eac92f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:28.536642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-091aa866-dedf-4846-bd7f-3cd620821f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:28.654118 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1994/3968] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:30.769118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110cb4-703a-43d6-baf9-70b8174a6347 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:30.770378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110cb4-703a-43d6-baf9-70b8174a6347 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:30.770977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c110cb4-703a-43d6-baf9-70b8174a6347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:30.804022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0c110cb4-703a-43d6-baf9-70b8174a6347 None None] MFA Rules not processed for user `69ccdedb76464d99b56ff7308cf44cce`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:30.809536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0c110cb4-703a-43d6-baf9-70b8174a6347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:30.845177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1975/3969] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:35.300625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac94a-461c-478f-8ab6-625f0e6d4627 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:35.304919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac94a-461c-478f-8ab6-625f0e6d4627 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:35.306135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8ac94a-461c-478f-8ab6-625f0e6d4627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:35.352852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-db8ac94a-461c-478f-8ab6-625f0e6d4627 None None] MFA Rules not processed for user `853162e1868045b4b5e6af9c03c461bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:35.355640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db8ac94a-461c-478f-8ab6-625f0e6d4627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:35.432498 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:35.464091 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1995/3970] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:35.641823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:35.642458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:35.642458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:35.708495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] MFA Rules not processed for user `58785d156c0c4c76ab6c607f98d120d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:35.710021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:35.723888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:35.724548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:35.725452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:35.764214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:35.766080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:35.809198 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:26:35.842428 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1996/3971] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:35.864704 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1976/3972] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:36.744009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:36.778978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fab1a6-d219-4a9d-b015-9a162b72325a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:36.785816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec182a6-1a6b-45ca-9f0a-2620654997e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:36.787338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec182a6-1a6b-45ca-9f0a-2620654997e4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:36.787746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec182a6-1a6b-45ca-9f0a-2620654997e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:36.788095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec182a6-1a6b-45ca-9f0a-2620654997e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:36.798573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec182a6-1a6b-45ca-9f0a-2620654997e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:36.800413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec182a6-1a6b-45ca-9f0a-2620654997e4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:36.813713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1997/3973] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:39.507788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:39.509974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:39.537529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9613e019-8eaf-4faa-8447-abb46b8f21f2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:39.558084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:39.558778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:39.559337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:39.559616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:39.561606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:39.615345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:39.617408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9e198-b4f1-4832-8536-0d6e774f56de service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:39.655509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1977/3974] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:39.719390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059dc9-2f97-4858-8730-fb0b74c92f62 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:39.719964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059dc9-2f97-4858-8730-fb0b74c92f62 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:39.720241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5059dc9-2f97-4858-8730-fb0b74c92f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:39.753701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d5059dc9-2f97-4858-8730-fb0b74c92f62 None None] MFA Rules not processed for user `58785d156c0c4c76ab6c607f98d120d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:39.755924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5059dc9-2f97-4858-8730-fb0b74c92f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:39.765732 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1998/3975] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:41.418923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a42d88-367c-4b78-bedf-bc5fa2187316 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:41.420212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a42d88-367c-4b78-bedf-bc5fa2187316 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:41.420705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a42d88-367c-4b78-bedf-bc5fa2187316 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:41.424334 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1978/3976] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:26:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:26:41.431622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ffb63-6b99-4ecc-9284-cd0ffdc7a77c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:41.432178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ffb63-6b99-4ecc-9284-cd0ffdc7a77c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:41.432178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ffb63-6b99-4ecc-9284-cd0ffdc7a77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:41.456662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-700ffb63-6b99-4ecc-9284-cd0ffdc7a77c None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:41.458165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-700ffb63-6b99-4ecc-9284-cd0ffdc7a77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:41.474673 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 1999/3977] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:26:41 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:41.486521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a42d88-367c-4b78-bedf-bc5fa2187316 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:41.513681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a42d88-367c-4b78-bedf-bc5fa2187316 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:41.528819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca57700-2c58-47fe-bc6e-f2272d8db2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:41.529824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca57700-2c58-47fe-bc6e-f2272d8db2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:41.530276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca57700-2c58-47fe-bc6e-f2272d8db2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:41.530706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca57700-2c58-47fe-bc6e-f2272d8db2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:41.549024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca57700-2c58-47fe-bc6e-f2272d8db2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:41.551115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca57700-2c58-47fe-bc6e-f2272d8db2f2 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:41.571714 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1979/3978] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:26:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:26:43.234692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf427ad-7d56-419f-9c7a-cda0bb2d5190 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:43.235598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf427ad-7d56-419f-9c7a-cda0bb2d5190 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:43.236270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf427ad-7d56-419f-9c7a-cda0bb2d5190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:43.261740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fcf427ad-7d56-419f-9c7a-cda0bb2d5190 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:43.264608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcf427ad-7d56-419f-9c7a-cda0bb2d5190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:43.278560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2000/3979] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:46.639962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442825a-6d3c-4279-8990-f6d13ebec9f5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:46.640476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442825a-6d3c-4279-8990-f6d13ebec9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:46.640749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442825a-6d3c-4279-8990-f6d13ebec9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:46.681115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c442825a-6d3c-4279-8990-f6d13ebec9f5 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:46.683517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c442825a-6d3c-4279-8990-f6d13ebec9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:46.701374 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1980/3980] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:47.525758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9f51-2580-4608-99e0-57c4d24a1234 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:47.526273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9f51-2580-4608-99e0-57c4d24a1234 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:47.526530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b9f51-2580-4608-99e0-57c4d24a1234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:47.545813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-975b9f51-2580-4608-99e0-57c4d24a1234 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:47.547139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-975b9f51-2580-4608-99e0-57c4d24a1234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:47.561679 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2001/3981] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:49.042550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb6b5c-cdae-46c2-8c48-8f3831e6f459 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:49.043161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb6b5c-cdae-46c2-8c48-8f3831e6f459 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:49.043161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fb6b5c-cdae-46c2-8c48-8f3831e6f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:49.063774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-45fb6b5c-cdae-46c2-8c48-8f3831e6f459 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:49.065232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45fb6b5c-cdae-46c2-8c48-8f3831e6f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:49.073033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1981/3982] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:49.868787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04852-b996-4673-84b2-9aec050c6922 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:49.869308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04852-b996-4673-84b2-9aec050c6922 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:49.869308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded04852-b996-4673-84b2-9aec050c6922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:49.898187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ded04852-b996-4673-84b2-9aec050c6922 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:49.899395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ded04852-b996-4673-84b2-9aec050c6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:49.906690 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2002/3983] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:50.961026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566a7d-5587-4649-a523-35b941fa367a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:50.962261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566a7d-5587-4649-a523-35b941fa367a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:50.962722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b566a7d-5587-4649-a523-35b941fa367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:50.993680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0b566a7d-5587-4649-a523-35b941fa367a None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:50.995329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0b566a7d-5587-4649-a523-35b941fa367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:51.005278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1982/3984] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:52.177766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a3035-3be2-485e-83bc-839ccb48b18b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:52.178321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a3035-3be2-485e-83bc-839ccb48b18b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:52.178514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7a3035-3be2-485e-83bc-839ccb48b18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:52.200805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4b7a3035-3be2-485e-83bc-839ccb48b18b None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:52.202159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b7a3035-3be2-485e-83bc-839ccb48b18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:52.209802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2003/3985] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:53.398208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b813fb9-6d0a-4a3a-aee3-962386087902 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:53.399257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b813fb9-6d0a-4a3a-aee3-962386087902 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:53.399867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b813fb9-6d0a-4a3a-aee3-962386087902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:53.421262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9b813fb9-6d0a-4a3a-aee3-962386087902 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:53.422487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b813fb9-6d0a-4a3a-aee3-962386087902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:53.430987 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1983/3986] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:55.302933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:55.303505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:55.303505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:55.323875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:55.325582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:55.337191 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2004/3987] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:56.774386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f2dd-b5e3-4fe7-a053-57f3ce960f49 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:56.774944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f2dd-b5e3-4fe7-a053-57f3ce960f49 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:56.775165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e1f2dd-b5e3-4fe7-a053-57f3ce960f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:56.798976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-07e1f2dd-b5e3-4fe7-a053-57f3ce960f49 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:56.800537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07e1f2dd-b5e3-4fe7-a053-57f3ce960f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:56.872517 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1984/3988] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:26:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:26:56.928900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:26:56.930877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:57.095266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bef33a-08df-44c3-9852-958b9e56dfb1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:26:57.100732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cba6d1-f565-421a-9cdf-469d08ba0ae0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:26:57.101638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cba6d1-f565-421a-9cdf-469d08ba0ae0 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:57.102167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cba6d1-f565-421a-9cdf-469d08ba0ae0 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:57.102619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cba6d1-f565-421a-9cdf-469d08ba0ae0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:57.112289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cba6d1-f565-421a-9cdf-469d08ba0ae0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:26:57.113984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cba6d1-f565-421a-9cdf-469d08ba0ae0 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:26:57.123820 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2005/3989] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:26:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:26:59.648222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670858f-2900-4e18-a382-d7067ea03e38 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:26:59.649296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670858f-2900-4e18-a382-d7067ea03e38 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:26:59.649623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b670858f-2900-4e18-a382-d7067ea03e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:26:59.674295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b670858f-2900-4e18-a382-d7067ea03e38 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:26:59.676242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b670858f-2900-4e18-a382-d7067ea03e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:26:59.693021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1985/3990] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:26:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:01.149879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:01.150471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:01.150471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:01.170557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:01.171787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:01.179820 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2006/3991] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:09.668075 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=63 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:10.530264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:10.530421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:10.530686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:10.549897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] MFA Rules not processed for user `d3277b161298479db5b7114cad011563`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:10.551118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:10.558858 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1986/3992] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:11.164848 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:20.544086 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:20.739435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:20.742463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:20.793387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19775e17-571e-4a38-a3b2-cfbe833d4743 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:20.797833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:20.798727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:20.799059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:20.799334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] PATH_INFO: `/v3/users/d821f2aafa4644edab1aeee30076595d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:20.800564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d821f2aafa4644edab1aeee30076595d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:20.802543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:20.859267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd821f2aafa4644edab1aeee30076595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:20.859937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd821f2aafa4644edab1aeee30076595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:20.868079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd821f2aafa4644edab1aeee30076595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:20.868782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd821f2aafa4644edab1aeee30076595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:20.876806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bfe1abb-bb97-4933-b269-75782e9464a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd821f2aafa4644edab1aeee30076595d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:20.895677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2007/3993] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:27:20 2022] DELETE /identity/v3/users/d821f2aafa4644edab1aeee30076595d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:27:21.084218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.096509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8e3d2-61c9-4502-85fc-01648c0e05c3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.156671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.157537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.157814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.158091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] PATH_INFO: `/v3/projects/b934a6d0d9ac4a259a9bfb55778a223a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.159322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b934a6d0d9ac4a259a9bfb55778a223a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.161269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.211510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b934a6d0d9ac4a259a9bfb55778a223a', 'request_id': 'req-da775759-24ef-46a6-89e0-beca24fd727b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:21.221727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b934a6d0d9ac4a259a9bfb55778a223a', 'request_id': 'req-da775759-24ef-46a6-89e0-beca24fd727b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:21.228821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b934a6d0d9ac4a259a9bfb55778a223a', 'request_id': 'req-da775759-24ef-46a6-89e0-beca24fd727b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:21.240477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] The token cache is being invalidate because project b934a6d0d9ac4a259a9bfb55778a223a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:27:21.240766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:21.241493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-da775759-24ef-46a6-89e0-beca24fd727b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:21.243112 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1987/3994] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:27:21 2022] DELETE /identity/v3/projects/b934a6d0d9ac4a259a9bfb55778a223a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:27:21.248574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.248861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.249142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.297879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:21.299231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:21.363147 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2008/3995] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:21.372234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.372565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.372843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.394173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:21.395426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:21.405607 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1988/3996] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:21.411026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.421865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50e7700-6231-4d23-9f32-3b8e4d19fb4a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.427144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.427810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.428096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.428371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.429118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:27:21.430151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.431800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.444358 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2009/3997] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:27:21.448954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.459895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9de43-f563-400f-bfd8-3268401e0bd7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.468920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.469832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.470151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.470472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.471478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.474444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.506780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1989/3998] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:27:21.511161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.521708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b48b-c304-4436-9dfc-f03e246bec72 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.526485 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:21.583298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.583996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.584290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.584579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.585279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.587203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.610753 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2010/3999] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:27:21 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:27:21.615070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.626377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff152283-d832-41f4-af58-f366f2844e89 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.631335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.632014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.632301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.632601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.633340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.634940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.649715 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1990/4000] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:27:21.651114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.662016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa1503-ce8b-483f-ad26-c85ed120fbb1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.669022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ec06e2-0d1d-4d91-9d69-d8ed6a4b5d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.670108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec06e2-0d1d-4d91-9d69-d8ed6a4b5d00 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.670108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec06e2-0d1d-4d91-9d69-d8ed6a4b5d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.670312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ec06e2-0d1d-4d91-9d69-d8ed6a4b5d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.671003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec06e2-0d1d-4d91-9d69-d8ed6a4b5d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.672872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ec06e2-0d1d-4d91-9d69-d8ed6a4b5d00 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.685114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2011/4001] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:27:21.691141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.702526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee46092-bead-41ae-b975-72dcce9b8f36 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.708500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.708882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.709287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.709630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] PATH_INFO: `/v3/projects/cd565f94e4c5444a8523badfb9fb6c2c/users/233295aaebd946e5bc4be28f4a3e3558/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.726285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd565f94e4c5444a8523badfb9fb6c2c, user_id=233295aaebd946e5bc4be28f4a3e3558, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.729132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.742658 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1991/4002] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:27:21 2022] PUT /identity/v3/projects/cd565f94e4c5444a8523badfb9fb6c2c/users/233295aaebd946e5bc4be28f4a3e3558/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:27:21.747585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e093b26-6f4f-42b5-8926-df6e33731c81 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.748103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e093b26-6f4f-42b5-8926-df6e33731c81 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.748213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e093b26-6f4f-42b5-8926-df6e33731c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.766705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9e093b26-6f4f-42b5-8926-df6e33731c81 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:21.767914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e093b26-6f4f-42b5-8926-df6e33731c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:21.837591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2012/4003] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:21.848651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:21.850489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:21.883351 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:21.935691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bb670-fb77-4a42-8579-7d19fb74e4be admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:21.940743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df34a06-7e3c-4fe3-af8e-944f2e90a32a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:21.941815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df34a06-7e3c-4fe3-af8e-944f2e90a32a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:21.942313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df34a06-7e3c-4fe3-af8e-944f2e90a32a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:21.942786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df34a06-7e3c-4fe3-af8e-944f2e90a32a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:21.958180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df34a06-7e3c-4fe3-af8e-944f2e90a32a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:21.959626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df34a06-7e3c-4fe3-af8e-944f2e90a32a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:21.970070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1992/4004] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:26.027894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:26.028491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:26.028491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:26.075010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] MFA Rules not processed for user `233295aaebd946e5bc4be28f4a3e3558`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:26.076574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:26.147869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2013/4005] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:26.158395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716695a-4548-4a14-b77d-5ca249722503 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:26.158946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716695a-4548-4a14-b77d-5ca249722503 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:26.158946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716695a-4548-4a14-b77d-5ca249722503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:26.177807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3716695a-4548-4a14-b77d-5ca249722503 None None] MFA Rules not processed for user `233295aaebd946e5bc4be28f4a3e3558`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:26.179041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3716695a-4548-4a14-b77d-5ca249722503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:26.188937 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1993/4006] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:26.198148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:26.200062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:26.227035 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:26.326438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816ed08-f3dd-4eb0-9920-2766222e952d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:26.342445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:26.343250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:26.343595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:26.343941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:26.353159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:26.354878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:26.366229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2014/4007] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:35.074579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011828-be0f-4f3f-9510-62f4906137ff None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:35.075061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011828-be0f-4f3f-9510-62f4906137ff None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:35.075184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67011828-be0f-4f3f-9510-62f4906137ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:35.095227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-67011828-be0f-4f3f-9510-62f4906137ff None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:35.096557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-67011828-be0f-4f3f-9510-62f4906137ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:35.174584 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1994/4008] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:27:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:35.195196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:35.197222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:35.371140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a57c46-6dc2-4357-81e0-9c7de0f5b590 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:35.383709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d2e272-3369-477c-9fc0-05e974366690 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:35.384444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e272-3369-477c-9fc0-05e974366690 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:35.384774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e272-3369-477c-9fc0-05e974366690 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:35.385058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d2e272-3369-477c-9fc0-05e974366690 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:35.397562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2e272-3369-477c-9fc0-05e974366690 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:35.399563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d2e272-3369-477c-9fc0-05e974366690 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:35.419719 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2015/4009] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:27:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:27:36.683138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9e0ff-2684-4f23-8d96-40ca51529436 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:36.683138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9e0ff-2684-4f23-8d96-40ca51529436 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:36.683138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e9e0ff-2684-4f23-8d96-40ca51529436 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:36.686628 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1995/4010] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:27:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:27:36.692924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab9e6-7eb3-485b-ba36-87022c3f9f46 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:36.693476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab9e6-7eb3-485b-ba36-87022c3f9f46 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:36.693612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ab9e6-7eb3-485b-ba36-87022c3f9f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:36.763497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e08ab9e6-7eb3-485b-ba36-87022c3f9f46 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:36.765380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e08ab9e6-7eb3-485b-ba36-87022c3f9f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:36.922145 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2016/4011] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:27:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:36.975983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9e0ff-2684-4f23-8d96-40ca51529436 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:36.978718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-48e9e0ff-2684-4f23-8d96-40ca51529436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:37.011851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e9e0ff-2684-4f23-8d96-40ca51529436 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:37.025958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:37.026650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:37.026939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:37.027216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:37.073092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:37.075663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:37.106473 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1996/4012] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:41.760122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:41.760681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:41.761176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:41.784056 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:41.802826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:41.804821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:41.834275 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2017/4013] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:27:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:41.845241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:41.863689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48731189-b680-439a-a78e-f51017a87f8f service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:41.880117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:41.882061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:41.884839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:41.885199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:41.909823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:41.914289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:41.974660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1997/4014] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:27:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:27:43.081842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:43.104445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6e9b2-3102-4389-b638-0f9ab9a8e269 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:43.121872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:43.122552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:43.122834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:43.125754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:43.131127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:43.163590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:43.165494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:43.209921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2018/4015] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:43.222544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:43.224161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:43.247411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a430e6-1fa8-42de-8f38-a7827dc5a370 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:43.254366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:43.257067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:43.257901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:43.261006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] PATH_INFO: `/v3/users/69ccdedb76464d99b56ff7308cf44cce` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:43.262634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69ccdedb76464d99b56ff7308cf44cce)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:43.266582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:43.363317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69ccdedb76464d99b56ff7308cf44cce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.376189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69ccdedb76464d99b56ff7308cf44cce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.396982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69ccdedb76464d99b56ff7308cf44cce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.398738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69ccdedb76464d99b56ff7308cf44cce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.405870 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:43.412384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-441d4b14-6b0d-4a67-bd5e-bbead47c2fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69ccdedb76464d99b56ff7308cf44cce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.439349 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1998/4016] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:27:43 2022] DELETE /identity/v3/users/69ccdedb76464d99b56ff7308cf44cce => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:27:43.779744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:43.797605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5e6055-9519-4abe-9429-9661e7e07fe5 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:43.901245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:43.902419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:43.902861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:43.903422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] PATH_INFO: `/v3/projects/0344445e5caf4c43a2e90fdb9eb18fcf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:43.905018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0344445e5caf4c43a2e90fdb9eb18fcf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:43.907258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:43.967042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0344445e5caf4c43a2e90fdb9eb18fcf', 'request_id': 'req-1d43072e-6248-4825-8d57-6768c00572de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.975616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0344445e5caf4c43a2e90fdb9eb18fcf', 'request_id': 'req-1d43072e-6248-4825-8d57-6768c00572de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:43.983162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0344445e5caf4c43a2e90fdb9eb18fcf', 'request_id': 'req-1d43072e-6248-4825-8d57-6768c00572de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:44.002443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] The token cache is being invalidate because project 0344445e5caf4c43a2e90fdb9eb18fcf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:27:44.003157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:44.003910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d43072e-6248-4825-8d57-6768c00572de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:27:44.009284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2019/4017] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:27:43 2022] DELETE /identity/v3/projects/0344445e5caf4c43a2e90fdb9eb18fcf => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:27:44.011252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.011751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.012206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.053450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:44.054717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:44.148090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 1999/4018] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:44.156055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.156547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.156653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.194787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:44.196291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:44.211925 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2020/4019] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:44.212850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.228664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a1bd5e-e359-4c30-9512-14a62ee405d6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:44.241214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:44.242334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.242779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.243215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.244149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:27:44.244680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:44.246629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:44.271210 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2000/4020] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:27:44.275747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.287687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570b178-b807-4bb4-a6f6-672af1a1db61 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:44.298048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:44.299115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.299795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.300295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.301206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:44.303907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:44.345377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2021/4021] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:27:44 2022] POST /identity/v3/projects => generated 379 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:27:44.350326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.367716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c232d4c-f138-4957-a2e2-e631aee68852 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:44.474197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:44.475207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.475658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.476493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.480838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:44.486444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:44.524446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2001/4022] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:27:44 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:27:44.525225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.538042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827e12aa-a8cb-4038-8422-f0b805c9a6fd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:44.546392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:44.547685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.548153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.548716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.550014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:44.551956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:44.566170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2022/4023] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:27:44.574890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.597113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59722b9-e19a-480b-b2f0-145add1298ca admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:44.607187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc70beed-86cd-42b9-84e9-4a48fa8225cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:44.608098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70beed-86cd-42b9-84e9-4a48fa8225cf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.608520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70beed-86cd-42b9-84e9-4a48fa8225cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.608899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc70beed-86cd-42b9-84e9-4a48fa8225cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.609750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70beed-86cd-42b9-84e9-4a48fa8225cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:44.618998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc70beed-86cd-42b9-84e9-4a48fa8225cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:44.642079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2002/4024] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:27:44.643491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.666204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfb7ca0-a670-4d4e-8cc6-d5337c557fb3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:44.683165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:44.685690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.686370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.686655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] PATH_INFO: `/v3/projects/f67dc2a8785543bcb1bdaf04688df7a4/users/0269af8ef32d4551b772630c02e32702/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.748268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f67dc2a8785543bcb1bdaf04688df7a4, user_id=0269af8ef32d4551b772630c02e32702, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:44.754975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:44.779937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2023/4025] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:27:44 2022] PUT /identity/v3/projects/f67dc2a8785543bcb1bdaf04688df7a4/users/0269af8ef32d4551b772630c02e32702/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:27:44.786226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e2b6-8eff-4b88-9a4f-b53fcc8e65b4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:44.786844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e2b6-8eff-4b88-9a4f-b53fcc8e65b4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:44.787231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c04e2b6-8eff-4b88-9a4f-b53fcc8e65b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:44.821713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0c04e2b6-8eff-4b88-9a4f-b53fcc8e65b4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:44.823082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0c04e2b6-8eff-4b88-9a4f-b53fcc8e65b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:44.910744 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:44.929746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2003/4026] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:44.937393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:44.939881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:44.963634 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:45.030753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9415c-1113-4b08-8aea-d1c78bc4c573 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:45.037738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f4563-9bbd-478a-886d-82a7bff66167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:45.038933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4563-9bbd-478a-886d-82a7bff66167 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:45.039457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4563-9bbd-478a-886d-82a7bff66167 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:45.039848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f4563-9bbd-478a-886d-82a7bff66167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:45.084369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4563-9bbd-478a-886d-82a7bff66167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:45.086969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f4563-9bbd-478a-886d-82a7bff66167 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:45.124947 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2024/4027] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:27:54.623827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:54.626580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:54.627063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:54.695904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:54.703738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:54.833141 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2004/4028] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:54.845368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:54.845876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:54.845993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:54.868375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:54.869561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:54.878019 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2025/4029] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:27:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:55.196816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:55.198994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:55.331363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a88c1-26e2-4f2b-8c05-97b600d4b0bf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:55.335210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:55.335878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:55.336138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:55.336465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:55.338562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:55.419626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:55.421053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:55.432419 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2005/4030] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:55.774695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:55.776118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:55.939332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bf6634-f186-4542-bbc9-5af5244699fc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:55.954642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d4cdcf-7273-4050-b879-0d09cfaca0f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:55.955672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4cdcf-7273-4050-b879-0d09cfaca0f1 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:55.956158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4cdcf-7273-4050-b879-0d09cfaca0f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:55.956688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d4cdcf-7273-4050-b879-0d09cfaca0f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:55.973022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4cdcf-7273-4050-b879-0d09cfaca0f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:55.975515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d4cdcf-7273-4050-b879-0d09cfaca0f1 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:55.987484 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2026/4031] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:55 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:57.171284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:57.172474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:57.215237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b63b87-36b3-467a-a582-53944ea569f1 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:57.235251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:57.236164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:57.236471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:57.236752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:57.238618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:57.274998 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:27:57.399321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:57.404937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:57.446034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2006/4032] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:27:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:27:58.956962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:58.957512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:58.957512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:59.019262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:27:59.020638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:59.320449 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2027/4033] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:27:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:27:59.439437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:27:59.441732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:27:59.713351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f4c93-f52b-4058-bb97-a614cac47632 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:27:59.725720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:27:59.726405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:27:59.726688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:27:59.726967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:27:59.765391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:27:59.767111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:27:59.804144 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2007/4034] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:27:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:28:00.133366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:00.135320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:00.203206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4156f-6523-414c-adaa-81d7c7b7ebc7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:00.218367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:00.220660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:00.223042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:00.224792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:00.232197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:00.283970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:00.286031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650e7da-60df-4e59-b0c7-3550172e818f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:00.312244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2028/4035] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:09.776229 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=49 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:10.298572 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:12.506498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:12.508748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:12.664670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb40a-b4e6-41c7-8ef0-69760b2d7111 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:12.689024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:12.689321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:12.689430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:12.689615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:12.696908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:12.748123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:12.781679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:12.868505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2008/4036] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:12.897439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:12.897997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:12.898120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:12.966386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] MFA Rules not processed for user `233295aaebd946e5bc4be28f4a3e3558`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:12.969002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:13.128441 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2029/4037] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:13.282765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:13.307971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9c4633-f7b8-4d46-8297-9e16c037c4c1 service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:13.314381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:13.315153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:13.315477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:13.315907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:13.325651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:13.352843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:13.355132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:13.376401 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2009/4038] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:13.761339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:13.781912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46249e70-c7d9-44cb-9294-34553aa8d923 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:13.803784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:13.804531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:13.804824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:13.805102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:13.817205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:13.885294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:13.887420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:13.994190 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2030/4039] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:15.061540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:15.064551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:15.303849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414957d-c894-424c-a2fb-d0a7b3f1a1d0 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:15.343311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:15.344063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:15.344367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:15.344642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:15.367432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:15.423419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:15.430548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:15.507413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2010/4040] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:28:15.704506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:15.707082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:15.809228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079da4-a5e0-4118-b713-ba456665e961 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:15.836944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:15.851045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:15.852622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:15.853144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] PATH_INFO: `/v3/users/70628393aac8485fae89e5d50eac92f0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:15.854805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70628393aac8485fae89e5d50eac92f0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:15.857112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:15.961468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70628393aac8485fae89e5d50eac92f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:15.962800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70628393aac8485fae89e5d50eac92f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:15.987008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70628393aac8485fae89e5d50eac92f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:15.988062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70628393aac8485fae89e5d50eac92f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:16.020675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0715ce4-0ae1-4c4d-8fcc-3b9fc4950427 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70628393aac8485fae89e5d50eac92f0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:16.093615 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2031/4041] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:28:15 2022] DELETE /identity/v3/users/70628393aac8485fae89e5d50eac92f0 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:28:17.680184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:17.702818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577273-1b58-46a6-a7f2-df664fad5990 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:17.892884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:17.893786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:17.894258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:17.894695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] PATH_INFO: `/v3/projects/77dbc3f73c61442b8ffa7219c01243c0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:17.937578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77dbc3f73c61442b8ffa7219c01243c0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:17.941806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:17.986308 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:18.125598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77dbc3f73c61442b8ffa7219c01243c0', 'request_id': 'req-41e6b8aa-03c2-404f-a2a6-df3c88951580'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:18.149174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77dbc3f73c61442b8ffa7219c01243c0', 'request_id': 'req-41e6b8aa-03c2-404f-a2a6-df3c88951580'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:18.163741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77dbc3f73c61442b8ffa7219c01243c0', 'request_id': 'req-41e6b8aa-03c2-404f-a2a6-df3c88951580'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:18.199018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] The token cache is being invalidate because project 77dbc3f73c61442b8ffa7219c01243c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:28:18.199312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:18.203842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-41e6b8aa-03c2-404f-a2a6-df3c88951580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:28:18.212238 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2011/4042] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:28:17 2022] DELETE /identity/v3/projects/77dbc3f73c61442b8ffa7219c01243c0 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:28:18.214179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:18.214716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:18.217362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:18.282790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:18.285061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:18.489347 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2032/4043] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:18.490284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:18.490681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:18.490959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:18.562423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:18.563752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:18.578545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2012/4044] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:28:18.581919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:18.589788 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:18.595675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7bfec-bf16-48cf-bb3f-2acc8e1d9939 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:18.609675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:18.621667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:18.621667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:18.622233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:18.623157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:28:18.623581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:18.625565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:18.648666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:18.655335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2033/4045] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:28:18.663149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d4d03-9800-4fa2-8fdb-5e4698445de0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:18.686708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:18.691425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:18.691425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:18.691425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:18.702331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:18.706424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:18.790106 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2013/4046] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:28:18 2022] POST /identity/v3/projects => generated 399 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:28:18.791390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:18.805951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262601e6-68f3-424c-ab51-048c51ee9f73 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:19.005362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f75506-3dc6-42b7-b824-598ef29d5457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:19.005918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f75506-3dc6-42b7-b824-598ef29d5457 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.006416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f75506-3dc6-42b7-b824-598ef29d5457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.007078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f75506-3dc6-42b7-b824-598ef29d5457 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.008895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f75506-3dc6-42b7-b824-598ef29d5457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:19.027325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f75506-3dc6-42b7-b824-598ef29d5457 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:19.137718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2034/4047] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:28:18 2022] POST /identity/v3/users => generated 300 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:28:19.139736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:19.161305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963bf48a-9763-43bd-b92c-3b13c48d65ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:19.184932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.186402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.186926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.201027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:19.202079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.205285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.208795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.209898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:19.213418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:19.217376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:19.219610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:19.267343 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2014/4048] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:28:19.268684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:19.312980 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2035/4049] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:28:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:28:19.319233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabf43f8-0cf1-4aec-9bbd-35697ca34ded admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:19.327020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:19.329435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:19.336333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:19.337080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.337373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.337653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.338655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:19.340793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:19.370690 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2015/4050] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:28:19.374709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:19.392917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ef0ab-0957-41b1-8dc1-557249c9ce1a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:19.408185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8d639-986c-4f73-abe7-8cb6752ed758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:19.409155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8d639-986c-4f73-abe7-8cb6752ed758 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.409439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8d639-986c-4f73-abe7-8cb6752ed758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.409719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8d639-986c-4f73-abe7-8cb6752ed758 admin admin] PATH_INFO: `/v3/projects/76fe2341dc33485797296bc25208ba38/users/09c479847a1442138e05c1a75223c1ae/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.459840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8d639-986c-4f73-abe7-8cb6752ed758 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fe2341dc33485797296bc25208ba38, user_id=09c479847a1442138e05c1a75223c1ae, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:19.463886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8d639-986c-4f73-abe7-8cb6752ed758 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:19.489144 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2016/4051] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:28:19 2022] PUT /identity/v3/projects/76fe2341dc33485797296bc25208ba38/users/09c479847a1442138e05c1a75223c1ae/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:28:19.494315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.494678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.494914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.552789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:19.555427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8274b16-678b-4e72-b6d6-bc808861b42d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:19.557665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:19.625210 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:19.731076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:19.731912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.732204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.732577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.734497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2017/4052] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:19.806684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:19.808147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:19.851006 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:19.911490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:19.916330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:19.929463 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2036/4053] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:28:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:28:19.939047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:19.946852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:19.968980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238691d-7c8a-4eee-9dab-ca0c39771169 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:19.987511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:19.990083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:19.990720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:19.991327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:19.995966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:19.997881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec07fbc-90df-471b-af5d-756ae60c57bf service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:20.034696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:20.035387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:20.035675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:20.035946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:20.088213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:20.096749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:20.140283 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2037/4054] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:20.369787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:20.371572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aef943-2058-4c59-9470-c8bcb954816f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:20.395024 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2018/4055] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:25.769051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:25.781770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ef1a3-050a-41fc-901e-1959fd924d5a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:25.791900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:25.793517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:25.793801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:25.794860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:25.800259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:25.821134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:25.822879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56209e-6b3b-4d29-9937-3eafb548c579 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:25.837651 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2038/4056] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:30.387861 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=46 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:33.518773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0370c71-9904-4725-ac87-488105415890 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:33.519567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0370c71-9904-4725-ac87-488105415890 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:33.519567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0370c71-9904-4725-ac87-488105415890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:33.601958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b0370c71-9904-4725-ac87-488105415890 None None] MFA Rules not processed for user `09c479847a1442138e05c1a75223c1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:33.603709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0370c71-9904-4725-ac87-488105415890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:33.790648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2019/4057] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:33.800252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ba7f2-8cdd-4715-ad5e-cd315201cc2f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:33.801047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ba7f2-8cdd-4715-ad5e-cd315201cc2f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:33.801656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724ba7f2-8cdd-4715-ad5e-cd315201cc2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:33.848205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-724ba7f2-8cdd-4715-ad5e-cd315201cc2f None None] MFA Rules not processed for user `09c479847a1442138e05c1a75223c1ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:33.849698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-724ba7f2-8cdd-4715-ad5e-cd315201cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:33.886595 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2039/4058] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:28:34.105836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0370c71-9904-4725-ac87-488105415890 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:34.109131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0370c71-9904-4725-ac87-488105415890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:34.172866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0370c71-9904-4725-ac87-488105415890 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:34.220498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb09c0de-2e77-4229-88af-c138bc149098 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:34.224944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09c0de-2e77-4229-88af-c138bc149098 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:34.225963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09c0de-2e77-4229-88af-c138bc149098 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:34.228984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb09c0de-2e77-4229-88af-c138bc149098 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:34.271736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09c0de-2e77-4229-88af-c138bc149098 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:34.281052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb09c0de-2e77-4229-88af-c138bc149098 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:34.331347 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2020/4059] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:28:35.648126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:35.648126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:35.648126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:35.718238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:35.719214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:36.066183 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2040/4060] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:28:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:28:42.619667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:42.620516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:42.620930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:42.647984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:28:42.650634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:42.667626 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2021/4061] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:28:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:28:42.677102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:42.696789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb59b9-9cf5-459a-abc2-453790848a52 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:42.712280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:42.713203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:42.713863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:42.714391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:42.728016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:42.729919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:42.744319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2041/4062] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:28:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:28:43.897528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:43.899067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:43.921211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5471bf24-90c4-4715-adc0-070da4b9388d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:43.928793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:43.929717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:43.930375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:43.931086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:43.934254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:44.017384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:44.019365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe54bbab-6ef7-4c0f-a189-9078ee5619af service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:44.033757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2022/4063] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:46.691822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:28:46.706971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7301a9e-9668-4f52-bcef-66d5ab5d7904 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:28:46.714063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:28:46.718139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:28:46.718698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:28:46.719056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:28:46.725599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:28:46.751489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:28:46.753620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:28:46.774352 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2042/4064] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:28:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:28:54.027441 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=69 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:28:56.768324 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:01.096872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:01.097380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:01.097655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:01.149743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:01.151071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:01.159297 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2023/4065] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:29:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:01.197668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:01.212212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac38c6a-11ef-41d5-8cb7-587d9505a2da service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:01.217946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:01.218469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:01.218751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:01.219030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:01.243076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:01.248998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:01.274257 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2043/4066] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:29:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:29:08.403023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:08.434157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e37a7-d1da-4632-9c01-69f438c5a144 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:08.450647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:08.451728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:08.452015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:08.452297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:08.475338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:08.520479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:08.527326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:08.554413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2024/4067] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:11.264225 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:12.841848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:12.859156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbceeea5-ea70-4306-9316-420bf83cd2c6 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:12.863849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:12.864996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:12.865433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:12.865707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] PATH_INFO: `/v3/users/09c479847a1442138e05c1a75223c1ae` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:12.867030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09c479847a1442138e05c1a75223c1ae)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:12.868983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:12.922636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09c479847a1442138e05c1a75223c1ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:12.923542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09c479847a1442138e05c1a75223c1ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:12.933733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09c479847a1442138e05c1a75223c1ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:12.934382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09c479847a1442138e05c1a75223c1ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:12.944104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-75ede06a-ecd8-460f-90c5-0a5ba3714b6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09c479847a1442138e05c1a75223c1ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:12.974617 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2044/4068] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:12 2022] DELETE /identity/v3/users/09c479847a1442138e05c1a75223c1ae => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:13.241821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.256591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebbb8e5-0c06-4a71-bfe4-79e4fe8686e7 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.325198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.325999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.326287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.326553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] PATH_INFO: `/v3/projects/76fe2341dc33485797296bc25208ba38` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.327836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fe2341dc33485797296bc25208ba38)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.329902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.393673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fe2341dc33485797296bc25208ba38', 'request_id': 'req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:13.403700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fe2341dc33485797296bc25208ba38', 'request_id': 'req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:13.411227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fe2341dc33485797296bc25208ba38', 'request_id': 'req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:13.423450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] The token cache is being invalidate because project 76fe2341dc33485797296bc25208ba38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:13.423892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:13.424615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ade1d57-98b7-43b8-8e03-ade3470ffcfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:13.426228 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2025/4069] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:13 2022] DELETE /identity/v3/projects/76fe2341dc33485797296bc25208ba38 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:13.432782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.433755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.433755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.457869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:13.459410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:13.538557 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2045/4070] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:13.546615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.546919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.547199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.570626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:13.571989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:13.585205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2026/4071] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:13.589215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.599933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2602b-6257-4545-adac-afcb12dfea11 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.606255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.607242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.607530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.607807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.608593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:29:13.608876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.610524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.626714 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2046/4072] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:29:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:13.628166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.638691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f384ec5-e03e-498c-a149-3b71317707fe None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.643660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.644522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.644806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.645088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.645790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.647723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.682978 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2027/4073] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:13 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:13.684856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.697835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602c5ae2-4fbf-4471-939b-2b07830536a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.776936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.778083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.778500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.778948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.780044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.782385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.790128 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:13.813056 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2047/4074] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:13 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:13.814084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.825849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74d9e4-d77c-4ca1-bc19-87a23a677b21 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.831121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.831841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.832219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.832622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.833471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.835175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.848380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2028/4075] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:29:13.852140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.863499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781f65e-9c45-4def-a52a-0ce395730848 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.869487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6562ae-5bf6-440d-a14b-807b4622bef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.870160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6562ae-5bf6-440d-a14b-807b4622bef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.870444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6562ae-5bf6-440d-a14b-807b4622bef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.870721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6562ae-5bf6-440d-a14b-807b4622bef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.871520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6562ae-5bf6-440d-a14b-807b4622bef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.873174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6562ae-5bf6-440d-a14b-807b4622bef9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.885076 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2048/4076] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:13.889512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:13.900084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67569ba1-18c4-403f-9a64-847a9ae6135c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:13.904945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:13.905872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.906158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.906409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] PATH_INFO: `/v3/projects/95a68afedb9045be817f74f8b2b39886/users/f8355abb2e02479f94615ae34bcee4a1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.922552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a68afedb9045be817f74f8b2b39886, user_id=f8355abb2e02479f94615ae34bcee4a1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:13.925396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:13.951699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2029/4077] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:13 2022] PUT /identity/v3/projects/95a68afedb9045be817f74f8b2b39886/users/f8355abb2e02479f94615ae34bcee4a1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:13.956262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:13.958054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:13.958518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:13.997938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] MFA Rules not processed for user `f8355abb2e02479f94615ae34bcee4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:14.000716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:14.144813 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2049/4078] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:14.154803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:14.156588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:14.171414 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:14.297885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d2d3ca-c603-424d-ad36-a10d3b06daf8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:14.320940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cef597-6792-4559-bfcc-7aadf11a4fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:14.321964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cef597-6792-4559-bfcc-7aadf11a4fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:14.322400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cef597-6792-4559-bfcc-7aadf11a4fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:14.322914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cef597-6792-4559-bfcc-7aadf11a4fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:14.354386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cef597-6792-4559-bfcc-7aadf11a4fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:14.356678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cef597-6792-4559-bfcc-7aadf11a4fc4 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:14.375602 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2030/4079] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:24.137380 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=39 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:24.370794 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=31 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:25.054489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:25.090069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01635829-b37e-4193-aadc-e677f2fb7a2d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:25.106298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:25.107111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:25.107396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:25.107670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:25.110445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:25.153347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:25.155056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:25.193367 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2050/4080] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:28.019709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:28.020199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:28.020300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:28.115094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:28.116487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:28.218819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2031/4081] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:29:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:28.227284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:28.228861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:28.349173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a4a97-c00e-4d77-9b9d-3efdfe48174a service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:28.357184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ba916f-0867-4ba8-aac6-f6cf205b549f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:28.358032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba916f-0867-4ba8-aac6-f6cf205b549f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:28.358318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba916f-0867-4ba8-aac6-f6cf205b549f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:28.358605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ba916f-0867-4ba8-aac6-f6cf205b549f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:28.368640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba916f-0867-4ba8-aac6-f6cf205b549f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:28.370421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ba916f-0867-4ba8-aac6-f6cf205b549f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:28.380610 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2051/4082] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:29:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:29:29.888852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:29.957992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc04f5a-c14d-4f37-8d77-b9244e7525d6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:29.963309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:29.964332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:29.964589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:29.964871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] PATH_INFO: `/v3/users/f8355abb2e02479f94615ae34bcee4a1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:29.966223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8355abb2e02479f94615ae34bcee4a1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:29.968198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:30.040242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8355abb2e02479f94615ae34bcee4a1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.067960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8355abb2e02479f94615ae34bcee4a1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.099002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8355abb2e02479f94615ae34bcee4a1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.099994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8355abb2e02479f94615ae34bcee4a1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.103182 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:30.114627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8355abb2e02479f94615ae34bcee4a1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.122892 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2032/4083] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:29 2022] DELETE /identity/v3/users/f8355abb2e02479f94615ae34bcee4a1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:30.127265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:30.127797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:30.127797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:30.156246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:30.158415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:30.257897 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2052/4084] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:30.268070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:30.269648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:30.342358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc6b96-7245-4b3a-aa52-a9ddcba54edc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:30.346704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc3fe72-87b5-4971-bba4-c9c5813f7a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:30.347387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fe72-87b5-4971-bba4-c9c5813f7a95 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:30.347731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fe72-87b5-4971-bba4-c9c5813f7a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:30.347951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3fe72-87b5-4971-bba4-c9c5813f7a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:30.358402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3fe72-87b5-4971-bba4-c9c5813f7a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:30.359885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc3fe72-87b5-4971-bba4-c9c5813f7a95 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:30.376768 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2033/4085] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:30.704284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:30.705879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:30.728513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82e510-be44-43a3-9f73-4a2dc55d94dc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:30.739686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:30.740600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:30.740885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:30.741159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] PATH_INFO: `/v3/projects/95a68afedb9045be817f74f8b2b39886` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:30.742422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a68afedb9045be817f74f8b2b39886)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:30.744362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:30.823425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a68afedb9045be817f74f8b2b39886', 'request_id': 'req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.826468 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:30.839643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a68afedb9045be817f74f8b2b39886', 'request_id': 'req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.853098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a68afedb9045be817f74f8b2b39886', 'request_id': 'req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.877697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] The token cache is being invalidate because project 95a68afedb9045be817f74f8b2b39886 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:30.877877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.879650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf235d7-cec1-4f47-a7b9-2e00ce31c74c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:30.893088 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2053/4086] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:30 2022] DELETE /identity/v3/projects/95a68afedb9045be817f74f8b2b39886 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:30.897090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:30.897555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:30.897741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:30.946951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:30.948456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:31.067900 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2034/4087] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:31.075861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.076547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.077055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.109356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:31.111105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:31.120552 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2054/4088] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:31.124675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.145014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b839113-7a6b-4153-a320-f18f37d2ac24 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.151184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.152226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.152818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.153295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.154220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:29:31.154702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.156622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.173713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2035/4089] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:29:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:29:31.178697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.193649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd7daa-8a95-41da-a5c0-2aea473415c9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.200809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.202038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.202884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.203673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.204834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.207324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.246949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.258290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3801db41-377f-4fee-aaad-a28ba0513b4f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.258857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2055/4090] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:31 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:31.351416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.352763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.353212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.353632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.354783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.357185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.391129 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2036/4091] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:31 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:31.395426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.411486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa0261-5e3e-47cd-82cf-74e11b338aaa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.422828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.423592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.423808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.424087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.424889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.426530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.439374 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2056/4092] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:29:31.443423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.459994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d62e63-01ff-4758-8f77-43286912b774 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.466127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d707e65-60d1-4f91-a66f-71c21ddd3eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.466828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707e65-60d1-4f91-a66f-71c21ddd3eca admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.467112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707e65-60d1-4f91-a66f-71c21ddd3eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.467637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d707e65-60d1-4f91-a66f-71c21ddd3eca admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.469570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707e65-60d1-4f91-a66f-71c21ddd3eca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.472051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d707e65-60d1-4f91-a66f-71c21ddd3eca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.479860 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:31.492998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2037/4093] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:29:31.494212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.506876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29415561-3eb1-4c5d-b8ee-9418d4a98b51 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.512290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.513752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.514107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.515494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] PATH_INFO: `/v3/projects/553532e0f69c408295c9485378c11e35/users/afd5c943c55b41f5bebd8fd6f74d08e8/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.540112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=553532e0f69c408295c9485378c11e35, user_id=afd5c943c55b41f5bebd8fd6f74d08e8, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.543127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.571302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2057/4094] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:31 2022] PUT /identity/v3/projects/553532e0f69c408295c9485378c11e35/users/afd5c943c55b41f5bebd8fd6f74d08e8/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:31.582012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.582378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.582729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.612930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] MFA Rules not processed for user `afd5c943c55b41f5bebd8fd6f74d08e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:31.614329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:31.754514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2038/4095] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:31.759299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.900063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c781c-a297-478e-a94b-5048b7e7d3a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:31.906840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:31.908175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:31.908685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:31.909877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:31.914144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:31.916108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:31.969979 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2058/4096] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:31 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:31.974632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:31.987381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6a6793-79de-4209-9813-69ce60852765 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:32.142127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:32.142986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:32.146391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:32.146767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:32.147562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:32.149615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:32.203036 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2039/4097] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:31 2022] POST /identity/v3/users => generated 295 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:32.204034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:32.222935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83637b7-b3fd-4559-8be6-a2019e6fac98 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:32.235377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:32.236625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:32.237156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:32.238387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:32.240963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:32.245693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:32.280286 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2059/4098] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:32.286197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:32.319483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff8f3d-4b6d-40b3-830e-28c1a5b0d1b8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:32.343551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:32.345215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:32.345921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:32.347582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] PATH_INFO: `/v3/projects/cefbe24b3dcf4a29a4105efca2a86210/users/5ec7900345614ad682a42e66f722ecfd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:32.370842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefbe24b3dcf4a29a4105efca2a86210, user_id=5ec7900345614ad682a42e66f722ecfd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:32.375748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:32.428714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:32.429768 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2040/4099] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:32 2022] PUT /identity/v3/projects/cefbe24b3dcf4a29a4105efca2a86210/users/5ec7900345614ad682a42e66f722ecfd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:32.442052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e5779-a51a-41db-9025-397e651440d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:32.556619 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:32.582445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363ed30d-cd09-4447-934e-ab9390a5cb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:32.583285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ed30d-cd09-4447-934e-ab9390a5cb60 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:32.583567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ed30d-cd09-4447-934e-ab9390a5cb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:32.583839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363ed30d-cd09-4447-934e-ab9390a5cb60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:32.584599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ed30d-cd09-4447-934e-ab9390a5cb60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:32.586293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363ed30d-cd09-4447-934e-ab9390a5cb60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:32.613941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:32.618516 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2060/4100] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:32 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:32.644565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5baa0bc-817a-4269-8668-7422bf60d4bb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:32.663335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:32.664482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:32.664814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:32.665043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] PATH_INFO: `/v3/projects/cefbe24b3dcf4a29a4105efca2a86210/users/5ec7900345614ad682a42e66f722ecfd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:32.672069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefbe24b3dcf4a29a4105efca2a86210, user_id=5ec7900345614ad682a42e66f722ecfd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:32.683500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:32.723835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:32.724119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:32.724980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:32.730450 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2041/4101] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:32 2022] PUT /identity/v3/projects/cefbe24b3dcf4a29a4105efca2a86210/users/5ec7900345614ad682a42e66f722ecfd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:32.837051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] MFA Rules not processed for user `5ec7900345614ad682a42e66f722ecfd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:32.843917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:32.973894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:32.975533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:33.097378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2061/4102] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:33.099451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:33.111431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8951212-72a5-4903-b86e-53b88a0e2adb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.118128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.118957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.119302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.119611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.120515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.121613 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:33.121613 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:29:33.121613 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:29:33.122915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.135821 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:33.160662 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2062/4103] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:29:33 2022] POST /identity/v3/domains => generated 245 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:33.161921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:33.213777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9575eb07-f871-4adc-9b4f-682dbcaac9c8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.290577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea45371-2c97-46e5-a1b9-d7fbada794cd tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.316335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.317204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.317490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.317772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.319132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.321237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.327214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.328703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.329347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.329826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.331922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:33.353434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.355365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.373269 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2042/4104] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:29:33.401641 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2063/4105] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:33 2022] POST /identity/v3/projects => generated 409 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:29:33.403240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:33.422269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27562fb7-5fa0-4bf5-9171-1e999054ccb1 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.504567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:33.506780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:33.565113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.566502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.566790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.567098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.567828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.569830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.609347 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2043/4106] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:33 2022] POST /identity/v3/users => generated 348 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:33.613574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:33.624145 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:33.627249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3991efe-7071-48af-b462-ac3f91d49d5f tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.634827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.635768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.638510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.638891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.639738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.643604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.669023 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2044/4107] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:33 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:29:33.672678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:33.686562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995d7d90-e709-4e8a-b127-26be4a8f0f41 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.693920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a30e57-f69d-4687-ba4c-335ec19bffe2 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.694919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e58ebb-ffe4-4c41-a754-b5f55b41bafb tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:33.695361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a30e57-f69d-4687-ba4c-335ec19bffe2 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.695809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a30e57-f69d-4687-ba4c-335ec19bffe2 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.696625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a30e57-f69d-4687-ba4c-335ec19bffe2 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/projects/8fdfb2d98984450cabe7d57d8e90e280/users/28e4ca3401e845f8a09c4c1940dcdaf6/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.702972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:33.704127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.704686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.704915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] PATH_INFO: `/v3/users/d3277b161298479db5b7114cad011563` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.706517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3277b161298479db5b7114cad011563)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.708730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.718086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a30e57-f69d-4687-ba4c-335ec19bffe2 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:create_grant(project_id=8fdfb2d98984450cabe7d57d8e90e280, user_id=28e4ca3401e845f8a09c4c1940dcdaf6, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:33.724906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a30e57-f69d-4687-ba4c-335ec19bffe2 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:33.748013 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2045/4108] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:33 2022] PUT /identity/v3/projects/8fdfb2d98984450cabe7d57d8e90e280/users/28e4ca3401e845f8a09c4c1940dcdaf6/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:33.753384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.753653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.753979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:33.789407 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:33.790912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3277b161298479db5b7114cad011563'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:33.791688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3277b161298479db5b7114cad011563'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:33.804366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3277b161298479db5b7114cad011563'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:33.805337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3277b161298479db5b7114cad011563'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:33.818542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f1b0e49d-c6bb-449c-a91b-8f3390a77ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3277b161298479db5b7114cad011563'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:33.871039 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2064/4109] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:33 2022] DELETE /identity/v3/users/d3277b161298479db5b7114cad011563 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:33.909690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] MFA Rules not processed for user `28e4ca3401e845f8a09c4c1940dcdaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:33.910950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:33.936889 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2046/4110] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:33.939826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:33.940119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:33.940417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.107144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] MFA Rules not processed for user `28e4ca3401e845f8a09c4c1940dcdaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:34.108794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.118451 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2065/4111] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:33 2022] POST /identity/v3/auth/tokens => generated 3350 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:34.123455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.134718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f713d6-f5aa-42a0-a30f-06eae7dc37ea None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.139982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28e4ca3401e845f8a09c4c1940dcdaf6', 'user_domain_id': '4ca44fed29db4e92ac8a466cf0d29e96', 'system_scope': None, 'project_id': '8fdfb2d98984450cabe7d57d8e90e280', 'project_domain_id': '4ca44fed29db4e92ac8a466cf0d29e96', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.140664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.140951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.141229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.159712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.161819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.180603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2047/4112] 10.222.0.15 () {56 vars in 1283 bytes} [Tue Jul 19 11:29:34 2022] GET /identity/v3/auth/tokens => generated 3350 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:34.182302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.183251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.184069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.185696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.269550 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:34.276156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b39a5-4e58-4c62-aa63-826bc291b014 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.283156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.284559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.284974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.285319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] PATH_INFO: `/v3/projects/5c850546307343069da2291117c28f0c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.286780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4ae3f9-5c86-449b-97ee-424a03544ddb tempest-test_project-411601068 tempest-user-2075088867] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.286909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c850546307343069da2291117c28f0c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.288931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.292415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.293474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.293958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.294307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/users/28e4ca3401e845f8a09c4c1940dcdaf6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.295952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:delete_user(user_id=28e4ca3401e845f8a09c4c1940dcdaf6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.298409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.358491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c850546307343069da2291117c28f0c', 'request_id': 'req-7050fc45-d37c-40ef-a784-cc13306560c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.361671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e4ca3401e845f8a09c4c1940dcdaf6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.366214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c850546307343069da2291117c28f0c', 'request_id': 'req-7050fc45-d37c-40ef-a784-cc13306560c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.371570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e4ca3401e845f8a09c4c1940dcdaf6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.374696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c850546307343069da2291117c28f0c', 'request_id': 'req-7050fc45-d37c-40ef-a784-cc13306560c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.393540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] The token cache is being invalidate because project 5c850546307343069da2291117c28f0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:34.394068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.394267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e4ca3401e845f8a09c4c1940dcdaf6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.395011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7050fc45-d37c-40ef-a784-cc13306560c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.395765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e4ca3401e845f8a09c4c1940dcdaf6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.401440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2066/4113] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:34 2022] DELETE /identity/v3/projects/5c850546307343069da2291117c28f0c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:34.403110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601eaa9-fd4a-4ae1-b664-ea54ab54101f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.403673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601eaa9-fd4a-4ae1-b664-ea54ab54101f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.404086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601eaa9-fd4a-4ae1-b664-ea54ab54101f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.404288 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:34.407289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e4ca3401e845f8a09c4c1940dcdaf6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.422379 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2048/4114] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:34 2022] DELETE /identity/v3/users/28e4ca3401e845f8a09c4c1940dcdaf6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:34.425258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.429803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.437819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f601eaa9-fd4a-4ae1-b664-ea54ab54101f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:34.439342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f601eaa9-fd4a-4ae1-b664-ea54ab54101f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.524099 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2067/4115] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:34.532535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.532886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.533225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.536725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04289af5-9ae7-4539-8ce5-7272a4301b71 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.543052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.544014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.544385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.544773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/projects/8fdfb2d98984450cabe7d57d8e90e280` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.546079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8fdfb2d98984450cabe7d57d8e90e280)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.548848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.557852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:34.559353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.573440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2068/4116] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:34.575198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.589455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e14d0-fab9-44b1-b428-dc9d9f0ae222 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.595324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.596526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.596966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.597377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.598292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:29:34.598747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.600818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.613036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8fdfb2d98984450cabe7d57d8e90e280', 'request_id': 'req-353fd41d-145b-4e58-9b61-4e2aace526a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.615697 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2069/4117] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:34.620762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.624473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8fdfb2d98984450cabe7d57d8e90e280', 'request_id': 'req-353fd41d-145b-4e58-9b61-4e2aace526a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.634033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8fdfb2d98984450cabe7d57d8e90e280', 'request_id': 'req-353fd41d-145b-4e58-9b61-4e2aace526a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.635498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467b314c-78d0-46c1-82d1-60797102b2af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.648254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] The token cache is being invalidate because project 8fdfb2d98984450cabe7d57d8e90e280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:34.648857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.649796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.656395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2049/4118] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:34 2022] DELETE /identity/v3/projects/8fdfb2d98984450cabe7d57d8e90e280 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:34.657892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.659664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.701064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.701853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.702139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.702415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.703263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.705790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.718279 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:34.751119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353fd41d-145b-4e58-9b61-4e2aace526a8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.753227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2070/4119] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:34 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:34.757638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.759421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:34.792008 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:34.840509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:34.842983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:34.842983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:34.842983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/domains/4ca44fed29db4e92ac8a466cf0d29e96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:34.844149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=4ca44fed29db4e92ac8a466cf0d29e96)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:34.845269 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:34.845269 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:34.845269 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:34.846230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:34.874174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.875064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.879996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71243eea-23d1-4ed8-a40f-a9dd06c799ec admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:34.916973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.917748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:34.921423 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2050/4120] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:29:34 2022] PATCH /identity/v3/domains/4ca44fed29db4e92ac8a466cf0d29e96 => generated 246 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:34.928985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:34.930739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:35.026128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e549df-b5f8-4de5-b6b8-b978799d6736 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:35.031825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ec7900345614ad682a42e66f722ecfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cefbe24b3dcf4a29a4105efca2a86210', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.032741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.033033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.033403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] PATH_INFO: `/v3/domains/4ca44fed29db4e92ac8a466cf0d29e96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.033672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.035897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.036635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.038648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.039620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.053911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=4ca44fed29db4e92ac8a466cf0d29e96)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.054986 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:35.054986 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:35.054986 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:35.056700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.062041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.110314 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2071/4121] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:34 2022] POST /identity/v3/users => generated 286 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:29:35.111276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:35.112155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.113304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:35.120685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.131245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded2bd85-7dd1-4195-9e32-c3b476bce51d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:35.160880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.161793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.162573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.162573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.163346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.168445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.194429 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2072/4122] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:35.196375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:35.209308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19712fb-daf5-4a9e-885e-9a13adc576ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:35.217518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.218414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.218705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.219249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.220378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.222953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.243910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96', 'request_id': 'req-e2bb2fe2-013a-44e5-9be4-981db65978c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.249644 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2073/4123] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:35.255120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96', 'request_id': 'req-e2bb2fe2-013a-44e5-9be4-981db65978c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.257401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:35.268923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96', 'request_id': 'req-e2bb2fe2-013a-44e5-9be4-981db65978c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.275789 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:35.279123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c99693-d96e-4146-b3f7-9abb1fd441a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:35.293396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] The token cache is being invalidate because project 4ca44fed29db4e92ac8a466cf0d29e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:35.293619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.296952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.343271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96', 'request_id': 'req-e2bb2fe2-013a-44e5-9be4-981db65978c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.344053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96', 'request_id': 'req-e2bb2fe2-013a-44e5-9be4-981db65978c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.344722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '4ca44fed29db4e92ac8a466cf0d29e96', 'request_id': 'req-e2bb2fe2-013a-44e5-9be4-981db65978c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.363711 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2051/4124] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:29:34 2022] DELETE /identity/v3/domains/4ca44fed29db4e92ac8a466cf0d29e96 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:35.372070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:35.373904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:35.434790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65364322-75b8-425e-8f26-7bb39cd5b95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.436911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364322-75b8-425e-8f26-7bb39cd5b95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.436911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364322-75b8-425e-8f26-7bb39cd5b95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.436911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65364322-75b8-425e-8f26-7bb39cd5b95b admin admin] PATH_INFO: `/v3/projects/aabe5e7662a6477ba3373866751fa0d2/users/c609537eaa164cf58ee27c71990fc4ba/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.465179 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:35.482908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65364322-75b8-425e-8f26-7bb39cd5b95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aabe5e7662a6477ba3373866751fa0d2, user_id=c609537eaa164cf58ee27c71990fc4ba, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.485943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65364322-75b8-425e-8f26-7bb39cd5b95b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.512159 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2074/4125] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:35 2022] PUT /identity/v3/projects/aabe5e7662a6477ba3373866751fa0d2/users/c609537eaa164cf58ee27c71990fc4ba/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:35.523771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.525476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.525877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.570732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bb2fe2-013a-44e5-9be4-981db65978c8 tempest-TestDefaultProjectId-1449708350 tempest-TestDefaultProjectId-1449708350-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:35.616044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] MFA Rules not processed for user `c609537eaa164cf58ee27c71990fc4ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:35.621255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:35.726520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.728082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.728612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.729269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] PATH_INFO: `/v3/users/afd5c943c55b41f5bebd8fd6f74d08e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.731361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd5c943c55b41f5bebd8fd6f74d08e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.734408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.781534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2075/4126] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:29:35.796648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:35.797942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:35.843391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd5c943c55b41f5bebd8fd6f74d08e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.863547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd5c943c55b41f5bebd8fd6f74d08e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.889144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd5c943c55b41f5bebd8fd6f74d08e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.890839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd5c943c55b41f5bebd8fd6f74d08e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.891694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b191f-f09e-4e50-a4b5-ad94507e75e2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:35.899389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:35.900109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.900470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.900787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.902901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:35.910371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-03a80974-024c-4683-91c0-72ffac7401e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd5c943c55b41f5bebd8fd6f74d08e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:35.916755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:35.918707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:35.937696 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2052/4127] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:35 2022] DELETE /identity/v3/users/afd5c943c55b41f5bebd8fd6f74d08e8 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:35.942191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:35.942458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:35.942745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:35.944442 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2076/4128] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:35.952316 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:35.990722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:35.993128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:36.175160 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2053/4129] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:29:36.200145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:36.201805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:36.305344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c86720f-93cc-4acf-93e4-544c040c750b service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:36.327224 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:36.368735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45be61d-faf7-4bcf-83c6-fecff9a19a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:36.369411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be61d-faf7-4bcf-83c6-fecff9a19a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:36.369729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be61d-faf7-4bcf-83c6-fecff9a19a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:36.370111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45be61d-faf7-4bcf-83c6-fecff9a19a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:36.381632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45be61d-faf7-4bcf-83c6-fecff9a19a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:36.383222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45be61d-faf7-4bcf-83c6-fecff9a19a5a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:36.396503 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2077/4130] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:37.649036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:37.650647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:37.676167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:37.676757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:37.676757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:37.700441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0078288f-839c-4b0d-b02f-555d63e7c92a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:37.722053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:37.726823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:37.727160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:37.727437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] PATH_INFO: `/v3/projects/553532e0f69c408295c9485378c11e35` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:37.728081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:37.730912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:37.732862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] RBAC: Authorizing `identity:delete_project(project_id=553532e0f69c408295c9485378c11e35)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:37.738448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:37.942626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '553532e0f69c408295c9485378c11e35', 'request_id': 'req-0040d659-0b71-4c88-86b2-64d27eab8072'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:37.966975 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2078/4131] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:37 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:37.972180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '553532e0f69c408295c9485378c11e35', 'request_id': 'req-0040d659-0b71-4c88-86b2-64d27eab8072'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:37.985852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '553532e0f69c408295c9485378c11e35', 'request_id': 'req-0040d659-0b71-4c88-86b2-64d27eab8072'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.018217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] The token cache is being invalidate because project 553532e0f69c408295c9485378c11e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:38.018524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.019239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.026036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:38.026571 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2054/4132] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:37 2022] DELETE /identity/v3/projects/553532e0f69c408295c9485378c11e35 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:38.059732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0e68e2-ae43-4445-b908-139d184ef7ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:38.252503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:38.252503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:38.252503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:38.252503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] PATH_INFO: `/v3/users/5ec7900345614ad682a42e66f722ecfd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:38.256377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec7900345614ad682a42e66f722ecfd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:38.256377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:38.372844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec7900345614ad682a42e66f722ecfd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.373559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec7900345614ad682a42e66f722ecfd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.405176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec7900345614ad682a42e66f722ecfd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.408126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec7900345614ad682a42e66f722ecfd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.433274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec7900345614ad682a42e66f722ecfd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:38.446981 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:38.483397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2079/4133] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:38 2022] DELETE /identity/v3/users/5ec7900345614ad682a42e66f722ecfd => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:40.537386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:40.542484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:40.574548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d659-0b71-4c88-86b2-64d27eab8072 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:40.801187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:40.802099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:40.802379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:40.802724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] PATH_INFO: `/v3/projects/cefbe24b3dcf4a29a4105efca2a86210` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:40.804701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefbe24b3dcf4a29a4105efca2a86210)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:40.806958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:40.854281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:40.857313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:40.909580 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:40.950609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefbe24b3dcf4a29a4105efca2a86210', 'request_id': 'req-96f74c90-4634-49c8-bb42-857ab0300282'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:40.970989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefbe24b3dcf4a29a4105efca2a86210', 'request_id': 'req-96f74c90-4634-49c8-bb42-857ab0300282'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:40.980879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefbe24b3dcf4a29a4105efca2a86210', 'request_id': 'req-96f74c90-4634-49c8-bb42-857ab0300282'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:41.026283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] The token cache is being invalidate because project cefbe24b3dcf4a29a4105efca2a86210 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:41.026583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:41.035733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f74c90-4634-49c8-bb42-857ab0300282 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:41.050328 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2055/4134] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:40 2022] DELETE /identity/v3/projects/cefbe24b3dcf4a29a4105efca2a86210 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:41.052126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896801e7-dad8-4497-ad8b-601a4e036987 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.052652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896801e7-dad8-4497-ad8b-601a4e036987 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.065415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896801e7-dad8-4497-ad8b-601a4e036987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.121481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-896801e7-dad8-4497-ad8b-601a4e036987 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:41.126616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-896801e7-dad8-4497-ad8b-601a4e036987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:41.126825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dae05-d9d2-43d9-980a-08d387f5895a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:41.271251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:41.271975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.272317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.272684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.277688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:41.307989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:41.309035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbe3be6-7b50-4981-9e18-989aaefa7c7e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:41.328454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2080/4135] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:41.329853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d2053-803f-4579-b1b7-eb8ee33a6315 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.330136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d2053-803f-4579-b1b7-eb8ee33a6315 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.330412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d2053-803f-4579-b1b7-eb8ee33a6315 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.333989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2056/4136] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:41.340050 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2081/4137] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:29:41 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:29:41.341532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.341924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.342294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.343299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.343584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.343857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.389387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:41.390645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:41.391944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:41.398281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:41.416112 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2057/4138] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:29:41.420322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:41.424518 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2082/4139] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:29:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:29:41.438228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbac0647-f666-40c8-9e8e-72acddd38f4a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:41.454289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:41.455121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.455502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.455878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.456795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:29:41.457197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:41.462838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:41.484853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:41.486274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:41.494829 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2058/4140] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:29:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:41.499605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:41.515675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a3a976-1caf-41f2-b72b-04ce21e3e7cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:41.527129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3849f0-7668-446b-a211-03c341418431 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:41.534408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:41.535364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.535784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.536311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.549587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:41.550368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.550648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.550922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.559658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:41.560695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:41.562827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:41.563321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:41.587316 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2083/4141] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:41.720623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:41.723103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2059/4142] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:41 2022] POST /identity/v3/projects => generated 369 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:29:41.723244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:41.727948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:41.899483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da378c-3bb9-409e-b1ba-cfdb281599a8 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:41.916138 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:41.924590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f525e031-8e66-4de1-89bc-ab610fcf9fba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:41.930581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:41.931827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:41.932217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:41.932545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:41.933491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:41.935800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:41.988211 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2060/4143] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:41 2022] POST /identity/v3/users => generated 285 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:41.989156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:41.993428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.011308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:42.012539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.013034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.013527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.015750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.020488 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:42.030618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f67a0-e31c-441b-9b8a-d0ba1a6c5ce9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:42.037555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:42.040471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d361068-9369-4b00-84e1-fd7c9123c677 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:42.041813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:42.042726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.043004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.043277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] PATH_INFO: `/v3/users/233295aaebd946e5bc4be28f4a3e3558` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.048203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] RBAC: Authorizing `identity:delete_user(user_id=233295aaebd946e5bc4be28f4a3e3558)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:42.053833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:42.055506 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2084/4144] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:42.057686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.058230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.058757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.083394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:42.085194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.174933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '233295aaebd946e5bc4be28f4a3e3558'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:42.176661 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2085/4145] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:42.179120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:42.181465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.202836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '233295aaebd946e5bc4be28f4a3e3558'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:42.257731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '233295aaebd946e5bc4be28f4a3e3558'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:42.261975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '233295aaebd946e5bc4be28f4a3e3558'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:42.297413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '233295aaebd946e5bc4be28f4a3e3558'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:42.316831 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2061/4146] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:41 2022] DELETE /identity/v3/users/233295aaebd946e5bc4be28f4a3e3558 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:42.317707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:42.332961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.334708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f1343-3de4-4cd2-bb74-4d2987ff4b7d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:42.505111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:42.506111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.508713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef41850-0a26-4c50-9688-a48b5edab273 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:42.513744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.514344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.520993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.522927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:42.523742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.524021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.524302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.525080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:42.526777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:42.550537 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:42.552963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2062/4147] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:42.554158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:42.566007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:42.567922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:42.575743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038873be-1430-4b3c-91cb-ca78ace48a3e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:42.591794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7f62a-9da8-4e47-9d7a-352960427102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:42.592815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7f62a-9da8-4e47-9d7a-352960427102 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.593111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7f62a-9da8-4e47-9d7a-352960427102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.593396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7f62a-9da8-4e47-9d7a-352960427102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.594156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7f62a-9da8-4e47-9d7a-352960427102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:42.595807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7f62a-9da8-4e47-9d7a-352960427102 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:42.605969 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2086/4148] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:42.626419 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2063/4149] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:42 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:42.627987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:42.641831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294055a-8ad3-4c40-b345-a49f0efbb3d3 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:42.657417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:42.658658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.658658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.658965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] PATH_INFO: `/v3/projects/c8344862ecea4ebcb5ee37528492c9f1/users/3850acda34ce4441ac9f881c2a579935/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.696889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8344862ecea4ebcb5ee37528492c9f1, user_id=3850acda34ce4441ac9f881c2a579935, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:42.699876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:42.746272 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2087/4150] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:42 2022] PUT /identity/v3/projects/c8344862ecea4ebcb5ee37528492c9f1/users/3850acda34ce4441ac9f881c2a579935/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:42.748581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:42.748871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:42.749148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:42.804284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] MFA Rules not processed for user `3850acda34ce4441ac9f881c2a579935`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:42.805531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.813414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:42.814995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:42.996431 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:43.029800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20418654-be3c-4563-aa50-bbff7e706bca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.058546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.058546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.058546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.058546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] PATH_INFO: `/v3/projects/cd565f94e4c5444a8523badfb9fb6c2c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.058984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd565f94e4c5444a8523badfb9fb6c2c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.065792 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2064/4151] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:43.066204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.070707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.093249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484cde54-cd71-41a4-a3e8-d5a1375ed53c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.123447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.124621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.125120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.125629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.126559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.131989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.226421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd565f94e4c5444a8523badfb9fb6c2c', 'request_id': 'req-103f238d-402c-4991-872d-b90f07eb2f02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:43.234750 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2065/4152] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:43 2022] POST /identity/v3/projects => generated 369 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:29:43.244824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.258730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd565f94e4c5444a8523badfb9fb6c2c', 'request_id': 'req-103f238d-402c-4991-872d-b90f07eb2f02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:43.285682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd565f94e4c5444a8523badfb9fb6c2c', 'request_id': 'req-103f238d-402c-4991-872d-b90f07eb2f02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:43.325612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] The token cache is being invalidate because project cd565f94e4c5444a8523badfb9fb6c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:43.325896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:43.327674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-103f238d-402c-4991-872d-b90f07eb2f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:43.336523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2088/4153] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:42 2022] DELETE /identity/v3/projects/cd565f94e4c5444a8523badfb9fb6c2c => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:43.340212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1168-bf54-4894-900f-100d69d1732f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.340825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1168-bf54-4894-900f-100d69d1732f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.344926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27e1168-bf54-4894-900f-100d69d1732f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.399529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a27e1168-bf54-4894-900f-100d69d1732f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:43.403406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a27e1168-bf54-4894-900f-100d69d1732f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:43.473805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7307ff4-f916-42f6-8615-4c4fa5aaaf16 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.493628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.494862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.495344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.495849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.496793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.502521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.551064 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2066/4154] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:43 2022] POST /identity/v3/users => generated 291 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:43.556674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.562697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:43.564863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2089/4155] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:43.566317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.566603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.566878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.583850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:43.592301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c1d8a-b113-4308-8587-553195ddb349 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.609650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.609892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:43.609986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.609986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.610130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.610663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:43.610993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.613626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.633285 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2090/4156] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:43.634530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.640634 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2067/4157] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:43.641645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.655947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4281fa-e074-46fa-8f62-2e4968877741 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.667101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22300c-3e48-450b-bcbb-bcda71d87169 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.672838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.673822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.674194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.674531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] PATH_INFO: `/v3/projects/bf87ef7411874187bcc21dea93a61531/users/5378de92f7e646239c41d13e5f5df847/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.677355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.678318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.678801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.679256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.680218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:29:43.681082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.687152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.710614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf87ef7411874187bcc21dea93a61531, user_id=5378de92f7e646239c41d13e5f5df847, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.713692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.730591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2091/4158] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:43.731846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.751119 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2068/4159] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:43 2022] PUT /identity/v3/projects/bf87ef7411874187bcc21dea93a61531/users/5378de92f7e646239c41d13e5f5df847/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:43.752195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.753950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2b1ad8-ea62-4dc0-8557-c2596827bd13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.879992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bb119-1593-480e-a5e1-3a40bdbb2924 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.891445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.892497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.898600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.899137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.900070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.900555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:43.901376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:43.901702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:43.902383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:43.902804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:43.904407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.904721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:43.940872 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2069/4160] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:43.941998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:43.979283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab45b25-8fc0-4447-b008-9b6abf36c1a9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:43.981517 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2092/4161] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:43 2022] POST /identity/v3/projects => generated 373 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:43.986310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:44.068427 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:44.188638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:44.189575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.189853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.190129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] PATH_INFO: `/v3/projects/bf87ef7411874187bcc21dea93a61531/users/5378de92f7e646239c41d13e5f5df847/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.192202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809ea08c-a75c-4686-ae9d-d7e6f1278cbf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:44.197372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf87ef7411874187bcc21dea93a61531, user_id=5378de92f7e646239c41d13e5f5df847, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:44.199454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:44.200139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:44.200882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.201389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.201917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.203397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:44.206036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:44.257772 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2093/4162] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:43 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:44.259462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:44.261320 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2070/4163] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:43 2022] PUT /identity/v3/projects/bf87ef7411874187bcc21dea93a61531/users/5378de92f7e646239c41d13e5f5df847/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:44.270119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:44.272839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:44.291998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222df10-e325-4c1d-9f47-43ab3f9afaf1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:44.415561 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:44.434602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:44.439851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.440457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.440746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] PATH_INFO: `/v3/users/c609537eaa164cf58ee27c71990fc4ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.442883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c609537eaa164cf58ee27c71990fc4ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:44.447874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:44.515084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8695f8-ca1c-4bad-af88-b24e9a231101 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:44.527983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cf9a1f-c89f-429f-9c9c-5daef853677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:44.528943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9a1f-c89f-429f-9c9c-5daef853677a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.529164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9a1f-c89f-429f-9c9c-5daef853677a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.529506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf9a1f-c89f-429f-9c9c-5daef853677a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.530324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf9a1f-c89f-429f-9c9c-5daef853677a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:44.532066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cf9a1f-c89f-429f-9c9c-5daef853677a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:44.558914 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2071/4164] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:44.560077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.560379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.560770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.601032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c609537eaa164cf58ee27c71990fc4ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:44.603896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c609537eaa164cf58ee27c71990fc4ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:44.623590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c609537eaa164cf58ee27c71990fc4ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:44.625347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c609537eaa164cf58ee27c71990fc4ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:44.630431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] MFA Rules not processed for user `5378de92f7e646239c41d13e5f5df847`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:44.631584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:44.644916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c609537eaa164cf58ee27c71990fc4ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:44.703602 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2094/4165] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:44 2022] DELETE /identity/v3/users/c609537eaa164cf58ee27c71990fc4ba => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:44.705010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:44.708650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:44.793338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf0302-87e5-4fac-b478-3d5e31b35f8a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:44.798045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:44.799015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.799524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.800175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.803568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:44.839796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2072/4166] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:44.840815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:44.845603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:44.876456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf5be95-23d9-4b00-9f49-e916ebbcb778 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:44.899906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:44.901841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab291bc-005a-4240-a6ed-275d811ef528 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:44.916511 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2095/4167] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:44.918704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:44.919197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:44.919667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:44.945191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:44.946859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:44.971573 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2096/4168] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:44.974606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.000633 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:45.043219 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:45.087548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.088409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.088642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.088914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.089661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.091348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.138049 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2073/4169] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:44 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:45.139001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.151114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b239c2-137d-474c-96ef-cd4e32971207 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.152590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:45.169215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.169907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.170214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.170466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.171212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.173185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.193070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee865886-b8fe-4d8e-a98d-0a20dbc48ca1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.205078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.205830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.206102 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2097/4170] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:29:44 2022] POST /identity/v3/domains => generated 276 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:45.206665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.206665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.211039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.244226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.245738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.309984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2074/4171] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:45.311093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.365677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1e2725-2c6f-4a5e-8a8f-1f0da3af073f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.412223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ca273-d8b0-40e5-8f0c-5ec88008abd1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.429902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174044f0-b6e1-4c76-a65b-b84cbc95cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.431192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174044f0-b6e1-4c76-a65b-b84cbc95cee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.432174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174044f0-b6e1-4c76-a65b-b84cbc95cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.432724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174044f0-b6e1-4c76-a65b-b84cbc95cee2 admin admin] PATH_INFO: `/v3/projects/34c205594ae1417cb72ed172e332cf01/users/61d129f38240447cbc0133726b37f861/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.470167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174044f0-b6e1-4c76-a65b-b84cbc95cee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c205594ae1417cb72ed172e332cf01, user_id=61d129f38240447cbc0133726b37f861, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.473175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174044f0-b6e1-4c76-a65b-b84cbc95cee2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.527007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2098/4172] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:45 2022] PUT /identity/v3/projects/34c205594ae1417cb72ed172e332cf01/users/61d129f38240447cbc0133726b37f861/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:45.529628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.529851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.530126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.556589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.558823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.559927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.560521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.563169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.566881 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:45.566881 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:45.566881 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:45.568123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.590275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:45.597711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:45.639272 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2075/4173] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:45 2022] POST /identity/v3/groups => generated 279 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:45.645144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.662693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd3b9c-32e7-49ec-bea2-2af3fe96249c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.753747 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2099/4174] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:45.774418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.776511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.776882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.777233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/aaec61c6a7924a568e554268b481be07` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.784544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:update_group(group_id=aaec61c6a7924a568e554268b481be07)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.785903 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:45.785903 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:45.785903 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:45.787453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.807684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.833370 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2076/4175] 10.222.0.15 () {60 vars in 1246 bytes} [Tue Jul 19 11:29:45 2022] PATCH /identity/v3/groups/aaec61c6a7924a568e554268b481be07 => generated 292 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:45.837555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.858110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42843e54-775f-4a60-a043-b0c00910500a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.867323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.868338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.868754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.869203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/aaec61c6a7924a568e554268b481be07` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.881232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:get_group(group_id=aaec61c6a7924a568e554268b481be07)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.882561 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:45.882561 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:45.882561 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:45.884046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.890384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2077/4176] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:45 2022] GET /identity/v3/groups/aaec61c6a7924a568e554268b481be07 => generated 292 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:29:45.891435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:45.921653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c06ef13-0a6d-4b56-bb3b-6f7cf0d95961 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.923644 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:45.953674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2073044-44c4-49e2-b146-91e826cfcad2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:45.956956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.958376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.960540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:45.961238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:45.961586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.961805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:45.961911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/aaec61c6a7924a568e554268b481be07` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.962074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:45.967658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:update_group(group_id=aaec61c6a7924a568e554268b481be07)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.977532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:45.993882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:45.995407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:46.016724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2100/4177] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:29:46.032112 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2078/4178] 10.222.0.15 () {60 vars in 1245 bytes} [Tue Jul 19 11:29:45 2022] PATCH /identity/v3/groups/aaec61c6a7924a568e554268b481be07 => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:46.036745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:46.073319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eafef3e-d036-448b-984b-a15463ee6ef3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:46.084816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:46.086986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:46.086986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:46.086986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/aaec61c6a7924a568e554268b481be07` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:46.101291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=aaec61c6a7924a568e554268b481be07)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:46.102351 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:46.102351 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:29:46.102351 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:29:46.103665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:46.245406 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2101/4179] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:46 2022] DELETE /identity/v3/groups/aaec61c6a7924a568e554268b481be07 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:46.246627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:46.276675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8b9ee7-c6fe-4a56-8c65-a4de9bb6c25c tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:46.288378 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:46.428981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:46.430203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:46.431047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:46.431520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:46.432669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:46.435988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:46.473528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2079/4180] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:46 2022] POST /identity/v3/groups => generated 325 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:46.474887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:46.496026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80601c3-e6e2-4761-a7f9-92b78e9fcd19 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:46.514920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:46.515927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:46.516378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:46.516802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:46.517645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:46.519894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:46.573566 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2102/4181] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:46 2022] POST /identity/v3/users => generated 323 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:46.574284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:46.595315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8759d64b-6419-44ad-b77c-e57c719b74cb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:46.620628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:46.622272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:46.622717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:46.623126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/280bb8c57e59442593062993122d1b02` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:46.669599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=280bb8c57e59442593062993122d1b02)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:46.670765 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:46.670765 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:46.670765 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:46.673016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:46.725560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2080/4182] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:29:46 2022] PUT /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/280bb8c57e59442593062993122d1b02 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:46.729111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:46.752674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a89f227-0077-4e4f-9401-ecfb2befd68a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:46.883653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:46.884460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:46.885073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:46.885403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:46.886240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:46.888722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:46.931320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2103/4183] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:46 2022] POST /identity/v3/users => generated 323 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:46.935457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:46.951922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339c53e-3ee4-428b-951d-3ca3c4ba0547 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:46.964405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:46.965525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:46.965916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:46.966850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/378084976efb4025aaaa1240e8b2d74a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:46.998581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=378084976efb4025aaaa1240e8b2d74a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.001459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.046716 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2081/4184] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:29:46 2022] PUT /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/378084976efb4025aaaa1240e8b2d74a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:47.051068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.067052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06d37d-d6ba-4250-a106-faae023270d3 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.203901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.206583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.206978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.207347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.208311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.213437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.222083 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=4,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:47.248479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2104/4185] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:47 2022] POST /identity/v3/users => generated 321 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:47.252218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.267465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7984e7-7dc5-4c1b-a93e-b6f4dfc6162a tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.274987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.276011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.276325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.276820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/c8f8212c325b4faa9443840683a6f1c2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.297649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=c8f8212c325b4faa9443840683a6f1c2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.299625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.327489 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2082/4186] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:29:47 2022] PUT /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/c8f8212c325b4faa9443840683a6f1c2 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:47.332188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.344605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305ccba-df87-4b8d-9d66-fa90823abc95 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.459963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.460860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.461149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.461576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.463110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.464605 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:47.464605 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:29:47.464605 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:29:47.466108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.496645 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2105/4187] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:29:47 2022] GET /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users => generated 1083 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:29:47.498328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.517775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13087be-ca47-4d0e-b15d-c8d9027186d1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.527841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.528887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.529178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.529512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/280bb8c57e59442593062993122d1b02` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.532064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=280bb8c57e59442593062993122d1b02)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.533184 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:47.533184 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:47.533184 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:47.535218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.576031 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2083/4188] 10.222.0.15 () {58 vars in 1341 bytes} [Tue Jul 19 11:29:47 2022] HEAD /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/280bb8c57e59442593062993122d1b02 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:47.578257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.596094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22d7e1e-bf15-4a0d-8668-ed97d0c2a3db tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.606315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.607383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.607753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.608091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/280bb8c57e59442593062993122d1b02` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.610165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=280bb8c57e59442593062993122d1b02)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.611334 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:47.611334 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:29:47.611334 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:29:47.612746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.628358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '280bb8c57e59442593062993122d1b02'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:47.648432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2106/4189] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:29:47 2022] DELETE /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/280bb8c57e59442593062993122d1b02 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:47.651647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.665777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1704389-d806-45e1-b124-d0bd533dad34 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.723549 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:47.745912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.747541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.747826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.748103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/378084976efb4025aaaa1240e8b2d74a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.749999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=378084976efb4025aaaa1240e8b2d74a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.752180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.774086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.774551 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2084/4190] 10.222.0.15 () {58 vars in 1341 bytes} [Tue Jul 19 11:29:47 2022] HEAD /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/378084976efb4025aaaa1240e8b2d74a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:47.787560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c45c4c3-0f05-40fa-b776-4daa1e966871 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.798359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:47.799336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:47.799632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:47.799914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/378084976efb4025aaaa1240e8b2d74a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:47.805764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=378084976efb4025aaaa1240e8b2d74a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:47.809982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:47.821453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '378084976efb4025aaaa1240e8b2d74a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:47.882940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.883421 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2107/4191] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:29:47 2022] DELETE /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/378084976efb4025aaaa1240e8b2d74a => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:47.894134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:47.902179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee319e06-f436-4009-99db-7cc68ba66481 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:47.906889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:48.112488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.113632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.114013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.114383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/c8f8212c325b4faa9443840683a6f1c2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.116422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=c8f8212c325b4faa9443840683a6f1c2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.118760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.146402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2085/4192] 10.222.0.15 () {58 vars in 1341 bytes} [Tue Jul 19 11:29:47 2022] HEAD /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/c8f8212c325b4faa9443840683a6f1c2 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:48.153798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.183623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afebc84-0375-45f8-916e-9ac579b00bc8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:48.183981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f4d59-de5c-4678-89ea-cd2d57fec172 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:48.197212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.198105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.198381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.198712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] PATH_INFO: `/v3/projects/aabe5e7662a6477ba3373866751fa0d2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.199453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.200316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] RBAC: Authorizing `identity:delete_project(project_id=aabe5e7662a6477ba3373866751fa0d2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.200578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.200952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.201332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/c8f8212c325b4faa9443840683a6f1c2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.202281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.207622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3, user_id=c8f8212c325b4faa9443840683a6f1c2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.208834 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:48.208834 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:48.208834 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:48.210286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.229776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'c8f8212c325b4faa9443840683a6f1c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.255632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2086/4193] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:29:48 2022] DELETE /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users/c8f8212c325b4faa9443840683a6f1c2 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:48.259807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.306838 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:48.327447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aabe5e7662a6477ba3373866751fa0d2', 'request_id': 'req-3b0d147c-7916-464d-9f65-1b291275432a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.353282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aabe5e7662a6477ba3373866751fa0d2', 'request_id': 'req-3b0d147c-7916-464d-9f65-1b291275432a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.380974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aabe5e7662a6477ba3373866751fa0d2', 'request_id': 'req-3b0d147c-7916-464d-9f65-1b291275432a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.412777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] The token cache is being invalidate because project aabe5e7662a6477ba3373866751fa0d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:48.413265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.414985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cace4a89-1730-4883-b98e-4910d3601371 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:48.415807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3b0d147c-7916-464d-9f65-1b291275432a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.418033 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2108/4194] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:47 2022] DELETE /identity/v3/projects/aabe5e7662a6477ba3373866751fa0d2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:48.425234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712b3a7-1f1b-42b7-8ed3-ec5aac841687 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.425912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712b3a7-1f1b-42b7-8ed3-ec5aac841687 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.427146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6712b3a7-1f1b-42b7-8ed3-ec5aac841687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.472882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6712b3a7-1f1b-42b7-8ed3-ec5aac841687 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:48.474484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6712b3a7-1f1b-42b7-8ed3-ec5aac841687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:48.515294 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:48.557867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.566302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.566302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.566302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.567643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.570315 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:48.570315 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:48.570315 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:48.574450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.584873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2109/4195] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:48.598431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.599137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.599506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.620522 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2087/4196] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:29:48 2022] GET /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3/users => generated 145 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:48.626984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.632181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:48.633491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:48.644928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:48.657090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298fdd5-711a-4634-b716-9ef648a826a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:48.666627 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2110/4197] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:48.672596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.672884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.674148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.676372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.676851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users/c8f8212c325b4faa9443840683a6f1c2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.680867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_user(user_id=c8f8212c325b4faa9443840683a6f1c2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.686844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.707789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f412239-5475-477f-92a6-d49bcf2df0b3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:48.737202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.738436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.738784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.739061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.739843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:29:48.740101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.748935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.778253 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2111/4198] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:29:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:48.779504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.795119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8f8212c325b4faa9443840683a6f1c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.807464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7f524-cc1e-4248-9d2d-c655be503ab3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:48.817783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8f8212c325b4faa9443840683a6f1c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.818307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:48.819265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:48.819824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:48.820107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:48.820851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:48.826570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:48.854086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8f8212c325b4faa9443840683a6f1c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.855307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8f8212c325b4faa9443840683a6f1c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.866065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8f8212c325b4faa9443840683a6f1c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:48.875513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2088/4199] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:48 2022] DELETE /identity/v3/users/c8f8212c325b4faa9443840683a6f1c2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:48.880208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.884025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:48.896421 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2112/4200] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:48 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:48.897606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:48.905302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:49.064110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8246ec-8016-49d0-a1ac-f1321c13f3e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:49.087388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:49.088613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.089017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.089426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.091487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:49.101558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:49.130553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba51cc0-6020-4be6-b232-ccccdc16417f tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:49.159393 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2113/4201] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:48 2022] POST /identity/v3/users => generated 288 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:49.160760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:49.184657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6a743-4f90-4c7c-b76b-0dbcdde88c59 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:49.194577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:49.196218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.196710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.197220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.198144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:49.200139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:49.215722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:49.218148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.218645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.219031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users/378084976efb4025aaaa1240e8b2d74a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.221908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_user(user_id=378084976efb4025aaaa1240e8b2d74a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:49.224475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:49.235525 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:49.238824 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2114/4202] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:49.242758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:49.274771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2006fa-dc62-476b-8ed6-04316524b3b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:49.281259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:49.282415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.283091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.283714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.286280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:49.292833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:49.297691 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:49.327791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2115/4203] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:49.332902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:49.340750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378084976efb4025aaaa1240e8b2d74a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.355617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3216023-4d59-4743-a1d5-b4beb7cc2737 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:49.358115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378084976efb4025aaaa1240e8b2d74a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.376267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b98788-f1fd-4bd1-b0c8-0b16cfc9892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:49.377710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98788-f1fd-4bd1-b0c8-0b16cfc9892d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.378314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98788-f1fd-4bd1-b0c8-0b16cfc9892d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.378890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b98788-f1fd-4bd1-b0c8-0b16cfc9892d admin admin] PATH_INFO: `/v3/projects/754b2f0f2f8a4cbe992e8727a20b66a1/users/ee4df4d9e07e40aab576f6118492c725/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.392956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378084976efb4025aaaa1240e8b2d74a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.393734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378084976efb4025aaaa1240e8b2d74a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.409271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378084976efb4025aaaa1240e8b2d74a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.424964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b98788-f1fd-4bd1-b0c8-0b16cfc9892d admin admin] RBAC: Authorizing `identity:create_grant(project_id=754b2f0f2f8a4cbe992e8727a20b66a1, user_id=ee4df4d9e07e40aab576f6118492c725, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:49.426526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2089/4204] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:48 2022] DELETE /identity/v3/users/378084976efb4025aaaa1240e8b2d74a => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:49.427537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:49.429163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:49.436787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b98788-f1fd-4bd1-b0c8-0b16cfc9892d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:49.474582 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2116/4205] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:49 2022] PUT /identity/v3/projects/754b2f0f2f8a4cbe992e8727a20b66a1/users/ee4df4d9e07e40aab576f6118492c725/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:49.484905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.486096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.486636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.577083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] MFA Rules not processed for user `ee4df4d9e07e40aab576f6118492c725`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:49.577814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff356fa-fbef-4fde-9b89-49e71f4cc096 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:49.581267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:49.706191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:49.707096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:49.707386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:49.707667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users/280bb8c57e59442593062993122d1b02` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:49.709483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_user(user_id=280bb8c57e59442593062993122d1b02)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:49.711527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:49.795806 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2117/4206] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:49.795992 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:49.797266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:49.802978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:49.817242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '280bb8c57e59442593062993122d1b02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.829578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '280bb8c57e59442593062993122d1b02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.859631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '280bb8c57e59442593062993122d1b02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.861114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '280bb8c57e59442593062993122d1b02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.875429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '280bb8c57e59442593062993122d1b02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:49.895141 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2090/4207] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:49 2022] DELETE /identity/v3/users/280bb8c57e59442593062993122d1b02 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:49.896161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:49.897649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:49.996469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc6144-a1af-4e78-aea4-3a33923d5880 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.003656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.004621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.004915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.005197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.006596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=f665e7ad289748c4a1c215a2f2d0c8f3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.007685 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:50.007685 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:50.007685 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:50.009751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.065028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46aaf1-5cf6-4f11-af65-4c2619920cb0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.100401 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2091/4208] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:49 2022] DELETE /identity/v3/groups/f665e7ad289748c4a1c215a2f2d0c8f3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:50.110428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.283866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadfa1eb-f5f5-46be-a352-1462fe588731 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.298116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.299263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.299373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.300107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.300217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.300306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.300613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.300726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.301410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.301533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.303255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.304596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.320124 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:50.339989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2092/4209] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:50 2022] POST /identity/v3/groups => generated 327 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:50.342279 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2118/4210] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:49 2022] POST /identity/v3/projects => generated 375 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:50.346353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.346861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.348729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:50.365572 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:50.371747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cd09dc-d5b7-4dd4-9bdd-9d0398c7b509 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.438761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee36ac-2edb-4221-9b0a-62d4ed4b5b04 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.443859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.445963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.446371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.446765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.448145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.450667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.501074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2119/4211] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:50 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:50.505368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.529416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3238086-c979-41b1-a707-4cf9b3e3811d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.544047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.546199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.547948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.548382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.552575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.557446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.569493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.569988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.570335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.570546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.571255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.575259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.588687 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2120/4212] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:50.595611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.625326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860bb1ea-637a-4ba1-b98f-d4f3b0fac22c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.631184 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2093/4213] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:50 2022] POST /identity/v3/groups => generated 325 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:50.634641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.649459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.650411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.650690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.650965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] PATH_INFO: `/v3/projects/e2a57de3eb0b4f16a7c64be620e84a0e/users/ac48d35c49b848ff979bc96c4ca61be9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.662594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696aa23-0742-4c36-8ebd-c1ec97612315 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.684584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.685282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.685566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.685839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.687973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.689997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.709426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a57de3eb0b4f16a7c64be620e84a0e, user_id=ac48d35c49b848ff979bc96c4ca61be9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.712822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.730348 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2094/4214] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:50 2022] POST /identity/v3/groups => generated 325 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:50.736245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.759471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2121/4215] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:50 2022] PUT /identity/v3/projects/e2a57de3eb0b4f16a7c64be620e84a0e/users/ac48d35c49b848ff979bc96c4ca61be9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:50.760517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.770519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a4efd-d27c-4bfd-aa5e-b574e0946f46 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.853268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.853642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.853932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.854212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.855134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.856239 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:29:50.856239 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:29:50.856239 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:29:50.857427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.867120 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2095/4216] 10.222.0.15 () {58 vars in 1124 bytes} [Tue Jul 19 11:29:50 2022] GET /identity/v3/groups => generated 1487 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:29:50.871803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.886984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659b1b3-8efe-4b28-a45d-5b6ff5949981 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.892690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.893800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.894768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.895979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/13bdde69af4d4d94be4080458c24097e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.902492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea44584-40be-470c-a2a2-f8868fd7942f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.903734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=13bdde69af4d4d94be4080458c24097e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.906943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.912524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.913216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.913496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.913769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.914653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:50.916379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:50.938751 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2122/4217] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:29:50.946721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.971722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400a907-343d-47e1-9163-d5fa1f276096 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:50.982919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fca594-9d5b-4dce-8e9f-c7eb62a83d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:50.983902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fca594-9d5b-4dce-8e9f-c7eb62a83d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:50.984192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fca594-9d5b-4dce-8e9f-c7eb62a83d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:50.984594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fca594-9d5b-4dce-8e9f-c7eb62a83d42 admin admin] PATH_INFO: `/v3/projects/e2a57de3eb0b4f16a7c64be620e84a0e/users/ac48d35c49b848ff979bc96c4ca61be9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:50.986492 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2096/4218] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:50 2022] DELETE /identity/v3/groups/13bdde69af4d4d94be4080458c24097e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:50.987476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:50.997360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fca594-9d5b-4dce-8e9f-c7eb62a83d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a57de3eb0b4f16a7c64be620e84a0e, user_id=ac48d35c49b848ff979bc96c4ca61be9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:51.000077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fca594-9d5b-4dce-8e9f-c7eb62a83d42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:51.036169 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2123/4219] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:29:50 2022] PUT /identity/v3/projects/e2a57de3eb0b4f16a7c64be620e84a0e/users/ac48d35c49b848ff979bc96c4ca61be9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:51.051438 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:51.062516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:51.064283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:51.064656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:51.106772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] MFA Rules not processed for user `ac48d35c49b848ff979bc96c4ca61be9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:51.108822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:51.137600 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:51.149485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3b841-798b-4d4c-a1e3-a191796e619d tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:51.260367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:51.262526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:51.263128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:51.263561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/1e454f325281432ab6eb839fea78d02c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:51.272517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1e454f325281432ab6eb839fea78d02c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:51.274379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2124/4220] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:51 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:29:51.279316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:51.281860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:51.313555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563079c1-8602-4f99-a93d-c1f163b95c88 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:51.336449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:51.345864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:51.346513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:51.348061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:51.349193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:51.359443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:51.398935 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2097/4221] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:50 2022] DELETE /identity/v3/groups/1e454f325281432ab6eb839fea78d02c => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:51.403127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:51.457319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2125/4222] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:29:51 2022] POST /identity/v3/projects => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:51.458967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:51.552111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f682d-bb96-49db-b7b1-812a08fac9a1 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:51.603214 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:51.633611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:51.635441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:51.635898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:51.636527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/87fa8dafbfaa4aee8dcfd0fb595a102c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:51.655195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32edbf37-659c-4b2e-9fa3-c4d6b580ea37 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:51.658019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=87fa8dafbfaa4aee8dcfd0fb595a102c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:51.663725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:51.667560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:51.668470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:51.669485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:51.670531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:51.673267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:51.678746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:51.748169 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2126/4223] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:29:51 2022] POST /identity/v3/projects => generated 351 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:51.754612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:51.770570 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2098/4224] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:51 2022] DELETE /identity/v3/groups/87fa8dafbfaa4aee8dcfd0fb595a102c => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:51.775888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:51.913762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351e4a9-6673-4993-9f03-6e5cc20e2419 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:51.931755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e349551a-c94b-419f-b75e-f59b60e12f6e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:51.946252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:51.947379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:51.948373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:51.952811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:51.954005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:51.957528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:51.960544 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:52.009469 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2099/4225] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:29:51 2022] POST /identity/v3/users => generated 321 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:52.010928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.029705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.032077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.034045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.034707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/users/ee4df4d9e07e40aab576f6118492c725` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.036589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fff6d3-d047-47fd-b320-796c210e1a62 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.037517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:get_user(user_id=ee4df4d9e07e40aab576f6118492c725)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.040042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.048866 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2127/4226] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:29:51 2022] GET /identity/v3/users/ee4df4d9e07e40aab576f6118492c725 => generated 288 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:52.050191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.051142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.051908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.052226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.059585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.060547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.062907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.063377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7c07-c62d-4d87-b206-b5f379d4f69c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.069749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.070641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.070994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.071369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.072365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.074537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.089734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2100/4227] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:52 2022] POST /identity/v3/groups => generated 325 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:52.092107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.114219 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2128/4228] 10.222.0.15 () {60 vars in 1161 bytes} [Tue Jul 19 11:29:52 2022] POST /identity/v3/credentials => generated 429 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:52.118344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598a69f6-62dc-4c21-812d-69b19df502a8 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.119533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.131577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.134703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.135006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.135314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/891311a5cb6c4f51a706d1ef4e8e6895/users/0fff3fc14c3042e7aeceeb30f2bcdea7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.162339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18820130-cb14-4fbe-9600-7a70a12e6237 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.177397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.180729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.181077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.183548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials/869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.194195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.197885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.201391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.204559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.216657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=891311a5cb6c4f51a706d1ef4e8e6895, user_id=0fff3fc14c3042e7aeceeb30f2bcdea7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.227658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.264496 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2129/4229] 10.222.0.15 () {60 vars in 1357 bytes} [Tue Jul 19 11:29:52 2022] PATCH /identity/v3/credentials/869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776 => generated 436 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:52.269505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.308622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0f4fd-c2a0-44f1-b97d-9dd753208ad7 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.313446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2101/4230] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:29:52 2022] PUT /identity/v3/groups/891311a5cb6c4f51a706d1ef4e8e6895/users/0fff3fc14c3042e7aeceeb30f2bcdea7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:52.321200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.461897 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:52.472216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.473425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.473552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.473761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials/869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.476114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.478080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.492612 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2130/4231] 10.222.0.15 () {58 vars in 1334 bytes} [Tue Jul 19 11:29:52 2022] GET /identity/v3/credentials/869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776 => generated 436 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:52.493709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.515181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd0ccd6-d56f-475b-9f67-4101db93fe61 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.525975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.527875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.527875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.527875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials/869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.530339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.543389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.548491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0013a9e5-86ee-47ea-b560-ac1a0f22825b tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.568182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.569447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.570161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.570593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.571607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.574926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.585660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2131/4232] 10.222.0.15 () {58 vars in 1337 bytes} [Tue Jul 19 11:29:52 2022] DELETE /identity/v3/credentials/869d03489bfe8e27a0cb889d2a1dd1531ff8b17683025b5b157cc59b96e74776 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:52.592146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.613100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab8726-9ca6-4ddc-90d4-d7f0dc0d885c tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.614450 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2102/4233] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:29:52 2022] POST /identity/v3/groups => generated 327 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:52.620243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.653866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.655071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.655581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.655929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.656716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.667732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.679080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33d0a3-2b97-4f2a-a000-e8abe586c6ce tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.697983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.698972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.699262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.699575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/6cd367cc60774778af97fa7bd5829b7c/users/0fff3fc14c3042e7aeceeb30f2bcdea7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.711115 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2132/4234] 10.222.0.15 () {60 vars in 1161 bytes} [Tue Jul 19 11:29:52 2022] POST /identity/v3/credentials => generated 431 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:52.715244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=6cd367cc60774778af97fa7bd5829b7c, user_id=0fff3fc14c3042e7aeceeb30f2bcdea7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.715445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.717284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.728452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220c605-4d21-40a4-9295-a40c9235e221 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.733961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.734650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.734934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.735204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.735935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.737821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.762059 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2133/4235] 10.222.0.15 () {60 vars in 1161 bytes} [Tue Jul 19 11:29:52 2022] POST /identity/v3/credentials => generated 430 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:29:52.763086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.776250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4a2b1-4ea6-4838-9511-e28ed007e032 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.791633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.794346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.794695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.795121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.795842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.802259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.837533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.839350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.856830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.859493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.860837 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2134/4236] 10.222.0.15 () {58 vars in 1139 bytes} [Tue Jul 19 11:29:52 2022] GET /identity/v3/credentials => generated 946 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:52.867720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.899580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d106a9aa-3a07-4277-8482-69f02860b71a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:52.913320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:52.914278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:52.914558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:52.914833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials/2dedf7cbc441651c3c426a112564e9756eb76d397de2b9b873bcc0a5411c002a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:52.925166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=2dedf7cbc441651c3c426a112564e9756eb76d397de2b9b873bcc0a5411c002a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:52.926974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:52.975335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2135/4237] 10.222.0.15 () {58 vars in 1337 bytes} [Tue Jul 19 11:29:52 2022] DELETE /identity/v3/credentials/2dedf7cbc441651c3c426a112564e9756eb76d397de2b9b873bcc0a5411c002a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:52.976434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:52.976824 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2103/4238] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:29:52 2022] PUT /identity/v3/groups/6cd367cc60774778af97fa7bd5829b7c/users/0fff3fc14c3042e7aeceeb30f2bcdea7 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:52.980323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:53.002964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e8faf-2883-448a-90c5-ca1be1a0a414 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:53.126715 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:53.175212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:53.176364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:53.176769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:53.177142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/credentials/9c358306dab8beaa57995fa417699e39737aea50feb8307c71ba514e987f42ac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:53.181106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=9c358306dab8beaa57995fa417699e39737aea50feb8307c71ba514e987f42ac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:53.181891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a40f2-0382-479c-9de8-d19686220992 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:53.196656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:53.197609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:53.197890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:53.198167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users/0fff3fc14c3042e7aeceeb30f2bcdea7/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:53.200730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:53.203848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=0fff3fc14c3042e7aeceeb30f2bcdea7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:53.210022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:53.239255 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2136/4239] 10.222.0.15 () {58 vars in 1337 bytes} [Tue Jul 19 11:29:52 2022] DELETE /identity/v3/credentials/9c358306dab8beaa57995fa417699e39737aea50feb8307c71ba514e987f42ac => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:53.246089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:53.247344 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2104/4240] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:29:52 2022] GET /identity/v3/users/0fff3fc14c3042e7aeceeb30f2bcdea7/groups => generated 838 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:53.251395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:53.265042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a485c-f4df-4f83-b949-6cbcb2e06101 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:53.271068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e3cdb-1abc-41d3-9688-2b835cc77adb tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:53.277959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:53.281906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:53.281906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:53.281906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/6cd367cc60774778af97fa7bd5829b7c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:53.281906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=6cd367cc60774778af97fa7bd5829b7c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:53.282692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:53.285162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:53.286276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:53.286376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:53.286624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/projects/13735a074c4040f7bdebe90eb7523c5c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:53.294825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:delete_project(project_id=13735a074c4040f7bdebe90eb7523c5c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:53.301484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:53.383758 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2105/4241] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:53 2022] DELETE /identity/v3/groups/6cd367cc60774778af97fa7bd5829b7c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:29:53.385399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:53.464381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13735a074c4040f7bdebe90eb7523c5c', 'request_id': 'req-76057d8a-9a74-416d-93bc-8230d6b9ff74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:53.493101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13735a074c4040f7bdebe90eb7523c5c', 'request_id': 'req-76057d8a-9a74-416d-93bc-8230d6b9ff74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:53.520972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13735a074c4040f7bdebe90eb7523c5c', 'request_id': 'req-76057d8a-9a74-416d-93bc-8230d6b9ff74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:53.558132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] The token cache is being invalidate because project 13735a074c4040f7bdebe90eb7523c5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:53.559588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:53.561317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:53.569624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2137/4242] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:53 2022] DELETE /identity/v3/projects/13735a074c4040f7bdebe90eb7523c5c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:53.573313 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:53.574790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:53.582302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:53.642892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c34f131-f2a6-452f-bddd-033661644b42 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:53.798203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:53.801783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:53.803747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:53.809149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/groups/891311a5cb6c4f51a706d1ef4e8e6895` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:53.811124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_group(group_id=891311a5cb6c4f51a706d1ef4e8e6895)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:53.814600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:53.842019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76057d8a-9a74-416d-93bc-8230d6b9ff74 tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:53.854168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ac48d35c49b848ff979bc96c4ca61be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:53.855139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:53.855430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:53.855711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] PATH_INFO: `/v3/projects/1bdd447c670f4755aa370affd3caade9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:53.858615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1bdd447c670f4755aa370affd3caade9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:53.864209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:53.928174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2106/4243] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:29:53 2022] DELETE /identity/v3/groups/891311a5cb6c4f51a706d1ef4e8e6895 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:53.932981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:53.939044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:53.988630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bdd447c670f4755aa370affd3caade9', 'request_id': 'req-9df90735-964e-4a2b-a6cd-26392d9bd87a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.003629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bdd447c670f4755aa370affd3caade9', 'request_id': 'req-9df90735-964e-4a2b-a6cd-26392d9bd87a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.015274 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:54.020364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bdd447c670f4755aa370affd3caade9', 'request_id': 'req-9df90735-964e-4a2b-a6cd-26392d9bd87a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.063742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] The token cache is being invalidate because project 1bdd447c670f4755aa370affd3caade9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:54.064047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.065218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.066404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2138/4244] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:53 2022] DELETE /identity/v3/projects/1bdd447c670f4755aa370affd3caade9 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:54.071883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:54.073387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:54.167832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f854e-d3d7-4563-b549-73dab5e666aa tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:54.225555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df90735-964e-4a2b-a6cd-26392d9bd87a tempest-CredentialsTestJSON-2049023140 tempest-CredentialsTestJSON-2049023140-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:54.233951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:54.234863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:54.235147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:54.235427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] PATH_INFO: `/v3/users/ee4df4d9e07e40aab576f6118492c725` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:54.238563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4df4d9e07e40aab576f6118492c725)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:54.240592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:54.287155 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:54.303273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:54.304373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:54.305514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:54.305947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/users/0fff3fc14c3042e7aeceeb30f2bcdea7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:54.310341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0fff3fc14c3042e7aeceeb30f2bcdea7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:54.318514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:54.339911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4df4d9e07e40aab576f6118492c725'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.341064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4df4d9e07e40aab576f6118492c725'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.352646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4df4d9e07e40aab576f6118492c725'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.353842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4df4d9e07e40aab576f6118492c725'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.363197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c5de5206-0883-430f-b8c3-ef3f482aba2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4df4d9e07e40aab576f6118492c725'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.413896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2139/4245] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:54 2022] DELETE /identity/v3/users/ee4df4d9e07e40aab576f6118492c725 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:54.415858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:54.416144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:54.419361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:54.462549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fff3fc14c3042e7aeceeb30f2bcdea7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.468764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:54.470097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:54.483261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fff3fc14c3042e7aeceeb30f2bcdea7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.563324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fff3fc14c3042e7aeceeb30f2bcdea7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.564660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fff3fc14c3042e7aeceeb30f2bcdea7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.586618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fff3fc14c3042e7aeceeb30f2bcdea7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:54.622565 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2107/4246] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:53 2022] DELETE /identity/v3/users/0fff3fc14c3042e7aeceeb30f2bcdea7 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:54.623930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:54.633681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:54.763245 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2140/4247] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:54.834279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:54.836703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:54.863290 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:54.950527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cee19d-2b6b-4a4d-9620-e2e26796ff98 tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:54.968531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:54.970348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:54.970348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:54.970635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/domains/457cc2d93c2246c9bc640588ea15007a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:54.975606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=457cc2d93c2246c9bc640588ea15007a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:54.981367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:55.030168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '457cc2d93c2246c9bc640588ea15007a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.031285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '457cc2d93c2246c9bc640588ea15007a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.086566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '457cc2d93c2246c9bc640588ea15007a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.087337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '457cc2d93c2246c9bc640588ea15007a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.089487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbac38e3-5c6d-427d-8f02-46fa21b389f1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:55.093014 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2108/4248] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:29:54 2022] PATCH /identity/v3/domains/457cc2d93c2246c9bc640588ea15007a => generated 277 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:29:55.101854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:55.106885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:55.259850 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:55.263412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:55.264239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:55.264553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:55.264923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:55.273101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:55.292366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b74c5-8793-47ad-9160-8de0ddf228cc tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:55.297770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5378de92f7e646239c41d13e5f5df847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bf87ef7411874187bcc21dea93a61531', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:55.299105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:55.299509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:55.299880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] PATH_INFO: `/v3/domains/457cc2d93c2246c9bc640588ea15007a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:55.315936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=457cc2d93c2246c9bc640588ea15007a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:55.318040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:55.345289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '457cc2d93c2246c9bc640588ea15007a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.349039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '457cc2d93c2246c9bc640588ea15007a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.452401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '457cc2d93c2246c9bc640588ea15007a', 'request_id': 'req-d068e7eb-69c0-4134-8b2a-218dd1994c0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.452612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:55.453567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:55.467642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '457cc2d93c2246c9bc640588ea15007a', 'request_id': 'req-d068e7eb-69c0-4134-8b2a-218dd1994c0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.477483 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2141/4249] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:29:55.478247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '457cc2d93c2246c9bc640588ea15007a', 'request_id': 'req-d068e7eb-69c0-4134-8b2a-218dd1994c0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.508659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] The token cache is being invalidate because project 457cc2d93c2246c9bc640588ea15007a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:55.508991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.510421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.532765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '457cc2d93c2246c9bc640588ea15007a', 'request_id': 'req-d068e7eb-69c0-4134-8b2a-218dd1994c0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.534743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '457cc2d93c2246c9bc640588ea15007a', 'request_id': 'req-d068e7eb-69c0-4134-8b2a-218dd1994c0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.537833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d068e7eb-69c0-4134-8b2a-218dd1994c0e tempest-GroupsV3TestJSON-1720245234 tempest-GroupsV3TestJSON-1720245234-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '457cc2d93c2246c9bc640588ea15007a', 'request_id': 'req-d068e7eb-69c0-4134-8b2a-218dd1994c0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.562710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2109/4250] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:29:55 2022] DELETE /identity/v3/domains/457cc2d93c2246c9bc640588ea15007a => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:55.569168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:55.571824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:55.594966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459bcc6-5bd5-4ac8-b135-811943911a7d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:55.717133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:55.718105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:55.718317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:55.718592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] PATH_INFO: `/v3/users/3850acda34ce4441ac9f881c2a579935` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:55.723632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3850acda34ce4441ac9f881c2a579935)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:55.725926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:55.754099 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:55.832257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3850acda34ce4441ac9f881c2a579935'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.832976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3850acda34ce4441ac9f881c2a579935'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.847035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3850acda34ce4441ac9f881c2a579935'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.847777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3850acda34ce4441ac9f881c2a579935'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.860004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3850acda34ce4441ac9f881c2a579935'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:55.896152 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2142/4251] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:55 2022] DELETE /identity/v3/users/3850acda34ce4441ac9f881c2a579935 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:55.901076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:55.901298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:55.901918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:55.951778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:55.987116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:56.323977 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2110/4252] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:56.437902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:56.439929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:56.577277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d243a-9329-4fcc-831c-5bc8705b3e41 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:56.603470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:56.604601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:56.605983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:56.606665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:56.629498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:56.630986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:56.645834 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2143/4253] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:29:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:29:57.157651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:57.159546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:57.185760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283f1d96-5885-4572-9569-79af6cb4b1e7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:57.191155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:57.192063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:57.192378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:57.192701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] PATH_INFO: `/v3/projects/754b2f0f2f8a4cbe992e8727a20b66a1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:57.193951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=754b2f0f2f8a4cbe992e8727a20b66a1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:57.196255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:57.216628 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:57.337476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '754b2f0f2f8a4cbe992e8727a20b66a1', 'request_id': 'req-36e093c9-4fe1-4acc-9f5f-97c54daacc96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.351791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '754b2f0f2f8a4cbe992e8727a20b66a1', 'request_id': 'req-36e093c9-4fe1-4acc-9f5f-97c54daacc96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.365416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '754b2f0f2f8a4cbe992e8727a20b66a1', 'request_id': 'req-36e093c9-4fe1-4acc-9f5f-97c54daacc96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.385919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] The token cache is being invalidate because project 754b2f0f2f8a4cbe992e8727a20b66a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:57.386440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.387322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.391880 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2111/4254] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:57 2022] DELETE /identity/v3/projects/754b2f0f2f8a4cbe992e8727a20b66a1 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:57.396683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:57.412663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f963c4b-3517-4b6f-8343-8f9a60a49f93 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:57.558557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:57.559758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:57.560227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:57.560718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] PATH_INFO: `/v3/users/ac48d35c49b848ff979bc96c4ca61be9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:57.562306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac48d35c49b848ff979bc96c4ca61be9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:57.564487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:57.634518 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:57.646499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac48d35c49b848ff979bc96c4ca61be9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.656557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac48d35c49b848ff979bc96c4ca61be9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.675590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac48d35c49b848ff979bc96c4ca61be9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.678397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac48d35c49b848ff979bc96c4ca61be9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.702589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac48d35c49b848ff979bc96c4ca61be9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:57.764454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2144/4255] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:57 2022] DELETE /identity/v3/users/ac48d35c49b848ff979bc96c4ca61be9 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:57.852677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:57.855207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:57.895117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e093c9-4fe1-4acc-9f5f-97c54daacc96 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:58.008964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:58.010190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:58.010538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:58.011155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] PATH_INFO: `/v3/users/853162e1868045b4b5e6af9c03c461bf` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:58.013629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853162e1868045b4b5e6af9c03c461bf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:58.019906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:58.168405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853162e1868045b4b5e6af9c03c461bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:58.179516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853162e1868045b4b5e6af9c03c461bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:58.218142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853162e1868045b4b5e6af9c03c461bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:58.221859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853162e1868045b4b5e6af9c03c461bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:58.247544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853162e1868045b4b5e6af9c03c461bf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:58.266452 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2112/4256] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:57 2022] DELETE /identity/v3/users/853162e1868045b4b5e6af9c03c461bf => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:59.019231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:59.022448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:59.046343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b73843c-2e25-4258-b7dd-450831fa24c3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:59.082986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:59.084735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:59.163214 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:59.248996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:59.249906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.250192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.250487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] PATH_INFO: `/v3/projects/c8344862ecea4ebcb5ee37528492c9f1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:59.252041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8344862ecea4ebcb5ee37528492c9f1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:59.254052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:59.262238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d935c1-2690-488a-89a7-422edcd0a656 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:59.268883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:59.269914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.270302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.270679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] PATH_INFO: `/v3/projects/e2a57de3eb0b4f16a7c64be620e84a0e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:59.272023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a57de3eb0b4f16a7c64be620e84a0e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:59.278346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:59.336483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8344862ecea4ebcb5ee37528492c9f1', 'request_id': 'req-351d7335-c540-461a-83ef-77aa3297191d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.345318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8344862ecea4ebcb5ee37528492c9f1', 'request_id': 'req-351d7335-c540-461a-83ef-77aa3297191d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.353317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8344862ecea4ebcb5ee37528492c9f1', 'request_id': 'req-351d7335-c540-461a-83ef-77aa3297191d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.371194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'request_id': 'req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.374435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] The token cache is being invalidate because project c8344862ecea4ebcb5ee37528492c9f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:59.375196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.376403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.379122 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2145/4257] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:59 2022] DELETE /identity/v3/projects/c8344862ecea4ebcb5ee37528492c9f1 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:59.380520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:59.382899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:59.386210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'request_id': 'req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.395981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a57de3eb0b4f16a7c64be620e84a0e', 'request_id': 'req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.410932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] The token cache is being invalidate because project e2a57de3eb0b4f16a7c64be620e84a0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:59.411487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.412547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.415002 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2113/4258] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:59 2022] DELETE /identity/v3/projects/e2a57de3eb0b4f16a7c64be620e84a0e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:59.416087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:29:59.417889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:59.446099 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:59.470566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d7335-c540-461a-83ef-77aa3297191d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:59.526963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5e43a-5a5e-4474-8cc7-c61975b9efbe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:29:59.542081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:59.544477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.546050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.547739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] PATH_INFO: `/v3/users/5378de92f7e646239c41d13e5f5df847` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:59.549871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5378de92f7e646239c41d13e5f5df847)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:59.557588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:59.574816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:29:59.577884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.589601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.591013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] PATH_INFO: `/v3/projects/d582e674a2074ba2bc77e76f9bb78fe9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:59.596901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d582e674a2074ba2bc77e76f9bb78fe9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:29:59.600418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:29:59.693798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5378de92f7e646239c41d13e5f5df847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.699342 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:29:59.710078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5378de92f7e646239c41d13e5f5df847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.730807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd582e674a2074ba2bc77e76f9bb78fe9', 'request_id': 'req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.738223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5378de92f7e646239c41d13e5f5df847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.739737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5378de92f7e646239c41d13e5f5df847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.745717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd582e674a2074ba2bc77e76f9bb78fe9', 'request_id': 'req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.755914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af4c5fa8-7297-438a-8310-7c2d281b2dc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5378de92f7e646239c41d13e5f5df847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.761216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd582e674a2074ba2bc77e76f9bb78fe9', 'request_id': 'req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.775660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2114/4259] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:29:59 2022] DELETE /identity/v3/users/5378de92f7e646239c41d13e5f5df847 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:59.783356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdf87-c5ad-434a-b748-7bdc4cc4bc4f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.783850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdf87-c5ad-434a-b748-7bdc4cc4bc4f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.784237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dfdf87-c5ad-434a-b748-7bdc4cc4bc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:59.806191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] The token cache is being invalidate because project d582e674a2074ba2bc77e76f9bb78fe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:29:59.806915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.810031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c531a5b-9bd7-4ee0-b410-62c57d1ab11e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:29:59.810828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-25dfdf87-c5ad-434a-b748-7bdc4cc4bc4f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:59.812147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25dfdf87-c5ad-434a-b748-7bdc4cc4bc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:59.814247 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2146/4260] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:29:59 2022] DELETE /identity/v3/projects/d582e674a2074ba2bc77e76f9bb78fe9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:29:59.821831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ef89-0272-431b-949f-f1aceb68b344 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.822252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ef89-0272-431b-949f-f1aceb68b344 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.822649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4ef89-0272-431b-949f-f1aceb68b344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:29:59.863548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-89a4ef89-0272-431b-949f-f1aceb68b344 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:29:59.865712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89a4ef89-0272-431b-949f-f1aceb68b344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:29:59.960058 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2115/4261] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:29:59.962077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:29:59.962439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:29:59.962700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.002720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:00.006731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:00.023659 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2147/4262] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:00.025411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.025708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.025989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.037976 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2116/4263] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:00.046038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.084273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c9256-47e7-4082-be49-479381cbc9d1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.109721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.111168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.113275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.114517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.118666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:00.121036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:00.122517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:00.122917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.138414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.171192 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2148/4264] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:00.176190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.181922 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2117/4265] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:00.189965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.205554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e8db4-383d-4192-8851-379e25be0d32 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.242739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.242739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.244239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc3d7d-17cc-412d-98a7-8a634240f96a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.246625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.248990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.251235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:00.252596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.260951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.264383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.265152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.270936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.271260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.283655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.286106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.305915 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2149/4266] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:30:00.307779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.315942 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:00.333962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e26f7-bd44-414d-9882-b901f9b01242 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.341448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.342186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.342600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.342928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.344240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.346970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.370365 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2118/4267] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:00 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:00.372627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.409150 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2150/4268] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:00 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:00.414909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.554331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd531b27-8be9-4175-b57e-a5776bbfc490 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.606452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc34e60-9f96-46ac-92fd-7b2017595d35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.621487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.623604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.624311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.625084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.626017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.629382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.638158 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:00.699726 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2151/4269] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:00 2022] POST /identity/v3/users => generated 287 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:00.700962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.701079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.702060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.702824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.702824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.703673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.704614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:00.709522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.736806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb34c23e-c043-4c72-8cd4-e0f9e565314e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.753907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.755368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.755368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.755559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] PATH_INFO: `/v3/projects/bf87ef7411874187bcc21dea93a61531` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.757440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf87ef7411874187bcc21dea93a61531)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.757575 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2119/4270] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:00 2022] POST /identity/v3/users => generated 284 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:00.758200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.771837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.782474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0815b10f-b060-4ca6-b328-343ccdeb949f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.797895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:00.798748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:00.799133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:00.800212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:00.800532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:00.803243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:00.829318 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2120/4271] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:00.830233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.857161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9981aa68-2f20-43e5-ac5f-05b75f25b6b5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:00.883365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf87ef7411874187bcc21dea93a61531', 'request_id': 'req-250c0bac-9704-4f06-a1e7-92c345deb7e6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:00.903660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf87ef7411874187bcc21dea93a61531', 'request_id': 'req-250c0bac-9704-4f06-a1e7-92c345deb7e6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:00.912107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf87ef7411874187bcc21dea93a61531', 'request_id': 'req-250c0bac-9704-4f06-a1e7-92c345deb7e6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:00.933387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] The token cache is being invalidate because project bf87ef7411874187bcc21dea93a61531 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:00.934324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:00.935221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:00.937192 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2152/4272] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:00 2022] DELETE /identity/v3/projects/bf87ef7411874187bcc21dea93a61531 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:00.941877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:00.943406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:01.016887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec76f72-b1a0-4318-b04c-402ea1462213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.018151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76f72-b1a0-4318-b04c-402ea1462213 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.018761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76f72-b1a0-4318-b04c-402ea1462213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.019047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec76f72-b1a0-4318-b04c-402ea1462213 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.019999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec76f72-b1a0-4318-b04c-402ea1462213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.023282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec76f72-b1a0-4318-b04c-402ea1462213 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.026328 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:01.047153 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2121/4273] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:01.047153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.047153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.047153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.065589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c0bac-9704-4f06-a1e7-92c345deb7e6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.074004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc381648-adfc-4cf6-827a-3061abd2d0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.074978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381648-adfc-4cf6-827a-3061abd2d0ab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.075262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381648-adfc-4cf6-827a-3061abd2d0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.075700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc381648-adfc-4cf6-827a-3061abd2d0ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.076491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc381648-adfc-4cf6-827a-3061abd2d0ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.076596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:01.077846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:01.078135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc381648-adfc-4cf6-827a-3061abd2d0ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.096182 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2122/4274] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:01.097899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.099539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:01.119582 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2153/4275] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:01.120373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbda6437-a208-4af4-9729-15a2534e07f4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.121199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.121745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.121745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.133732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.133732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.134039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.134290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.135170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.138827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.163652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2123/4276] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:01.165826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.167204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:01.168562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:01.178001 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2154/4277] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:01.178942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.189945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa20125-9843-43db-9408-746e2592ca2a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.194386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae3e86-9801-4ffb-97eb-ed53ed1d9970 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.195188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.196099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.196680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.196965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] PATH_INFO: `/v3/projects/574fb6db93424eff8f5fa29aace01c65/users/f04da65fc69a4144b98acfa774efb300/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.206332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9a420-9d2d-40f2-ad56-1733c6692510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.207363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a420-9d2d-40f2-ad56-1733c6692510 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.207650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a420-9d2d-40f2-ad56-1733c6692510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.207925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9a420-9d2d-40f2-ad56-1733c6692510 admin admin] PATH_INFO: `/v3/projects/24222cfbdaa14e69bc1acc96f341bfd1/users/00cf9fd1b0be435594ab915a8a2db17a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.218176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=574fb6db93424eff8f5fa29aace01c65, user_id=f04da65fc69a4144b98acfa774efb300, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.221003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.241846 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2155/4278] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:01 2022] PUT /identity/v3/projects/574fb6db93424eff8f5fa29aace01c65/users/f04da65fc69a4144b98acfa774efb300/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:01.243655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.246843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9a420-9d2d-40f2-ad56-1733c6692510 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24222cfbdaa14e69bc1acc96f341bfd1, user_id=00cf9fd1b0be435594ab915a8a2db17a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.252636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9a420-9d2d-40f2-ad56-1733c6692510 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.293192 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2124/4279] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:01 2022] PUT /identity/v3/projects/24222cfbdaa14e69bc1acc96f341bfd1/users/00cf9fd1b0be435594ab915a8a2db17a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:01.297939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.299333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.299821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.344269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb451289-da96-4673-b47a-ef51c46a2eaf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.378477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] MFA Rules not processed for user `f04da65fc69a4144b98acfa774efb300`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:01.381060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:01.449928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.450652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.450944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.451219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.457619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:01.458123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.462578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a540f494-d0cc-48a9-a4d9-a983cfef8dba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.475249 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:01.491721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2156/4280] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:01.493326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.493754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.493955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.499127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2125/4281] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:01.500578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.527209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dff77a8-4222-49c2-a36f-380edde56d73 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.533617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.535559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.535952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.536319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.537871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.541422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.553178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] MFA Rules not processed for user `00cf9fd1b0be435594ab915a8a2db17a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:01.554373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:01.616602 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2126/4282] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:01.617926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.738822 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:01.787427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fed18-23f0-46a5-bcf5-f22ea2138b17 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.790187 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2157/4283] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:01.797386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.798887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec4291d-9544-4d67-a019-730c9917f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.803139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4291d-9544-4d67-a019-730c9917f064 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.803511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4291d-9544-4d67-a019-730c9917f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.804229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec4291d-9544-4d67-a019-730c9917f064 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.809732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4291d-9544-4d67-a019-730c9917f064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.813615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec4291d-9544-4d67-a019-730c9917f064 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.821485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8ce15-93e7-411a-b932-43ba445500e0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.835539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:01.836367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.836688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.836972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.837993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:01.843125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:01.884278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2127/4284] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/projects => generated 367 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:01.886049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:01.886526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:01.886903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:01.895174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2158/4285] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:01.896451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:01.922738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5898e-75fd-418e-985a-9dbd43e0ca19 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:01.939014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] MFA Rules not processed for user `61d129f38240447cbc0133726b37f861`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:01.940262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:02.074281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.074991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.075239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.075511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.076418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.078373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.100484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2128/4286] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:02.100484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.100484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:02.152648 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2159/4287] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:01 2022] POST /identity/v3/projects => generated 371 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:02.154819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.173040 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:02.183776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b596f0-e07e-47b6-956f-7586f40dc686 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.229348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f82e4e-82fb-4ca2-98cf-fc3519ed6972 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.243286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.243993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.244276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.244665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.245977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.248159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.285285 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2160/4288] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:02 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:02.286022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.291256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.292654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.292941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.293412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.296633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:02.301057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751e4dd-3402-44ca-9e1c-69532b3d8fea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.306979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.308224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.308726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.310112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.311217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.312285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.313384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.313828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e1fd1a-d9a5-41a5-ba48-cd8b613e754e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.327471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2161/4290] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:02.327666 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2129/4290] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:02.328745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.329169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.329453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.330136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.342856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2e88ac-4a75-48e8-8be8-38cc6648c5a6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.350255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.351344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.352077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.352540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.353702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.356049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.359355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] MFA Rules not processed for user `61d129f38240447cbc0133726b37f861`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:02.363213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:02.389118 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2162/4291] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:02 2022] POST /identity/v3/users => generated 292 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:02.390266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.412852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1d76-9e83-42e8-b547-7436071313e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.419255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.419940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.420221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.420537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.421278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.423392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.438099 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2163/4292] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:02.438978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.453468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1455c73-80b5-4dbd-8212-cf0b52eb3e45 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.460279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.460853 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2130/4293] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:02 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:02.461924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.462297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.462419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.462797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.463823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.465884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.468688 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:02.486470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a34a2-1418-4106-8c8b-cdf038e170e2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.492591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.493370 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2164/4294] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:02.493485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.493650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.493935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.494685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.494822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.496885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.509850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2131/4295] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:02 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:02.511124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.513449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f831ba5-b2b9-42d3-a78e-bcafd6a8115e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.514375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:02.530570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.531508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.532002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.532448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] PATH_INFO: `/v3/projects/9b12606d5964491dbd8785c77f4029b8/users/35f52c572e654b46a3f5d959d267cbd8/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.570814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b12606d5964491dbd8785c77f4029b8, user_id=35f52c572e654b46a3f5d959d267cbd8, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.574168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.598928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2165/4296] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:02 2022] PUT /identity/v3/projects/9b12606d5964491dbd8785c77f4029b8/users/35f52c572e654b46a3f5d959d267cbd8/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:02.602152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.695818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a558f50-06e6-4a49-9110-342f79d95a04 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.727494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2370f98-2035-4cdb-9063-ef024e7b2e74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:02.744846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.745781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.746574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.746937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] PATH_INFO: `/v3/projects/93396d152d0b491ab8a17ea2b10addd6/users/ee2d3e8e4bd44cba8b1a349e5b6857c0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.782274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93396d152d0b491ab8a17ea2b10addd6, user_id=ee2d3e8e4bd44cba8b1a349e5b6857c0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.789385 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:02.790384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:02.832491 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2166/4297] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:02 2022] PUT /identity/v3/projects/93396d152d0b491ab8a17ea2b10addd6/users/ee2d3e8e4bd44cba8b1a349e5b6857c0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:02.832491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:02.860025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:02.860762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:02.861158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:02.861310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:02.989557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:02.991164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:03.012440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2132/4298] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:02 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:03.013513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:03.036384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf11cecc-3ea1-4616-97d0-218872231b02 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:03.126912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72273026-fdf2-4305-837e-5e26be9a2751 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:03.159611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:03.163254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.163749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.164771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] PATH_INFO: `/v3/projects/61cf20891d2d43e4999502f54afc708b/users/fd6ff7444e3a46428bfb7528ec5879b0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.210617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ec805-fdc2-4723-8709-fbedf609912e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:03.211208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ec805-fdc2-4723-8709-fbedf609912e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.211846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ec805-fdc2-4723-8709-fbedf609912e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.212020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ec805-fdc2-4723-8709-fbedf609912e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.212760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ec805-fdc2-4723-8709-fbedf609912e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:03.214569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ec805-fdc2-4723-8709-fbedf609912e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:03.224988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cf20891d2d43e4999502f54afc708b, user_id=fd6ff7444e3a46428bfb7528ec5879b0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:03.241006 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2133/4299] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:03.242669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.243355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:03.247427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.249953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.289380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2167/4300] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:02 2022] PUT /identity/v3/projects/61cf20891d2d43e4999502f54afc708b/users/fd6ff7444e3a46428bfb7528ec5879b0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:03.290462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:03.345708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] MFA Rules not processed for user `ee2d3e8e4bd44cba8b1a349e5b6857c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:03.347623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:03.410088 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:03.495208 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2134/4301] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:03.495208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:03.498246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a463aff8-3e5c-4518-83c1-9f23eb895749 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:03.509831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:03.510765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.511047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.511997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] PATH_INFO: `/v3/projects/9b12606d5964491dbd8785c77f4029b8/users/35f52c572e654b46a3f5d959d267cbd8/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.514300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b12606d5964491dbd8785c77f4029b8, user_id=35f52c572e654b46a3f5d959d267cbd8, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:03.517430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:03.526501 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:03.551876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c74bd5-fd28-43d2-8570-ed3ac765c188 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:03.562942 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2168/4302] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:03 2022] PUT /identity/v3/projects/9b12606d5964491dbd8785c77f4029b8/users/35f52c572e654b46a3f5d959d267cbd8/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:03.562942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:03.704611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c51aa3-119d-468f-b5eb-10fd663b2dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:03.705597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51aa3-119d-468f-b5eb-10fd663b2dad admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.706047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51aa3-119d-468f-b5eb-10fd663b2dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.707080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c51aa3-119d-468f-b5eb-10fd663b2dad admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.708126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c51aa3-119d-468f-b5eb-10fd663b2dad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:03.726562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9dd47-f7fa-4c79-a2d0-9972f77e17fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:03.727170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c51aa3-119d-468f-b5eb-10fd663b2dad admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:03.742713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:03.743485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.743769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.744045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.745066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:03.747033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:03.756294 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2135/4303] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:03 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:03.760944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e66cd-cc1b-45cd-a7b5-2ac955d2d5bc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:03.761428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e66cd-cc1b-45cd-a7b5-2ac955d2d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:03.761984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344e66cd-cc1b-45cd-a7b5-2ac955d2d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:03.819437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2169/4304] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:03 2022] POST /identity/v3/projects => generated 387 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:03.819437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:03.846625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-344e66cd-cc1b-45cd-a7b5-2ac955d2d5bc None None] MFA Rules not processed for user `35f52c572e654b46a3f5d959d267cbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:03.848391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-344e66cd-cc1b-45cd-a7b5-2ac955d2d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:03.989233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d8472-f388-4805-9da4-2feb8751125a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.003563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.005752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.005752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.005752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] PATH_INFO: `/v3/projects/61cf20891d2d43e4999502f54afc708b/users/fd6ff7444e3a46428bfb7528ec5879b0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.013948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cf20891d2d43e4999502f54afc708b, user_id=fd6ff7444e3a46428bfb7528ec5879b0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.017029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.045631 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2170/4305] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:03 2022] PUT /identity/v3/projects/61cf20891d2d43e4999502f54afc708b/users/fd6ff7444e3a46428bfb7528ec5879b0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:04.047346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.076046 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2136/4306] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:03 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:04.076046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.076046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.076046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.168491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] MFA Rules not processed for user `fd6ff7444e3a46428bfb7528ec5879b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:04.169734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:04.183125 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:04.210578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ee00b5-8cb7-4838-a588-9e632e414b6f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.229226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.240232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.242571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.243058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.245493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.249363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.319615 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2171/4307] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:04 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:04.321927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.433911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2137/4308] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:04.434815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.464000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc2dc3-384c-49a8-a245-64c9f306ec3b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.482413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.483318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.483607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.483878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.486223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.486351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.518364 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:04.545618 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2138/4309] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:04 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:04.545618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.559391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8624b0-e4cc-4fa9-a5c8-30558b61233d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.580287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8985f-a67c-47b2-9466-424a9ef60b42 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.589573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.590335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.590627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.590906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.591670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.593429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.595514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.596456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.596856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.597406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.598410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.599572 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:04.599572 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:04.599572 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:04.602999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.641351 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2139/4310] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:30:04 2022] POST /identity/v3/domains => generated 276 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:04.641351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.641633 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2172/4311] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:30:04 2022] POST /identity/v3/domains => generated 276 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:04.642339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.646408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:04.825121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1ee937-f94a-4ff1-a688-c979827032ee tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.843087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa26c82c-d90d-4424-bdae-bcee29c56626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:04.863243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.866623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.871457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.873908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.884375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:04.913496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:04.915108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:04.915570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:04.915999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] PATH_INFO: `/v3/projects/3f9a673fdc0e431aa0b38d09dd8b293d/users/3ea0966eaccf4a60b482f3cf1c077c34/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:04.931869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.934268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.937268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9a673fdc0e431aa0b38d09dd8b293d, user_id=3ea0966eaccf4a60b482f3cf1c077c34, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:04.940330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:04.958997 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2140/4312] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:04.963617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:04.974140 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2173/4313] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:04 2022] PUT /identity/v3/projects/3f9a673fdc0e431aa0b38d09dd8b293d/users/3ea0966eaccf4a60b482f3cf1c077c34/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:04.974563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.017513 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:05.164495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08c9f2-7664-4f23-9990-71a89fc1ee9a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.190627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2939d7a9-1898-41c6-9e71-2b4f10ac2c2d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.200826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.204765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.205075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.205368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.210489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.214905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.313567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2174/4314] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:04 2022] POST /identity/v3/projects => generated 403 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:05.314683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.320002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.321270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.323276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.323679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.324551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.328775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.428867 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2141/4315] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:04 2022] POST /identity/v3/users => generated 347 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:05.428867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.467502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2319c81-5d8a-449c-82d4-3478366a0ac0 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.496218 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:05.511042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8d251-dfb9-4e02-8f93-7a45a94ce1f7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.533643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.534525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.534921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.535399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.536386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.538185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.568070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2175/4316] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:05 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:05.568070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.583204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.584707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.585433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.585864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.586818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.590164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.619220 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2142/4317] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:30:05 2022] POST /identity/v3/groups => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:05.620920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.637656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c903aab-1e4e-468e-8e0e-eafcb6c0fe5e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.646531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.657651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.658923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.660071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] PATH_INFO: `/v3/projects/3f9a673fdc0e431aa0b38d09dd8b293d/users/3ea0966eaccf4a60b482f3cf1c077c34/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.662983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f9a673fdc0e431aa0b38d09dd8b293d, user_id=3ea0966eaccf4a60b482f3cf1c077c34, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.669539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.705509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2143/4318] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:05 2022] PUT /identity/v3/projects/3f9a673fdc0e431aa0b38d09dd8b293d/users/3ea0966eaccf4a60b482f3cf1c077c34/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:05.706657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.724870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a1c3c-0d23-4875-94c1-445d6efe9181 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.771107 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:05.846385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbeffb-c080-4150-bb14-4224d58dd353 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.847172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbeffb-c080-4150-bb14-4224d58dd353 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.847464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbeffb-c080-4150-bb14-4224d58dd353 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.852138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbeffb-c080-4150-bb14-4224d58dd353 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.853047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbeffb-c080-4150-bb14-4224d58dd353 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.856753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbeffb-c080-4150-bb14-4224d58dd353 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.881332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7047aaaa-12b7-40a2-9181-ec8e20f01679 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.891946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.892689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.892981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.893351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.894096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:05.896078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:05.902650 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2176/4319] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:05 2022] POST /identity/v3/users => generated 324 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:05.904599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.904708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.904994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:05.957032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2144/4320] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:05 2022] POST /identity/v3/users => generated 442 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:05.958041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:05.977995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e71ee-362d-4b91-aef5-229e80748630 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:05.988687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:05.989607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:05.989900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:05.990179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users/2aa7c87933264c85945d0826b1197f0f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:06.015466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:get_user(user_id=2aa7c87933264c85945d0826b1197f0f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:06.017051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] MFA Rules not processed for user `3ea0966eaccf4a60b482f3cf1c077c34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:06.017800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:06.019466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:06.026893 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2145/4321] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:30:05 2022] GET /identity/v3/users/2aa7c87933264c85945d0826b1197f0f => generated 347 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:06.027798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.046622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf731c-ea7f-4061-9f17-a164a3d4f601 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:06.047827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:06.048597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:06.048886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:06.049168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:06.050150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:06.051717 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:06.051717 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:06.051717 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:06.055596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:06.078631 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2146/4322] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:06 2022] POST /identity/v3/roles => generated 240 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:06.085462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.115987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e8652-72c0-4e65-a8ff-8f9ef98823a8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:06.138341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:06.139206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:06.139595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:06.139978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:06.141423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Adding query filter params (domain_id=2b1921235917404f954b115a3dc2c480) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:06.141940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:06.147892 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:06.147892 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:06.147892 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:06.150871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:06.198269 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2147/4323] 10.222.0.15 () {58 vars in 1206 bytes} [Tue Jul 19 11:30:06 2022] GET /identity/v3/users?domain_id=2b1921235917404f954b115a3dc2c480 => generated 484 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:06.199562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.214686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f064bb0-4a96-4a9b-9234-a3576039b760 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:06.238082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:06.239970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:06.241209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:06.241605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/groups/b94fd7de79b945baaaf9769692296938/roles/d5b9af8259144d958951b6cc7a2fb86e/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:06.287960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, group_id=b94fd7de79b945baaaf9769692296938, role_id=d5b9af8259144d958951b6cc7a2fb86e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:06.294542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:06.337910 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2148/4324] 10.222.0.15 () {60 vars in 1584 bytes} [Tue Jul 19 11:30:06 2022] PUT /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/groups/b94fd7de79b945baaaf9769692296938/roles/d5b9af8259144d958951b6cc7a2fb86e/inherited_to_projects => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:06.337910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.398331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2177/4325] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:05 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:06.399624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.458648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46851d95-d542-401d-a8b3-ec6171fb8be5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:06.540422 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:06.713054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c41072-880f-4204-b8f6-9e89dc0f3734 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:06.724712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:06.726116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:06.726618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:06.727183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:06.728449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:06.730975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:06.849199 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2149/4326] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:06 2022] GET /identity/v3/users => generated 9883 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:06.850413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.853328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:06.853328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:06.858616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:06.859035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/groups/b94fd7de79b945baaaf9769692296938/roles/d5b9af8259144d958951b6cc7a2fb86e/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:06.874409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, group_id=b94fd7de79b945baaaf9769692296938, role_id=d5b9af8259144d958951b6cc7a2fb86e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:06.875823 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:06.875823 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:06.875823 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:06.890409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:06.945522 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2178/4327] 10.222.0.15 () {58 vars in 1566 bytes} [Tue Jul 19 11:30:06 2022] HEAD /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/groups/b94fd7de79b945baaaf9769692296938/roles/d5b9af8259144d958951b6cc7a2fb86e/inherited_to_projects => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:06.946536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:06.985443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b302534d-28db-4555-87ce-327a8f9cd845 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:06.999005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:06.999704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.000059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.000366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.001192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Adding query filter params (name=tempest-test_user-872239685) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:07.001502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.003493 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:07.003493 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:07.003493 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:07.010822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.067240 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2179/4328] 10.222.0.15 () {58 vars in 1186 bytes} [Tue Jul 19 11:30:06 2022] GET /identity/v3/users?name=tempest-test_user-872239685 => generated 474 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:07.068075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:07.089684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4c14-075a-4ee3-9974-9b025eda3f24 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.107379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.108247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.108648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.109083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.109864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.111949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.140903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7ffa18-46c5-4462-8139-853fe2b108bd tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.160741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.161118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.162520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.162520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/groups/b94fd7de79b945baaaf9769692296938/roles/d5b9af8259144d958951b6cc7a2fb86e/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.168670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, group_id=b94fd7de79b945baaaf9769692296938, role_id=d5b9af8259144d958951b6cc7a2fb86e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.170485 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:07.170485 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:07.170485 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:07.179933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.194545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2150/4329] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:06 2022] POST /identity/v3/projects => generated 359 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:07.195901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:07.200320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role d5b9af8259144d958951b6cc7a2fb86e was removed from group b94fd7de79b945baaaf9769692296938 on project 1cde6eaf8fa84dab9f9b0454a27b1900. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:07.200702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:07.204816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:07.247239 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2180/4330] 10.222.0.15 () {58 vars in 1568 bytes} [Tue Jul 19 11:30:07 2022] DELETE /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/groups/b94fd7de79b945baaaf9769692296938/roles/d5b9af8259144d958951b6cc7a2fb86e/inherited_to_projects => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:07.248853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:07.255138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:07.274152 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:07.415468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5fad6a-eeec-4665-9c60-ea4a2673c295 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.428094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.429067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.429284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.429921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-272746646` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.440055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=16e071b7fd0848f48b327d3d1d277fbf, value=tempest-tag-272746646)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.445225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.466542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff421fa5-e310-459c-87e5-c30282a83bbb tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.580035 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:07.591975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.592833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.593200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.593883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.599034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:07.599507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.603129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.641353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2151/4331] 10.222.0.15 () {58 vars in 1148 bytes} [Tue Jul 19 11:30:07 2022] GET /identity/v3/users?enabled=False => generated 432 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:07.641353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:07.644119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:07.661420 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-272746646. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:30:07.661420 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:30:07.661420 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:07.684620 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2181/4332] 10.222.0.15 () {60 vars in 1329 bytes} [Tue Jul 19 11:30:07 2022] PUT /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-272746646 => generated 0 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 290 bytes (1 switches on core 0) Jul 19 11:30:07.685628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:07.691596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:07.732070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403fa21a-9f43-4664-99f6-60a94bff2d73 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.752994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.754214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.754668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.754957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users/e08c2f99ce8346719e022ff045fb3939` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.816683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e08c2f99ce8346719e022ff045fb3939)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.818117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.829760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b88ac-82e3-47a2-bc60-34c35e42c879 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:07.839638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:07.840921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:07.841345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:07.841626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles/d5b9af8259144d958951b6cc7a2fb86e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:07.843325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d5b9af8259144d958951b6cc7a2fb86e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:07.844443 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:07.844443 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:07.844443 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:07.850963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:07.961323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e08c2f99ce8346719e022ff045fb3939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:07.962350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e08c2f99ce8346719e022ff045fb3939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:07.980997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e08c2f99ce8346719e022ff045fb3939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:07.981314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e08c2f99ce8346719e022ff045fb3939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:07.997884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role d5b9af8259144d958951b6cc7a2fb86e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:07.998198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.002085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.002609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e08c2f99ce8346719e022ff045fb3939'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.007275 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2152/4333] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:07 2022] DELETE /identity/v3/roles/d5b9af8259144d958951b6cc7a2fb86e => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:08.008256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.015084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.044595 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2182/4334] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:07 2022] DELETE /identity/v3/users/e08c2f99ce8346719e022ff045fb3939 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:08.044595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.046008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.129397 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:08.189472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1e9f5-ced7-4f2e-af99-621d0c50ae35 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:08.236717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e006a6b-8c8a-4a64-9a5e-cde54d723fec tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:08.252986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:08.254634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:08.254634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:08.254634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:08.255030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:08.257514 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:08.257514 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:08.257514 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:08.259651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:08.299075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2183/4335] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:08 2022] POST /identity/v3/roles => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:08.299075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.302887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.342517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:08.343438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:08.343753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:08.343992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-272746646` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:08.370893 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:08.377250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=16e071b7fd0848f48b327d3d1d277fbf, value=tempest-tag-272746646)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:08.381798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:08.429899 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2153/4336] 10.222.0.15 () {58 vars in 1310 bytes} [Tue Jul 19 11:30:08 2022] GET /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-272746646 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:08.431787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.435980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.475830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c7fb5-f927-44c3-a6e5-a6bd62c24776 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:08.488970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592c80a-1701-41a3-9417-53ef62d6647b tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:08.491869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:08.495054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:08.495271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:08.495402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:08.496726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:08.496881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:08.497137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/e0bcc9a4ec3c44d6b0e08145855abb2c/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:08.497253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/users/2aa7c87933264c85945d0826b1197f0f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:08.498728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2aa7c87933264c85945d0826b1197f0f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:08.501613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:08.549500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=e0bcc9a4ec3c44d6b0e08145855abb2c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:08.557782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:08.568753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa7c87933264c85945d0826b1197f0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.569739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa7c87933264c85945d0826b1197f0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.586870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa7c87933264c85945d0826b1197f0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.587701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa7c87933264c85945d0826b1197f0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.591457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2154/4337] 10.222.0.15 () {60 vars in 1581 bytes} [Tue Jul 19 11:30:08 2022] PUT /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/e0bcc9a4ec3c44d6b0e08145855abb2c/inherited_to_projects => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:08.594821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.598101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa7c87933264c85945d0826b1197f0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:08.605458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.623710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2184/4338] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:08 2022] DELETE /identity/v3/users/2aa7c87933264c85945d0826b1197f0f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:08.624857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.627269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.689555 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:08.746744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12931c-dccf-49c5-86e3-77643259ea89 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:08.767545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:08.768493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:08.768779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:08.769057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/e0bcc9a4ec3c44d6b0e08145855abb2c/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:08.769848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f7494-3c2f-4574-8ec5-d86e5ef3c72a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:08.776433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:check_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=e0bcc9a4ec3c44d6b0e08145855abb2c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:08.783241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:08.801752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2185/4339] 10.222.0.15 () {58 vars in 1563 bytes} [Tue Jul 19 11:30:08 2022] HEAD /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/e0bcc9a4ec3c44d6b0e08145855abb2c/inherited_to_projects => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:08.803628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:08.810363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:08.911572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:08.912511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:08.912805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:08.913861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:08.915538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=16e071b7fd0848f48b327d3d1d277fbf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:08.919889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:09.009963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2155/4340] 10.222.0.15 () {60 vars in 1264 bytes} [Tue Jul 19 11:30:08 2022] PUT /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags => generated 141 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:09.011277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:09.039369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec11eff-e32a-41cd-837b-279842dc1e74 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:09.045753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:09.047656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:09.049113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:09.049786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/domains/2b1921235917404f954b115a3dc2c480` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:09.051952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=2b1921235917404f954b115a3dc2c480)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:09.053282 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:09.053282 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:09.053282 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:09.055977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:09.060374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bc3a-9fcf-4098-87c0-595cd7c750cf tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:09.082633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:09.083530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:09.083831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:09.084099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/e0bcc9a4ec3c44d6b0e08145855abb2c/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:09.089495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=e0bcc9a4ec3c44d6b0e08145855abb2c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:09.094292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '2b1921235917404f954b115a3dc2c480'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.095733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '2b1921235917404f954b115a3dc2c480'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.097166 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:09.097166 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:09.097166 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:09.102855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:09.130311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role e0bcc9a4ec3c44d6b0e08145855abb2c was removed from user 3b9d4c36086b46379542a6d2c3a2568d on project 1cde6eaf8fa84dab9f9b0454a27b1900. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:09.130311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.149746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.159358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '2b1921235917404f954b115a3dc2c480'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.160879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '2b1921235917404f954b115a3dc2c480'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.169649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2186/4341] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:30:08 2022] PATCH /identity/v3/domains/2b1921235917404f954b115a3dc2c480 => generated 277 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:09.171316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:09.174952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:09.192254 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2156/4342] 10.222.0.15 () {58 vars in 1565 bytes} [Tue Jul 19 11:30:09 2022] DELETE /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/e0bcc9a4ec3c44d6b0e08145855abb2c/inherited_to_projects => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:09.192254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:09.199338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:09.264869 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:09.364324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1ca1c4-89b5-45b9-a7a2-bd6e801924d5 tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:09.373652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e95af5e-f9ee-4b8c-9d17-4486a7de788c tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:09.385982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35f52c572e654b46a3f5d959d267cbd8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b12606d5964491dbd8785c77f4029b8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:09.386901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:09.387185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:09.387462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] PATH_INFO: `/v3/domains/2b1921235917404f954b115a3dc2c480` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:09.415571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=2b1921235917404f954b115a3dc2c480)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:09.420045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:09.510237 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:09.514280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '2b1921235917404f954b115a3dc2c480'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.527232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '2b1921235917404f954b115a3dc2c480'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.568968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:09.569858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:09.570143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:09.570422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:09.627215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=16e071b7fd0848f48b327d3d1d277fbf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:09.635913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:09.686490 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2187/4343] 10.222.0.15 () {58 vars in 1244 bytes} [Tue Jul 19 11:30:09 2022] GET /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags => generated 141 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:09.686490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:09.693399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b1921235917404f954b115a3dc2c480', 'request_id': 'req-c0638754-a4db-473a-a21a-93372eb5674f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.701336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:09.704647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b1921235917404f954b115a3dc2c480', 'request_id': 'req-c0638754-a4db-473a-a21a-93372eb5674f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.713791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b1921235917404f954b115a3dc2c480', 'request_id': 'req-c0638754-a4db-473a-a21a-93372eb5674f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.733912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] The token cache is being invalidate because project 2b1921235917404f954b115a3dc2c480 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:09.734570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.736582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.751041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '2b1921235917404f954b115a3dc2c480', 'request_id': 'req-c0638754-a4db-473a-a21a-93372eb5674f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.753329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '2b1921235917404f954b115a3dc2c480', 'request_id': 'req-c0638754-a4db-473a-a21a-93372eb5674f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.755210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '2b1921235917404f954b115a3dc2c480', 'request_id': 'req-c0638754-a4db-473a-a21a-93372eb5674f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:09.806317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2157/4344] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:30:09 2022] DELETE /identity/v3/domains/2b1921235917404f954b115a3dc2c480 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:09.806317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:09.814627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:09.838092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a67674-a984-4b47-86b8-c7f2eefa2636 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:09.941036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:09.941849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:09.942133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:09.942410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles/e0bcc9a4ec3c44d6b0e08145855abb2c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:09.945683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e0bcc9a4ec3c44d6b0e08145855abb2c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:09.946738 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:09.946738 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:09.946738 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:09.947637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:09.993416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0638754-a4db-473a-a21a-93372eb5674f tempest-UsersV3TestJSON-1180271850 tempest-UsersV3TestJSON-1180271850-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:10.015907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:10.016879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:10.017424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:10.017704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] PATH_INFO: `/v3/users/da0bfcb32bea448eb22f4aab2b99d796` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:10.020997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=da0bfcb32bea448eb22f4aab2b99d796)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:10.039105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:10.050175 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:10.080752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role e0bcc9a4ec3c44d6b0e08145855abb2c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:10.081350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.082880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.094117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2188/4345] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:09 2022] DELETE /identity/v3/roles/e0bcc9a4ec3c44d6b0e08145855abb2c => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:10.096676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:10.100003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:10.143037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da0bfcb32bea448eb22f4aab2b99d796'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.158922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da0bfcb32bea448eb22f4aab2b99d796'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.190574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da0bfcb32bea448eb22f4aab2b99d796'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.193474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da0bfcb32bea448eb22f4aab2b99d796'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.202854 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:10.239909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da0bfcb32bea448eb22f4aab2b99d796'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.247563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f1d245-0b93-44a9-855a-a8b6e199c2dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:10.253190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:10.255104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:10.255440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:10.255918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-2124292511` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:10.257312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=16e071b7fd0848f48b327d3d1d277fbf, value=tempest-tag-2124292511)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:10.260856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:10.265048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2158/4346] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:09 2022] DELETE /identity/v3/users/da0bfcb32bea448eb22f4aab2b99d796 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:10.266367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:10.276646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:10.356056 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-2124292511. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:30:10.356056 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:30:10.356056 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:10.370087 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2189/4347] 10.222.0.15 () {58 vars in 1316 bytes} [Tue Jul 19 11:30:10 2022] DELETE /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-2124292511 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:10.371712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:10.374599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:10.499157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b04f2-863b-4a80-8811-7db4830748fb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:10.510123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:10.511588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:10.512027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:10.512508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] PATH_INFO: `/v3/users/f04da65fc69a4144b98acfa774efb300` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:10.518592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f04da65fc69a4144b98acfa774efb300)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:10.525282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:10.562476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461082-45e3-4c58-acb9-b6c61ad5a631 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:10.658242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f04da65fc69a4144b98acfa774efb300'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.685511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f04da65fc69a4144b98acfa774efb300'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.713011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7695935-ad92-468d-b867-7332258cc0b9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:10.713653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695935-ad92-468d-b867-7332258cc0b9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:10.713927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695935-ad92-468d-b867-7332258cc0b9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:10.714384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7695935-ad92-468d-b867-7332258cc0b9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:10.715163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695935-ad92-468d-b867-7332258cc0b9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:10.724015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7695935-ad92-468d-b867-7332258cc0b9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:10.727884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f04da65fc69a4144b98acfa774efb300'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.729067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f04da65fc69a4144b98acfa774efb300'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.748007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f04da65fc69a4144b98acfa774efb300'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:10.755461 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:10.766181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2159/4348] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:10 2022] DELETE /identity/v3/users/f04da65fc69a4144b98acfa774efb300 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:10.767292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:10.773803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:10.786326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2190/4349] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:10 2022] POST /identity/v3/roles => generated 240 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:10.790956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:10.791252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:10.791537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:10.827728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:10.835103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:10.915488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48e1c1-03bd-447b-b3d2-e5b1cbf71672 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:10.926285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:10.928676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:10.930536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:10.930919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-2124292511` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:10.945233 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:10.982208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=16e071b7fd0848f48b327d3d1d277fbf, value=tempest-tag-2124292511)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:10.985575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.005055 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2191/4350] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:11.006214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.011981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Could not find project tag: tempest-tag-2124292511.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-2124292511. Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Jul 19 11:30:11.049748 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Jul 19 11:30:11.050873 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:11.050873 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:11.050873 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Jul 19 11:30:11.050873 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Jul 19 11:30:11.050873 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-2124292511. Jul 19 11:30:11.050873 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:11.066897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2160/4351] 10.222.0.15 () {58 vars in 1313 bytes} [Tue Jul 19 11:30:10 2022] GET /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags/tempest-tag-2124292511 => generated 107 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:11.069379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.105226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0038b70-f0d7-4878-a0f9-1dae182a9879 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.116532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.119245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.120287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:11.120702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:11.122940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=16e071b7fd0848f48b327d3d1d277fbf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:11.130628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.227193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25beff47-9ad6-4ab4-ad6b-45cb871bf800 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.254405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.256573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.262912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:11.263844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/1e40ce15fd3a4f319de44559ace9f227/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:11.274428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, group_id=b94fd7de79b945baaaf9769692296938, role_id=1e40ce15fd3a4f319de44559ace9f227)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:11.277529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.290471 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2161/4352] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:30:11 2022] DELETE /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:11.298395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.321448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2192/4353] 10.222.0.15 () {60 vars in 1581 bytes} [Tue Jul 19 11:30:11 2022] PUT /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/1e40ce15fd3a4f319de44559ace9f227/inherited_to_projects => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:11.331729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.339157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46a751-a236-40e7-9fb3-23671ef5d5cc tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.465826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.466871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.467159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:11.467434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:11.503026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=16e071b7fd0848f48b327d3d1d277fbf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:11.505468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.527034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2162/4354] 10.222.0.15 () {58 vars in 1244 bytes} [Tue Jul 19 11:30:11 2022] GET /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf/tags => generated 66 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:30:11.527990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.539694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:11.594231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905161d-01ae-4d47-a50d-b0cf3a978169 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.618130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.619312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.619801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:11.620277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:11.622334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f3cd84c2dd36496db0064c3708f1eef7, group_id=b94fd7de79b945baaaf9769692296938)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:11.623595 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:11.623595 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:11.623595 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:11.625827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.658904 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2193/4355] 10.222.0.15 () {58 vars in 1463 bytes} [Tue Jul 19 11:30:11 2022] GET /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/inherited_to_projects => generated 448 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:11.660183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.688174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca50416-8b0b-47e9-897b-f20c22d1334f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.696488 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:11.702071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ea0966eaccf4a60b482f3cf1c077c34', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3f9a673fdc0e431aa0b38d09dd8b293d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.705070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.705596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:11.706095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] PATH_INFO: `/v3/projects/16e071b7fd0848f48b327d3d1d277fbf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:11.708035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorizing `identity:delete_project(project_id=16e071b7fd0848f48b327d3d1d277fbf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:11.710246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.756918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a1914-b01d-4463-ae97-477f51242d9a tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.768240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.768950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.769235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:11.769514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:11.810276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16e071b7fd0848f48b327d3d1d277fbf', 'request_id': 'req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:11.825003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16e071b7fd0848f48b327d3d1d277fbf', 'request_id': 'req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:11.841692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16e071b7fd0848f48b327d3d1d277fbf', 'request_id': 'req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:11.861876 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:11.866990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] The token cache is being invalidate because project 16e071b7fd0848f48b327d3d1d277fbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:11.867642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:11.868566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:11.870665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2194/4356] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:11 2022] DELETE /identity/v3/projects/16e071b7fd0848f48b327d3d1d277fbf => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:11.871859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:11.877159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:11.976369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:11.978586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:11.991930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9cbd1-bb0f-40cc-acdf-8c1e22b59ff5 tempest-IdentityV3ProjectTagsTest-1244401871 tempest-IdentityV3ProjectTagsTest-1244401871-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:11.997948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:11.999460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:11.999908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:12.000462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/1e40ce15fd3a4f319de44559ace9f227/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:12.003553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, group_id=b94fd7de79b945baaaf9769692296938, role_id=1e40ce15fd3a4f319de44559ace9f227)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:12.007035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:12.015822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2195/4357] 10.222.0.15 () {58 vars in 1563 bytes} [Tue Jul 19 11:30:11 2022] HEAD /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/1e40ce15fd3a4f319de44559ace9f227/inherited_to_projects => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:12.017176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:12.022105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:12.045365 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2163/4358] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:12.046257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:12.047659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:12.072547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f620a16-e1df-4a1c-88d1-cc48e7163b94 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:12.116213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4c95a5-2a8a-497c-9c3a-0063de1c46de tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:12.122940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:12.124867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:12.125337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:12.125663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] PATH_INFO: `/v3/projects/6b871fb24ca54c2a97666083e9b5eaac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:12.131244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b871fb24ca54c2a97666083e9b5eaac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:12.134645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:12.256692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b871fb24ca54c2a97666083e9b5eaac', 'request_id': 'req-25890cd0-45ce-4c4f-be91-825a9c93b2ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.268169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b871fb24ca54c2a97666083e9b5eaac', 'request_id': 'req-25890cd0-45ce-4c4f-be91-825a9c93b2ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.276149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b871fb24ca54c2a97666083e9b5eaac', 'request_id': 'req-25890cd0-45ce-4c4f-be91-825a9c93b2ac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.285549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:12.286468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:12.286742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:12.287054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] PATH_INFO: `/v3/users/ee2d3e8e4bd44cba8b1a349e5b6857c0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:12.291678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2d3e8e4bd44cba8b1a349e5b6857c0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:12.293931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:12.313215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] The token cache is being invalidate because project 6b871fb24ca54c2a97666083e9b5eaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:12.313460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.314262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.325288 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2196/4359] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:12 2022] DELETE /identity/v3/projects/6b871fb24ca54c2a97666083e9b5eaac => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:12.328457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:12.349756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:12.424831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2d3e8e4bd44cba8b1a349e5b6857c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.440060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2d3e8e4bd44cba8b1a349e5b6857c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.461270 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:12.549397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25890cd0-45ce-4c4f-be91-825a9c93b2ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:12.568254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2d3e8e4bd44cba8b1a349e5b6857c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.570877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2d3e8e4bd44cba8b1a349e5b6857c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.571013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:12.574906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:12.576171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:12.576473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/1e40ce15fd3a4f319de44559ace9f227/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:12.585042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, group_id=b94fd7de79b945baaaf9769692296938, role_id=1e40ce15fd3a4f319de44559ace9f227)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:12.586944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2d3e8e4bd44cba8b1a349e5b6857c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.600385 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2164/4360] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:12 2022] DELETE /identity/v3/users/ee2d3e8e4bd44cba8b1a349e5b6857c0 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:12.600385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:12.602594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:12.602696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:12.617080 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:12.627749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role 1e40ce15fd3a4f319de44559ace9f227 was removed from group b94fd7de79b945baaaf9769692296938 on domain f3cd84c2dd36496db0064c3708f1eef7. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:12.628797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.630278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-88692fdd-c5eb-4215-8e2d-755f8fef1325 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:12.724982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2197/4361] 10.222.0.15 () {58 vars in 1565 bytes} [Tue Jul 19 11:30:12 2022] DELETE /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/groups/b94fd7de79b945baaaf9769692296938/roles/1e40ce15fd3a4f319de44559ace9f227/inherited_to_projects => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:12.735612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:12.735909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:12.737489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:12.769080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10bf34-1fb8-4892-8d4f-63a43a6e4d0f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:12.844832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:12.860388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.057281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.058212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.061221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.061577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] PATH_INFO: `/v3/users/c46794bb84504b8283ee36bac032ac80` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.063294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c46794bb84504b8283ee36bac032ac80)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.071626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.144839 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2198/4362] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:13.147249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.153218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.212207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c46794bb84504b8283ee36bac032ac80'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.227165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c46794bb84504b8283ee36bac032ac80'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.285090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c46794bb84504b8283ee36bac032ac80'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.291365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c46794bb84504b8283ee36bac032ac80'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.308695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686d9e5-d5a2-4a47-86ee-4c96a9d6d96a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.313621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c46794bb84504b8283ee36bac032ac80'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.313797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.315816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.315816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.316024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles/1e40ce15fd3a4f319de44559ace9f227` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.317602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1e40ce15fd3a4f319de44559ace9f227)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.319271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.326036 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2165/4363] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:12 2022] DELETE /identity/v3/users/c46794bb84504b8283ee36bac032ac80 => generated 0 bytes in 723 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:13.326748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.328552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.363604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role 1e40ce15fd3a4f319de44559ace9f227 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:13.364003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.364773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:13.368034 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:13.369196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2199/4364] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:13 2022] DELETE /identity/v3/roles/1e40ce15fd3a4f319de44559ace9f227 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:13.375610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.377968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.417626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd73e0c-9a28-4bb8-9145-9f780452c377 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.422778 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:13.497363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c212f80-fb7c-422f-aaef-5478df74dcc1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.502676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.503642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.503937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.504268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.505132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.507171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.529613 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2200/4365] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:13 2022] POST /identity/v3/roles => generated 240 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:13.533186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.555005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee30f67-90e0-4648-a2bb-c9d3a74b9037 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.567177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.567865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.568160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.568435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.582026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.610596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.611938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.612921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.614240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/83c2e5eaaed14e4eace98ef0d9aebdba/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.617559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=83c2e5eaaed14e4eace98ef0d9aebdba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.623994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.684330 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2201/4366] 10.222.0.15 () {60 vars in 1578 bytes} [Tue Jul 19 11:30:13 2022] PUT /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/83c2e5eaaed14e4eace98ef0d9aebdba/inherited_to_projects => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:13.687040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.697525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.738329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.739846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.759466 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2166/4367] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:13.768555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.784479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d048d3bc-1b3e-4c31-a7d3-8e1b896fa80e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.887978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9079a1d-9e45-49cd-93a0-33a1bb2189f6 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.896178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.897074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.897544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.897985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.898152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.898627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.898861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.899088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.901425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=f3cd84c2dd36496db0064c3708f1eef7, user_id=3b9d4c36086b46379542a6d2c3a2568d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.901756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:13.902825 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:13.902825 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:13.902825 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:13.904989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.926624 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2167/4368] 10.222.0.15 () {58 vars in 1460 bytes} [Tue Jul 19 11:30:13 2022] GET /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/inherited_to_projects => generated 447 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:13.931427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:13.939400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.941117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:13.952712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4496ba55-5921-44f7-b931-78dfaf94ad46 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:13.964465 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2202/4369] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:13.970114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:13.971885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:13.972389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:13.974097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/83c2e5eaaed14e4eace98ef0d9aebdba/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:13.980630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=83c2e5eaaed14e4eace98ef0d9aebdba)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:13.985735 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:13.985735 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:13.985735 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:13.990333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.024027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2168/4370] 10.222.0.15 () {58 vars in 1560 bytes} [Tue Jul 19 11:30:13 2022] HEAD /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/83c2e5eaaed14e4eace98ef0d9aebdba/inherited_to_projects => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:14.025810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.049864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02309c38-137c-4b80-b92e-f915cfa91ffc service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.068582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.068744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.069696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.071607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/83c2e5eaaed14e4eace98ef0d9aebdba/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.079289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=83c2e5eaaed14e4eace98ef0d9aebdba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.082080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.104507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role 83c2e5eaaed14e4eace98ef0d9aebdba was removed from user 3b9d4c36086b46379542a6d2c3a2568d on domain f3cd84c2dd36496db0064c3708f1eef7. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:14.104805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:14.108517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:14.146620 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2203/4371] 10.222.0.15 () {58 vars in 1562 bytes} [Tue Jul 19 11:30:14 2022] DELETE /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/83c2e5eaaed14e4eace98ef0d9aebdba/inherited_to_projects => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:14.147837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.149734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:14.174637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b239e9-fd11-4385-a6d2-67c4a942be2d tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.216445 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:14.280893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.286897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.287190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.287477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles/83c2e5eaaed14e4eace98ef0d9aebdba` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.289291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_role(role_id=83c2e5eaaed14e4eace98ef0d9aebdba)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.291018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.391823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role 83c2e5eaaed14e4eace98ef0d9aebdba has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:14.392182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:14.393184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:14.400923 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2169/4372] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:14 2022] DELETE /identity/v3/roles/83c2e5eaaed14e4eace98ef0d9aebdba => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:14.402121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.416400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7db4cb-5fe0-4da4-8307-31d473f2f762 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.502373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.504391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.504814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.505844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.506695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.508700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.542698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2204/4373] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:14 2022] POST /identity/v3/roles => generated 239 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:14.543973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.545562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:14.573314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb9d252-cb23-4dcd-b8fa-81229b8583da tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.579521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.580840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.581731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.582202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.583113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.586705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.637349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.639409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:14.657412 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:14.659510 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2170/4374] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:14 2022] POST /identity/v3/projects => generated 409 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:14.662637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.807485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56772b7-1851-47f7-a516-6c4caec1b49e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.808479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b96fd3-0c4f-481e-a1ba-072be0130cc4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.816583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.817525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.817810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.818088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/b550b77c6f9a443a9de475c0f5e7981d/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.820606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=b550b77c6f9a443a9de475c0f5e7981d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.824253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.840110 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2171/4375] 10.222.0.15 () {60 vars in 1578 bytes} [Tue Jul 19 11:30:14 2022] PUT /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/b550b77c6f9a443a9de475c0f5e7981d/inherited_to_projects => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:14.844614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:14.924589 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:14.947810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.949133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.949425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.949709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] PATH_INFO: `/v3/projects/1eb277d104fe4947a074dd88206af05a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.951324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eb277d104fe4947a074dd88206af05a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.953147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2620d-c892-4365-9ee2-01b95fd50372 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:14.955394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:14.961701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:14.962840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:14.963399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:14.964155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:14.965506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Adding query filter params (scope.project.id=1cde6eaf8fa84dab9f9b0454a27b1900, user.id=3b9d4c36086b46379542a6d2c3a2568d) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:14.966331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:14.967448 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:14.967448 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:14.967448 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:14.969017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:15.060989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2172/4376] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:14 2022] GET /identity/v3/role_assignments?scope.project.id=1cde6eaf8fa84dab9f9b0454a27b1900&user.id=3b9d4c36086b46379542a6d2c3a2568d&effective => generated 648 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:30:15.061534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:15.063337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.084979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eb277d104fe4947a074dd88206af05a', 'request_id': 'req-8cd3b611-87c0-4dd3-b91a-045b8a124313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.092189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eb277d104fe4947a074dd88206af05a', 'request_id': 'req-8cd3b611-87c0-4dd3-b91a-045b8a124313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.100166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eb277d104fe4947a074dd88206af05a', 'request_id': 'req-8cd3b611-87c0-4dd3-b91a-045b8a124313'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.121501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] The token cache is being invalidate because project 1eb277d104fe4947a074dd88206af05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:15.121725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.127271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.129397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2205/4377] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:14 2022] DELETE /identity/v3/projects/1eb277d104fe4947a074dd88206af05a => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:15.156036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:15.161098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.185972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6111ad4-ba2b-4612-aa0d-b19e3ae1d6bf tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:15.217882 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:15.239230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3b611-87c0-4dd3-b91a-045b8a124313 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:15.244592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:15.245564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.245922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.246272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] PATH_INFO: `/v3/projects/93396d152d0b491ab8a17ea2b10addd6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.247589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93396d152d0b491ab8a17ea2b10addd6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:15.249829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:15.264842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:15.265829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.266185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.266528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] PATH_INFO: `/v3/projects/574fb6db93424eff8f5fa29aace01c65` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.267846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=574fb6db93424eff8f5fa29aace01c65)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:15.269815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:15.308652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93396d152d0b491ab8a17ea2b10addd6', 'request_id': 'req-992a85dd-74a5-46c8-9c14-46c0c508f752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.326353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '574fb6db93424eff8f5fa29aace01c65', 'request_id': 'req-9e97c5a4-6bde-464e-b468-003485061a45'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.333171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93396d152d0b491ab8a17ea2b10addd6', 'request_id': 'req-992a85dd-74a5-46c8-9c14-46c0c508f752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.336838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '574fb6db93424eff8f5fa29aace01c65', 'request_id': 'req-9e97c5a4-6bde-464e-b468-003485061a45'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.338662 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:15.345339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93396d152d0b491ab8a17ea2b10addd6', 'request_id': 'req-992a85dd-74a5-46c8-9c14-46c0c508f752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.347027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '574fb6db93424eff8f5fa29aace01c65', 'request_id': 'req-9e97c5a4-6bde-464e-b468-003485061a45'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.370039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] The token cache is being invalidate because project 93396d152d0b491ab8a17ea2b10addd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:15.370039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.370467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.371926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] The token cache is being invalidate because project 574fb6db93424eff8f5fa29aace01c65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:15.372287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.372556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2206/4378] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:15 2022] DELETE /identity/v3/projects/93396d152d0b491ab8a17ea2b10addd6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:15.373446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:15.374883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.377432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e97c5a4-6bde-464e-b468-003485061a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.380057 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2173/4379] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:15 2022] DELETE /identity/v3/projects/574fb6db93424eff8f5fa29aace01c65 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:15.381812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d630b-d77d-4a76-9840-b8031f20ae74 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.384459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d630b-d77d-4a76-9840-b8031f20ae74 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.384805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d630b-d77d-4a76-9840-b8031f20ae74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.407135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4c2d630b-d77d-4a76-9840-b8031f20ae74 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:15.408457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c2d630b-d77d-4a76-9840-b8031f20ae74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.475091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a85dd-74a5-46c8-9c14-46c0c508f752 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:15.506429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2174/4380] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:15.507974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.508262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.508574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.529720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:15.531604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.551410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:15.552219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.553065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.553359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.554623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Adding query filter params (scope.project.id=1ddd90c0141843caabe440087de97acf, user.id=3b9d4c36086b46379542a6d2c3a2568d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:15.554942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:15.555995 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:15.555995 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:15.555995 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:15.557279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:15.594715 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:15.626416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2175/4381] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:15.628653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:15.631126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.653358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a7829-517c-4125-879d-9b900491e469 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:15.660677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:15.661559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.661876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.662166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] PATH_INFO: `/v3/users/3ea0966eaccf4a60b482f3cf1c077c34` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.663786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ea0966eaccf4a60b482f3cf1c077c34)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:15.667344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:15.681580 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2207/4382] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:15 2022] GET /identity/v3/role_assignments?scope.project.id=1ddd90c0141843caabe440087de97acf&user.id=3b9d4c36086b46379542a6d2c3a2568d&effective => generated 648 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:15.682440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:15.686852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.708632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f175f86a-5dc0-45f8-b617-79119ec5915e tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:15.715862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:15.724234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.724234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.724786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] PATH_INFO: `/v3/users/35f52c572e654b46a3f5d959d267cbd8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.725885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] RBAC: Authorizing `identity:delete_user(user_id=35f52c572e654b46a3f5d959d267cbd8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:15.728184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:15.779493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ea0966eaccf4a60b482f3cf1c077c34'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.796896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ea0966eaccf4a60b482f3cf1c077c34'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.806609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35f52c572e654b46a3f5d959d267cbd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.807575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35f52c572e654b46a3f5d959d267cbd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.818211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35f52c572e654b46a3f5d959d267cbd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.819346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35f52c572e654b46a3f5d959d267cbd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.824245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ea0966eaccf4a60b482f3cf1c077c34'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.825157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ea0966eaccf4a60b482f3cf1c077c34'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.835037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bde138f8-e212-49ef-ac88-ab963a693cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ea0966eaccf4a60b482f3cf1c077c34'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.837904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35f52c572e654b46a3f5d959d267cbd8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:15.848180 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2176/4383] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:15 2022] DELETE /identity/v3/users/3ea0966eaccf4a60b482f3cf1c077c34 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:15.850921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:15.852794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:15.853927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:15.862438 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:15.881444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:15.882836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:15.899381 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2208/4384] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:15 2022] DELETE /identity/v3/users/35f52c572e654b46a3f5d959d267cbd8 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:15.901600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:15.905647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.006259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2177/4385] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:16.011582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.027141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5b488-705e-4ec4-9cad-ecb6bb3e504a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.087308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7d8c7a-5a7d-4037-b323-266598650cac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.095259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.096627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.097095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.097432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/b550b77c6f9a443a9de475c0f5e7981d/inherited_to_projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.101853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=f3cd84c2dd36496db0064c3708f1eef7, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=b550b77c6f9a443a9de475c0f5e7981d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.106754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.115600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role b550b77c6f9a443a9de475c0f5e7981d was removed from user 3b9d4c36086b46379542a6d2c3a2568d on domain f3cd84c2dd36496db0064c3708f1eef7. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:16.116041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.116973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.128020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.129212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.129738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.130162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.131193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:16.131736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.134256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.140413 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2209/4386] 10.222.0.15 () {58 vars in 1562 bytes} [Tue Jul 19 11:30:15 2022] DELETE /identity/v3/OS-INHERIT/domains/f3cd84c2dd36496db0064c3708f1eef7/users/3b9d4c36086b46379542a6d2c3a2568d/roles/b550b77c6f9a443a9de475c0f5e7981d/inherited_to_projects => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:16.158295 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2178/4387] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:30:16.159900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.163196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.166909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.167385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.189430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8113e6fb-9019-4905-b18f-8286d2c46758 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.298896 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:16.325092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.325092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.325092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.326999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.326999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.329858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.345242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cb182-1bd4-4dbd-b277-d2b70740e6d8 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.352774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.354110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.354683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.355305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.358009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Adding query filter params (scope.project.id=1cde6eaf8fa84dab9f9b0454a27b1900, user.id=3b9d4c36086b46379542a6d2c3a2568d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:16.358960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.363235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.393790 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2179/4388] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:16 2022] POST /identity/v3/projects => generated 393 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:16.400732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.462482 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:16.502169 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2210/4389] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:16 2022] GET /identity/v3/role_assignments?scope.project.id=1cde6eaf8fa84dab9f9b0454a27b1900&user.id=3b9d4c36086b46379542a6d2c3a2568d&effective => generated 228 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:16.513866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.542979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f31b503-7c23-4575-bb57-42566b3a255a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.561574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5853eaec-7351-470d-860d-79521e144d5a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.573472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.574846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.575438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.577790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.579948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.584908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.628070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2180/4390] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:16 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:30:16.628070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.628070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.642197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac06cd0-cbab-4880-8790-6372a0f49157 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.648509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.649300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.649582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.649864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] PATH_INFO: `/v3/projects/9b12606d5964491dbd8785c77f4029b8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.651359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b12606d5964491dbd8785c77f4029b8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.653653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.657964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.659672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.660243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.660768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.663313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Adding query filter params (scope.project.id=1ddd90c0141843caabe440087de97acf, user.id=3b9d4c36086b46379542a6d2c3a2568d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:16.664070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.669027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ecf55-65d4-4470-bba1-fd0933ece540 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.724244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b12606d5964491dbd8785c77f4029b8', 'request_id': 'req-f08590b0-f881-44f5-a943-26301d9597ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.743524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b12606d5964491dbd8785c77f4029b8', 'request_id': 'req-f08590b0-f881-44f5-a943-26301d9597ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.755846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b12606d5964491dbd8785c77f4029b8', 'request_id': 'req-f08590b0-f881-44f5-a943-26301d9597ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.775059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] The token cache is being invalidate because project 9b12606d5964491dbd8785c77f4029b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:16.775335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.777974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:16.780691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2181/4391] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:16 2022] DELETE /identity/v3/projects/9b12606d5964491dbd8785c77f4029b8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:16.787905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.794148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2211/4392] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:16 2022] GET /identity/v3/role_assignments?scope.project.id=1ddd90c0141843caabe440087de97acf&user.id=3b9d4c36086b46379542a6d2c3a2568d&effective => generated 228 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:16.794148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.794148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.794148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.795450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.820193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:16.822279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.893451 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:16.919021 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2212/4393] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:16.920041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:16.926320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:16.930061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08590b0-f881-44f5-a943-26301d9597ba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:16.939197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88038a-c4a5-46dc-b01e-eac29517f38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:16.940450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88038a-c4a5-46dc-b01e-eac29517f38d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.940971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88038a-c4a5-46dc-b01e-eac29517f38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.941523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88038a-c4a5-46dc-b01e-eac29517f38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.942404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88038a-c4a5-46dc-b01e-eac29517f38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:16.944139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88038a-c4a5-46dc-b01e-eac29517f38d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:16.960012 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2182/4394] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:16 2022] GET /identity/v3/roles => generated 1650 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:16.960012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:16.960012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:16.960012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:16.991178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:16.993501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.009256 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2183/4395] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:17.015477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.028736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f4b76-4de3-4e56-bbfc-98dbc968457f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.034321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b633e4f-ad43-40f7-8962-cece5bef195e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.035668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.036494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.036780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.037150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.037909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.040051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.050798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.052746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.053869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.053869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/projects/1ddd90c0141843caabe440087de97acf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.056530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1ddd90c0141843caabe440087de97acf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.058944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.067742 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2184/4396] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:17 2022] GET /identity/v3/roles => generated 1650 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:17.069250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.086615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764d61f-17b4-4b7c-9cfb-2954835cc810 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.096740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.098307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.098773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.100296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.101777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:17.102383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.104247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.117908 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:17.123197 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2185/4397] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:17.124068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.132272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ddd90c0141843caabe440087de97acf', 'request_id': 'req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.139471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e77e45-8be1-4a74-a44e-68922ac2b528 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.143041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ddd90c0141843caabe440087de97acf', 'request_id': 'req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.166869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ddd90c0141843caabe440087de97acf', 'request_id': 'req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.193313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] The token cache is being invalidate because project 1ddd90c0141843caabe440087de97acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:17.194084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.197747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.205872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2213/4398] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:16 2022] DELETE /identity/v3/projects/1ddd90c0141843caabe440087de97acf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:17.205872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.205872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.277780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.278836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.279120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.279391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] PATH_INFO: `/v3/projects/de2a7f7d10614ee7bae10d3b54f5f0e6/users/f35d623b786740f08b362ad2e393a042/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.311313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2a7f7d10614ee7bae10d3b54f5f0e6, user_id=f35d623b786740f08b362ad2e393a042, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.314044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.337163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dd51b5-3dbf-4ba7-b5f9-7005e22ce3b4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.349816 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2186/4399] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:17 2022] PUT /identity/v3/projects/de2a7f7d10614ee7bae10d3b54f5f0e6/users/f35d623b786740f08b362ad2e393a042/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:17.349816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.349816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.424951 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:17.504384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d447982a-0c0d-42ae-b558-da021e372366 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.510778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.511816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.512110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.512469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles/b550b77c6f9a443a9de475c0f5e7981d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.512783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.513634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.514021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.514348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b550b77c6f9a443a9de475c0f5e7981d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.514461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.515277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.516393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.517592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.575462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2214/4400] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:17 2022] POST /identity/v3/projects => generated 375 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:17.577002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.580431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.591413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role b550b77c6f9a443a9de475c0f5e7981d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:17.591721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.592430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b1767ed-2a88-499e-9be0-e74ba3f0d080 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.594649 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2187/4401] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:17 2022] DELETE /identity/v3/roles/b550b77c6f9a443a9de475c0f5e7981d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:17.596986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.597438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.597731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.669328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:17.671008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.770458 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:17.806905 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2188/4402] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:17.806905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.812731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.824485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe62cee-dae9-430e-9e15-a45df2f550d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.832477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a0c4e0-d0f1-4988-8420-9ec4ba1a1b83 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:17.835808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.836888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.837169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.837440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] PATH_INFO: `/v3/projects/3f9a673fdc0e431aa0b38d09dd8b293d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.839036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f9a673fdc0e431aa0b38d09dd8b293d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.841057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.846854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:17.847669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:17.847955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:17.848227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:17.848972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:17.851093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:17.884241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2189/4403] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:17 2022] POST /identity/v3/users => generated 288 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:17.884241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.885265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:17.920324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f9a673fdc0e431aa0b38d09dd8b293d', 'request_id': 'req-0feefca7-9771-4666-a367-f1942b790c85'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.928648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f9a673fdc0e431aa0b38d09dd8b293d', 'request_id': 'req-0feefca7-9771-4666-a367-f1942b790c85'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.939131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f9a673fdc0e431aa0b38d09dd8b293d', 'request_id': 'req-0feefca7-9771-4666-a367-f1942b790c85'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.966649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] The token cache is being invalidate because project 3f9a673fdc0e431aa0b38d09dd8b293d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:17.966926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.967772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:17.979108 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2215/4404] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:17 2022] DELETE /identity/v3/projects/3f9a673fdc0e431aa0b38d09dd8b293d => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:17.980212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:17.981723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:18.029735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb65f732-3e4e-4e50-ab21-f50ff28da150 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.111986 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:18.133235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feefca7-9771-4666-a367-f1942b790c85 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.139931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.140760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.141325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.141615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.146732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:18.201610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.202386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.202743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.203238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.214975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.216885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.272488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2190/4405] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:17 2022] POST /identity/v3/roles => generated 240 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:18.273216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.280050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:18.346358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.349243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9f0292-14bb-4517-b8e7-28bad4c71c70 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.374293 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2216/4406] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:18.375835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.376304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.376621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.407037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:18.408715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:18.436454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2217/4407] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:18.436729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfdb6b-bd8a-41ba-a7a1-53f74cec7381 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.436920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.436920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:18.437161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a8607b-6e67-4575-a36e-286683395fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.437161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8607b-6e67-4575-a36e-286683395fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.437161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8607b-6e67-4575-a36e-286683395fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.437161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a8607b-6e67-4575-a36e-286683395fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.438009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8607b-6e67-4575-a36e-286683395fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.441443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a8607b-6e67-4575-a36e-286683395fe3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.445839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b0d655-e726-4da7-a6b6-a3f1a09086d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.458300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.459001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.459330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.459580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.460177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2191/4408] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:18 2022] GET /identity/v3/roles => generated 1651 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:18.461596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.461870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.462179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.463998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.469349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.483988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:18.485288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:18.510052 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2192/4409] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:18.510052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.512644 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:18.518214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae97be2-ed9a-4f46-bc95-408c8289a1ab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.536264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.537119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.537506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.537909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.538489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.541758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.553897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2193/4410] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:18 2022] GET /identity/v3/roles => generated 1651 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:18.555543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.561623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2218/4411] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:18 2022] POST /identity/v3/projects => generated 409 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:18.562400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.582132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851058ed-468f-45a5-9ae1-a49c53e455fc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.709354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.710582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.711118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.711595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.712653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:18.714117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.718868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.721992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9dfff-3d12-4ea4-9435-cc9f020607dd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:18.741135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:18.747056 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2194/4412] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:18.748429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.751593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:18.752489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:18.752992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] PATH_INFO: `/v3/projects/78e6d6f33d504eeea88402dcd043a4ee/users/aea630b7ee4f4a74be921e6786031819/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:18.811020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e6d6f33d504eeea88402dcd043a4ee, user_id=aea630b7ee4f4a74be921e6786031819, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:18.820246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:18.883754 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2219/4413] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:18 2022] PUT /identity/v3/projects/78e6d6f33d504eeea88402dcd043a4ee/users/aea630b7ee4f4a74be921e6786031819/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:18.886515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:18.940450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6611f123-5346-4439-ba3c-0903154b5b27 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:19.040315 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:19.078476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe77fffd-576f-4993-94ae-091ba1109675 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:19.087055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:19.089813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.090291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.090836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.091732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:19.093588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703a1ea-2cec-4c0d-9c97-19e6b582f32a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:19.094345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:19.094713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a1ea-2cec-4c0d-9c97-19e6b582f32a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.095000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a1ea-2cec-4c0d-9c97-19e6b582f32a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.095278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703a1ea-2cec-4c0d-9c97-19e6b582f32a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/078c46f1897d41f49df116f19391ceff/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.099629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703a1ea-2cec-4c0d-9c97-19e6b582f32a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=078c46f1897d41f49df116f19391ceff)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:19.104237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703a1ea-2cec-4c0d-9c97-19e6b582f32a tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:19.138417 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2195/4414] 10.222.0.15 () {60 vars in 1581 bytes} [Tue Jul 19 11:30:18 2022] PUT /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/078c46f1897d41f49df116f19391ceff/inherited_to_projects => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:19.140062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.140992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.143193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.171457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2220/4415] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:18 2022] POST /identity/v3/projects => generated 397 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:19.174494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:19.218762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] MFA Rules not processed for user `aea630b7ee4f4a74be921e6786031819`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:19.222503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:19.256558 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:19.348376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b40c14e-5665-462d-b5b7-a84ce701d04c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:19.359287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:19.360096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.361318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.362531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.363529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Adding query filter params (scope.project.id=87b71beb0c0f4d3ea2e8c016078c1a2a, user.id=3b9d4c36086b46379542a6d2c3a2568d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:19.365891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:19.369605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:19.399421 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2196/4416] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:19.401134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:19.592793 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2221/4417] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:19 2022] GET /identity/v3/role_assignments?scope.project.id=87b71beb0c0f4d3ea2e8c016078c1a2a&user.id=3b9d4c36086b46379542a6d2c3a2568d&effective => generated 649 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:19.593868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:19.649186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc4dc5b-f668-4e97-8537-8112fbf08d5d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:19.658507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:19.658859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.659162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.659338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.660014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:19.662015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:19.736749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2197/4418] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:19 2022] POST /identity/v3/users => generated 299 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:19.740873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:19.753475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88635b2-99fa-494f-8212-ce165f8287fd tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:19.767357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771bc39-0ec8-40ce-8539-68930a972072 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:19.771946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:19.772671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.773021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.773304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.774020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:19.776585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:19.782211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:19.783494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:19.784491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:19.785656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/078c46f1897d41f49df116f19391ceff/inherited_to_projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:19.792911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=1cde6eaf8fa84dab9f9b0454a27b1900, user_id=3b9d4c36086b46379542a6d2c3a2568d, role_id=078c46f1897d41f49df116f19391ceff)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:19.802752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:19.818601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role 078c46f1897d41f49df116f19391ceff was removed from user 3b9d4c36086b46379542a6d2c3a2568d on project 1cde6eaf8fa84dab9f9b0454a27b1900. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:19.819278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:19.823508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:19.849087 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2198/4419] 10.222.0.15 () {58 vars in 1565 bytes} [Tue Jul 19 11:30:19 2022] DELETE /identity/v3/OS-INHERIT/projects/1cde6eaf8fa84dab9f9b0454a27b1900/users/3b9d4c36086b46379542a6d2c3a2568d/roles/078c46f1897d41f49df116f19391ceff/inherited_to_projects => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:19.850115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:19.853768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:19.874714 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2222/4420] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:19 2022] POST /identity/v3/projects => generated 375 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:19.876335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:19.883466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:19.907534 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:20.002171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb82da-110d-4c54-9401-0a59f72f96a7 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.029174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeca6362-c3be-4630-8921-13b5d37e75cd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.047116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.047116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.047116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.047626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.047626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Adding query filter params (scope.project.id=87b71beb0c0f4d3ea2e8c016078c1a2a, user.id=3b9d4c36086b46379542a6d2c3a2568d) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:20.047626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.048795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.079950 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:20.125468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2223/4421] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:19 2022] GET /identity/v3/role_assignments?scope.project.id=87b71beb0c0f4d3ea2e8c016078c1a2a&user.id=3b9d4c36086b46379542a6d2c3a2568d&effective => generated 228 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:20.126928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.132262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:20.148249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.149824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.149824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.149824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.150279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.154578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.175404 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2199/4422] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:19 2022] GET /identity/v3/roles => generated 1651 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:20.176587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.196294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8aba3-464f-4f9b-87c7-e858018d172a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.203857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.204713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.204993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.205269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/projects/87b71beb0c0f4d3ea2e8c016078c1a2a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.207280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_project(project_id=87b71beb0c0f4d3ea2e8c016078c1a2a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.211915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.299029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62532f2-3cbf-4e7a-857a-4c7186fab626 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.313910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87b71beb0c0f4d3ea2e8c016078c1a2a', 'request_id': 'req-eabc5db8-3720-4970-a4e7-9ed80589fa70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.325682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87b71beb0c0f4d3ea2e8c016078c1a2a', 'request_id': 'req-eabc5db8-3720-4970-a4e7-9ed80589fa70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.343579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87b71beb0c0f4d3ea2e8c016078c1a2a', 'request_id': 'req-eabc5db8-3720-4970-a4e7-9ed80589fa70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.371846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] The token cache is being invalidate because project 87b71beb0c0f4d3ea2e8c016078c1a2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:20.372776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.374286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.378775 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2200/4423] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:20 2022] DELETE /identity/v3/projects/87b71beb0c0f4d3ea2e8c016078c1a2a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:20.380650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.383309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:20.424239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.425399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.426096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.427091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.427972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.431831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.464287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2224/4424] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:20 2022] POST /identity/v3/users => generated 294 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:20.468972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.471845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:20.478557 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:20.508039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc5db8-3720-4970-a4e7-9ed80589fa70 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.520125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.520957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.521329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.522278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.523124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.524975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.540521 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2201/4425] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:20 2022] GET /identity/v3/roles => generated 1651 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:20.541510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.544663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:20.566746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ab9f5b-8bdf-4628-b65b-7a461e0bc7b9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.574852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.575882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.576177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.576840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.578572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.580207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.605308 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2202/4426] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:20 2022] GET /identity/v3/roles => generated 1651 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:20.606292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.625876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03541f93-4cdf-4389-98f0-9130803a61eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.631498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d1a3a6-4964-4a8f-a9bf-29f008158487 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.638557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.641790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.642085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.642955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/roles/078c46f1897d41f49df116f19391ceff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.645749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:20.646828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.647111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.648889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_role(role_id=078c46f1897d41f49df116f19391ceff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.650634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.652240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] PATH_INFO: `/v3/projects/86e0e7fefdd24498997da19ef4028da0/users/656d65af43be459e8be9eb597992dc04/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.683114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86e0e7fefdd24498997da19ef4028da0, user_id=656d65af43be459e8be9eb597992dc04, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:20.687034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:20.711187 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2203/4427] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:20 2022] PUT /identity/v3/projects/86e0e7fefdd24498997da19ef4028da0/users/656d65af43be459e8be9eb597992dc04/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:20.712744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:20.748016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invalidating the token cache because role 078c46f1897d41f49df116f19391ceff has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:20.749397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.755250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5774dbb3-6b47-4a0f-b71e-257955418cd5 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:20.764440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2225/4428] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:20 2022] DELETE /identity/v3/roles/078c46f1897d41f49df116f19391ceff => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:20.769265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:20.769879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:20.771455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:20.784533 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:20.839132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] MFA Rules not processed for user `656d65af43be459e8be9eb597992dc04`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:20.844080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:20.908109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30754128-0e58-452e-b7e4-7f501c3c1117 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:20.999549 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2226/4429] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:20 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:21.005256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.008840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:21.065110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:21.068774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:21.069909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:21.070449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] PATH_INFO: `/v3/projects/a64cb7b8b9e54827a05c161d31c13821/users/d0e7ffcc00014cbfb6c50782a9f7e359/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:21.112594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64cb7b8b9e54827a05c161d31c13821, user_id=d0e7ffcc00014cbfb6c50782a9f7e359, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:21.122241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:21.148580 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2204/4430] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:20 2022] PUT /identity/v3/projects/a64cb7b8b9e54827a05c161d31c13821/users/d0e7ffcc00014cbfb6c50782a9f7e359/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:21.149534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.153401 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:21.156936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:21.171882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fe63aa-0cf5-4f1e-b0ea-5a8b9c41db8c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:21.304874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda5063-96d5-4924-951e-72d97a3c7b79 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:21.318884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:21.319895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:21.320706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:21.321794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:21.322162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:21.322532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:21.323378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:21.323740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:21.324584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/users/3b9d4c36086b46379542a6d2c3a2568d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:21.329203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:21.330642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3b9d4c36086b46379542a6d2c3a2568d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:21.334665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:21.412146 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2205/4431] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:21 2022] POST /identity/v3/projects => generated 397 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:21.413240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.415248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:21.509475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b9d4c36086b46379542a6d2c3a2568d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:21.512456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b9d4c36086b46379542a6d2c3a2568d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:21.530586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b9d4c36086b46379542a6d2c3a2568d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:21.538303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b9d4c36086b46379542a6d2c3a2568d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:21.560858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b9d4c36086b46379542a6d2c3a2568d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:21.561665 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:21.603682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2227/4432] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:20 2022] DELETE /identity/v3/users/3b9d4c36086b46379542a6d2c3a2568d => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:21.604448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.608306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:21.628241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77be56-748c-4111-a1f1-7445cd5df3cb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:21.738352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:21.739062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:21.739428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:21.739800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:21.741488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:21.744761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:21.760673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb8bdc-817c-4c68-9b5d-941a721e2978 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:21.768677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2206/4433] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:21.770069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.772062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:21.783879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:21.787554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:21.788128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:21.789120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:21.790434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:21.797798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:21.849791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2228/4434] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:21 2022] POST /identity/v3/users => generated 305 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:21.850685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.852889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:21.875290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88196162-b31f-4308-a975-cd274a04dee6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:21.882502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:21.883443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:21.883730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:21.884010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] PATH_INFO: `/v3/projects/a64cb7b8b9e54827a05c161d31c13821/users/d0e7ffcc00014cbfb6c50782a9f7e359/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:21.886969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a64cb7b8b9e54827a05c161d31c13821, user_id=d0e7ffcc00014cbfb6c50782a9f7e359, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:21.889806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:21.899058 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:21.917717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2229/4435] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:21 2022] PUT /identity/v3/projects/a64cb7b8b9e54827a05c161d31c13821/users/d0e7ffcc00014cbfb6c50782a9f7e359/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:21.920112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:21.965585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899a86c-28aa-4a91-906c-bb493eadd3c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:22.070185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dd5c7-6aa3-43b0-a94d-842383745c52 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:22.089555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa100e-4306-4b30-b55f-d7387447de83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:22.090326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa100e-4306-4b30-b55f-d7387447de83 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:22.090599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa100e-4306-4b30-b55f-d7387447de83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:22.091044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa100e-4306-4b30-b55f-d7387447de83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:22.091848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa100e-4306-4b30-b55f-d7387447de83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:22.100606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa100e-4306-4b30-b55f-d7387447de83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:22.122604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:22.123523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:22.123817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:22.124163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/groups/b94fd7de79b945baaaf9769692296938` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:22.128137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_group(group_id=b94fd7de79b945baaaf9769692296938)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:22.130245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:22.152870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2230/4436] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:22.155641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:22.159760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:22.160807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:22.189442 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:22.241208 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2207/4437] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:30:21 2022] DELETE /identity/v3/groups/b94fd7de79b945baaaf9769692296938 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:22.242476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:22.283613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] MFA Rules not processed for user `d0e7ffcc00014cbfb6c50782a9f7e359`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:22.284957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:22.399457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9be950-dd11-4022-9b42-e3915f4be1d4 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:22.405496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:22.406916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:22.407786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:22.412632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] PATH_INFO: `/v3/projects/bd4d61e220384b55b2f2f4d8751568ff/users/a7e549d0616b4a138867e338f0eeeb7d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:22.461093 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2231/4438] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:22 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:22.464581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4d61e220384b55b2f2f4d8751568ff, user_id=a7e549d0616b4a138867e338f0eeeb7d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:22.464726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:22.464897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:22.515938 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2208/4439] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:22 2022] PUT /identity/v3/projects/bd4d61e220384b55b2f2f4d8751568ff/users/a7e549d0616b4a138867e338f0eeeb7d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:22.530557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:22.580569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a530d6-93cf-4ef1-8c7a-8cfccaeb15ff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:22.650124 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:22.729685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:22.730594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:22.730877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:22.731150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/projects/1cde6eaf8fa84dab9f9b0454a27b1900` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:22.736739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1cde6eaf8fa84dab9f9b0454a27b1900)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:22.738911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:22.759921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b41b30-3f26-489b-9f85-0a79363ce895 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:22.772107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:22.774204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:22.774523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:22.775024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:22.775829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:22.790058 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:22.790058 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:22.790058 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:22.792047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:22.865395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2209/4440] 10.222.0.15 () {60 vars in 1184 bytes} [Tue Jul 19 11:30:22 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:22.866632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:22.870223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cde6eaf8fa84dab9f9b0454a27b1900', 'request_id': 'req-7b3d5efd-012c-435d-b475-428876de0bd9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:22.882997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cde6eaf8fa84dab9f9b0454a27b1900', 'request_id': 'req-7b3d5efd-012c-435d-b475-428876de0bd9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:22.902232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cde6eaf8fa84dab9f9b0454a27b1900', 'request_id': 'req-7b3d5efd-012c-435d-b475-428876de0bd9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:22.939989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] The token cache is being invalidate because project 1cde6eaf8fa84dab9f9b0454a27b1900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:22.941098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:22.956441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:22.963543 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2232/4441] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:22 2022] DELETE /identity/v3/projects/1cde6eaf8fa84dab9f9b0454a27b1900 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:22.964891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:22.971431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:23.037681 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:23.063910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77426cd1-726e-42b2-8a86-9265df3bd83e tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:23.216810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d5efd-012c-435d-b475-428876de0bd9 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:23.252056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:23.252922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.253269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.253620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4e33354b1b7843c993e626afb226b9ad` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.254382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=4e33354b1b7843c993e626afb226b9ad)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:23.255421 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:23.255421 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:23.255421 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:23.260665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:23.264015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:23.266087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.266690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.267227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.268300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:23.271265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:23.283219 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2233/4442] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:30:22 2022] GET /identity/v3/OS-OAUTH1/consumers/4e33354b1b7843c993e626afb226b9ad => generated 220 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:23.284146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:23.288287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:23.304897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2210/4443] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 439 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:23.306138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:23.337216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8589cd5e-215d-4c39-9607-a72c23501818 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:23.352403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:23.361340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.361764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.362053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/4e33354b1b7843c993e626afb226b9ad` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.363949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=4e33354b1b7843c993e626afb226b9ad)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:23.366215 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:23.366215 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:23.366215 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:23.367424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:23.370321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invalidating token cache because consumer 4e33354b1b7843c993e626afb226b9ad has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:23.370640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.374573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.426980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '4e33354b1b7843c993e626afb226b9ad', 'request_id': 'req-5263512f-0311-4136-b6ee-2d0bd77e7729'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.459937 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:23.472980 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2211/4444] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:30:23 2022] DELETE /identity/v3/OS-OAUTH1/consumers/4e33354b1b7843c993e626afb226b9ad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:23.482473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:23.485400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d6105f-0e02-484e-8905-c11e79acb2a4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:23.489927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:23.508336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:23.513177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.516131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.516588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/domains/f3cd84c2dd36496db0064c3708f1eef7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.519640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=f3cd84c2dd36496db0064c3708f1eef7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:23.525771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:23.545592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5263512f-0311-4136-b6ee-2d0bd77e7729 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:23.561341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:23.562765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.563248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.563626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] PATH_INFO: `/v3/projects/bd4d61e220384b55b2f2f4d8751568ff/users/a7e549d0616b4a138867e338f0eeeb7d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.571136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4d61e220384b55b2f2f4d8751568ff, user_id=a7e549d0616b4a138867e338f0eeeb7d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:23.575188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:23.597509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.599498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.624059 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2212/4445] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:23 2022] PUT /identity/v3/projects/bd4d61e220384b55b2f2f4d8751568ff/users/a7e549d0616b4a138867e338f0eeeb7d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:23.625350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:23.629508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:23.672246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.673925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c48c7be0-d216-468a-80ee-c866901bcf0f tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:23.698977 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2234/4446] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:30:23 2022] PATCH /identity/v3/domains/f3cd84c2dd36496db0064c3708f1eef7 => generated 277 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:23.698977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.698977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.698977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.746627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] MFA Rules not processed for user `a7e549d0616b4a138867e338f0eeeb7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:23.748741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:23.782001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e063dd-93bc-4036-b3e3-230d6c857862 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:23.943226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2235/4447] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:23.945952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:23.948332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:23.949359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:23.949805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:23.950423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:23.951510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:23.955620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:23.963987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:23.990044 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2213/4448] 10.222.0.15 () {60 vars in 1184 bytes} [Tue Jul 19 11:30:23 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:23.991301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:23.994439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.001489 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:24.106242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2778e0-b4b6-49f7-ad25-cebf933db969 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.115651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656d65af43be459e8be9eb597992dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86e0e7fefdd24498997da19ef4028da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.116608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.117040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.117446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.118453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Jul 19 11:30:24.127251 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Jul 19 11:30:24.128573 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.134315 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2214/4449] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:23 2022] POST /identity/v3/projects => generated 136 bytes in 143 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:24.136047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.138589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.159492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f930c38-329c-4161-b8eb-a1eb055c4eff tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.165283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.168004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.180582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.181287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.182260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c8bb4260850b4deebec019a766614934)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.183179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbec30b-660f-4aa1-a59c-875b99a1bbf2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.185337 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:24.185337 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:24.185337 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:24.186642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.194378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fd6ff7444e3a46428bfb7528ec5879b0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '61cf20891d2d43e4999502f54afc708b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.197537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.199692 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2215/4450] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:30:24 2022] GET /identity/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934 => generated 221 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:24.200858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.201740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.202198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] PATH_INFO: `/v3/domains/f3cd84c2dd36496db0064c3708f1eef7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.217152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fee85e-7595-424e-a61d-9bb862189349 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.223869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e549d0616b4a138867e338f0eeeb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4d61e220384b55b2f2f4d8751568ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.224807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.225095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.225377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.226466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.229075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.233012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=f3cd84c2dd36496db0064c3708f1eef7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.234247 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:24.234247 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:24.234247 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:24.235750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invalid input for field 'name': '' is too short Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: '' Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise error Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application '' Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.251353 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:30:24.252957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application '' Jul 19 11:30:24.254270 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.257513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2216/4451] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:24 2022] POST /identity/v3/projects => generated 283 bytes in 57 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:30:24.258535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.273398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6287826e-387f-4a80-9196-018103932dbf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.277125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.287879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.293956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.298903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.299419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.299994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.301000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c8bb4260850b4deebec019a766614934)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.302822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.307896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invalidating token cache because consumer c8bb4260850b4deebec019a766614934 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:24.308421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.310225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.329895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c8bb4260850b4deebec019a766614934', 'request_id': 'req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.336712 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:24.374443 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2217/4452] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:30:24 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:24.375520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.377924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.399174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d429c51-6e1f-44c0-9ae6-7d76d311d4b4 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.402366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7', 'request_id': 'req-375f1785-aa0c-4b06-885f-5d4077f413b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.412227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7', 'request_id': 'req-375f1785-aa0c-4b06-885f-5d4077f413b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.424267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7', 'request_id': 'req-375f1785-aa0c-4b06-885f-5d4077f413b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.457728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] The token cache is being invalidate because project f3cd84c2dd36496db0064c3708f1eef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:24.458200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.459919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.506871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7', 'request_id': 'req-375f1785-aa0c-4b06-885f-5d4077f413b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.509131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7', 'request_id': 'req-375f1785-aa0c-4b06-885f-5d4077f413b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.517296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'f3cd84c2dd36496db0064c3708f1eef7', 'request_id': 'req-375f1785-aa0c-4b06-885f-5d4077f413b1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.538207 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2236/4453] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:30:23 2022] DELETE /identity/v3/domains/f3cd84c2dd36496db0064c3708f1eef7 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:24.539630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.541507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.550280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e549d0616b4a138867e338f0eeeb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4d61e220384b55b2f2f4d8751568ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.551507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.552024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.552561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.554805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.557308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise error Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:30:24.567992 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:24.569192 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 11:30:24.570234 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:24.582152 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2218/4454] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:24 2022] POST /identity/v3/projects => generated 412 bytes in 207 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:30:24.583771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.586568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.651373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375f1785-aa0c-4b06-885f-5d4077f413b1 tempest-InheritsV3TestJSON-268377404 tempest-InheritsV3TestJSON-268377404-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.670073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.671643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.672143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.672846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.674138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c8bb4260850b4deebec019a766614934)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.676926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.703177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30af90-5159-46b9-88e6-ff8380f3eabf tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.710815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.712043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.712451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.712841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] PATH_INFO: `/v3/users/00cf9fd1b0be435594ab915a8a2db17a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.714858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00cf9fd1b0be435594ab915a8a2db17a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Jul 19 11:30:24.717008 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 19 11:30:24.718125 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:24.719456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.722331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2237/4455] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:30:24 2022] GET /identity/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934 => generated 74 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:30:24.724179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.726911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.740240 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:24.780490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12256b6d-8e60-43f9-9829-e6692599c313 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.793953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e549d0616b4a138867e338f0eeeb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4d61e220384b55b2f2f4d8751568ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:24.799306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:24.799306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:24.799306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] PATH_INFO: `/v3/projects/45c2e178f6fb4a63a0565f34e431ec6a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:24.827511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00cf9fd1b0be435594ab915a8a2db17a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.835445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorizing `identity:delete_project(project_id=45c2e178f6fb4a63a0565f34e431ec6a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:24.838225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:24.845424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00cf9fd1b0be435594ab915a8a2db17a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Could not find project: 45c2e178f6fb4a63a0565f34e431ec6a.: keystone.exception.ProjectNotFound: Could not find project: 45c2e178f6fb4a63a0565f34e431ec6a. Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 19 11:30:24.874149 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 45c2e178f6fb4a63a0565f34e431ec6a. Jul 19 11:30:24.875236 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:24.877349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00cf9fd1b0be435594ab915a8a2db17a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.879333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00cf9fd1b0be435594ab915a8a2db17a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.882613 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2238/4456] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:24 2022] DELETE /identity/v3/projects/45c2e178f6fb4a63a0565f34e431ec6a => generated 113 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:24.884431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.887788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:24.898423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00cf9fd1b0be435594ab915a8a2db17a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:24.915611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24880c2b-a675-4225-8928-749dae63747c tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:24.916864 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2219/4457] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:24 2022] DELETE /identity/v3/users/00cf9fd1b0be435594ab915a8a2db17a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:24.921109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:24.922871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:25.083576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efbd56c-bf58-42f1-8f24-fb89e69754e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.102818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651a2d8a-0f78-43c1-a9aa-99ec10b96e4c tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '656d65af43be459e8be9eb597992dc04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86e0e7fefdd24498997da19ef4028da0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.104391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2d8a-0f78-43c1-a9aa-99ec10b96e4c tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.105534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2d8a-0f78-43c1-a9aa-99ec10b96e4c tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.106535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651a2d8a-0f78-43c1-a9aa-99ec10b96e4c tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.107091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.107941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651a2d8a-0f78-43c1-a9aa-99ec10b96e4c tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.108953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.112689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.113381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.114605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c8bb4260850b4deebec019a766614934)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.115813 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:25.115813 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:25.115813 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:25.118081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.120538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invalidating token cache because consumer c8bb4260850b4deebec019a766614934 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:25.121140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:25.123710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-651a2d8a-0f78-43c1-a9aa-99ec10b96e4c tempest-ProjectsNegativeStaticTestJSON-1577586565 tempest-ProjectsNegativeStaticTestJSON-1577586565-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Jul 19 11:30:25.136215 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._list_projects() Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Jul 19 11:30:25.137371 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:25.145246 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2220/4458] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:30:24 2022] GET /identity/v3/projects => generated 135 bytes in 228 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:25.146986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.147606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.148827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.199681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:25.202436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Jul 19 11:30:25.204998 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Jul 19 11:30:25.206108 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:25.209705 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2239/4459] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:30:24 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c8bb4260850b4deebec019a766614934 => generated 74 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:30:25.212303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.215702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:25.244255 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:25.439240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e149f42-e9d4-407c-a33b-cd99253055ae tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.447594 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2221/4460] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:25.449957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.451543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:25.457876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e549d0616b4a138867e338f0eeeb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4d61e220384b55b2f2f4d8751568ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.460518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.462692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.463035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.463883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.470687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.484375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5055ee28-e133-4716-b192-e3240995cfb1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.498464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.508955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.509358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.509737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.510607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.512445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.535578 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2222/4461] 10.222.0.15 () {60 vars in 1184 bytes} [Tue Jul 19 11:30:25 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:25.535578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.541293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:25.560721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2240/4462] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:25 2022] POST /identity/v3/projects => generated 357 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:25.562060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.603318 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:25.640830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caaf76-1428-4421-847f-484926e01c15 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.710976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e93bde-766f-4672-bf07-8eb9220668e7 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.716663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.717512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.717829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.718199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.719871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.721269 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:25.721269 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:25.721269 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:25.722264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.756692 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2241/4463] 10.222.0.15 () {60 vars in 1184 bytes} [Tue Jul 19 11:30:25 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:25.758921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.763575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.764284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.764581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.764869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.893650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.895663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.908443 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2223/4464] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:25.910223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.924644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b83896-f42c-4f60-ae63-bf7245f78964 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.931866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.932590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.932880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.933162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.933832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.935094 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:25.935094 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:25.935094 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:25.936156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.939290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96af761f-fc3b-43c4-8efe-8228647fbe16 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.943552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2224/4465] 10.222.0.15 () {58 vars in 1163 bytes} [Tue Jul 19 11:30:25 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 535 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:25.948583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:25.951410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e549d0616b4a138867e338f0eeeb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4d61e220384b55b2f2f4d8751568ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.953300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.953731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.954224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.955418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.958209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.961761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f42f5-5410-4445-8e14-31b65fe93302 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:25.967804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:25.969858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:25.969858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:25.970115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/cf409c175e5745f2b1ef0d9e09c56bf5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:25.971593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=cf409c175e5745f2b1ef0d9e09c56bf5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:25.973703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:25.974058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invalidating token cache because consumer cf409c175e5745f2b1ef0d9e09c56bf5 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:25.974416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:25.975249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:25.984566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.sql.core [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-157130271' for key 'project.ixu_project_name_domain_id'") Jul 19 11:30:25.984566 n-d-master-1 devstack@keystone.service[80581]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 11:30:25.984566 n-d-master-1 devstack@keystone.service[80581]: [parameters: {'id': '514084864b4b413f88eb0ba84a1d618b', 'name': 'tempest-project-dup-157130271', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 11:30:25.984566 n-d-master-1 devstack@keystone.service[80581]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80581) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-157130271, project id 514084864b4b413f88eb0ba84a1d618b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-157130271, project id 514084864b4b413f88eb0ba84a1d618b. Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 11:30:25.995357 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-157130271' for key 'project.ixu_project_name_domain_id'") Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 11:30:25.996566 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application yield resource Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application next(self.gen) Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise self.value Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 11:30:25.997911 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application session.commit() Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.session.flush() Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application compat.raise_( Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 11:30:25.999096 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 11:30:26.000418 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application conn.query(q) Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application result.read() Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 11:30:26.001542 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-157130271' for key 'project.ixu_project_name_domain_id'") Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [parameters: {'id': '514084864b4b413f88eb0ba84a1d618b', 'name': 'tempest-project-dup-157130271', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:26.002675 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-157130271 at domain ID default. Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:26.003687 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-157130271, project id 514084864b4b413f88eb0ba84a1d618b. Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2242/4466] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:25 2022] POST /identity/v3/projects => generated 284 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:30:26.005925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.007521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:26.007694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'cf409c175e5745f2b1ef0d9e09c56bf5', 'request_id': 'req-1c51bdcb-e599-4e8b-b986-399a754f8707'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.040109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63187cd4-b98c-4a38-aea8-75ffb24b0610 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.052201 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2225/4467] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:30:25 2022] DELETE /identity/v3/OS-OAUTH1/consumers/cf409c175e5745f2b1ef0d9e09c56bf5 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:26.055648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.055880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a7e549d0616b4a138867e338f0eeeb7d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bd4d61e220384b55b2f2f4d8751568ff', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.056766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.057625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.057625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] PATH_INFO: `/v3/projects/38a0a9ee20074f0fb79d292572b2c554` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.058911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorizing `identity:delete_project(project_id=38a0a9ee20074f0fb79d292572b2c554)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.062010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.063852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:26.072957 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:26.094298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51bdcb-e599-4e8b-b986-399a754f8707 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.100931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.101801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.102083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.102542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/79cc28396b594962ab7e8a8d76ed3554` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.104370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=79cc28396b594962ab7e8a8d76ed3554)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.106065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.106334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invalidating token cache because consumer 79cc28396b594962ab7e8a8d76ed3554 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:26.106613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.107446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.129878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '79cc28396b594962ab7e8a8d76ed3554', 'request_id': 'req-65263da6-0fe5-4009-bc1b-8e0c79299f75'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.164620 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2226/4468] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:30:26 2022] DELETE /identity/v3/OS-OAUTH1/consumers/79cc28396b594962ab7e8a8d76ed3554 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:26.168836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a0a9ee20074f0fb79d292572b2c554', 'request_id': 'req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.169918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.173492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:26.183389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a0a9ee20074f0fb79d292572b2c554', 'request_id': 'req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.194617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65263da6-0fe5-4009-bc1b-8e0c79299f75 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.197897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a0a9ee20074f0fb79d292572b2c554', 'request_id': 'req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.237585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] The token cache is being invalidate because project 38a0a9ee20074f0fb79d292572b2c554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:26.249457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.250438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.257537 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2243/4469] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:26 2022] DELETE /identity/v3/projects/38a0a9ee20074f0fb79d292572b2c554 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:26.264052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.279592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:26.338328 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:26.439493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.440372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.440616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.440897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.441740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.443319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.472569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2227/4470] 10.222.0.15 () {60 vars in 1184 bytes} [Tue Jul 19 11:30:26 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:26.473528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.475408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:26.492676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be27695-4537-41d3-a3c1-0906d434addd tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.511340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.514463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.515694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.515979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c689e96c7ae84e6ea6498bea13bb6eae` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.516781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=c689e96c7ae84e6ea6498bea13bb6eae)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.518298 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:26.518298 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:26.518298 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:26.522290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7d2527-6eaf-47f4-9fc6-8f6f834ac048 tempest-ProjectsNegativeStaticTestJSON-1806419758 tempest-ProjectsNegativeStaticTestJSON-1806419758-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.527293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.566023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.576217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.576582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.576876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] PATH_INFO: `/v3/users/656d65af43be459e8be9eb597992dc04` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.586763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] RBAC: Authorizing `identity:delete_user(user_id=656d65af43be459e8be9eb597992dc04)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.595108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.612569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2228/4471] 10.222.0.15 () {60 vars in 1284 bytes} [Tue Jul 19 11:30:26 2022] PATCH /identity/v3/OS-OAUTH1/consumers/c689e96c7ae84e6ea6498bea13bb6eae => generated 221 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:26.613837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.668832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b8fcf2-291d-402a-a5c2-f10cde52cd8c tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.705357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.706630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.706920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.707967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c689e96c7ae84e6ea6498bea13bb6eae` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.708900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=c689e96c7ae84e6ea6498bea13bb6eae)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.715537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.743037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2229/4472] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:30:26 2022] GET /identity/v3/OS-OAUTH1/consumers/c689e96c7ae84e6ea6498bea13bb6eae => generated 221 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:26.768379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.799121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '656d65af43be459e8be9eb597992dc04'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.802126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '656d65af43be459e8be9eb597992dc04'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.808307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a4d5f-aec5-45b6-a060-ee0379f95525 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.817057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd0e7ffcc00014cbfb6c50782a9f7e359', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64cb7b8b9e54827a05c161d31c13821', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:26.817992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.818290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.818617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/c689e96c7ae84e6ea6498bea13bb6eae` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.819451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=c689e96c7ae84e6ea6498bea13bb6eae)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:26.821612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '656d65af43be459e8be9eb597992dc04'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.822449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '656d65af43be459e8be9eb597992dc04'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.823666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:26.823950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invalidating token cache because consumer c689e96c7ae84e6ea6498bea13bb6eae has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:26.824598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.830125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.845029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87088673-ae23-4f56-a8d5-c2fce177988a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '656d65af43be459e8be9eb597992dc04'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.876918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'c689e96c7ae84e6ea6498bea13bb6eae', 'request_id': 'req-e095b236-21f8-4420-bf52-452e5914c011'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:26.903863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2230/4473] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:30:26 2022] DELETE /identity/v3/OS-OAUTH1/consumers/c689e96c7ae84e6ea6498bea13bb6eae => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:26.908908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:26.911102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:26.918691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2244/4474] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:26 2022] DELETE /identity/v3/users/656d65af43be459e8be9eb597992dc04 => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:26.923717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:26.924009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:26.924294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:26.952852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e095b236-21f8-4420-bf52-452e5914c011 tempest-OAUTHConsumersV3Test-856404989 tempest-OAUTHConsumersV3Test-856404989-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:26.999523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:27.004502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:27.048998 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:27.189133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:27.190300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:27.190300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:27.190652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] PATH_INFO: `/v3/users/aea630b7ee4f4a74be921e6786031819` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:27.191985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea630b7ee4f4a74be921e6786031819)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:27.194009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:27.233383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2245/4475] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:27.236033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:27.275630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:27.320136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea630b7ee4f4a74be921e6786031819'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.333379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa366f9e-0e66-4795-a8ba-8f1399aed971 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:27.340339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea630b7ee4f4a74be921e6786031819'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.355626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:27.356549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:27.356714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:27.357000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] PATH_INFO: `/v3/users/b70a43fcc1af4115b466fb2c94ae2303` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:27.364261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b70a43fcc1af4115b466fb2c94ae2303)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:27.365464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:27.393887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea630b7ee4f4a74be921e6786031819'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.393887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea630b7ee4f4a74be921e6786031819'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.411841 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=12 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:27.422717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea630b7ee4f4a74be921e6786031819'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.454148 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2231/4476] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:26 2022] DELETE /identity/v3/users/aea630b7ee4f4a74be921e6786031819 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:27.457343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:27.461903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:27.521556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b70a43fcc1af4115b466fb2c94ae2303'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.524796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b70a43fcc1af4115b466fb2c94ae2303'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.558237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b70a43fcc1af4115b466fb2c94ae2303'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.564119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b70a43fcc1af4115b466fb2c94ae2303'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.597229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f31a38e-fb06-4ea6-9c46-ef717435132f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b70a43fcc1af4115b466fb2c94ae2303'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:27.731980 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2246/4477] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:27 2022] DELETE /identity/v3/users/b70a43fcc1af4115b466fb2c94ae2303 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:27.734377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:27.734999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:27.735296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:27.765634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751f7cb-c876-4ccf-bed1-81dc81c121b0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:27.819531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:27.820883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:27.919053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:27.921446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:27.923204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:27.923698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:27.964781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:28.049448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2247/4478] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:28.136074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:28.141306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:28.222081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029fb9bf-339e-4c83-8238-6992f0636aa2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:28.236297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:28.237506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:28.238019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:28.239412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:28.272708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:28.275846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:28.277704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:28.279361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:28.291600 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2248/4479] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:28.317929 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2232/4480] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 863 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:29.855481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:29.858574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:29.887095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90833eb6-9a45-4603-875d-a1c460e95336 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:29.903186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:29.904552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:29.905156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:29.905614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] PATH_INFO: `/v3/projects/50976400d1f44ac5b513db26bc19ac60` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:29.909097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=50976400d1f44ac5b513db26bc19ac60)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:29.925059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:29.946589 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:30.039912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50976400d1f44ac5b513db26bc19ac60', 'request_id': 'req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.051495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50976400d1f44ac5b513db26bc19ac60', 'request_id': 'req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.063632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50976400d1f44ac5b513db26bc19ac60', 'request_id': 'req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.101939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] The token cache is being invalidate because project 50976400d1f44ac5b513db26bc19ac60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:30.102399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.104608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.112280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:30.114020 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2249/4481] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:29 2022] DELETE /identity/v3/projects/50976400d1f44ac5b513db26bc19ac60 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:30.129587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d5f76a-c5e3-4e95-805d-8bebf892c27f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:30.263514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:30.264829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:30.265152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:30.265469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] PATH_INFO: `/v3/users/6b55d40fdca647f6b71025469def6742` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:30.269533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b55d40fdca647f6b71025469def6742)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:30.273212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:30.276313 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:30.301065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:30.306068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:30.337764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d78f7-8750-44cb-8bfc-7a628cc045ab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:30.355014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:30.356102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:30.356484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:30.356842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] PATH_INFO: `/v3/projects/24222cfbdaa14e69bc1acc96f341bfd1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:30.359639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24222cfbdaa14e69bc1acc96f341bfd1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:30.363212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:30.435134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b55d40fdca647f6b71025469def6742'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.455304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b55d40fdca647f6b71025469def6742'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.484994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b55d40fdca647f6b71025469def6742'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.486368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b55d40fdca647f6b71025469def6742'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.508874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b55d40fdca647f6b71025469def6742'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.521917 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2233/4482] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:30 2022] DELETE /identity/v3/users/6b55d40fdca647f6b71025469def6742 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:30.525767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24222cfbdaa14e69bc1acc96f341bfd1', 'request_id': 'req-5ccee726-c421-4286-a3de-a84ceb2c3c52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.542337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24222cfbdaa14e69bc1acc96f341bfd1', 'request_id': 'req-5ccee726-c421-4286-a3de-a84ceb2c3c52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.556641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24222cfbdaa14e69bc1acc96f341bfd1', 'request_id': 'req-5ccee726-c421-4286-a3de-a84ceb2c3c52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.577168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] The token cache is being invalidate because project 24222cfbdaa14e69bc1acc96f341bfd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:30.577489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.579524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:30.588080 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2250/4483] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:30 2022] DELETE /identity/v3/projects/24222cfbdaa14e69bc1acc96f341bfd1 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:30.592212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:30.594626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:30.807667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ce4c6-6411-4074-8cd6-4e15872b9919 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:30.834509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:30.835550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:30.835891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:30.836905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] PATH_INFO: `/v3/users/fd6ff7444e3a46428bfb7528ec5879b0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:30.841341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd6ff7444e3a46428bfb7528ec5879b0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:30.844859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:30.971774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:30.974165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:31.014260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd6ff7444e3a46428bfb7528ec5879b0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.041370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd6ff7444e3a46428bfb7528ec5879b0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.115744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd6ff7444e3a46428bfb7528ec5879b0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.116807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd6ff7444e3a46428bfb7528ec5879b0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.138816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd6ff7444e3a46428bfb7528ec5879b0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.141676 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:31.159537 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2234/4484] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:30 2022] DELETE /identity/v3/users/fd6ff7444e3a46428bfb7528ec5879b0 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:31.193515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccee726-c421-4286-a3de-a84ceb2c3c52 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:31.288604 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:31.345660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:31.347694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:31.399645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:31.401048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:31.401767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:31.402057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] PATH_INFO: `/v3/projects/78e6d6f33d504eeea88402dcd043a4ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:31.407045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e6d6f33d504eeea88402dcd043a4ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:31.413427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:31.524670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693fba4f-6f29-4c7c-959c-01fb35630373 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:31.550083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e6d6f33d504eeea88402dcd043a4ee', 'request_id': 'req-25268f94-7c41-4a74-87f3-46cd7038aa4a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.565811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e6d6f33d504eeea88402dcd043a4ee', 'request_id': 'req-25268f94-7c41-4a74-87f3-46cd7038aa4a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.586218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e6d6f33d504eeea88402dcd043a4ee', 'request_id': 'req-25268f94-7c41-4a74-87f3-46cd7038aa4a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.605841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] The token cache is being invalidate because project 78e6d6f33d504eeea88402dcd043a4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:31.606383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.609734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.611686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2251/4485] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:30 2022] DELETE /identity/v3/projects/78e6d6f33d504eeea88402dcd043a4ee => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:31.615964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:31.617626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:31.667147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:31.667804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:31.668092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:31.668411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] PATH_INFO: `/v3/projects/86e0e7fefdd24498997da19ef4028da0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:31.669681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] RBAC: Authorizing `identity:delete_project(project_id=86e0e7fefdd24498997da19ef4028da0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:31.671831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:31.767881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25268f94-7c41-4a74-87f3-46cd7038aa4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:31.785836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86e0e7fefdd24498997da19ef4028da0', 'request_id': 'req-fbf67632-9b4f-4f94-b128-477cfa63890b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.803219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86e0e7fefdd24498997da19ef4028da0', 'request_id': 'req-fbf67632-9b4f-4f94-b128-477cfa63890b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.823314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86e0e7fefdd24498997da19ef4028da0', 'request_id': 'req-fbf67632-9b4f-4f94-b128-477cfa63890b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.849818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] The token cache is being invalidate because project 86e0e7fefdd24498997da19ef4028da0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:31.850114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.853722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:31.860542 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2235/4486] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:31 2022] DELETE /identity/v3/projects/86e0e7fefdd24498997da19ef4028da0 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:31.864677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:31.866208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:31.894229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:31.895742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:31.897384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:31.898239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] PATH_INFO: `/v3/users/d0e7ffcc00014cbfb6c50782a9f7e359` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:31.901636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e7ffcc00014cbfb6c50782a9f7e359)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:31.906006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:31.923399 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:31.997024 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:32.074809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e7ffcc00014cbfb6c50782a9f7e359'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.081460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e7ffcc00014cbfb6c50782a9f7e359'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.114257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e7ffcc00014cbfb6c50782a9f7e359'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.116569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e7ffcc00014cbfb6c50782a9f7e359'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.138359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf67632-9b4f-4f94-b128-477cfa63890b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:32.141663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e7ffcc00014cbfb6c50782a9f7e359'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.151624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:32.157256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:32.158961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:32.159482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] PATH_INFO: `/v3/users/a7e549d0616b4a138867e338f0eeeb7d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:32.162611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7e549d0616b4a138867e338f0eeeb7d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:32.168303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:32.199958 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2252/4487] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:31 2022] DELETE /identity/v3/users/d0e7ffcc00014cbfb6c50782a9f7e359 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:32.202506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:32.221683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:32.398814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7e549d0616b4a138867e338f0eeeb7d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.424855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7e549d0616b4a138867e338f0eeeb7d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.448527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7e549d0616b4a138867e338f0eeeb7d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.449293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7e549d0616b4a138867e338f0eeeb7d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.462313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8c7bc935-2329-46b9-aeff-0584a9618fb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7e549d0616b4a138867e338f0eeeb7d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.471073 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2236/4488] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:31 2022] DELETE /identity/v3/users/a7e549d0616b4a138867e338f0eeeb7d => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:32.556218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1ea6a-3f86-4377-b9e6-6e454ddfd3f3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:32.710358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:32.713071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:32.715386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:32.715991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] PATH_INFO: `/v3/projects/13b0cedfc7424b55ba495d5edb198758` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:32.717727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b0cedfc7424b55ba495d5edb198758)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:32.720937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:32.825367 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:32.870278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b0cedfc7424b55ba495d5edb198758', 'request_id': 'req-a8644792-9862-437e-a0f0-03f0b67397e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.886920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b0cedfc7424b55ba495d5edb198758', 'request_id': 'req-a8644792-9862-437e-a0f0-03f0b67397e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.902264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b0cedfc7424b55ba495d5edb198758', 'request_id': 'req-a8644792-9862-437e-a0f0-03f0b67397e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.936127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] The token cache is being invalidate because project 13b0cedfc7424b55ba495d5edb198758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:32.936592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.937563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a8644792-9862-437e-a0f0-03f0b67397e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:32.946013 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2253/4489] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:32 2022] DELETE /identity/v3/projects/13b0cedfc7424b55ba495d5edb198758 => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:32.950158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:32.950759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:32.951247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:33.002467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:33.004804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:33.209168 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2237/4490] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:33.213894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:33.214741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:33.216155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:33.302596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:33.304277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:33.320451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:33.322713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2254/4491] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:33.347637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f2f98-45cb-423b-b62e-7e3ff0c0b6a1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:33.363202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:33.366828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:33.367414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:33.367414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:33.368394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:33.368712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:33.370433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:33.397356 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2238/4492] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:33.404241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:33.417951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04ec71-d1f1-4f3e-8a8f-c43db37159a3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:33.439814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:33.439814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:33.439814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:33.439814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:33.441120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:33.442473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:33.443467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:33.446708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:33.468667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc00df7-bde1-4f5b-821c-c1cd3c4f13dc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:33.480578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:33.482538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:33.482768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:33.485236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] PATH_INFO: `/v3/projects/61cf20891d2d43e4999502f54afc708b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:33.490164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61cf20891d2d43e4999502f54afc708b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:33.496204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:33.550445 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2255/4493] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:33 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:33.556449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:33.681130 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:33.712096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61cf20891d2d43e4999502f54afc708b', 'request_id': 'req-3264a799-deb7-44e6-862b-1da0a3bb9da5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:33.733969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61cf20891d2d43e4999502f54afc708b', 'request_id': 'req-3264a799-deb7-44e6-862b-1da0a3bb9da5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:33.774529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61cf20891d2d43e4999502f54afc708b', 'request_id': 'req-3264a799-deb7-44e6-862b-1da0a3bb9da5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:33.840734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] The token cache is being invalidate because project 61cf20891d2d43e4999502f54afc708b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:33.842438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:33.844732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3264a799-deb7-44e6-862b-1da0a3bb9da5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:33.852479 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2239/4494] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:33 2022] DELETE /identity/v3/projects/61cf20891d2d43e4999502f54afc708b => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:33.865922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5af19-4008-4c43-a1ea-e7da3ee77c1e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:33.878345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5af19-4008-4c43-a1ea-e7da3ee77c1e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:33.878628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee5af19-4008-4c43-a1ea-e7da3ee77c1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:33.886720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1babdca-282e-4b23-a6da-e25e696f3dfb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:33.976631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3ee5af19-4008-4c43-a1ea-e7da3ee77c1e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:33.993205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ee5af19-4008-4c43-a1ea-e7da3ee77c1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:34.218306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:34.220956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.224217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.253230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.257494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:34.260121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:34.376567 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2240/4495] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:34.387415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.387797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.388207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.392233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2256/4496] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:33 2022] POST /identity/v3/users => generated 296 bytes in 836 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:34.393804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:34.400062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:34.433164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1263399-e57f-4a2c-8a31-0b71b94e8b89 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:34.440424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:34.441389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.442143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.442580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.444325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:34.446143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:34.497656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:34.500295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:34.503632 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2257/4497] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:34.508667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:34.527742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd952e2-9a75-4c0d-8eda-6280ef025e56 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:34.536207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2241/4498] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:34.537619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:34.542074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:34.542774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.543116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.544055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.555315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:34.557749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:34.565594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff3459-9c63-427c-886c-871fe831b2ec None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:34.598978 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2258/4499] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:34.602459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:34.603771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:34.603771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.604381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.606915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.607838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:34.608145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:34.616964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:34.632299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123ff63-5576-473e-a26b-b0e42afe8233 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:34.665818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:34.667157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.667581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.668086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] PATH_INFO: `/v3/projects/3c2d4d40948b478e80da6a8c4591ae4b/users/ec8e9dbd170a4e829e1edadbaf3c2164/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.672413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2242/4500] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:34.679605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:34.697314 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:34.724841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b43489-0b96-47aa-b3ae-073c7729d19d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:34.756662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42805c5-f672-4254-ad7b-d35bcba76fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:34.760206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42805c5-f672-4254-ad7b-d35bcba76fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.763718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42805c5-f672-4254-ad7b-d35bcba76fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.764650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42805c5-f672-4254-ad7b-d35bcba76fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.766729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c2d4d40948b478e80da6a8c4591ae4b, user_id=ec8e9dbd170a4e829e1edadbaf3c2164, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:34.769121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42805c5-f672-4254-ad7b-d35bcba76fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:34.778258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42805c5-f672-4254-ad7b-d35bcba76fd3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:34.782237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:34.869649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2259/4501] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:34 2022] PUT /identity/v3/projects/3c2d4d40948b478e80da6a8c4591ae4b/users/ec8e9dbd170a4e829e1edadbaf3c2164/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:34.874358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:34.885610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:34.901227 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2243/4502] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:34 2022] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:34.902591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:34.903037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:34.903540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:34.998510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:35.022669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:35.294052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a45b1f-519e-43ef-ad85-024828913b8c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:35.343233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2244/4503] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:35.343233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:35.383547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbd3ac-ef08-41e0-9f84-d089abf7903d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:35.417380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:35.418358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:35.421845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:35.423682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:35.424934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:35.431487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:35.511050 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2245/4504] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:35 2022] POST /identity/v3/users => generated 284 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:35.511561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:35.519827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:35.538867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:35.539812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:35.540100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:35.540607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] PATH_INFO: `/v3/projects/a64cb7b8b9e54827a05c161d31c13821` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:35.542086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a64cb7b8b9e54827a05c161d31c13821)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:35.544703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:35.569358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e334a-f165-48cb-9706-cc738ce28240 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:35.592024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:35.593517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:35.603457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:35.604122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] PATH_INFO: `/v3/projects/bd4d61e220384b55b2f2f4d8751568ff` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:35.611327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4d61e220384b55b2f2f4d8751568ff)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:35.616885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:35.620457 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:35.647717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a64cb7b8b9e54827a05c161d31c13821', 'request_id': 'req-003bc89e-15af-4f52-a871-82f8f44775d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.662884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a64cb7b8b9e54827a05c161d31c13821', 'request_id': 'req-003bc89e-15af-4f52-a871-82f8f44775d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.673910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a64cb7b8b9e54827a05c161d31c13821', 'request_id': 'req-003bc89e-15af-4f52-a871-82f8f44775d0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.701797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] The token cache is being invalidate because project a64cb7b8b9e54827a05c161d31c13821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:35.702985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.705798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-003bc89e-15af-4f52-a871-82f8f44775d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.709727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2260/4505] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:34 2022] DELETE /identity/v3/projects/a64cb7b8b9e54827a05c161d31c13821 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:35.712438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:35.713448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:35.713915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:35.771642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4d61e220384b55b2f2f4d8751568ff', 'request_id': 'req-dbd296c1-e054-424c-82f1-2ffbb8468201'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.775099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] MFA Rules not processed for user `f35d623b786740f08b362ad2e393a042`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:35.778118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:35.795020 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:35.807796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4d61e220384b55b2f2f4d8751568ff', 'request_id': 'req-dbd296c1-e054-424c-82f1-2ffbb8468201'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.823053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4d61e220384b55b2f2f4d8751568ff', 'request_id': 'req-dbd296c1-e054-424c-82f1-2ffbb8468201'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.850113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] The token cache is being invalidate because project bd4d61e220384b55b2f2f4d8751568ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:35.850582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.855290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:35.860632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2246/4506] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:35 2022] DELETE /identity/v3/projects/bd4d61e220384b55b2f2f4d8751568ff => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:35.862498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:35.865361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:35.923312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2261/4507] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:35.923662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:35.925283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.027015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd296c1-e054-424c-82f1-2ffbb8468201 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.037158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.038082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.038682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.039065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.045702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f8152-297b-4050-8e43-2a471ed463a8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.050865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb45278-3578-40fd-9774-46c551452419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.051579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb45278-3578-40fd-9774-46c551452419 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.051864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb45278-3578-40fd-9774-46c551452419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.052143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb45278-3578-40fd-9774-46c551452419 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.053051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb45278-3578-40fd-9774-46c551452419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.055422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb45278-3578-40fd-9774-46c551452419 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.070317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.088002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2262/4508] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:36.088002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1610-8fd9-4ddd-912f-f07ae97f88f0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.088002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1610-8fd9-4ddd-912f-f07ae97f88f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.088002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da1610-8fd9-4ddd-912f-f07ae97f88f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.103367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.105062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d66c84-7f25-4e80-bbd6-0f697b049ebc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.137621 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2247/4509] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:36.139122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153add-fabf-4239-a1c6-7571a5573a32 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.139443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153add-fabf-4239-a1c6-7571a5573a32 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.139728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e153add-fabf-4239-a1c6-7571a5573a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.154683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2da1610-8fd9-4ddd-912f-f07ae97f88f0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:36.157418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2da1610-8fd9-4ddd-912f-f07ae97f88f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.176771 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2263/4510] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:36.176771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.176771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.176771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.197770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] MFA Rules not processed for user `f35d623b786740f08b362ad2e393a042`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:36.198239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9e153add-fabf-4239-a1c6-7571a5573a32 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:36.199028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.199540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9e153add-fabf-4239-a1c6-7571a5573a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.225074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2264/4511] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:36.226628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:36.229022 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2248/4512] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:36.230471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecc0f-25ba-4129-b48a-5dfdf5b35629 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.230757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecc0f-25ba-4129-b48a-5dfdf5b35629 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.231031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940ecc0f-25ba-4129-b48a-5dfdf5b35629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.252015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee39da-0bbf-47aa-9860-9aebffbe60c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.272705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.275767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.276882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.279272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.281537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-940ecc0f-25ba-4129-b48a-5dfdf5b35629 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:36.282475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.282726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-940ecc0f-25ba-4129-b48a-5dfdf5b35629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.288847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.314558 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2249/4513] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:36.314558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.314558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.314558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.332902 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2265/4514] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:36 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:36.335362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:36.339363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.359204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:36.361070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:36.374039 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2250/4515] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:36.375169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:36.392258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394e3a3-ab35-40da-bd39-01de7ab1c312 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.405670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.406381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.406953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.407244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.409184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:36.409495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.414703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.447903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2251/4516] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:36.449896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:36.482707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a233e5ab-3f49-401d-9579-8c486849d4f7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.493016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.494238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.494852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.495437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] PATH_INFO: `/v3/projects/c039a1fe3f094caf8c39592fa84bab16/users/7a0b03d6a40a46a1ac1d0a269614e9eb/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.537365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c039a1fe3f094caf8c39592fa84bab16, user_id=7a0b03d6a40a46a1ac1d0a269614e9eb, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.543767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.582014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2ad52-8491-4e41-8252-bd260150f98e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.589847 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2252/4517] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:36 2022] PUT /identity/v3/projects/c039a1fe3f094caf8c39592fa84bab16/users/7a0b03d6a40a46a1ac1d0a269614e9eb/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:36.589847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:36.626108 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:36.748861 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:36.775166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b35f1b-129d-4bb3-b423-2e7c330e07dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.775856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35f1b-129d-4bb3-b423-2e7c330e07dc service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.776135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35f1b-129d-4bb3-b423-2e7c330e07dc service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.776432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b35f1b-129d-4bb3-b423-2e7c330e07dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.818866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a250010-eb4f-4c42-b2fe-7312c744c45c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.837223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.837926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.838242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.842851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.843687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:36.844013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.845780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.878481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2253/4518] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:36.879756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:36.901374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f911608-17e8-4101-aa9f-e0683ec5d20a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:36.907613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67327652-f569-4014-b5fa-08e22af39f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:36.908093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327652-f569-4014-b5fa-08e22af39f3d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.908465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327652-f569-4014-b5fa-08e22af39f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.908753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327652-f569-4014-b5fa-08e22af39f3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.909476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67327652-f569-4014-b5fa-08e22af39f3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.911734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67327652-f569-4014-b5fa-08e22af39f3d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.939528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35f1b-129d-4bb3-b423-2e7c330e07dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:36.943829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b35f1b-129d-4bb3-b423-2e7c330e07dc service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:36.964528 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2266/4519] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:36.967340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:36.967606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:36.967873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:36.994032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2254/4520] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:37.009263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:37.010923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:37.011347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:37.036718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] MFA Rules not processed for user `7a0b03d6a40a46a1ac1d0a269614e9eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:37.038237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:37.063589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] MFA Rules not processed for user `58785d156c0c4c76ab6c607f98d120d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:37.067537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:37.229587 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2267/4521] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:37.232384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:37.336455 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2255/4522] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:37.338422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:37.429352 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:37.471086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd9a9c-52be-4626-88c4-11c2625a01b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:37.482334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:37.482835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:37.482975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:37.483330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:37.483848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:37.493102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:37.503180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa955515-6ef4-4180-8754-4efab8dfe3d9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:37.520297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:37.522812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:37.523125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:37.523403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:37.524152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:37.526240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:37.569481 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2268/4523] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:37 2022] POST /identity/v3/projects => generated 379 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:37.571735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:37.596149 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2256/4524] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:37 2022] POST /identity/v3/users => generated 284 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:37.597802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:37.632812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18363b10-99ee-4c00-a30a-733f97e51601 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:37.739706 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:37.786186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f467b-0c28-4719-9ab7-508b171cc323 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:37.793083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:37.793793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:37.794127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:37.794346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:37.795061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:37.797091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:37.818192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:37.819031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:37.819310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:37.819585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:37.820296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:37.822347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:37.859319 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2257/4525] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:37 2022] POST /identity/v3/users => generated 290 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:37.861352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:37.890636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb2460e-a6b1-4377-9b46-2015fcf92d1b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:37.892471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2269/4526] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:37 2022] POST /identity/v3/projects => generated 367 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:37.894479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.084601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.085621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.085890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.086218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.086974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.089184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.105027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85373d5d-36e0-4b3e-813b-d6f546934393 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.118186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.119082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.119382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.119698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.120402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.122163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.125002 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2258/4527] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:38.127024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.150333 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2270/4528] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:37 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:38.154090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10b6c8e-d099-4639-895d-a1cab90aaaed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.154814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.165572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.168001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.172000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.175310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.176214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.182319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.195419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77656c-4c0b-4c09-9935-e70c3b79e799 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.217218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.217927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.218244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.218480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.219240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.224392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.231093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2259/4529] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:38 2022] POST /identity/v3/users => generated 290 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:38.232032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.260065 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2271/4530] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:38.260276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f9c97c-49da-494c-951e-d8dcd841d1b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.260831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.280031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.280612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.280747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.280947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.281732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.283611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.284254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd481437-9a16-47ae-ad49-bb43d1628a0b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.298630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.303578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.303903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.304186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.305040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.317076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.332643 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2260/4531] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:38.333609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.355453 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2272/4532] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:38.358324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcbb81b-fadf-48bb-a98a-9a2782e6efca admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.360215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.373173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57c5e4-a2e3-47f2-9fa2-050c5b56bec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.374192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c5e4-a2e3-47f2-9fa2-050c5b56bec1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.374498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c5e4-a2e3-47f2-9fa2-050c5b56bec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.374789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57c5e4-a2e3-47f2-9fa2-050c5b56bec1 admin admin] PATH_INFO: `/v3/projects/873f1dd08d0e4786b3658c9fe37fed67/users/ed39ab7c866147e28c7c8d5cd91200a2/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.391230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d9859-35ad-48e1-abc4-9e645f388453 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.409168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.410490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.411049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.411565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] PATH_INFO: `/v3/projects/c40a8ca78bba404e9bea8dfe610ef7b8/users/8b3ceb681ae84c38b43ee007004eeb41/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.442133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57c5e4-a2e3-47f2-9fa2-050c5b56bec1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=873f1dd08d0e4786b3658c9fe37fed67, user_id=ed39ab7c866147e28c7c8d5cd91200a2, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.447285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c57c5e4-a2e3-47f2-9fa2-050c5b56bec1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.454373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c40a8ca78bba404e9bea8dfe610ef7b8, user_id=8b3ceb681ae84c38b43ee007004eeb41, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.455710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.494137 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2273/4534] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:38 2022] PUT /identity/v3/projects/c40a8ca78bba404e9bea8dfe610ef7b8/users/8b3ceb681ae84c38b43ee007004eeb41/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:38.494137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.494410 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2261/4534] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:38 2022] PUT /identity/v3/projects/873f1dd08d0e4786b3658c9fe37fed67/users/ed39ab7c866147e28c7c8d5cd91200a2/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:38.494410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5fbbe-f717-4ad6-8965-1ee4c3e2c90b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.494410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5fbbe-f717-4ad6-8965-1ee4c3e2c90b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.494410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5fbbe-f717-4ad6-8965-1ee4c3e2c90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.512533 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:38.556398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fdc5fbbe-f717-4ad6-8965-1ee4c3e2c90b None None] MFA Rules not processed for user `ed39ab7c866147e28c7c8d5cd91200a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:38.557889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fdc5fbbe-f717-4ad6-8965-1ee4c3e2c90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:38.681605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54432699-e5b8-4f60-9342-a30b84207365 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:38.694358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:38.696895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.698498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.699260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] PATH_INFO: `/v3/projects/612530c7f21c4491be307cc54f792e2c/users/f8397348bfd348b286a8db2aa904ceda/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.737770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612530c7f21c4491be307cc54f792e2c, user_id=f8397348bfd348b286a8db2aa904ceda, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:38.740115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:38.759462 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2262/4535] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:38 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:38.772782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:38.773100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:38.773383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:38.787736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2274/4536] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:38 2022] PUT /identity/v3/projects/612530c7f21c4491be307cc54f792e2c/users/f8397348bfd348b286a8db2aa904ceda/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:38.790350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:38.810233 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:38.883887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] MFA Rules not processed for user `8b3ceb681ae84c38b43ee007004eeb41`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:38.885912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:39.095884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1423d216-75b7-4e51-af71-b9aec8c31894 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:39.136656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:39.144229 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2263/4537] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:39.146361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:39.152629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:39.156669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:39.157339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:39.174663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:39.183148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:39.196591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cde611-8e2b-4abf-8268-d732753e9bbb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:39.210940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:39.212567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:39.214772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:39.215626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:39.218101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:39.232411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:39.288100 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2264/4538] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:39 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:39.290099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:39.308471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2275/4539] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:38 2022] POST /identity/v3/projects => generated 367 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:39.308471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:39.332430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743620e6-66bf-42bd-923b-2fb42d63350e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:39.505344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357e229-a881-4398-aceb-7a397fac6ecf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:39.538707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:39.543215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:39.543517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:39.543803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] PATH_INFO: `/v3/projects/612530c7f21c4491be307cc54f792e2c/users/f8397348bfd348b286a8db2aa904ceda/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:39.551444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=612530c7f21c4491be307cc54f792e2c, user_id=f8397348bfd348b286a8db2aa904ceda, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:39.561917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:39.606546 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2276/4540] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:39 2022] PUT /identity/v3/projects/612530c7f21c4491be307cc54f792e2c/users/f8397348bfd348b286a8db2aa904ceda/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:39.612229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:39.663272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b019d21-a42e-4521-9af1-2615bae847d0 tempest-DefaultDomainTestJSON-1622057022 tempest-DefaultDomainTestJSON-1622057022-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8b3ceb681ae84c38b43ee007004eeb41', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c40a8ca78bba404e9bea8dfe610ef7b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:39.665548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019d21-a42e-4521-9af1-2615bae847d0 tempest-DefaultDomainTestJSON-1622057022 tempest-DefaultDomainTestJSON-1622057022-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:39.666163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019d21-a42e-4521-9af1-2615bae847d0 tempest-DefaultDomainTestJSON-1622057022 tempest-DefaultDomainTestJSON-1622057022-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:39.666755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b019d21-a42e-4521-9af1-2615bae847d0 tempest-DefaultDomainTestJSON-1622057022 tempest-DefaultDomainTestJSON-1622057022-project] PATH_INFO: `/v3/domains/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:39.671322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b019d21-a42e-4521-9af1-2615bae847d0 tempest-DefaultDomainTestJSON-1622057022 tempest-DefaultDomainTestJSON-1622057022-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:39.677292 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:39.685256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b019d21-a42e-4521-9af1-2615bae847d0 tempest-DefaultDomainTestJSON-1622057022 tempest-DefaultDomainTestJSON-1622057022-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:39.689103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2265/4541] 10.222.0.15 () {58 vars in 1151 bytes} [Tue Jul 19 11:30:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:39.699580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4d96-a026-4e9f-905b-7dc68db82d1a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:39.700126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4d96-a026-4e9f-905b-7dc68db82d1a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:39.702199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a4d96-a026-4e9f-905b-7dc68db82d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:39.855249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a81a4d96-a026-4e9f-905b-7dc68db82d1a None None] MFA Rules not processed for user `f8397348bfd348b286a8db2aa904ceda`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:39.861966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a81a4d96-a026-4e9f-905b-7dc68db82d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:39.867541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9fd29-d69f-4984-a952-8ab943b9a524 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:39.888144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:39.889087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:39.889442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:39.890213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:39.893787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:39.897338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:39.955677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2277/4542] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:39 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:39.963354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:39.991568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4154d-c6d4-44f8-8284-4a07961b0c82 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:40.016774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:40.018102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:40.018546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:40.019454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] PATH_INFO: `/v3/users/8b3ceb681ae84c38b43ee007004eeb41` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:40.023702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3ceb681ae84c38b43ee007004eeb41)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:40.026051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:40.175477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3ceb681ae84c38b43ee007004eeb41'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:40.180735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3ceb681ae84c38b43ee007004eeb41'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:40.198483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3ceb681ae84c38b43ee007004eeb41'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:40.199345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3ceb681ae84c38b43ee007004eeb41'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:40.220013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3ceb681ae84c38b43ee007004eeb41'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:40.280117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2278/4543] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:39 2022] DELETE /identity/v3/users/8b3ceb681ae84c38b43ee007004eeb41 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:40.281240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:40.285784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:40.321632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2266/4544] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:39 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 630 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:40.324299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:40.329500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:40.335194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:40.455239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:40.460877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:40.507852 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:40.538152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803f7d7-0808-4194-b316-8da0423b4408 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:40.555543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:40.556488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:40.556839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:40.557165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:40.559562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:40.564002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:40.594094 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2279/4545] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:40.602846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:40.624913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:40.701138 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:40.754871 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2267/4546] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:40.755991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:40.774982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c67ce-560d-4424-946c-3db020e8355b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:40.783121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:40.784569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:40.785054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:40.785844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] PATH_INFO: `/v3/projects/96fc757654654e7eb09a2b717c0e8b2b/users/c5c4a0c051fe4c93b6d40df5c24947df/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:40.813368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fc757654654e7eb09a2b717c0e8b2b, user_id=c5c4a0c051fe4c93b6d40df5c24947df, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:40.817479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:40.843478 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2268/4547] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:40 2022] PUT /identity/v3/projects/96fc757654654e7eb09a2b717c0e8b2b/users/c5c4a0c051fe4c93b6d40df5c24947df/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:40.845281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:41.000439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922cee45-c50a-4609-b53d-d321a114bddd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:41.246517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f6c52-235e-4706-a807-38dfed72623c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:41.262718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c88ef8-be24-4786-ab20-43b7c0988bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:41.264135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88ef8-be24-4786-ab20-43b7c0988bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:41.264886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88ef8-be24-4786-ab20-43b7c0988bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:41.265310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c88ef8-be24-4786-ab20-43b7c0988bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:41.266674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88ef8-be24-4786-ab20-43b7c0988bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:41.278264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c88ef8-be24-4786-ab20-43b7c0988bbd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:41.311574 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2269/4548] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:30:41.313914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:41.314443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:41.315077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:41.345054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:41.350682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:41.351688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:41.354707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:41.357141 n-d-master-1 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 11:30:41.369178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:41.369944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] MFA Rules not processed for user `f35d623b786740f08b362ad2e393a042`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:41.371547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:41.376274 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:41.376274 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:41.376274 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:41.396287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:41.493043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2280/4549] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:40 2022] POST /identity/v3/policies => generated 229 bytes in 898 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:41.496994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:41.512567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:41.641946 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2270/4550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:41.643112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:41.679613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059f48b-c240-411a-a1f5-0ce7b7079991 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:41.694320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:41.696791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:41.697077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:41.698621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] PATH_INFO: `/v3/projects/96fc757654654e7eb09a2b717c0e8b2b/users/c5c4a0c051fe4c93b6d40df5c24947df/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:41.706671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96fc757654654e7eb09a2b717c0e8b2b, user_id=c5c4a0c051fe4c93b6d40df5c24947df, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:41.715369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:41.767409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8a5fce-c14a-46dd-879b-5c16e6e0b741 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:41.768126 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2271/4551] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:41 2022] PUT /identity/v3/projects/96fc757654654e7eb09a2b717c0e8b2b/users/c5c4a0c051fe4c93b6d40df5c24947df/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:41.775166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:41.888046 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:41.967159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:41.967918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:41.972010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:41.972412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.054643 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:42.066761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6340d91-902b-4237-bb57-3a8739329814 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.090110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.091027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.091316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.091594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies/41ca437d42d443b78d98f12c70e0b33f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.092679 n-d-master-1 devstack@keystone.service[80580]: WARNING oslo_log.versionutils [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 11:30:42.093233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=41ca437d42d443b78d98f12c70e0b33f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.110584 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:42.110584 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:42.110584 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:42.112889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bf870-f936-4d3e-969b-4d19cb4af244 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.180845 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2272/4552] 10.222.0.15 () {60 vars in 1251 bytes} [Tue Jul 19 11:30:41 2022] PATCH /identity/v3/policies/41ca437d42d443b78d98f12c70e0b33f => generated 236 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:42.184997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.185691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.186295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.187464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.189249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.238454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2281/4553] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 744 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:42.239399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.274165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb40b34-7849-466b-8867-b3a98ec131b4 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.292565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.293779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.294238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.294664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies/41ca437d42d443b78d98f12c70e0b33f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.295697 n-d-master-1 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 11:30:42.296548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=41ca437d42d443b78d98f12c70e0b33f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.298017 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:42.298017 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:42.298017 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:42.301465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.334648 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2282/4554] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:30:42 2022] GET /identity/v3/policies/41ca437d42d443b78d98f12c70e0b33f => generated 236 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:42.339667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.354883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] MFA Rules not processed for user `c5c4a0c051fe4c93b6d40df5c24947df`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:42.361528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c2088-0817-4d4f-8dbc-f3cb53588d91 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.371013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:42.381226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.382755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.383203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.383648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies/41ca437d42d443b78d98f12c70e0b33f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.384697 n-d-master-1 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 11:30:42.385499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=41ca437d42d443b78d98f12c70e0b33f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.386937 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:42.386937 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:42.386937 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:42.389377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.423658 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2283/4555] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:42 2022] DELETE /identity/v3/policies/41ca437d42d443b78d98f12c70e0b33f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:42.430331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.461588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812150f-288e-46c1-bc46-8655f7b9e7cc tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.469382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.471091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.472101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.472815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.495423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.507108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.586084 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2284/4556] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:42 2022] POST /identity/v3/policies => generated 230 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:42.598459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.675401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd95bb49-8be7-49fe-9ab9-9d676c8838d9 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.724477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.728500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.730269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.732479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.738597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.745498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.746151 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2273/4557] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:42 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 564 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:42.747180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.796783 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2285/4558] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:42 2022] POST /identity/v3/policies => generated 227 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:42.801476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c54f18-19a6-4e43-9300-17cb7eee0fa6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.806851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.820651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e831f-09c8-498e-ab1e-61e6f67a4b3c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.825120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.827624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.828565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.828981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.829453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.829732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.829854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.831478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.832388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.834535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.835207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.844279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.862628 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2286/4559] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:30:42 2022] POST /identity/v3/policies => generated 227 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:42.868758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.909688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb0357b-f5de-4d5c-b4af-cb292e24831b tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.913965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2274/4560] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:42 2022] POST /identity/v3/roles => generated 235 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:42.914965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.923355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.924216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.924738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.925092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.926136 n-d-master-1 devstack@keystone.service[80581]: WARNING oslo_log.versionutils [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Jul 19 11:30:42.927404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.930131 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:42.930131 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:42.930131 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:42.932592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.946243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28617032-822d-44cf-8edc-9e2affe378ce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.963266 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2287/4561] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:30:42 2022] GET /identity/v3/policies => generated 760 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:42.965018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.965727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.966014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.967481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:42.968057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:42.970334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:42.975382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:42.985490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a39480a-649c-402d-89d4-185c24fb5c5d tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:42.996633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:42.998033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:42.998642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:42.999261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies/bf9019e25f794a28a57a21005f2fa8d8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.001170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=bf9019e25f794a28a57a21005f2fa8d8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.004100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.034671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2288/4562] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:42 2022] DELETE /identity/v3/policies/bf9019e25f794a28a57a21005f2fa8d8 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:43.040612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:43.065869 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2275/4563] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:42 2022] POST /identity/v3/roles => generated 234 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:43.070396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:43.086711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb730a60-e147-4bdf-b1af-162c18b96f2c tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:43.111600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb0593-28a8-4bdb-a436-7d5b8cb877cf tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:43.120946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:43.133112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:43.133929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:43.134349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:43.134471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:43.134677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:43.134830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.134974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies/45762e1e22b1423aa0955ce42cc69dda` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.135832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.139027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=45762e1e22b1423aa0955ce42cc69dda)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.141018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.146806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.185010 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2276/4564] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:43 2022] POST /identity/v3/roles => generated 234 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:43.189067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:43.207567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2289/4565] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:43 2022] DELETE /identity/v3/policies/45762e1e22b1423aa0955ce42cc69dda => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:43.212148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a7143-92c2-41a9-957b-793998f6f618 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:43.214441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:43.232731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:43.233725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:43.235868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:43.239164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.241522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.243759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.249637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e786f-2415-471a-8a58-1ba8c9774fa8 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:43.271027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f8397348bfd348b286a8db2aa904ceda', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '612530c7f21c4491be307cc54f792e2c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:43.273528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2277/4566] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:30:43 2022] POST /identity/v3/domains => generated 275 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:30:43.277985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:43.278619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:43.278746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:43.279526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] PATH_INFO: `/v3/policies/158dff0d863b431594134416a235a7fa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.284304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=158dff0d863b431594134416a235a7fa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.290524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.334331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2290/4567] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:43 2022] DELETE /identity/v3/policies/158dff0d863b431594134416a235a7fa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:43.342074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:43.348133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:43.421443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34af55d-5e35-43a4-bd0e-f635d4c6f987 tempest-PoliciesTestJSON-896004134 tempest-PoliciesTestJSON-896004134-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:43.471508 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:43.573585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eaf555-74bd-4b7f-a446-115fdd889dbc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:43.615542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:43.626101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:43.627533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:43.633305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.641225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.655846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.745617 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:43.791708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:43.793474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:43.793893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:43.794296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] PATH_INFO: `/v3/users/7a0b03d6a40a46a1ac1d0a269614e9eb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:43.807470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a0b03d6a40a46a1ac1d0a269614e9eb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:43.823028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:43.927657 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2278/4568] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:43 2022] POST /identity/v3/projects => generated 399 bytes in 650 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:43.929835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:44.209531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a0b03d6a40a46a1ac1d0a269614e9eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:44.214741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a0b03d6a40a46a1ac1d0a269614e9eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:44.246964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a0b03d6a40a46a1ac1d0a269614e9eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:44.250280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a0b03d6a40a46a1ac1d0a269614e9eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:44.287989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc7d0c74-8b60-4be2-84ac-6f2d80ef006f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a0b03d6a40a46a1ac1d0a269614e9eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:44.304115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e39ac-e640-40bc-a344-681bd15c3a70 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:44.338714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:44.343717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.344121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.346529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:44.347317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:44.351533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:44.389003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2291/4569] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:43 2022] DELETE /identity/v3/users/7a0b03d6a40a46a1ac1d0a269614e9eb => generated 0 bytes in 1045 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:44.396911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.397150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.397373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:44.409429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2279/4570] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:30:43 2022] POST /identity/v3/groups => generated 301 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:44.431887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:44.445313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:44.515713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451ffdd9-6276-439b-be88-f8a30f76a0d0 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:44.521743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:44.523007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:44.659515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:44.660230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.660560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.660841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:44.661636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:44.663439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:44.692682 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2280/4571] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:44 2022] POST /identity/v3/roles => generated 235 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:44.693597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:44.713912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4756b4-4bdd-497d-9d13-d7a53e33887e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:44.727571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:44.728298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.728613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.728897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:44.729642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:44.732262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:44.741291 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2292/4572] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:44.757630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:44.761437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:44.784648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2281/4573] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:44 2022] POST /identity/v3/users => generated 439 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:44.790588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:44.840312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ede4b-4b4a-4951-af7d-88145bec24fe tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:44.857790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:44.858507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.858801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.859085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:44.866851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:44.870593 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:44.870593 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:44.870593 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:44.871543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:44.895705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95344e64-a179-44c0-890b-a0d0a8c92f49 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:44.902070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:44.903062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.903737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.904450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:44.921063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:44.922745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:44.931205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2282/4574] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:44 2022] POST /identity/v3/roles => generated 270 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:44.933671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:44.950312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2293/4575] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:44.961335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509560c-8704-483e-af48-ff35f1a741de tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:44.967442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:44.968546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:44.978061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:44.980194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/61b8f0a601e149a2b52ff9f53ec027cd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:45.041078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=61b8f0a601e149a2b52ff9f53ec027cd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:45.055256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:45.060535 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:45.119273 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2283/4576] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:44 2022] PUT /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/61b8f0a601e149a2b52ff9f53ec027cd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:45.119543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:45.166298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc545e-5f7a-4979-977b-00d2be7864a4 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:45.248133 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:45.490233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:45.493902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:45.498538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:45.498538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:45.508522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Adding query filter params (scope.project.id=b5722dda529546039fe414de88dd0f1e, user.id=3d6c798e83db460384be89d934faeb12) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:45.510066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:45.520540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:45.675810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2294/4577] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:45 2022] GET /identity/v3/role_assignments?scope.project.id=b5722dda529546039fe414de88dd0f1e&user.id=3d6c798e83db460384be89d934faeb12&effective => generated 228 bytes in 557 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:30:45.683539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:45.708401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15124bc8-1249-41da-93c0-b533720d42f1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:45.744138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:45.745109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:45.745426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:45.745711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/61b8f0a601e149a2b52ff9f53ec027cd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:45.752302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=61b8f0a601e149a2b52ff9f53ec027cd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:45.763960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:45.795300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 61b8f0a601e149a2b52ff9f53ec027cd was removed from user 3d6c798e83db460384be89d934faeb12 on project b5722dda529546039fe414de88dd0f1e. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:45.795606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:45.796497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:45.829746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2284/4578] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:30:45 2022] DELETE /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/61b8f0a601e149a2b52ff9f53ec027cd => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:45.836927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:45.840329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:45.859843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528b9ddd-d48b-4e6d-a19a-ac7f03988b39 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:46.075176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:46.076275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:46.083174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:46.083807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/61b8f0a601e149a2b52ff9f53ec027cd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:46.089062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=61b8f0a601e149a2b52ff9f53ec027cd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:46.090438 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:46.090438 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:46.090438 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:46.091786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:46.104247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:46.106592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:46.174720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 61b8f0a601e149a2b52ff9f53ec027cd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:46.174720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.185148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.190154 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2295/4579] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:45 2022] DELETE /identity/v3/roles/61b8f0a601e149a2b52ff9f53ec027cd => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:46.195656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:46.197357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:46.248392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb7e36f-8ac1-4512-b295-ab069d5d79db tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:46.309083 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:46.346402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87916a33-9c96-41f7-8ebd-a948fee817fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:46.351755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:46.352893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:46.354472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:46.354472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/9f81740fe41842179cf737cd8f4fffde` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:46.356740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=9f81740fe41842179cf737cd8f4fffde)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:46.361565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:46.389896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2296/4580] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:46 2022] PUT /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/9f81740fe41842179cf737cd8f4fffde => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:46.395233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:46.445492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:46.446769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:46.447220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:46.447651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] PATH_INFO: `/v3/projects/c40a8ca78bba404e9bea8dfe610ef7b8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:46.451479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c40a8ca78bba404e9bea8dfe610ef7b8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:46.465501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:46.579005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c40a8ca78bba404e9bea8dfe610ef7b8', 'request_id': 'req-1d55f274-6c95-45c3-b5bb-1205f2b0915d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.586142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96688c46-be74-4b7f-998f-efa018ef81fc tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:46.598129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c40a8ca78bba404e9bea8dfe610ef7b8', 'request_id': 'req-1d55f274-6c95-45c3-b5bb-1205f2b0915d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.607055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c40a8ca78bba404e9bea8dfe610ef7b8', 'request_id': 'req-1d55f274-6c95-45c3-b5bb-1205f2b0915d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.634274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] The token cache is being invalidate because project c40a8ca78bba404e9bea8dfe610ef7b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:46.634576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.637570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1d55f274-6c95-45c3-b5bb-1205f2b0915d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:46.640523 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2285/4581] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:46 2022] DELETE /identity/v3/projects/c40a8ca78bba404e9bea8dfe610ef7b8 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:46.646325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40d74-b50c-4f64-97e0-4417b34ea076 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:46.646616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40d74-b50c-4f64-97e0-4417b34ea076 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:46.646904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40d74-b50c-4f64-97e0-4417b34ea076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:46.691649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-40e40d74-b50c-4f64-97e0-4417b34ea076 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:46.693045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-40e40d74-b50c-4f64-97e0-4417b34ea076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:46.707044 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=2,keystone:SELECT=90,keystone:DELETE=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:46.752632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:46.755626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:46.755939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:46.756236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:46.763070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:46.764676 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:46.764676 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:46.764676 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:46.766534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:46.834668 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2297/4582] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:30:46 2022] PUT /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 520 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:46.835947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:46.838335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:46.845989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2286/4583] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:46.855354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:46.855710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:46.855884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:46.895574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:46.897019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:47.074417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6435a9-b794-4e4a-a948-c45b2b30c301 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.079278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2287/4584] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:30:47.084941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.085170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.086173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.086471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.086808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.087989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Adding query filter params (scope.project.id=b5722dda529546039fe414de88dd0f1e, user.id=3d6c798e83db460384be89d934faeb12) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:47.088373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.090439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.102514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a617822-a2c9-4d10-ac8b-1ed40765178d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.105745 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:47.109986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.111989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.112590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.114192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.115293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:47.115784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.117798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.134892 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2288/4585] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:30:47.141354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.157870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbaff1-2a4f-4f9b-ae00-a0796e4fc6f4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.163642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.164532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.164819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.165094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.166121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.168045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.209040 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2289/4586] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:47 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:30:47.216308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.225786 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2298/4587] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:46 2022] GET /identity/v3/role_assignments?scope.project.id=b5722dda529546039fe414de88dd0f1e&user.id=3d6c798e83db460384be89d934faeb12&effective => generated 1061 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:47.227907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.248767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef826d1-d740-4979-a7c9-b0b1335dc602 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.348422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15007331-4eab-414d-abc8-192e2da085b3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.357871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.358586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.358864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.359140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.360127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.362170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.394288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.395298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.395956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.396326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.402401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.410707 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:47.410707 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:47.410707 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:47.412938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.415098 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2290/4588] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:47 2022] POST /identity/v3/users => generated 288 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:30:47.425590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.445922 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2299/4589] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:30:47 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:47.446646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.447815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbcaaf9-aa43-400e-922c-fe0ee7ca875e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.466723 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:47.592979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638ca6d4-7414-406e-8e19-b7c0373f50c5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.600853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.601929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.602463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.602943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.603936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.605883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.610996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.611702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.611998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.612286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.613169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Adding query filter params (scope.project.id=b5722dda529546039fe414de88dd0f1e, user.id=3d6c798e83db460384be89d934faeb12) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:47.613487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.616152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.641920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2291/4590] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:47 2022] GET /identity/v3/roles => generated 2322 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:47.642879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.679033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeef6811-12f1-45ba-9642-0572e9541c29 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.684453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.685102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.685391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.685673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.686424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.688397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.718463 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2292/4591] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:47 2022] GET /identity/v3/roles => generated 2322 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:47.722276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.734070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2300/4592] 10.222.0.15 () {58 vars in 1355 bytes} [Tue Jul 19 11:30:47 2022] GET /identity/v3/role_assignments?scope.project.id=b5722dda529546039fe414de88dd0f1e&user.id=3d6c798e83db460384be89d934faeb12&effective => generated 577 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:30:47.736725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191596f9-0da9-4890-a749-7d0158b1b3d9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.738384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.748446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e38a2d-759c-4e72-bf5b-4cea8b269102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.749378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e38a2d-759c-4e72-bf5b-4cea8b269102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.749662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e38a2d-759c-4e72-bf5b-4cea8b269102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.749977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e38a2d-759c-4e72-bf5b-4cea8b269102 admin admin] PATH_INFO: `/v3/projects/0a58c3f01b564d42ae10a77b54fcef5e/users/73f9b87ab9514ce0a49186c27aae6c0a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.778386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7acd3-439d-4306-ab7b-fa90a339f2d6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.783913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:47.784787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.785075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.785355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.789687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.793002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e38a2d-759c-4e72-bf5b-4cea8b269102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a58c3f01b564d42ae10a77b54fcef5e, user_id=73f9b87ab9514ce0a49186c27aae6c0a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:47.793969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.795704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e38a2d-759c-4e72-bf5b-4cea8b269102 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:47.825157 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2293/4593] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:47 2022] PUT /identity/v3/projects/0a58c3f01b564d42ae10a77b54fcef5e/users/73f9b87ab9514ce0a49186c27aae6c0a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533.: keystone.exception.ImpliedRoleNotFound: 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533. Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = query.one() Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:47.837934 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 19 11:30:47.839136 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 19 11:30:47.840207 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 19 11:30:47.840207 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 19 11:30:47.840207 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 19 11:30:47.840207 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533. Jul 19 11:30:47.840207 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:47.840597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:47.840597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:47.840752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:47.842838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2301/4594] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:30:47 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 137 bytes in 105 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:47.843782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:47.866630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a0808-96cb-4412-9770-449eb5f4a022 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:47.879240 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:47.910874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:47.913445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:48.017590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.018966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.019629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.019747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/9f81740fe41842179cf737cd8f4fffde` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.022444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=9f81740fe41842179cf737cd8f4fffde)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:48.026450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:48.041832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 9f81740fe41842179cf737cd8f4fffde was removed from user 3d6c798e83db460384be89d934faeb12 on project b5722dda529546039fe414de88dd0f1e. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:48.042163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.046099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.070795 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2294/4595] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:48.070795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.072591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:48.097862 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2302/4596] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:30:47 2022] DELETE /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/9f81740fe41842179cf737cd8f4fffde => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:48.100039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.101582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:48.191118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308f0299-ec40-4e89-b79d-74022da7c5a8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:48.201401 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:48.313637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89216f8-796a-495a-b98a-e5c9fc2ab641 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:48.322848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.332534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.333366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.333716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.346132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.350672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.351388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.351679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] PATH_INFO: `/v3/projects/c039a1fe3f094caf8c39592fa84bab16` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.358226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c039a1fe3f094caf8c39592fa84bab16)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:48.363201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:48.444749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.462366 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2303/4597] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:48 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:48.464639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.467570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:48.505195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c039a1fe3f094caf8c39592fa84bab16', 'request_id': 'req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.522779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c039a1fe3f094caf8c39592fa84bab16', 'request_id': 'req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.553980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c039a1fe3f094caf8c39592fa84bab16', 'request_id': 'req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.578471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] The token cache is being invalidate because project c039a1fe3f094caf8c39592fa84bab16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:48.580954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.582283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.588207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2295/4598] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:48 2022] DELETE /identity/v3/projects/c039a1fe3f094caf8c39592fa84bab16 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:48.589647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.596052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:48.614534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0544624d-de11-49c3-9827-c219505777cf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:48.691043 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:48.756463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d9f27b-51f0-48f2-b3cc-1fc26eab6956 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:48.762708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.764392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.764392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.766883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] PATH_INFO: `/v3/users/f8397348bfd348b286a8db2aa904ceda` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.768936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8397348bfd348b286a8db2aa904ceda)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:48.771439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:48.792886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.793608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.793897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.794178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.794953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:48.796008 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:48.796008 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:48.796008 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:48.797015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:48.824525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2304/4599] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:48 2022] POST /identity/v3/roles => generated 271 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:48.828094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.829910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:48.847670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfb1aa-2350-4737-819d-6e558c727051 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:48.853349 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:48.857204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.858865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.859177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.860336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.861317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Adding query filter params (domain_id=663cf6c06c934becadf49b6e8c2c1cc7) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:48.861699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:48.861816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8397348bfd348b286a8db2aa904ceda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.862992 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:48.862992 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:48.862992 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:48.863899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:48.878211 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2305/4600] 10.222.0.15 () {58 vars in 1206 bytes} [Tue Jul 19 11:30:48 2022] GET /identity/v3/roles?domain_id=663cf6c06c934becadf49b6e8c2c1cc7 => generated 408 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:48.885232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.885408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8397348bfd348b286a8db2aa904ceda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.903856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbe10d-7a43-43aa-b60f-4378156d270c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:48.912864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8397348bfd348b286a8db2aa904ceda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.913885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8397348bfd348b286a8db2aa904ceda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.925307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8397348bfd348b286a8db2aa904ceda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.929218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:48.930134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:48.930413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:48.930693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/45ec3cdf97904ebaa533c0412307adf8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:48.932044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=45ec3cdf97904ebaa533c0412307adf8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:48.933836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:48.937333 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2296/4601] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:48 2022] DELETE /identity/v3/users/f8397348bfd348b286a8db2aa904ceda => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:48.983865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 45ec3cdf97904ebaa533c0412307adf8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:48.984203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.985130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:48.992105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:48.993665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2306/4602] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:48 2022] DELETE /identity/v3/roles/45ec3cdf97904ebaa533c0412307adf8 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:48.994450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:49.123651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b461ad4d-d0ec-4113-9945-23b35320b8b8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.222614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.223518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.223696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.223948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.225536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Adding query filter params (domain_id=663cf6c06c934becadf49b6e8c2c1cc7) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:49.225868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:49.228461 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:49.228461 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:49.228461 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:49.228749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:49.236108 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2297/4603] 10.222.0.15 () {58 vars in 1206 bytes} [Tue Jul 19 11:30:48 2022] GET /identity/v3/roles?domain_id=663cf6c06c934becadf49b6e8c2c1cc7 => generated 148 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:49.241111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.245477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:49.264418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dda231-eab6-4c11-ad64-bc1d81236322 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.273037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.273936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.274218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.275192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/45ec3cdf97904ebaa533c0412307adf8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.316979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Could not find role: 45ec3cdf97904ebaa533c0412307adf8.: keystone.exception.RoleNotFound: Could not find role: 45ec3cdf97904ebaa533c0412307adf8. Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Jul 19 11:30:49.333169 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:30:49.334484 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 45ec3cdf97904ebaa533c0412307adf8. Jul 19 11:30:49.336961 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:49.341416 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2307/4604] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:49 2022] DELETE /identity/v3/roles/45ec3cdf97904ebaa533c0412307adf8 => generated 110 bytes in 101 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:49.344686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.366896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c147b-79d0-48ef-8fe8-d4a80d65d766 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.375340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3973ed7-5500-489f-9a8c-46d3e9aa79b9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.376778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3973ed7-5500-489f-9a8c-46d3e9aa79b9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.377300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3973ed7-5500-489f-9a8c-46d3e9aa79b9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.378445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3973ed7-5500-489f-9a8c-46d3e9aa79b9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.389589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3973ed7-5500-489f-9a8c-46d3e9aa79b9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:49.394923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3973ed7-5500-489f-9a8c-46d3e9aa79b9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:49.414744 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2298/4605] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:49 2022] PUT /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:49.418854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.443860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78edeea2-a8d8-48de-8623-b058ddcf0a82 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.467457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed78cf8-7092-48a2-bdfa-1622c270ef17 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.468106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed78cf8-7092-48a2-bdfa-1622c270ef17 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.468652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed78cf8-7092-48a2-bdfa-1622c270ef17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.507142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3ed78cf8-7092-48a2-bdfa-1622c270ef17 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:49.510327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ed78cf8-7092-48a2-bdfa-1622c270ef17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:49.521737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2299/4606] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:49 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:30:49.523373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.523687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.524850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.562487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:49.564544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:49.587539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.588802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.589445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.589800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.591836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, group_id=8f205821e7e04672996a09aa2097024f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:49.594708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:49.610476 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:49.614093 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2308/4607] 10.222.0.15 () {58 vars in 1364 bytes} [Tue Jul 19 11:30:49 2022] GET /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles => generated 410 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:49.616075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.632619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd59737-b349-4d4f-9557-b8a03a59ff43 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.638301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.639228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.640272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.640638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.643400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:49.647242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:49.654457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2300/4608] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:49.655480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.670913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288b068-5926-4aa3-817c-654d135fb382 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.672456 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2309/4609] 10.222.0.15 () {58 vars in 1464 bytes} [Tue Jul 19 11:30:49 2022] HEAD /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:49.673668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.675829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.678735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.678892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.679159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.690242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f704548-5e59-46cc-8d53-0a40666a1b12 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.703827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.705628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.705987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.706557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.709927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:49.713002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:49.737746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 343bec11e81441cd9e652eff1964074a was removed from group 8f205821e7e04672996a09aa2097024f on domain 663cf6c06c934becadf49b6e8c2c1cc7. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:49.739007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:49.740549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:49.756701 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 11:30:49.757605 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:49.758508 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2301/4610] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:49 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 188 bytes in 103 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:30:49.762782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.765131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:49.765766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2310/4611] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:30:49 2022] DELETE /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:49.781653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.783398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:49.784472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779aeb-6f80-44f3-a1e7-3f32c3779ff7 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.818511 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:49.904197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.905292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.905576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.905850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.925964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69f012-2b1c-4925-8ac5-04cf4e302e93 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.933562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:49.934037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:49.935438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:49.935833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:49.940580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b5722dda529546039fe414de88dd0f1e, group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:49.947539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:49.954438 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Jul 19 11:30:49.955572 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:49.963836 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2302/4612] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:49 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 188 bytes in 196 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Jul 19 11:30:49.963836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:49.978477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70fbc9-73f5-4643-92c7-436ae96d7426 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:49.979320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2311/4613] 10.222.0.15 () {60 vars in 1485 bytes} [Tue Jul 19 11:30:49 2022] PUT /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:49.981103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.086661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.088338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.088882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.090487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.111081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d9f39-7d8f-460a-a0a1-3ad50fb438e1 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.119184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b975e2-a41b-45a6-b4ad-834bc3a6f9ea tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.120399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b975e2-a41b-45a6-b4ad-834bc3a6f9ea tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.121274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b975e2-a41b-45a6-b4ad-834bc3a6f9ea tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.122784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b975e2-a41b-45a6-b4ad-834bc3a6f9ea tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.125643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b975e2-a41b-45a6-b4ad-834bc3a6f9ea tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_grants(project_id=b5722dda529546039fe414de88dd0f1e, group_id=8f205821e7e04672996a09aa2097024f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.129486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b975e2-a41b-45a6-b4ad-834bc3a6f9ea tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.153211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.167420 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2303/4614] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:49 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:50.204530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2312/4615] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:30:49 2022] GET /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles => generated 411 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:50.207092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.220865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1ae397-c911-40ed-831e-d6f757371cc3 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.244842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.245964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.246454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.246598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/groups/8f205821e7e04672996a09aa2097024f/users/3d6c798e83db460384be89d934faeb12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.252140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=8f205821e7e04672996a09aa2097024f, user_id=3d6c798e83db460384be89d934faeb12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.254996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.292425 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2304/4616] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:30:50 2022] PUT /identity/v3/groups/8f205821e7e04672996a09aa2097024f/users/3d6c798e83db460384be89d934faeb12 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:50.297182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.298202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.298971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.361278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] MFA Rules not processed for user `3d6c798e83db460384be89d934faeb12`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:50.362800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:50.491840 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:50.501585 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2313/4617] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:50.506563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.518237 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:50.608120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6824987-dbbc-48bf-a6f5-cb87f07353c7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.610337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.612595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:50.617173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.618950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.619244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.619554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.628058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b5722dda529546039fe414de88dd0f1e, group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.634659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.657665 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2305/4618] 10.222.0.15 () {58 vars in 1467 bytes} [Tue Jul 19 11:30:50 2022] HEAD /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:50.662930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.689822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd53a70c-8b59-4985-9828-50437759cbf5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.695854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.698628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.699198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.699666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.702793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b5722dda529546039fe414de88dd0f1e, group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.706101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.712626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 343bec11e81441cd9e652eff1964074a was removed from group 8f205821e7e04672996a09aa2097024f on project b5722dda529546039fe414de88dd0f1e. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:50.712932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.713641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.727896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33c5b7d-a4f9-492e-86d6-9af85a59ecc7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.735664 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2306/4619] 10.222.0.15 () {58 vars in 1469 bytes} [Tue Jul 19 11:30:50 2022] DELETE /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:50.736915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.740143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:50.830271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.844148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.845377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.845826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] PATH_INFO: `/v3/projects/612530c7f21c4491be307cc54f792e2c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.850999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=612530c7f21c4491be307cc54f792e2c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.853245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.857907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d520d5a-5076-428d-be45-50fabd2a818d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:50.869504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:50.870449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.870738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.871012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/groups/8f205821e7e04672996a09aa2097024f/users/3d6c798e83db460384be89d934faeb12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:50.877576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=8f205821e7e04672996a09aa2097024f, user_id=3d6c798e83db460384be89d934faeb12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:50.881206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:50.898676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '3d6c798e83db460384be89d934faeb12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.927331 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2307/4620] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:30:50 2022] DELETE /identity/v3/groups/8f205821e7e04672996a09aa2097024f/users/3d6c798e83db460384be89d934faeb12 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:50.935228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:50.950292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '612530c7f21c4491be307cc54f792e2c', 'request_id': 'req-c7b95710-64ae-4330-97ac-c93d0da568fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.959013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '612530c7f21c4491be307cc54f792e2c', 'request_id': 'req-c7b95710-64ae-4330-97ac-c93d0da568fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.967468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '612530c7f21c4491be307cc54f792e2c', 'request_id': 'req-c7b95710-64ae-4330-97ac-c93d0da568fd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.990192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] The token cache is being invalidate because project 612530c7f21c4491be307cc54f792e2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:50.990497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.991311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7b95710-64ae-4330-97ac-c93d0da568fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:50.996436 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2314/4621] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:50 2022] DELETE /identity/v3/projects/612530c7f21c4491be307cc54f792e2c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:50.999069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15270d-c6be-4883-9601-c88cae3fa17e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:50.999069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15270d-c6be-4883-9601-c88cae3fa17e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:50.999501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15270d-c6be-4883-9601-c88cae3fa17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.029270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd665f1-4a89-4a55-be83-4483bf6e799d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.031758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-db15270d-c6be-4883-9601-c88cae3fa17e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:51.033588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-db15270d-c6be-4883-9601-c88cae3fa17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:51.037332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.039737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.040325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.040855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.043438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.044952 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:51.044952 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:51.044952 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:51.046326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.065008 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2308/4622] 10.222.0.15 () {60 vars in 1380 bytes} [Tue Jul 19 11:30:50 2022] PUT /identity/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:51.070134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.073446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:51.091094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7729e2-1574-46bd-951e-ae44e3a3e5fb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.095293 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:51.100405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.102336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.102744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.103102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.109052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=8f205821e7e04672996a09aa2097024f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.112650 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:51.112650 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:51.112650 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:51.114995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.124171 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:51.136304 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2309/4623] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:30:51 2022] GET /identity/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles => generated 376 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:51.142531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.152198 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2315/4624] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:51.155328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab742f0-801e-4a1a-ae48-87b60156467c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.162134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.162418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.162767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.163026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.163141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.163311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.163592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.165877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.166924 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:51.166924 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:51.166924 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:51.167832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffd854e-d962-4be2-85dd-29751458eb11 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.180942 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2310/4625] 10.222.0.15 () {58 vars in 1362 bytes} [Tue Jul 19 11:30:51 2022] HEAD /identity/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:51.180942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.180942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.180942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.186791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:51.188928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:51.204586 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2316/4626] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:51.205556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.222891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:51.224133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:51.237632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2311/4627] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:51 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:30:51.237632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.238822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a4b11-275a-4d22-a851-c83af4633c84 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.246151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.247381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.247767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.248148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.259246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=8f205821e7e04672996a09aa2097024f, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.260700 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:51.260700 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:51.260700 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:51.262270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbd4346-ab65-42b3-9bf7-16adc05eaa9c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.262768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.274950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.275694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.276108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.276277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.278895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:51.279265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.282365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0073730f-37fa-4e86-81b2-874627110061 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.312693 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2312/4628] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:51.314138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.314804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.315112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.323233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2317/4629] 10.222.0.15 () {58 vars in 1364 bytes} [Tue Jul 19 11:30:51 2022] DELETE /identity/v3/system/groups/8f205821e7e04672996a09aa2097024f/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:51.327245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.349526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fa604f-c4f0-4a5e-bd9a-c241f3c32482 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.357481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:51.360731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.361568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.361901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:51.362022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.362922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.363718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.365909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.416158 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2318/4630] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:51 2022] POST /identity/v3/projects => generated 367 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:51.417318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.508072 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2313/4631] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:51.509189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.537733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719951a-f241-47f2-88e1-5b6b43da7ab0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.557962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3481fa-063e-4822-8805-d3f099a58c15 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.565091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.567078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.568124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.568641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.579475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.586642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.627380 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2319/4632] 10.222.0.15 () {60 vars in 1479 bytes} [Tue Jul 19 11:30:51 2022] PUT /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:51.628230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.704626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.707223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.709749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.709749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.725519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.736489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.789592 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2314/4633] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:51 2022] POST /identity/v3/users => generated 284 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:51.793100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.818132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3aca-eed6-4316-8a54-670b6c5e44e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.834024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557af717-6584-4b99-810d-6dadc86be549 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:51.844879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.845956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.850446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.851387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.948209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:51.968780 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2320/4634] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:51 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:51.968780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:51.979209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:51.980391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:51.980737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:51.981025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:51.984613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, user_id=3d6c798e83db460384be89d934faeb12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:51.988158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:51.992319 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:51.994407 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:52.022342 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2315/4635] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Jul 19 11:30:51 2022] GET /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles => generated 409 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:52.023923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.051161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002979dc-ee87-4e03-87a9-6c6019207880 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.070722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.074892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.075208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.075505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.083001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.091276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.105236 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2316/4636] 10.222.0.15 () {58 vars in 1461 bytes} [Tue Jul 19 11:30:52 2022] HEAD /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:52.109622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.125825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5b15c-e19a-43fb-919f-e51b27e1fd3e tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.126056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c256da32-8e86-4579-9e9a-8c699beedaed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.132885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.134152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.134517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.134866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.137121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.137527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=663cf6c06c934becadf49b6e8c2c1cc7, user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.137814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.138098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.138522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.139271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.142292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.142717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.149879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 343bec11e81441cd9e652eff1964074a was removed from user 3d6c798e83db460384be89d934faeb12 on domain 663cf6c06c934becadf49b6e8c2c1cc7. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:52.150336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:52.151144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:52.169134 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2321/4637] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:51 2022] GET /identity/v3/roles => generated 2322 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:52.173250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.176906 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2317/4638] 10.222.0.15 () {58 vars in 1463 bytes} [Tue Jul 19 11:30:52 2022] DELETE /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:52.180036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:52.181898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.184250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:52.214914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32359572-b683-43d0-97c4-9c31dc6b7e3f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.296185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9fd68-bbb7-4170-87b6-fd9abe8821bb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.305028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.306167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.306613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.307068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.311187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.320238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.356402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2318/4639] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:52 2022] PUT /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:30:52.361515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.385578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.386309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.386600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.386884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.391759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.393463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.440305 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2322/4640] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:52 2022] GET /identity/v3/roles => generated 2322 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:52.441137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.468111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbad6624-36ce-455b-83d5-391265d1206a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.512953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c76d417-bf98-4cbe-b15f-ca34e2982c60 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.519850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.521380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.540731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.541208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.547059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_grants(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.551117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.574537 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2319/4641] 10.222.0.15 () {58 vars in 1364 bytes} [Tue Jul 19 11:30:52 2022] GET /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles => generated 410 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:52.578519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.616282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01f7c1a-b40e-4805-b4f9-309aa2390df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.618441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7c1a-b40e-4805-b4f9-309aa2390df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.619015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7c1a-b40e-4805-b4f9-309aa2390df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.619532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f7c1a-b40e-4805-b4f9-309aa2390df4 admin admin] PATH_INFO: `/v3/projects/703d3eebac98466da0834e25980d927c/users/715eb0a0c7f24025baf67438f66da863/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.622981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f274d-24a8-4ff4-9b7e-bf638a14cc84 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.639023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.641245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.642068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.642959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.649192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.653705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.659522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f7c1a-b40e-4805-b4f9-309aa2390df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=703d3eebac98466da0834e25980d927c, user_id=715eb0a0c7f24025baf67438f66da863, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.663010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01f7c1a-b40e-4805-b4f9-309aa2390df4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.676711 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2320/4642] 10.222.0.15 () {58 vars in 1464 bytes} [Tue Jul 19 11:30:52 2022] HEAD /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:52.678798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.701042 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2323/4643] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:52 2022] PUT /identity/v3/projects/703d3eebac98466da0834e25980d927c/users/715eb0a0c7f24025baf67438f66da863/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:52.701249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cfe10d-017c-42cb-b4fc-c6fe3974fbed tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:52.798755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7a00-2183-4864-bd7c-2577019b04c0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.800144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7a00-2183-4864-bd7c-2577019b04c0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.801484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae7a00-2183-4864-bd7c-2577019b04c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.822994 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:52.871849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:52.872825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:52.873132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2fae7a00-2183-4864-bd7c-2577019b04c0 None None] MFA Rules not processed for user `715eb0a0c7f24025baf67438f66da863`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:52.873290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:52.873431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:52.875384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fae7a00-2183-4864-bd7c-2577019b04c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:52.877058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=b5722dda529546039fe414de88dd0f1e, user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:52.880947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:52.888006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 343bec11e81441cd9e652eff1964074a was removed from user 3d6c798e83db460384be89d934faeb12 on project b5722dda529546039fe414de88dd0f1e. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:52.888435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:52.889335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:52.908397 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:52.921117 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2321/4644] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:30:52 2022] DELETE /identity/v3/projects/b5722dda529546039fe414de88dd0f1e/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:52.928263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:52.932012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:53.081545 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2324/4645] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:52 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:53.083389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.084683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.084950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.090458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2a2dce-de32-464a-885c-c0beb43a0df7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.098418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.099963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.100488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.100894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.105140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.106629 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:53.106629 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:53.106629 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:53.107863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.117612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:53.119080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:53.124177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2322/4646] 10.222.0.15 () {60 vars in 1377 bytes} [Tue Jul 19 11:30:52 2022] PUT /identity/v3/system/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:53.124177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.125502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:53.127890 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2325/4647] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:53 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:30:53.132501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.153766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840bc3ba-f565-45d4-9725-438326fec4cd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.161474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.162684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.162928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.163372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/users/3d6c798e83db460384be89d934faeb12/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.164888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=3d6c798e83db460384be89d934faeb12)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.166587 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:53.166587 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:53.166587 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:53.168168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f9eb1-5621-4b65-a286-2e071630b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.190504 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2326/4648] 10.222.0.15 () {58 vars in 1259 bytes} [Tue Jul 19 11:30:53 2022] GET /identity/v3/system/users/3d6c798e83db460384be89d934faeb12/roles => generated 375 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:53.190504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.190504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.190504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.274096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:53.276962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:53.298272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91b55c4-839d-421e-9215-45bf8cc13bce tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.312872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.313907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.314193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.314475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.323055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.327086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.408561 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2323/4649] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:53 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:53.412812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.433455 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2327/4650] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:53.437193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.503765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaad7d-d9c2-493e-b339-3f278b8db4c8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.571257 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:53.583782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84287cdc-7540-48bd-b73f-8a59a17fb2e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.600287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.601612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.601900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.602433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.607570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.611029 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:53.611029 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:53.611029 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:53.620047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.637404 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2324/4651] 10.222.0.15 () {58 vars in 1359 bytes} [Tue Jul 19 11:30:53 2022] HEAD /identity/v3/system/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:53.643502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.732100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.734137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.736587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.737083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.740571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.744298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.766639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c371b-eef0-4ecf-8fed-d2e95caa9851 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.774819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.776455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.777073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.777735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.787515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2328/4652] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:53 2022] POST /identity/v3/users => generated 290 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:53.791019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.802063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:53.842013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6a77e-c8dc-4a34-b801-4f9bab046326 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.858538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:53.865167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.866058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.866389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.866727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] PATH_INFO: `/v3/users/61d129f38240447cbc0133726b37f861` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.869537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61d129f38240447cbc0133726b37f861)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.871575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.880452 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2325/4653] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:53 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:53.882216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.907230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c870343-cafb-4284-b03e-07c118f1b44f tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.915456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.917589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.919730 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:53.921005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.921488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/system/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.924273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=3d6c798e83db460384be89d934faeb12, role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.925966 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:53.925966 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:53.925966 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:53.928423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.939787 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2326/4654] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Jul 19 11:30:53 2022] DELETE /identity/v3/system/users/3d6c798e83db460384be89d934faeb12/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:53.941210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:53.962227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32667a18-d781-49aa-b4ca-74c07d6e7686 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:53.968706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:53.969567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:53.970017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:53.973232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:53.976104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:53.977176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61d129f38240447cbc0133726b37f861'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:53.978019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61d129f38240447cbc0133726b37f861'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:53.978481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:53.991858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61d129f38240447cbc0133726b37f861'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:53.992820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61d129f38240447cbc0133726b37f861'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:53.999443 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2327/4655] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:53 2022] GET /identity/v3/roles => generated 2322 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:54.005153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.008917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:54.015141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61d129f38240447cbc0133726b37f861'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:54.033255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55afbab-5cfd-4835-9c8d-f99a5fbc2f3a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.057914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.058215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.058483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.058762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.062794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2329/4656] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:53 2022] DELETE /identity/v3/users/61d129f38240447cbc0133726b37f861 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:54.062794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.062794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:54.073264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.075376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.097127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2328/4657] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:53 2022] POST /identity/v3/roles => generated 269 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:54.102289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.131932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780a2127-4de2-4ad5-87f7-d7cec0d4a09a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.186058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50574232-6de4-4970-a358-d6c6629eef28 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.196014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.197191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.197581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.197959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] PATH_INFO: `/v3/projects/c39e07e14e3e44e595d436bd5d7fa01c/users/f708991d8ffa445080b3b598b7b10f56/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.220935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.221647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.221994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.222283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.223709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.225117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.234114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39e07e14e3e44e595d436bd5d7fa01c, user_id=f708991d8ffa445080b3b598b7b10f56, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.237195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.258326 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2329/4658] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:54 2022] POST /identity/v3/roles => generated 268 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:54.263707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.267799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2330/4659] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:54 2022] PUT /identity/v3/projects/c39e07e14e3e44e595d436bd5d7fa01c/users/f708991d8ffa445080b3b598b7b10f56/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:54.272084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.301354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4eb26-885a-44cd-924b-1e0356d698bd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.389584 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:54.446544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.447729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.456095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.459639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/41c1320123174f2bb8d157ae8d25f239` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.462307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3, implied_role_id=41c1320123174f2bb8d157ae8d25f239)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.463050 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:54.463050 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:54.463050 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:54.468372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.490592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff0510-484d-4edc-853a-3f44cedae33b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.498417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.499674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.500140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.500672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.501570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.503485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.516402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2330/4660] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:30:54 2022] PUT /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/41c1320123174f2bb8d157ae8d25f239 => generated 528 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:30:54.520271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.533623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2331/4661] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:54 2022] GET /identity/v3/roles => generated 2322 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:30:54.535625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.551498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73882ceb-036a-49a8-8432-c92b827cd49b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.577057 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:54.653820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fc559e-08a0-4211-b097-9a262d4bc223 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.665620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.666545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.666844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.667127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.668889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.672900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.692031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.693772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.694208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.694643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] PATH_INFO: `/v3/projects/c39e07e14e3e44e595d436bd5d7fa01c/users/f708991d8ffa445080b3b598b7b10f56/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.698149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c39e07e14e3e44e595d436bd5d7fa01c, user_id=f708991d8ffa445080b3b598b7b10f56, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.701516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.705424 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2331/4662] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:30:54 2022] POST /identity/v3/domains => generated 277 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:54.705424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.708430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:54.725094 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2332/4663] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:54 2022] PUT /identity/v3/projects/c39e07e14e3e44e595d436bd5d7fa01c/users/f708991d8ffa445080b3b598b7b10f56/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:54.726159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:54.827395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc1d0b-3d05-4374-b3df-0c78a3a570f7 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.830480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004727c5-60b3-4e87-8f14-11a53e2650cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:54.837710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7bc1b-ab09-4ae3-b23c-781cd6c58323 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.838420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7bc1b-ab09-4ae3-b23c-781cd6c58323 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.838696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7bc1b-ab09-4ae3-b23c-781cd6c58323 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.839431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7bc1b-ab09-4ae3-b23c-781cd6c58323 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.839732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7bc1b-ab09-4ae3-b23c-781cd6c58323 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.841461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7bc1b-ab09-4ae3-b23c-781cd6c58323 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:54.864065 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2333/4664] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:30:54 2022] POST /identity/v3/roles => generated 269 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:54.871529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.871529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.871529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.912175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] MFA Rules not processed for user `f708991d8ffa445080b3b598b7b10f56`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:54.913536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:54.923501 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:54.939096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:54.941277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:54.941277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:54.941277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] PATH_INFO: `/v3/projects/34c205594ae1417cb72ed172e332cf01` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:54.944332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c205594ae1417cb72ed172e332cf01)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:54.949843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:55.094836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c205594ae1417cb72ed172e332cf01', 'request_id': 'req-b2b855dc-fac3-479d-aa11-05b6eb41507d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:55.106926 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2334/4665] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:54 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:55.108005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:55.114855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c205594ae1417cb72ed172e332cf01', 'request_id': 'req-b2b855dc-fac3-479d-aa11-05b6eb41507d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:55.123791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c205594ae1417cb72ed172e332cf01', 'request_id': 'req-b2b855dc-fac3-479d-aa11-05b6eb41507d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:55.144570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] The token cache is being invalidate because project 34c205594ae1417cb72ed172e332cf01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:55.144982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:55.146019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2b855dc-fac3-479d-aa11-05b6eb41507d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:55.149438 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2332/4666] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:30:54 2022] DELETE /identity/v3/projects/34c205594ae1417cb72ed172e332cf01 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:55.150960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:55.151243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:55.152664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:55.156684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1142e39f-19b5-438e-bf42-2a72772c6ce4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:55.214220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:55.215878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:55.222947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2333/4667] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:55 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:30:55.224158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:55.226026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:55.239839 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:55.316436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eacee20-5e6f-47ee-a953-94a7ec9fca0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:55.317804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacee20-5e6f-47ee-a953-94a7ec9fca0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:55.323712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacee20-5e6f-47ee-a953-94a7ec9fca0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:55.324064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eacee20-5e6f-47ee-a953-94a7ec9fca0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/812701f67fd94b7a8630bcc3e96565e8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:55.326323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacee20-5e6f-47ee-a953-94a7ec9fca0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3, implied_role_id=812701f67fd94b7a8630bcc3e96565e8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:55.328030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eacee20-5e6f-47ee-a953-94a7ec9fca0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:55.368589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3b4732-a5cf-445c-9a8d-ed43e5c7050e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:55.383466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:55.384475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:55.385452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:55.385947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:55.386911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:55.388171 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:55.388171 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:55.388171 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:55.390383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369851e-f15d-4972-89d8-29f37eeb19b9 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:55.446566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2334/4668] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:30:55 2022] POST /identity/v3/regions => generated 223 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:55.448387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:55.448750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:55.449030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:55.451614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2335/4669] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:30:55 2022] PUT /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/812701f67fd94b7a8630bcc3e96565e8 => generated 529 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:55.452469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:55.452757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:55.453054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:55.498424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:55.499652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:55.502282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:55.503556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:55.693990 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2336/4670] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:55.694614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:55.704748 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:55.712416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2335/4671] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:55.713582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:55.716138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:55.974894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dac224-26ae-4316-bd00-e6a2ad0bedc8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.004748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.008579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636979e-b252-42e7-879e-1308ddefaf6f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.009579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.011606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.012403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.016526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.017594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.017947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.018298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.019097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.020454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3, implied_role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.022344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.023421 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:56.023421 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:56.023421 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:56.034513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d0bf7-ee7a-4cf2-bd4b-af0adab26645 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.089600 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2336/4672] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:30:55 2022] PUT /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/343bec11e81441cd9e652eff1964074a => generated 525 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:56.096833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.115134 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2337/4673] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:30:55 2022] POST /identity/v3/regions => generated 222 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:56.116205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.116577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.117028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.139952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:56.141353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:56.197423 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:56.253236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93acddb2-6094-4961-9414-065b14c06201 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.275116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.276234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.277424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.278221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.315412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2338/4674] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:56.316656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.344284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:56.362912 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2337/4675] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:30:56 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:56.364912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.432842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7220e5-2de3-472d-971a-343dbc2cfd7a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.437592 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:56.441399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.442622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.442988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.443451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/343bec11e81441cd9e652eff1964074a/implies/64fe82d9a03b4d39a43d99c2b4ac96d3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.446960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=343bec11e81441cd9e652eff1964074a, implied_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.451449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.493202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82100cc1-de62-43d9-ac69-7cd7714bdfda tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.502219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.503450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] 64fe82d9a03b4d39a43d99c2b4ac96d3 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 64fe82d9a03b4d39a43d99c2b4ac96d3 cannot be an implied roles. Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Jul 19 11:30:56.503937 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Jul 19 11:30:56.505284 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:56.505284 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:56.505284 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Jul 19 11:30:56.505284 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Jul 19 11:30:56.505284 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 64fe82d9a03b4d39a43d99c2b4ac96d3 cannot be an implied roles. Jul 19 11:30:56.505284 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:30:56.505927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.509691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2339/4676] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:30:56 2022] PUT /identity/v3/roles/343bec11e81441cd9e652eff1964074a/implies/64fe82d9a03b4d39a43d99c2b4ac96d3 => generated 116 bytes in 190 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:56.509691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.509873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/de4e6aaf-a5b7-4cac-8c36-9d7c82a575ac` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.509873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:create_region(region_id=de4e6aaf-a5b7-4cac-8c36-9d7c82a575ac)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.516924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.527382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c769e946-0c8f-4bf4-a14b-87ca86bdf53c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.534949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.535873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.536290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.537199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.538115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:30:56.538434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.540695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.565212 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2340/4677] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:56.566358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.591723 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2338/4678] 10.222.0.15 () {60 vars in 1258 bytes} [Tue Jul 19 11:30:56 2022] PUT /identity/v3/regions/de4e6aaf-a5b7-4cac-8c36-9d7c82a575ac => generated 231 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:56.593136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.657701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3845b442-ed3d-4535-9cbc-267550fafdca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.672265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c83067-6a91-4169-aa14-46fd19fc0279 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.678390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.679211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.679506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.680078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.680859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.683581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.710210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.711428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.711743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.712054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.714622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3, implied_role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.718904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.736466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2341/4679] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:30:56 2022] DELETE /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:56.736466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.742343 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2339/4680] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:30:56 2022] POST /identity/v3/projects => generated 405 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:56.743551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:56.916074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5670563-59c6-4db2-95a5-67b47d8bc2aa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.923321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:56.924094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637296ac-c433-4b7d-ad08-5d04ed8fc0d4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:56.925634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:56.928153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:56.929626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/812701f67fd94b7a8630bcc3e96565e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:56.933124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3, implied_role_id=812701f67fd94b7a8630bcc3e96565e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:56.935147 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:56.935782 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:56.935782 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:56.935782 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:56.939910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:56.952771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2340/4681] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:30:56 2022] DELETE /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/812701f67fd94b7a8630bcc3e96565e8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:56.955144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.064687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.066550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.067074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.067608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/de4e6aaf-a5b7-4cac-8c36-9d7c82a575ac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.069256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=de4e6aaf-a5b7-4cac-8c36-9d7c82a575ac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.070788 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:57.070788 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:30:57.070788 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:30:57.072143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.102953 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2342/4682] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:30:56 2022] DELETE /identity/v3/regions/de4e6aaf-a5b7-4cac-8c36-9d7c82a575ac => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:57.103895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.107320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ef2d89-44d2-4d55-b193-ef89dae09f90 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.139018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.139506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.139790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.140310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.141243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.144324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.147797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94478ab6-5f35-48d6-aafb-392374a46d0d tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.185411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2341/4683] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:30:56 2022] POST /identity/v3/users => generated 303 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:57.186369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.208325 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:57.235938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.236978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.237269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.237590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/812701f67fd94b7a8630bcc3e96565e8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.239006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=812701f67fd94b7a8630bcc3e96565e8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.241529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.288515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 812701f67fd94b7a8630bcc3e96565e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:57.288745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:57.290103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:57.300419 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2343/4684] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:57 2022] DELETE /identity/v3/roles/812701f67fd94b7a8630bcc3e96565e8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:57.300419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.309728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:57.397525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d473297-5915-4b03-9231-3f5849cb7526 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.466777 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:57.513077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036e05e-e9b5-4fda-89e8-a41330c797c2 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.521314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.522523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.522880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.523339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.524254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.528656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.569874 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2344/4685] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:57 2022] GET /identity/v3/roles => generated 2322 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:57.572693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.577332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:57.601995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7270aa8-5359-418f-b769-98c6c8c4603c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.602704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270aa8-5359-418f-b769-98c6c8c4603c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.602982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270aa8-5359-418f-b769-98c6c8c4603c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.603270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7270aa8-5359-418f-b769-98c6c8c4603c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.605928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7270aa8-5359-418f-b769-98c6c8c4603c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.616677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7270aa8-5359-418f-b769-98c6c8c4603c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.651205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2342/4686] 10.222.0.15 () {60 vars in 1149 bytes} [Tue Jul 19 11:30:57 2022] POST /identity/v3/regions => generated 254 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:30:57.651205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.651205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.651205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.690166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:57.691406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:57.695310 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2343/4687] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:57 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:30:57.698403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.705052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac02dce-e13e-430a-97fd-3c484ab94fa7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.727222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f49ee-c1bf-462a-8278-b57d57e379f9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.733818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.733956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.734678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.734998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.735147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.735303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.735661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.736083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.736507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/17c31c9ba66d4d2ab541adb8f47b3ac9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.737893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.756125 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2344/4688] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:30:57 2022] GET /identity/v3/roles => generated 2322 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:30:57.757212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=17c31c9ba66d4d2ab541adb8f47b3ac9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.757330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.768367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:57.768599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.789644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0308d92a-e936-49fb-905e-2ebab322f9e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.792496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:57.794804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:57.795140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.796445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.796743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.797262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/c03ab71e93254d558e032815d9d5ee18` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.798293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:update_region(region_id=c03ab71e93254d558e032815d9d5ee18)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:57.800138 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:57.800138 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:57.800138 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:57.801096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee2657-b63a-4ba1-80f4-c6fcbf371938 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:57.828176 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2345/4689] 10.222.0.15 () {60 vars in 1249 bytes} [Tue Jul 19 11:30:57 2022] PATCH /identity/v3/regions/c03ab71e93254d558e032815d9d5ee18 => generated 253 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:57.828176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.828176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.828176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.830656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:57.831322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:57.837209 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2345/4690] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:30:57 2022] PATCH /identity/v3/domains/17c31c9ba66d4d2ab541adb8f47b3ac9 => generated 278 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:57.837209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.837209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:57.867904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] MFA Rules not processed for user `ec8e9dbd170a4e829e1edadbaf3c2164`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:57.869402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:57.902575 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:57.943119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44048c0-f927-4634-b6c9-8b27426c4150 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:57.969919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:57.973179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:57.973890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:57.974295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] PATH_INFO: `/v3/projects/ff6c4c81832d49fc8fcd1f809730d632/users/9ba7d6118edc4c4eb4931b8cdebcdcde/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:57.987523 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2346/4691] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:57.988469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:57.999865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.006635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6c4c81832d49fc8fcd1f809730d632, user_id=9ba7d6118edc4c4eb4931b8cdebcdcde, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:58.011843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:58.035989 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2346/4692] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:30:57 2022] PUT /identity/v3/projects/ff6c4c81832d49fc8fcd1f809730d632/users/9ba7d6118edc4c4eb4931b8cdebcdcde/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:58.037448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:58.041650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.056796 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:58.160934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0378e3f8-8845-44a1-a73d-4695f6570193 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:58.172303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69d5c61-ecbf-431a-8dcc-19f983813210 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:58.181405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:58.183180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.183666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.183951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/17c31c9ba66d4d2ab541adb8f47b3ac9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.201045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=17c31c9ba66d4d2ab541adb8f47b3ac9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:58.202997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:58.233733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.238156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.241077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d3346b-e30d-487b-b730-b35b26a0b4fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:58.242157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3346b-e30d-487b-b730-b35b26a0b4fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.242618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3346b-e30d-487b-b730-b35b26a0b4fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.243121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d3346b-e30d-487b-b730-b35b26a0b4fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/c03ab71e93254d558e032815d9d5ee18` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.244152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3346b-e30d-487b-b730-b35b26a0b4fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:get_region(region_id=c03ab71e93254d558e032815d9d5ee18)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:58.245576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d3346b-e30d-487b-b730-b35b26a0b4fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:58.256147 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2347/4693] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:30:57 2022] GET /identity/v3/regions/c03ab71e93254d558e032815d9d5ee18 => generated 253 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:58.259235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.259676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.260157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.283154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] MFA Rules not processed for user `ec8e9dbd170a4e829e1edadbaf3c2164`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:58.284622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.318826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9', 'request_id': 'req-7d1d9af4-5e96-4e20-8734-96a483d88e6c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.335846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9', 'request_id': 'req-7d1d9af4-5e96-4e20-8734-96a483d88e6c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.352472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9', 'request_id': 'req-7d1d9af4-5e96-4e20-8734-96a483d88e6c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.371762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] The token cache is being invalidate because project 17c31c9ba66d4d2ab541adb8f47b3ac9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:58.372135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.372751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.381358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9', 'request_id': 'req-7d1d9af4-5e96-4e20-8734-96a483d88e6c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.382124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9', 'request_id': 'req-7d1d9af4-5e96-4e20-8734-96a483d88e6c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.385516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7d1d9af4-5e96-4e20-8734-96a483d88e6c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '17c31c9ba66d4d2ab541adb8f47b3ac9', 'request_id': 'req-7d1d9af4-5e96-4e20-8734-96a483d88e6c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:58.395569 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2347/4694] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:30:58 2022] DELETE /identity/v3/domains/17c31c9ba66d4d2ab541adb8f47b3ac9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:58.397647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.397937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.398213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.406748 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2348/4695] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:58.408280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:58.418427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:58.418870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.419619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.435420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76688c55-5d80-4b01-b047-d37131f71ad3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:58.443779 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:58.462090 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:58.516439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:58.517574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.517948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.518344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/c03ab71e93254d558e032815d9d5ee18` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.519029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c03ab71e93254d558e032815d9d5ee18)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:58.520733 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:58.520733 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:58.520733 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:58.525022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:58.525183 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2348/4696] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:58.525183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:58.525183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.563149 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2349/4697] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:30:58 2022] DELETE /identity/v3/regions/c03ab71e93254d558e032815d9d5ee18 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:58.564168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:58.565981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.607215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000188f-1784-4296-92b7-0f893caaa1b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:58.635147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:58.636150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.636508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.636788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/41c1320123174f2bb8d157ae8d25f239` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.638806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=64fe82d9a03b4d39a43d99c2b4ac96d3, implied_role_id=41c1320123174f2bb8d157ae8d25f239)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:58.641071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:58.659499 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2349/4698] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:30:58 2022] DELETE /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3/implies/41c1320123174f2bb8d157ae8d25f239 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:58.661223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:58.663769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.727231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77d9b9-8d07-4c97-a515-883134729f11 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:58.798721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b05516-862a-4c16-a9a7-a35f1b100dcb tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:58.808994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:58.811362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.812055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.813993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.862828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:58.863930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:58.866337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:58.866991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:58.871031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:58.909666 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:58.935045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:58.937411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:58.955947 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:58.973060 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2350/4699] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:58.974528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:59.047186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:59.055472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:59.136683 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2350/4700] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:30:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:30:59.138302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:59.224524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ecadd-f20a-456c-9f8a-34a8873fffca service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:59.236816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c4b64-f391-4238-ac77-9575558768fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:59.239392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c4b64-f391-4238-ac77-9575558768fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.239689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c4b64-f391-4238-ac77-9575558768fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.239966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c4b64-f391-4238-ac77-9575558768fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.241135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c4b64-f391-4238-ac77-9575558768fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:59.244012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170c4b64-f391-4238-ac77-9575558768fd tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:59.261413 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2351/4701] 10.222.0.15 () {58 vars in 1127 bytes} [Tue Jul 19 11:30:58 2022] GET /identity/v3/regions => generated 667 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:59.264239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.264506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.266401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.317107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:59.320214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:59.358309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56930776-79ac-4a35-bcc0-8909e3960512 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:59.377533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:59.378464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.378754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.383881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/41c1320123174f2bb8d157ae8d25f239` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.390834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=41c1320123174f2bb8d157ae8d25f239)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:59.391934 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:30:59.391934 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:30:59.391934 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:30:59.392896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:59.514774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 41c1320123174f2bb8d157ae8d25f239 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:59.516505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:59.518245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:59.524401 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2351/4702] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:59 2022] DELETE /identity/v3/roles/41c1320123174f2bb8d157ae8d25f239 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:59.533189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:59.539025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:59.587402 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2352/4703] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:30:59.588595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:59.593435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:59.628091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66038472-302f-42ba-8946-c6e0f600df43 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:59.721520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d4a1d-d7b1-43e9-ad78-ea7ce8dc4a4a tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:59.733280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:59.734378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.734798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.735205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/c03ab71e93254d558e032815d9d5ee18` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.735994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=c03ab71e93254d558e032815d9d5ee18)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:59.739909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-988855e2-b9e2-4514-be48-be489a76bfd1 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Could not find region: c03ab71e93254d558e032815d9d5ee18.: keystone.exception.RegionNotFound: Could not find region: c03ab71e93254d558e032815d9d5ee18. Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: c03ab71e93254d558e032815d9d5ee18. Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:30:59.777347 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: c03ab71e93254d558e032815d9d5ee18. Jul 19 11:30:59.778592 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:30:59.784712 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2352/4704] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:30:59 2022] DELETE /identity/v3/regions/c03ab71e93254d558e032815d9d5ee18 => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:30:59.784712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.784712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.785689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.795395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:59.796489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.796779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.797118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.798488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=64fe82d9a03b4d39a43d99c2b4ac96d3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:59.800168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:59.836290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:30:59.837549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:30:59.842190 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2353/4705] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:59 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:30:59.843028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:59.849950 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:59.881359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cfc0c-1ad2-41bb-b20a-3fdb95e31d92 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:30:59.908625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:30:59.910433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.911269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.911269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.911727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:30:59.913301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:30:59.916981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 64fe82d9a03b4d39a43d99c2b4ac96d3 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:30:59.917278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:59.917978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e8aaca5-1bbf-4128-b3bd-4c3eaa536990 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:30:59.923417 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2353/4706] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:30:59 2022] DELETE /identity/v3/roles/64fe82d9a03b4d39a43d99c2b4ac96d3 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:30:59.924843 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:30:59.928857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:30:59.928857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:30:59.928857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:30:59.950655 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2354/4707] 10.222.0.15 () {58 vars in 1127 bytes} [Tue Jul 19 11:30:59 2022] GET /identity/v3/regions => generated 667 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:30:59.951612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:30:59.959399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:00.000625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4a7989-46d5-4e20-934a-bf86bd42f9bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.075088 n-d-master-1 devstack@keystone.service[80581]: WARNING keystone.server.flask.application [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] Authorization failed. The request you have made requires authentication. from 10.222.0.15: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 11:31:00.078257 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2354/4708] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:30:59 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 154 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 11:31:00.080130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.083203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:00.163092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5c3746-1491-4ec2-b8a1-aab18c5808b3 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.163941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c3746-1491-4ec2-b8a1-aab18c5808b3 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.164227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c3746-1491-4ec2-b8a1-aab18c5808b3 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.164565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5c3746-1491-4ec2-b8a1-aab18c5808b3 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.166823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c3746-1491-4ec2-b8a1-aab18c5808b3 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.168589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5c3746-1491-4ec2-b8a1-aab18c5808b3 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.222826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa0e2b-88c6-4efe-8282-00b727877d5f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.223281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2355/4709] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:30:59 2022] PUT /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 520 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:00.233321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5067-7097-4d33-a3a4-ea3b6b552e8b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.234821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5067-7097-4d33-a3a4-ea3b6b552e8b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.235104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed5067-7097-4d33-a3a4-ea3b6b552e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.311300 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.server.flask.application [None req-0aed5067-7097-4d33-a3a4-ea3b6b552e8b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.15: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 11:31:00.313919 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2356/4710] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 90 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 11:31:00.317230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5067-7097-4d33-a3a4-ea3b6b552e8b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.355431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d59d59-63f5-4ae0-bdf4-176bee47cd0c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.356131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59d59-63f5-4ae0-bdf4-176bee47cd0c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.356438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59d59-63f5-4ae0-bdf4-176bee47cd0c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.356712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d59d59-63f5-4ae0-bdf4-176bee47cd0c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.359015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d59d59-63f5-4ae0-bdf4-176bee47cd0c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.364259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d59d59-63f5-4ae0-bdf4-176bee47cd0c tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.437495 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2355/4711] 10.222.0.15 () {60 vars in 1149 bytes} [Tue Jul 19 11:31:00 2022] POST /identity/v3/regions => generated 253 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:00.440717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed494a-ec00-45b5-b4cc-3baac949248a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.441001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed494a-ec00-45b5-b4cc-3baac949248a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.441276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed494a-ec00-45b5-b4cc-3baac949248a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.502587 n-d-master-1 devstack@keystone.service[80581]: WARNING keystone.server.flask.application [None req-3eed494a-ec00-45b5-b4cc-3baac949248a None None] Authorization failed. The request you have made requires authentication. from 10.222.0.15: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 11:31:00.509317 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2356/4712] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:00 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 73 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 11:31:00.511900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed494a-ec00-45b5-b4cc-3baac949248a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.538082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed5067-7097-4d33-a3a4-ea3b6b552e8b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.555157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.556429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.556429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.556698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.559631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.562883 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:00.562883 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:31:00.562883 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:31:00.564291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.565205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed494a-ec00-45b5-b4cc-3baac949248a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.566430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.568015 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:00.568015 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:31:00.568015 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:31:00.568906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.576379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.577098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.577542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.577830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.578552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Adding query filter params (parent_region_id=990fa5359c894cd38c62d490b6ffe22c) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:00.578860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.580231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.584652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2357/4713] 10.222.0.15 () {58 vars in 1344 bytes} [Tue Jul 19 11:31:00 2022] HEAD /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:00.590275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.599169 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2357/4714] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:31:00 2022] GET /identity/v3/regions?parent_region_id=990fa5359c894cd38c62d490b6ffe22c => generated 399 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:00.603217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.613229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aabc2a-c7fe-4891-8093-d12832f8d06b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.617230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4366a15-b65b-4b22-80bd-71e6954862bc tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.637751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.638714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.638999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.639312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.642822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.646408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.655637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.660619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.661189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.661486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/bf70f39af0424df38acc2a797900741f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.667076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=bf70f39af0424df38acc2a797900741f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.676805 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2358/4715] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:31:00 2022] GET /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 520 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:00.676952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.678123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.757005 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2358/4716] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:31:00 2022] DELETE /identity/v3/regions/bf70f39af0424df38acc2a797900741f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:00.757328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c59e53-7ca6-45a1-98da-315d55f8ae62 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.764562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.802968 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:00.812603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137041c2-4c84-4b00-8aad-342a0e7a8fe3 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:00.838678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.839793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.840548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.840909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/7b86c15d3cd242eead6cc721be06c54f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.842201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7b86c15d3cd242eead6cc721be06c54f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.844427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.848249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:00.850629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:00.853936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:00.858135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:00.862578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:00.867299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:00.908179 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2359/4717] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:00 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:00.912183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.935429 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2359/4718] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:31:00 2022] DELETE /identity/v3/regions/7b86c15d3cd242eead6cc721be06c54f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:00.937773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:00.971852 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:00.976044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6231cc3a-1f8e-4b3f-a8c7-7acc3353dcf6 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:01.092824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda83a60-afb0-4aa4-8871-e66ee6a29a66 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:01.107677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f708991d8ffa445080b3b598b7b10f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c39e07e14e3e44e595d436bd5d7fa01c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:01.109232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.109582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.109962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] PATH_INFO: `/v3/regions/990fa5359c894cd38c62d490b6ffe22c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.110689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=990fa5359c894cd38c62d490b6ffe22c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:01.112953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:01.128723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:01.130760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.131091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.132601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.137576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:01.141164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:01.148556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2360/4719] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:31:00 2022] DELETE /identity/v3/regions/990fa5359c894cd38c62d490b6ffe22c => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:01.154341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:01.159996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533.: keystone.exception.ImpliedRoleNotFound: 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533. Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = query.one() Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:01.207275 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 19 11:31:01.208528 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 19 11:31:01.209443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 19 11:31:01.209443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533. Jul 19 11:31:01.209443 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:01.215629 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2360/4720] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:31:00 2022] GET /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 137 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:01.216680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:01.259613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f3dbf-061e-409e-a147-1ded805b9550 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:01.325221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:01.326223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.326545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.326835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.331705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:01.333603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533.: keystone.exception.ImpliedRoleNotFound: 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533. Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = query.one() Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:01.374903 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Jul 19 11:31:01.376186 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Jul 19 11:31:01.377266 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Jul 19 11:31:01.377266 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Jul 19 11:31:01.377266 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Jul 19 11:31:01.377266 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 9f81740fe41842179cf737cd8f4fffde does not imply ee165ad901e045e18dadd8c7459ef533. Jul 19 11:31:01.377266 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:01.392888 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2361/4721] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:01 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 137 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:01.393908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:01.412210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7dbfac-9283-450d-85d4-69b62498335f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:01.424405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:01.429021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adddfc6b-1733-4b11-8814-c3f6762fbaa0 tempest-RegionsTestJSON-1172177268 tempest-RegionsTestJSON-1172177268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:01.430551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.430787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.431056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.437642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:01.439417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:01.439988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.440484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.441365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:01.441791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] PATH_INFO: `/v3/users/715eb0a0c7f24025baf67438f66da863` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.445786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=715eb0a0c7f24025baf67438f66da863)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:01.448934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:01.523283 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2362/4722] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:31:01 2022] PUT /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 520 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:01.534191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:01.582446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '715eb0a0c7f24025baf67438f66da863'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:01.583452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '715eb0a0c7f24025baf67438f66da863'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:01.594103 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:01.606282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '715eb0a0c7f24025baf67438f66da863'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:01.608318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '715eb0a0c7f24025baf67438f66da863'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:01.630219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-48828279-edde-463e-8059-d9329012fae6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '715eb0a0c7f24025baf67438f66da863'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:01.697710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2361/4723] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:01 2022] DELETE /identity/v3/users/715eb0a0c7f24025baf67438f66da863 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:01.726460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.727241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.727551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.736058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1e24a-e20d-498c-b5c3-21fb2bb5a40f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:01.824153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:01.827817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:01.921232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:01.922202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:01.922486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:01.922762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:01.933323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=e25d3be007eb4308bc2350f155301587)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:01.935156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.003833 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:02.021053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2363/4724] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:31:01 2022] PUT /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587 => generated 520 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:02.022207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.025639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:02.080362 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2362/4725] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:02.091233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.095169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:02.191037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446acd7-ea66-4e7a-a02a-3bcf861c9d3f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:02.200056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:02.201077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:02.201360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:02.201638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:02.204682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e25d3be007eb4308bc2350f155301587, implied_role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:02.206850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.258269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba168b0-738c-4c7b-97f1-40decfa388e7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:02.275568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2364/4726] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:31:02 2022] PUT /identity/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a => generated 520 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:02.278641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.346324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:02.347857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:02.348390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:02.348899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:02.411662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1818351-de34-4786-867f-db4659646797 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:02.418577 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:02.429548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:02.430200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:02.430737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:02.431258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:02.432121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:02.435146 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:02.435146 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:31:02.435146 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:31:02.436377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.486488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2365/4727] 10.222.0.15 () {58 vars in 1151 bytes} [Tue Jul 19 11:31:02 2022] GET /identity/v3/role_inferences => generated 1605 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:02.487502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.498187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:02.500681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.502113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f8c8a-b7b3-43b0-9b48-cb2a571ffa67 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:02.510196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:02.511142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:02.511421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:02.511694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:02.513880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e25d3be007eb4308bc2350f155301587, implied_role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:02.515530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.518564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2363/4728] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:31:02.549631 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2366/4729] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:02 2022] DELETE /identity/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:02.552534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.566157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c216d0d0-6192-46ab-892a-821305d07806 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:02.722399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:02.727645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:02.728077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:02.744688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:02.748589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=e25d3be007eb4308bc2350f155301587)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:02.750257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.789572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2364/4730] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:02 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:02.793796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.817855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb630c5-d55c-469f-aabf-f02f8c380137 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:02.924417 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:02.942470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:02.943861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:02.944304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:02.945168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:02.950211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:02.954442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:02.979650 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2367/4731] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:02 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:02.984705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:02.999327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170293-e473-4c01-b698-60deef9fafb9 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:03.180115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:03.180865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.181289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.181574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.182316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:03.183973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:03.219986 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2365/4732] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:02 2022] GET /identity/v3/roles => generated 2322 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:03.221044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:03.245728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7964d4-39ba-4e47-bf4b-389e11ff6ea5 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:03.292459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:03.293167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.293989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.294292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.295085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:03.296773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:03.340409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:03.345882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2368/4733] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:03 2022] POST /identity/v3/roles => generated 235 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:03.352808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1291883-3d49-423b-b901-931689042282 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:03.380708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:03.386107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.386625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.387059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/aedb6b014b474d5cbe5b9858d5d8fba4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.390577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:update_role(role_id=aedb6b014b474d5cbe5b9858d5d8fba4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:03.396907 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:03.396907 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:31:03.396907 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:31:03.402042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:03.508143 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2366/4734] 10.222.0.15 () {60 vars in 1242 bytes} [Tue Jul 19 11:31:03 2022] PATCH /identity/v3/roles/aedb6b014b474d5cbe5b9858d5d8fba4 => generated 238 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:03.513749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:03.527590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dcdfb-1c67-40eb-bb43-5e87e1caa36b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:03.538463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:03.539466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.539744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.541149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/aedb6b014b474d5cbe5b9858d5d8fba4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.575988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:get_role(role_id=aedb6b014b474d5cbe5b9858d5d8fba4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:03.581958 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:03.581958 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:31:03.581958 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:31:03.582955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:03.589097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:03.589761 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2369/4735] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:31:03 2022] GET /identity/v3/roles/aedb6b014b474d5cbe5b9858d5d8fba4 => generated 238 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:03.611714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b6de7a-6e34-4138-b5e3-1005e8f2eabd tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:03.620526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a2137-0e0e-415b-baf3-98afc2e3c75e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:03.621602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a2137-0e0e-415b-baf3-98afc2e3c75e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.622098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a2137-0e0e-415b-baf3-98afc2e3c75e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.622645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a2137-0e0e-415b-baf3-98afc2e3c75e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.623601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a2137-0e0e-415b-baf3-98afc2e3c75e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:03.628525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a2137-0e0e-415b-baf3-98afc2e3c75e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:03.658649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2367/4736] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:03 2022] GET /identity/v3/roles => generated 2551 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:31:03.662656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:03.678305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8120223-91ac-4fd9-b972-de2d199f606f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:03.696292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:03.699439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.699738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.700028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/aedb6b014b474d5cbe5b9858d5d8fba4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.708889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=aedb6b014b474d5cbe5b9858d5d8fba4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:03.716547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:03.830447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:03.830949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:03.831213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:03.836677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role aedb6b014b474d5cbe5b9858d5d8fba4 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:03.837289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:03.839738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:03.847265 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2370/4737] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:03 2022] DELETE /identity/v3/roles/aedb6b014b474d5cbe5b9858d5d8fba4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:03.864336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:03.866566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:03.867434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:03.867978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:03.935347 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:04.026258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c28b65-10a0-4f5d-b4b3-925583a6856d tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:04.039629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:04.040651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:04.040936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:04.043818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:04.047484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:04.050949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:04.107398 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2368/4738] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:04.109631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:04.118590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:04.136004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2371/4739] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:31:03 2022] PUT /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 520 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:04.139277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:04.281297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c14f31-8fc6-461e-a515-f7d99e12a528 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:04.311517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b14f4b-8745-4542-b8b3-9c759ab73ea9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:04.312641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:04.313626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:04.313953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:04.314232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:04.319025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=e25d3be007eb4308bc2350f155301587)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:04.331716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:04.364571 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:04.435030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2372/4740] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:31:04 2022] PUT /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587 => generated 520 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:04.436479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:04.439890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:04.501974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:04.503633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:04.504064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:04.504582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] PATH_INFO: `/v3/projects/703d3eebac98466da0834e25980d927c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:04.506733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=703d3eebac98466da0834e25980d927c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:04.509787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:04.617896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7aaa3d-b524-429d-b9c2-fbb5b8538795 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:04.629911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:04.630612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:04.630900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:04.634133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:04.686540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '703d3eebac98466da0834e25980d927c', 'request_id': 'req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:04.700582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '703d3eebac98466da0834e25980d927c', 'request_id': 'req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:04.724306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '703d3eebac98466da0834e25980d927c', 'request_id': 'req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:04.730961 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:04.751315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] The token cache is being invalidate because project 703d3eebac98466da0834e25980d927c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:04.753558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:04.755957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:04.760007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2369/4741] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:04 2022] DELETE /identity/v3/projects/703d3eebac98466da0834e25980d927c => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:04.761476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:04.765322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:04.789578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:04.795544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:04.820528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2373/4742] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:04.821536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:04.871138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bba4a5a-3e48-4d07-93ee-e20bb8de8a0c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:04.876144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:04.877984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:04.878337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:04.878718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:04.880828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=e25d3be007eb4308bc2350f155301587, implied_role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:04.882791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:04.936751 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2370/4743] 10.222.0.15 () {60 vars in 1362 bytes} [Tue Jul 19 11:31:04 2022] PUT /identity/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a => generated 520 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:04.944655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:04.956392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f728f1-e581-478d-b8f0-564bc1da4a22 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:05.031761 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:05.042660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0d2e1-10b8-4cfc-978f-bd6eafb1f317 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:05.061785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:05.062972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:05.063264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:05.063543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/e25d3be007eb4308bc2350f155301587/implies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:05.065132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=e25d3be007eb4308bc2350f155301587)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:05.068813 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:05.068813 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:31:05.068813 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:31:05.069751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:05.100153 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2371/4744] 10.222.0.15 () {58 vars in 1244 bytes} [Tue Jul 19 11:31:04 2022] GET /identity/v3/roles/e25d3be007eb4308bc2350f155301587/implies => generated 489 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:05.101982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:05.128506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:05.129970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:05.131669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:05.132207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] PATH_INFO: `/v3/users/f708991d8ffa445080b3b598b7b10f56` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:05.134076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f708991d8ffa445080b3b598b7b10f56)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:05.144547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:05.152956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03567a1b-9768-4af0-81c9-fd5b3de3b28f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:05.173830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:05.174720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:05.175006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:05.175284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:05.183538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=9f81740fe41842179cf737cd8f4fffde)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:05.185261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:05.207951 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2372/4745] 10.222.0.15 () {58 vars in 1244 bytes} [Tue Jul 19 11:31:05 2022] GET /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies => generated 659 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:05.215229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:05.236223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2c17b-13b2-45b0-b8d1-87be2b053815 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:05.244765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f708991d8ffa445080b3b598b7b10f56'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:05.246995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:05.248000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:05.248313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:05.253035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:05.262137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f708991d8ffa445080b3b598b7b10f56'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:05.268778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=e25d3be007eb4308bc2350f155301587, implied_role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:05.275237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:05.297922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f708991d8ffa445080b3b598b7b10f56'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:05.298130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2373/4746] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:05 2022] DELETE /identity/v3/roles/e25d3be007eb4308bc2350f155301587/implies/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:05.298835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f708991d8ffa445080b3b598b7b10f56'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:05.302613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:05.305713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:05.323571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f708991d8ffa445080b3b598b7b10f56'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:05.352289 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2374/4747] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:04 2022] DELETE /identity/v3/users/f708991d8ffa445080b3b598b7b10f56 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:05.535806 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:05.542164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad25984-de16-434b-b675-ea5456b7abc6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:05.697463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:05.700421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:05.705006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:05.705461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:05.707821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=e25d3be007eb4308bc2350f155301587)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:05.713960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:05.730523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2374/4748] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:05 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/e25d3be007eb4308bc2350f155301587 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:05.734906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:05.753784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a7dd0-f035-4bbc-af3d-d57772fa2835 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:05.923772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:05.925179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:05.925566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:05.925939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:05.931880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=9f81740fe41842179cf737cd8f4fffde, implied_role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:05.934377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:05.947071 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2375/4749] 10.222.0.15 () {58 vars in 1346 bytes} [Tue Jul 19 11:31:05 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde/implies/ee165ad901e045e18dadd8c7459ef533 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:05.952635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:05.970223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44f01ee-e7f8-4b30-adfe-0fdd0fa7c544 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:06.096027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:06.099787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:06.100295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:06.100771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/17c31c9ba66d4d2ab541adb8f47b3ac9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:06.123565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Could not find domain: 17c31c9ba66d4d2ab541adb8f47b3ac9.: keystone.exception.DomainNotFound: Could not find domain: 17c31c9ba66d4d2ab541adb8f47b3ac9. Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 17c31c9ba66d4d2ab541adb8f47b3ac9. Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:06.157412 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:06.158744 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 17c31c9ba66d4d2ab541adb8f47b3ac9. Jul 19 11:31:06.159868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:06.170527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:06.172152 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2375/4750] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:31:05 2022] PATCH /identity/v3/domains/17c31c9ba66d4d2ab541adb8f47b3ac9 => generated 112 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:06.193816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc65f3-aaaa-42ff-9870-f856db92eac4 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:06.205064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:06.207254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:06.207612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:06.207890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/users/3d6c798e83db460384be89d934faeb12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:06.211687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3d6c798e83db460384be89d934faeb12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:06.218618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:06.319000 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:06.333614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d6c798e83db460384be89d934faeb12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.354218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d6c798e83db460384be89d934faeb12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.390668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d6c798e83db460384be89d934faeb12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.391839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d6c798e83db460384be89d934faeb12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.414711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d6c798e83db460384be89d934faeb12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.431417 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2376/4751] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:06 2022] DELETE /identity/v3/users/3d6c798e83db460384be89d934faeb12 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:06.435305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:06.437172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:06.460621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aaa9e7-f99e-4d76-b20a-355144385e0e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:06.599900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:06.600823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:06.601112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:06.601397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/343bec11e81441cd9e652eff1964074a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:06.605488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=343bec11e81441cd9e652eff1964074a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:06.607146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:06.686581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 343bec11e81441cd9e652eff1964074a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:06.686906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.687735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:06.691990 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2376/4752] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:06 2022] DELETE /identity/v3/roles/343bec11e81441cd9e652eff1964074a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:06.696189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:06.714844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337d313-c181-4ba7-b996-d4918853045c tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:06.813057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:06.814602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:06.815105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:06.815625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/groups/8f205821e7e04672996a09aa2097024f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:06.817707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_group(group_id=8f205821e7e04672996a09aa2097024f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:06.820593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:06.920315 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2377/4753] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:31:06 2022] DELETE /identity/v3/groups/8f205821e7e04672996a09aa2097024f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:06.924025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:06.925481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:06.936751 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:06.955036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403c331-eb3b-455d-ae75-17ae6ca39952 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:07.123051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:07.123984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:07.124270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:07.124576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/projects/b5722dda529546039fe414de88dd0f1e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:07.127898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b5722dda529546039fe414de88dd0f1e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:07.130001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:07.203566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:07.206174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:07.269928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5722dda529546039fe414de88dd0f1e', 'request_id': 'req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.279255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5722dda529546039fe414de88dd0f1e', 'request_id': 'req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.289993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5722dda529546039fe414de88dd0f1e', 'request_id': 'req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.337002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] The token cache is being invalidate because project b5722dda529546039fe414de88dd0f1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:07.337244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.339155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.341252 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2377/4754] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:06 2022] DELETE /identity/v3/projects/b5722dda529546039fe414de88dd0f1e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:07.345478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:07.348016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:07.480518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393bef54-ea5b-4089-90de-e2b0cb695cc8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:07.535011 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:07.564935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5263ba-5e9a-4dbc-93f0-2fc2b11c0005 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:07.581545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:07.582794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:07.583272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:07.583729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:07.585758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=663cf6c06c934becadf49b6e8c2c1cc7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:07.589010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:07.610853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:07.611829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:07.612183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:07.612564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] PATH_INFO: `/v3/projects/c39e07e14e3e44e595d436bd5d7fa01c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:07.614182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c39e07e14e3e44e595d436bd5d7fa01c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:07.616387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:07.624326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.625510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.698981 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:07.701679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c39e07e14e3e44e595d436bd5d7fa01c', 'request_id': 'req-b23837e2-b496-4078-bd59-e0122c5931d6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.710909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.711528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.717879 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2378/4755] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:31:07 2022] PATCH /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7 => generated 276 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:07.719581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:07.720654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c39e07e14e3e44e595d436bd5d7fa01c', 'request_id': 'req-b23837e2-b496-4078-bd59-e0122c5931d6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.721284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:07.732070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c39e07e14e3e44e595d436bd5d7fa01c', 'request_id': 'req-b23837e2-b496-4078-bd59-e0122c5931d6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.754281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] The token cache is being invalidate because project c39e07e14e3e44e595d436bd5d7fa01c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:07.754814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.761023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b23837e2-b496-4078-bd59-e0122c5931d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:07.767407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2378/4756] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:07 2022] DELETE /identity/v3/projects/c39e07e14e3e44e595d436bd5d7fa01c => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:07.770396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562664be-f630-4e28-8707-a5376dde211c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:07.770867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562664be-f630-4e28-8707-a5376dde211c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:07.771364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562664be-f630-4e28-8707-a5376dde211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:07.799006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-562664be-f630-4e28-8707-a5376dde211c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:07.800808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-562664be-f630-4e28-8707-a5376dde211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:07.880994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d013714-c86b-4244-95fb-c007090e975b tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:07.953856 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2379/4757] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:07.963276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451571df-fb41-439c-b801-311e1d6c414c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:07.963936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451571df-fb41-439c-b801-311e1d6c414c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:07.964294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451571df-fb41-439c-b801-311e1d6c414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:07.999563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-451571df-fb41-439c-b801-311e1d6c414c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:08.000834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-451571df-fb41-439c-b801-311e1d6c414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:08.025653 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2380/4758] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:08.027923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451571df-fb41-439c-b801-311e1d6c414c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.059456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.062274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.062560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.063256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.066097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451571df-fb41-439c-b801-311e1d6c414c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.081400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.083012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.083012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.083012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.083434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:08.085837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.087525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.093245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=663cf6c06c934becadf49b6e8c2c1cc7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.094839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.123536 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2381/4759] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:31:08.125073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.143406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534ca82f-e747-45aa-8920-cea4aecfe1ef admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.149495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.155647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.156824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.157108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.157383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.159402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.160030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.162040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.228238 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2382/4760] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:08 2022] POST /identity/v3/projects => generated 369 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:08.233247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.302932 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:08.340416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7', 'request_id': 'req-dd660874-13a1-47cb-9b9e-b7353f5193b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.381147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7', 'request_id': 'req-dd660874-13a1-47cb-9b9e-b7353f5193b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.403800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7', 'request_id': 'req-dd660874-13a1-47cb-9b9e-b7353f5193b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.434540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] The token cache is being invalidate because project 663cf6c06c934becadf49b6e8c2c1cc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:08.437030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.439586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.443852 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:08.457558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7', 'request_id': 'req-dd660874-13a1-47cb-9b9e-b7353f5193b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.460854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7', 'request_id': 'req-dd660874-13a1-47cb-9b9e-b7353f5193b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.471160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '663cf6c06c934becadf49b6e8c2c1cc7', 'request_id': 'req-dd660874-13a1-47cb-9b9e-b7353f5193b8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.489608 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2379/4761] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:31:07 2022] DELETE /identity/v3/domains/663cf6c06c934becadf49b6e8c2c1cc7 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:08.493568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfebb8dc-6fd0-4c99-8588-daa3c5ead3f4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.495168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.498628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:08.630822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.631572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.631853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.632127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.633549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.641249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.693789 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2383/4762] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:08 2022] POST /identity/v3/users => generated 285 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:31:08.698506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.700862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:08.719684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49198d58-da75-4696-9a7e-aa3670989703 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.725098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.726505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.727175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.727582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.728805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.730740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.747578 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2384/4763] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:08 2022] GET /identity/v3/roles => generated 2096 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:08.750899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd660874-13a1-47cb-9b9e-b7353f5193b8 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.751297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.770672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9900c5-c70e-4464-9838-26f0bb91957b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.778748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.779938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.780461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.781447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/e25d3be007eb4308bc2350f155301587` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.786746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.788162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e25d3be007eb4308bc2350f155301587)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.789284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.789681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.790322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.791875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.793781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.808709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.814012 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2385/4764] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:08 2022] GET /identity/v3/roles => generated 2096 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:08.819715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.846641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2012d3-7e24-455e-a902-e64120f98422 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:08.864811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133e5ac4-77bc-4da5-be00-815c849cc275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:08.865891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e5ac4-77bc-4da5-be00-815c849cc275 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.866254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e5ac4-77bc-4da5-be00-815c849cc275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.866601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133e5ac4-77bc-4da5-be00-815c849cc275 admin admin] PATH_INFO: `/v3/projects/baeb261bf4574cbfa09891e81567d30a/users/31ca494d389446e88225205e57e5884f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:08.907424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role e25d3be007eb4308bc2350f155301587 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:08.908019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.908939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:08.911345 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2380/4765] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:08 2022] DELETE /identity/v3/roles/e25d3be007eb4308bc2350f155301587 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:08.914786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e5ac4-77bc-4da5-be00-815c849cc275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baeb261bf4574cbfa09891e81567d30a, user_id=31ca494d389446e88225205e57e5884f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:08.915181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:08.917822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133e5ac4-77bc-4da5-be00-815c849cc275 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:08.920446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:08.944500 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2386/4766] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:08 2022] PUT /identity/v3/projects/baeb261bf4574cbfa09891e81567d30a/users/31ca494d389446e88225205e57e5884f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:08.956848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:08.957260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:08.957496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:09.027362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] MFA Rules not processed for user `31ca494d389446e88225205e57e5884f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:09.028640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:09.122762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c172a98a-af6a-4264-b26f-5d30d9df938f tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:09.183199 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:09.234712 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2387/4767] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:09.242707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:09.248878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:09.275860 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=93 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:09.292309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:09.293332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:09.294199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:09.294199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/ee165ad901e045e18dadd8c7459ef533` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:09.299837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ee165ad901e045e18dadd8c7459ef533)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:09.302568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:09.418742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role ee165ad901e045e18dadd8c7459ef533 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:09.419074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:09.420757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:09.428077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2381/4768] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:08 2022] DELETE /identity/v3/roles/ee165ad901e045e18dadd8c7459ef533 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:09.429403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:09.437856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:09.451341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5c460-1a61-4442-8530-f6d4b9643705 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:09.591615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:09.592572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:09.593014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:09.593651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:09.594773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:09.596976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:09.662150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2388/4769] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:09 2022] POST /identity/v3/projects => generated 369 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:09.666506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:09.668733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5cde89-ee72-4f9b-9d13-4932e5fd14c6 tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:09.670662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:09.736401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c4a0c051fe4c93b6d40df5c24947df', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '96fc757654654e7eb09a2b717c0e8b2b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:09.737781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:09.738177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:09.738646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] PATH_INFO: `/v3/roles/9f81740fe41842179cf737cd8f4fffde` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:09.740452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9f81740fe41842179cf737cd8f4fffde)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:09.742325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:09.791186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invalidating the token cache because role 9f81740fe41842179cf737cd8f4fffde has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:09.791883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:09.792843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:09.795432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2382/4770] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:09 2022] DELETE /identity/v3/roles/9f81740fe41842179cf737cd8f4fffde => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:09.804315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:09.807647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:09.844571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aed2f-57f4-4d2c-b5ca-d71073f9dc10 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:09.861490 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:09.908683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba48948-d780-495a-8abf-014baaacde8e tempest-RolesV3TestJSON-2005965718 tempest-RolesV3TestJSON-2005965718-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:09.915479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:09.916872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:09.917381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:09.917880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] PATH_INFO: `/v3/users/ed39ab7c866147e28c7c8d5cd91200a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:09.919615 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:09.921834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed39ab7c866147e28c7c8d5cd91200a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:09.924713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:09.990257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:09.991046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:09.991492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:09.991774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:09.992533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:09.994572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:10.041238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed39ab7c866147e28c7c8d5cd91200a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:10.050697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed39ab7c866147e28c7c8d5cd91200a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:10.070279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2389/4771] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:09 2022] POST /identity/v3/users => generated 291 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:10.074111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:10.077091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed39ab7c866147e28c7c8d5cd91200a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:10.078436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed39ab7c866147e28c7c8d5cd91200a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:10.079308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:10.103171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785603f2-0fd2-4567-b9b0-993b79b49415 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:10.117883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:10.118637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.118889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.119156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.120088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:10.121759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:10.122406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37ee5f85-15a6-4376-bd2d-3e8778a9f66f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed39ab7c866147e28c7c8d5cd91200a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:10.145492 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2390/4772] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:10.146961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:10.163027 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2383/4773] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:09 2022] DELETE /identity/v3/users/ed39ab7c866147e28c7c8d5cd91200a2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:10.169832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.172976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.173495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.181095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff75ada-50e2-4e3b-a9e5-ff1a832dbbb9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:10.202438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:10.204536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:10.288322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:10.289279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.290214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.290500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] PATH_INFO: `/v3/projects/9b4d8286d87449d9bcd16f593a7a6817/users/448c59c9f3954b938261c297fe1c28a6/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.299391 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2384/4774] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:10.310395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:10.313114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:10.315891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4d8286d87449d9bcd16f593a7a6817, user_id=448c59c9f3954b938261c297fe1c28a6, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:10.320426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:10.350780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2391/4775] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:10 2022] PUT /identity/v3/projects/9b4d8286d87449d9bcd16f593a7a6817/users/448c59c9f3954b938261c297fe1c28a6/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:10.361295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:10.396238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d4b0e9-2d66-49de-b1ee-409cc089418f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:10.404957 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:10.513487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:10.514578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.516219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.517074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.544736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb8506-f376-4ca1-a097-8e13824fdc80 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:10.557665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:10.562437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.562807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.563163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.564013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:10.568785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:10.596725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2392/4776] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:10.598675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:10.626089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f7bf-a6ce-44e7-8fed-09d50ea98577 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:10.648375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57642c2-316e-4300-8883-cd1913970254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:10.650343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57642c2-316e-4300-8883-cd1913970254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.652100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57642c2-316e-4300-8883-cd1913970254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.653734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57642c2-316e-4300-8883-cd1913970254 admin admin] PATH_INFO: `/v3/projects/9b4d8286d87449d9bcd16f593a7a6817/users/448c59c9f3954b938261c297fe1c28a6/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.660913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57642c2-316e-4300-8883-cd1913970254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4d8286d87449d9bcd16f593a7a6817, user_id=448c59c9f3954b938261c297fe1c28a6, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:10.671981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57642c2-316e-4300-8883-cd1913970254 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:10.695586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:10.697382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:10.707239 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2393/4777] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:10 2022] PUT /identity/v3/projects/9b4d8286d87449d9bcd16f593a7a6817/users/448c59c9f3954b938261c297fe1c28a6/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:10.717710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:10.718086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:10.718432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:10.728892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2385/4778] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:31:10.773649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] MFA Rules not processed for user `448c59c9f3954b938261c297fe1c28a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:10.775408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:10.782161 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:10.998683 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2394/4779] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:10 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:11.003525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:11.208177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f1ef72-52a9-4f49-aaf7-e3136fb39dc9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:11.236105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017347ce-57d6-4cfc-9b79-d5790cf9cd79 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:11.236845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017347ce-57d6-4cfc-9b79-d5790cf9cd79 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:11.238394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017347ce-57d6-4cfc-9b79-d5790cf9cd79 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:11.241815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017347ce-57d6-4cfc-9b79-d5790cf9cd79 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:11.243207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017347ce-57d6-4cfc-9b79-d5790cf9cd79 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:11.249325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017347ce-57d6-4cfc-9b79-d5790cf9cd79 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:11.308538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2386/4780] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:31:11 2022] POST /identity/v3/projects => generated 329 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:11.310054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:11.320439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b7f58-c4c6-4498-a41e-b16a5310c2f3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:11.516753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:11.518154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:11.518778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:11.519668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:11.521125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:11.521688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:11.521975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:11.525123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:11.533781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:11.616033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2395/4781] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:11 2022] POST /identity/v3/users => generated 413 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:11.617684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:11.629458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:11.631637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0dff3a-b6cb-418d-94d3-2bac034f61ac tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:11.636937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:11.639747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:11.640740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:11.641182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:11.641718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:11.643325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:11.646687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:11.662541 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2387/4782] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:11 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:11.663560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:11.673369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:11.673620 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2396/4783] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:11 2022] POST /identity/v3/roles => generated 243 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:11.674717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:11.678423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:11.774257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167e7bc3-bf15-4076-9317-6189b69d5aba tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:11.790565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:11.792146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:11.792146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:11.792373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:11.807098 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:11.885084 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:11.905398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3eb4bc-7a2c-4a42-acc8-2f1f0ef45519 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:11.906055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:11.916500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:11.917675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:11.918109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:11.918560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] PATH_INFO: `/v3/projects/873f1dd08d0e4786b3658c9fe37fed67` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:11.921330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=873f1dd08d0e4786b3658c9fe37fed67)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:11.930392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2397/4784] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:31:11 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:11.930719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:11.935216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:11.966825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce5c47e-883f-470f-916e-00eaddab3a18 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:11.987763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:12.015255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.019207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.020675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.021698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:12.034251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:12.034884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873f1dd08d0e4786b3658c9fe37fed67', 'request_id': 'req-6dd913d1-8435-4145-9d9b-c330e6392cab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.051425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873f1dd08d0e4786b3658c9fe37fed67', 'request_id': 'req-6dd913d1-8435-4145-9d9b-c330e6392cab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.070431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873f1dd08d0e4786b3658c9fe37fed67', 'request_id': 'req-6dd913d1-8435-4145-9d9b-c330e6392cab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.096945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] The token cache is being invalidate because project 873f1dd08d0e4786b3658c9fe37fed67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:12.097709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.098811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.100249 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2398/4785] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:11 2022] POST /identity/v3/roles => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:12.101554 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2388/4786] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:11 2022] DELETE /identity/v3/projects/873f1dd08d0e4786b3658c9fe37fed67 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:12.105436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:12.107669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:12.118689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:12.123852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:12.196411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4b75e-9166-4459-9ca4-13e935a0fb8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:12.393558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd913d1-8435-4145-9d9b-c330e6392cab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:12.401206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:12.402411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.402789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.403160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] PATH_INFO: `/v3/users/c5c4a0c051fe4c93b6d40df5c24947df` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.404955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c4a0c051fe4c93b6d40df5c24947df)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:12.407277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:12.430763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:12.432972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.433367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.433744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/e9a2ee3aad254ff7a08cbbd21a617c4a/users/39ee3b928981430b81a050adce7945f3/roles/d7f36d6add314a05ba2d63db8a0c7a1a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.455288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e9a2ee3aad254ff7a08cbbd21a617c4a, user_id=39ee3b928981430b81a050adce7945f3, role_id=d7f36d6add314a05ba2d63db8a0c7a1a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:12.459038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:12.492446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2399/4787] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:12 2022] PUT /identity/v3/projects/e9a2ee3aad254ff7a08cbbd21a617c4a/users/39ee3b928981430b81a050adce7945f3/roles/d7f36d6add314a05ba2d63db8a0c7a1a => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:12.499176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:12.532158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c4a0c051fe4c93b6d40df5c24947df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.532783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c4a0c051fe4c93b6d40df5c24947df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.548427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c4a0c051fe4c93b6d40df5c24947df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.549223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c4a0c051fe4c93b6d40df5c24947df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.551151 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:12.584309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c4a0c051fe4c93b6d40df5c24947df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:12.622707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682f1a4c-d66b-4431-abb5-ed04532eefca tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:12.635254 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2389/4788] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:12 2022] DELETE /identity/v3/users/c5c4a0c051fe4c93b6d40df5c24947df => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:12.639998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a1fe03-9de1-4a63-8ef0-2b38f1304b90 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:12.642078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fe03-9de1-4a63-8ef0-2b38f1304b90 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.642758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fe03-9de1-4a63-8ef0-2b38f1304b90 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.643050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a1fe03-9de1-4a63-8ef0-2b38f1304b90 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/e9a2ee3aad254ff7a08cbbd21a617c4a/users/39ee3b928981430b81a050adce7945f3/roles/af7865df619c4beeb200523198e0314b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.647619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1fe03-9de1-4a63-8ef0-2b38f1304b90 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=e9a2ee3aad254ff7a08cbbd21a617c4a, user_id=39ee3b928981430b81a050adce7945f3, role_id=af7865df619c4beeb200523198e0314b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:12.652489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a1fe03-9de1-4a63-8ef0-2b38f1304b90 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:12.696808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:12.697624 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2400/4789] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:12 2022] PUT /identity/v3/projects/e9a2ee3aad254ff7a08cbbd21a617c4a/users/39ee3b928981430b81a050adce7945f3/roles/af7865df619c4beeb200523198e0314b => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:12.698618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:12.782423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6756f-6b7d-4cfb-a9cf-deb4193e590e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:12.852440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7f67d-bc7a-445b-bf93-d8cdf1d61920 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:12.853724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f67d-bc7a-445b-bf93-d8cdf1d61920 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.854313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f67d-bc7a-445b-bf93-d8cdf1d61920 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.855108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7f67d-bc7a-445b-bf93-d8cdf1d61920 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.857364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f67d-bc7a-445b-bf93-d8cdf1d61920 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:12.859990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae7f67d-bc7a-445b-bf93-d8cdf1d61920 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:12.917325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353425b-137e-408a-a1cc-cedaad7f8163 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.918451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353425b-137e-408a-a1cc-cedaad7f8163 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.919205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353425b-137e-408a-a1cc-cedaad7f8163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.919524 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2390/4790] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:12 2022] GET /identity/v3/users => generated 7793 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:12.952441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394605d-2152-4dd5-afff-76043165f530 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:12.952441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394605d-2152-4dd5-afff-76043165f530 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:12.952441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b394605d-2152-4dd5-afff-76043165f530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:12.995847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b394605d-2152-4dd5-afff-76043165f530 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:12.999593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b394605d-2152-4dd5-afff-76043165f530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.009686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2391/4791] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:12 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:13.014818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dccd82-8d34-4c67-9f42-6b730be16840 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.015117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dccd82-8d34-4c67-9f42-6b730be16840 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.015399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dccd82-8d34-4c67-9f42-6b730be16840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.019936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35dccd82-8d34-4c67-9f42-6b730be16840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.048644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b353425b-137e-408a-a1cc-cedaad7f8163 None None] MFA Rules not processed for user `39ee3b928981430b81a050adce7945f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:13.051343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b353425b-137e-408a-a1cc-cedaad7f8163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.141369 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=5,keystone:DELETE=2,keystone:SELECT=93 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:13.264291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2401/4792] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:12 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-35dccd82-8d34-4c67-9f42-6b730be16840 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(*args, **kwargs) Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Jul 19 11:31:13.266927 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:13.268012 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:13.269066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2392/4793] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:13 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 19 11:31:13.274013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.274296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.274665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.275505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd54b4-21c3-4bc9-84b0-e167fc1a800b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.275803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd54b4-21c3-4bc9-84b0-e167fc1a800b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.276085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd54b4-21c3-4bc9-84b0-e167fc1a800b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.331263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] MFA Rules not processed for user `39ee3b928981430b81a050adce7945f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:13.336992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.343921 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.server.flask.application [None req-2bcd54b4-21c3-4bc9-84b0-e167fc1a800b None None] Authorization failed. The request you have made requires authentication. from 10.222.0.15: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 11:31:13.346793 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2402/4794] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:13 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 74 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 11:31:13.354464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.354789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.355061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.389778 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2393/4795] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:13 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:13.391624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:13.427135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:13.429768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.432879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a8b17-bd50-4c53-9624-59f5732ff72c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:13.442517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ee3b928981430b81a050adce7945f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9a2ee3aad254ff7a08cbbd21a617c4a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-238441355', 'tempest-DelegatedRole-262729244'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:13.443197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.444905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.446620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.447734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2403/4796] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:13.448145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: Authorizing `identity:create_trust()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:13.450497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:13.453932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:13.488070 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:13.493391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19e9639-7e21-499f-939c-7909b2686721 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:13.502684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:13.504404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.504693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.504991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.616189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:13.631433 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2394/4797] 10.222.0.15 () {60 vars in 1173 bytes} [Tue Jul 19 11:31:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:13.633613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:13.642673 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2404/4798] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:31:13 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:13.655118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d185814-7f5f-490a-ae9e-be803096a843 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:13.671426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:13.672106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.673616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.673907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.674638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:13.675802 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:13.675802 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:31:13.675802 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:31:13.677122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:13.687955 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2395/4799] 10.222.0.15 () {58 vars in 1154 bytes} [Tue Jul 19 11:31:13 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:13.689001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:13.703419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16fd7d3-f3eb-4286-a949-731e2c4f51bf tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:13.713233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ee3b928981430b81a050adce7945f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9a2ee3aad254ff7a08cbbd21a617c4a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-238441355', 'tempest-DelegatedRole-262729244'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:13.714402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.716033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.716463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] PATH_INFO: `/v3/OS-TRUST/trusts/c3bfb0f28b29425d96dc5274ffe04895` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.759549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: Authorizing `identity:delete_trust(trust_id=c3bfb0f28b29425d96dc5274ffe04895)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:13.761200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:13.807618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'c3bfb0f28b29425d96dc5274ffe04895', 'request_id': 'req-76659958-59a7-4fa8-be6a-67699bd429a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:13.821915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c3bfb0f28b29425d96dc5274ffe04895', 'request_id': 'req-76659958-59a7-4fa8-be6a-67699bd429a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:13.825506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'c3bfb0f28b29425d96dc5274ffe04895', 'request_id': 'req-76659958-59a7-4fa8-be6a-67699bd429a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:13.845104 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2405/4800] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:31:13 2022] DELETE /identity/v3/OS-TRUST/trusts/c3bfb0f28b29425d96dc5274ffe04895 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:13.846494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:13.848607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.869446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91c963c-5830-4ef9-8d9c-23e95e59b0fe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:13.874442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39ee3b928981430b81a050adce7945f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e9a2ee3aad254ff7a08cbbd21a617c4a', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-238441355', 'tempest-DelegatedRole-262729244'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:13.875667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.876135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.876645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] PATH_INFO: `/v3/OS-TRUST/trusts/c3bfb0f28b29425d96dc5274ffe04895` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Could not find trust: c3bfb0f28b29425d96dc5274ffe04895.: keystone.exception.TrustNotFound: Could not find trust: c3bfb0f28b29425d96dc5274ffe04895. Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 11:31:13.905234 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: c3bfb0f28b29425d96dc5274ffe04895. Jul 19 11:31:13.906490 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:13.917162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:13.920943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:13.929819 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2396/4801] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:13 2022] GET /identity/v3/OS-TRUST/trusts/c3bfb0f28b29425d96dc5274ffe04895 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:13.964028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76659958-59a7-4fa8-be6a-67699bd429a9 tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:13.974176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:13.976639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:13.977362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:13.977843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/af7865df619c4beeb200523198e0314b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:13.980910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=af7865df619c4beeb200523198e0314b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:13.983631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:14.198920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:14.201390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:14.223094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role af7865df619c4beeb200523198e0314b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:14.223404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.230910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.242598 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2406/4802] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:13 2022] DELETE /identity/v3/roles/af7865df619c4beeb200523198e0314b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:14.243753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:14.249081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:14.384021 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:UPDATE=4,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:14.454904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90db0beb-b880-4ad7-86d3-83fa36bf93dc tempest-TrustsV3TestJSON-1571113260 tempest-user-709438699] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:14.466641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a8aebb-80b3-44d3-8f3e-f34af79b84fb tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:14.478628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:14.483806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:14.484143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:14.484859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/d7f36d6add314a05ba2d63db8a0c7a1a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:14.490315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=d7f36d6add314a05ba2d63db8a0c7a1a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:14.495795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:14.600193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role d7f36d6add314a05ba2d63db8a0c7a1a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:14.600768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.602093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.609439 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2407/4803] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:14 2022] DELETE /identity/v3/roles/d7f36d6add314a05ba2d63db8a0c7a1a => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:14.613433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:14.615693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:14.669454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:14.670679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:14.672194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:14.672674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] PATH_INFO: `/v3/projects/96fc757654654e7eb09a2b717c0e8b2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:14.677676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96fc757654654e7eb09a2b717c0e8b2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:14.682864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:14.746133 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:14.768633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96fc757654654e7eb09a2b717c0e8b2b', 'request_id': 'req-4a950065-0c41-4c9f-b7d7-38b9283f8107'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.776678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96fc757654654e7eb09a2b717c0e8b2b', 'request_id': 'req-4a950065-0c41-4c9f-b7d7-38b9283f8107'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.785245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96fc757654654e7eb09a2b717c0e8b2b', 'request_id': 'req-4a950065-0c41-4c9f-b7d7-38b9283f8107'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.794336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697cccac-cbeb-47e8-aca8-87545eb9eecc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:14.825074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] The token cache is being invalidate because project 96fc757654654e7eb09a2b717c0e8b2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:14.825348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.828295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4a950065-0c41-4c9f-b7d7-38b9283f8107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:14.833220 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2397/4804] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:14 2022] DELETE /identity/v3/projects/96fc757654654e7eb09a2b717c0e8b2b => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:14.839607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c4f12-efc2-4651-8625-4a908d08e946 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:14.839950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c4f12-efc2-4651-8625-4a908d08e946 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:14.840162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c4f12-efc2-4651-8625-4a908d08e946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:14.904323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-032c4f12-efc2-4651-8625-4a908d08e946 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:14.907330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-032c4f12-efc2-4651-8625-4a908d08e946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:14.915435 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2398/4805] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:14 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:14.917342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b237-66b3-4812-a12d-da7767343c27 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:14.917698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b237-66b3-4812-a12d-da7767343c27 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:14.917990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7626b237-66b3-4812-a12d-da7767343c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:14.947740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7626b237-66b3-4812-a12d-da7767343c27 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:14.949781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7626b237-66b3-4812-a12d-da7767343c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:14.960150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:14.961246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:14.961736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:14.962082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users/39ee3b928981430b81a050adce7945f3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:14.966973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=39ee3b928981430b81a050adce7945f3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:14.972195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:15.069150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ee3b928981430b81a050adce7945f3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.084916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ee3b928981430b81a050adce7945f3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.086381 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:15.132115 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2399/4806] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:15.133310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ee3b928981430b81a050adce7945f3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.133493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73278655-d610-4bc7-8775-b33cb42b6f73 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:15.133788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73278655-d610-4bc7-8775-b33cb42b6f73 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:15.134065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73278655-d610-4bc7-8775-b33cb42b6f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:15.138286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ee3b928981430b81a050adce7945f3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.161510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8109fdc6-ea97-460c-a4fd-5a5f5da06b2c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ee3b928981430b81a050adce7945f3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.178165 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2408/4807] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:14 2022] DELETE /identity/v3/users/39ee3b928981430b81a050adce7945f3 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:15.179477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bc563-252f-41de-a483-292f94efd61d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:15.179766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bc563-252f-41de-a483-292f94efd61d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:15.180038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bc563-252f-41de-a483-292f94efd61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:15.204391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73278655-d610-4bc7-8775-b33cb42b6f73 None None] MFA Rules not processed for user `9ba7d6118edc4c4eb4931b8cdebcdcde`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:15.205981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73278655-d610-4bc7-8775-b33cb42b6f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:15.217621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a36bc563-252f-41de-a483-292f94efd61d None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:15.218907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a36bc563-252f-41de-a483-292f94efd61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:15.306102 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2400/4808] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:15.307586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:15.307872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:15.308158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:15.338678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2409/4809] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:15.339719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bc563-252f-41de-a483-292f94efd61d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:15.341176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a36bc563-252f-41de-a483-292f94efd61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:15.357543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:15.357543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:15.455804 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:15.459052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bc563-252f-41de-a483-292f94efd61d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:15.476798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:15.479757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:15.480035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:15.480317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/e9a2ee3aad254ff7a08cbbd21a617c4a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:15.483845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e9a2ee3aad254ff7a08cbbd21a617c4a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:15.487039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:15.513300 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2401/4810] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:15.514414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:15.518732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:15.544589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9857bbf5-109d-4079-b202-c683ab437142 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:15.558363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:15.560052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:15.560325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:15.560942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:15.564084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:15.570409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:15.604596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a2ee3aad254ff7a08cbbd21a617c4a', 'request_id': 'req-ad163789-0f90-4e1c-86cf-0b38246ad043'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.621261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a2ee3aad254ff7a08cbbd21a617c4a', 'request_id': 'req-ad163789-0f90-4e1c-86cf-0b38246ad043'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.634898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2402/4811] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:15 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:15.635869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:15.636596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a2ee3aad254ff7a08cbbd21a617c4a', 'request_id': 'req-ad163789-0f90-4e1c-86cf-0b38246ad043'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.667472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] The token cache is being invalidate because project e9a2ee3aad254ff7a08cbbd21a617c4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:15.668062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.669285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.671481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2410/4812] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:15 2022] DELETE /identity/v3/projects/e9a2ee3aad254ff7a08cbbd21a617c4a => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:15.672612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:15.681249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:15.696878 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:15.775222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a43d0a8-6496-419a-a0d7-b4c78e446875 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:15.823700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:15.824637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:15.824920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:15.825191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:15.875228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad163789-0f90-4e1c-86cf-0b38246ad043 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:15.924255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:15.947076 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2403/4813] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:31:15 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:15.948145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:15.950858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:16.077183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.079819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.080289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.080799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.085276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:16.085814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.091055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.136218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2411/4814] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 461 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:16.136218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.149815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:16.211758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f61935-d9bc-42f2-8283-351e48478c47 tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.228556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.229623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.233950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.234395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.235457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.237718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.277892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2404/4815] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:15 2022] POST /identity/v3/users => generated 303 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:16.279173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.293690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc51c81-9e79-4ed8-891a-b1f012dfa953 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.311949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.314882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.315268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.316130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.318658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.321958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc135d02-638d-45c1-95d0-c473366be519 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.323084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.333541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.335793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.336229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.337712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.340883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.343289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.395021 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2405/4816] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:16 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:16.396473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.406581 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:16.424664 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2412/4817] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:31:16 2022] POST /identity/v3/projects => generated 328 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:16.428935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.535167 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:16.572878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb1d88-3a5e-4dc0-85d7-1d2eff458e53 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.579815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6fb7d-68be-42b6-885d-b7ce9739fc74 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.597815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.598885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.599354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.600515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.601500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.603913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.605070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.605845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.606039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.606312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.608562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.608933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.639384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2413/4818] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:16 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:16.640380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.652055 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2406/4819] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:16.656315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.686769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc19f3-c7a0-446c-a447-77c8c9277d64 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.705133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.705832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.706370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.706771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.707449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.710850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.744103 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2407/4820] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:16.749166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.765245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24071657-1b4a-4ed5-adec-178df7c41a87 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.771962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.773477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.773957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.774455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.775145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06894ad2-1d05-483b-9418-edf948a76e60 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.775620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.778021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.787248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.788784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.791033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.795617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.797238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.801330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.820808 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2414/4821] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:16 2022] POST /identity/v3/users => generated 416 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:16.822758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.835153 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2408/4822] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:16.836825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.845916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf22415-8ce4-42ae-8fed-0aa280be4fa2 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.857745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.860004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.860578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.861071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.866168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.869256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.874802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84183d-98f4-4d76-aee8-76508bc45fa0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.886290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.887860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.891963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.892664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.893918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.896077 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2415/4823] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:16.897300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.898042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:16.921506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518b16a-8d07-4119-ad6b-e860d7084061 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.928096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.929170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:16.929521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:16.932760 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2409/4824] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:16 2022] POST /identity/v3/roles => generated 244 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:16.932919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] PATH_INFO: `/v3/projects/10fd55360b63440eaa930565461e64a5/users/30494727ccea43e0a9ea4c54a1622192/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:16.940026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:16.976124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daf56c1-d064-46de-ba39-a44a7c0bc6bc tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:16.996214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] RBAC: Authorizing `identity:create_grant(project_id=10fd55360b63440eaa930565461e64a5, user_id=30494727ccea43e0a9ea4c54a1622192, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:16.998945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2bfdad-73e5-4709-a91f-035d6a5930d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:16.999799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bfdad-73e5-4709-a91f-035d6a5930d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.000076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bfdad-73e5-4709-a91f-035d6a5930d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.000443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2bfdad-73e5-4709-a91f-035d6a5930d0 admin admin] PATH_INFO: `/v3/projects/66812f6ad61242bcb1354e7a6ff368d9/users/082d4dcf80e94e4f8f4ca19feb10e6e8/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.000547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:17.021464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bfdad-73e5-4709-a91f-035d6a5930d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66812f6ad61242bcb1354e7a6ff368d9, user_id=082d4dcf80e94e4f8f4ca19feb10e6e8, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:17.027529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2bfdad-73e5-4709-a91f-035d6a5930d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:17.035266 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2416/4825] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:16 2022] PUT /identity/v3/projects/10fd55360b63440eaa930565461e64a5/users/30494727ccea43e0a9ea4c54a1622192/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:17.037688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:17.072765 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2410/4826] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:16 2022] PUT /identity/v3/projects/66812f6ad61242bcb1354e7a6ff368d9/users/082d4dcf80e94e4f8f4ca19feb10e6e8/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:17.077761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1bd5-769f-4559-a3c8-ac088064fffc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.078062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1bd5-769f-4559-a3c8-ac088064fffc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.078356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1bd5-769f-4559-a3c8-ac088064fffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.129128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ab8f1bd5-769f-4559-a3c8-ac088064fffc None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:17.135187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab8f1bd5-769f-4559-a3c8-ac088064fffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:17.149277 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2411/4827] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:17 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:17.150545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.150911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.151259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.185583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2ae62-576a-423a-a030-d322597ae33b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:17.210844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] MFA Rules not processed for user `082d4dcf80e94e4f8f4ca19feb10e6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:17.213490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:17.244894 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:17.404011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3be128-627b-46df-bfe7-d2af6e6a2964 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:17.405429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be128-627b-46df-bfe7-d2af6e6a2964 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.405921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be128-627b-46df-bfe7-d2af6e6a2964 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.406418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3be128-627b-46df-bfe7-d2af6e6a2964 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.408684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3be128-627b-46df-bfe7-d2af6e6a2964 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:17.410642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3be128-627b-46df-bfe7-d2af6e6a2964 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:17.442771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2417/4828] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:17 2022] POST /identity/v3/roles => generated 246 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:17.443748 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2412/4829] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:17 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:17.444858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:17.445353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.445825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.446471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.478168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a48ee7-591c-44cd-a805-b984be144597 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:17.489592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:17.490561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.490909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.491207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/54c1bcfd0d204433adaf4458389de9da/users/1061deb800dd4da5b781249e802d9da4/roles/5236a2e4366443889de2db846b3de621` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.502768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:17.507382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:17.531908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=54c1bcfd0d204433adaf4458389de9da, user_id=1061deb800dd4da5b781249e802d9da4, role_id=5236a2e4366443889de2db846b3de621)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:17.539115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:17.559947 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:17.576904 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2413/4830] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:17 2022] PUT /identity/v3/projects/54c1bcfd0d204433adaf4458389de9da/users/1061deb800dd4da5b781249e802d9da4/roles/5236a2e4366443889de2db846b3de621 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:17.577891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:17.652876 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2418/4831] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:17.653981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:17.677195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128d628-14fc-4910-8c26-1504d80c3116 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:17.759193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2abe5a-1fe2-45e4-ac4c-8420f5b812f4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:17.777189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:17.777789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.778111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.778388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.779089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:17.782252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:17.811504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:17.812712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:17.813012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:17.813291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/54c1bcfd0d204433adaf4458389de9da/users/1061deb800dd4da5b781249e802d9da4/roles/49d1262652b544b4aff8d009422d3617` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:17.816566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=54c1bcfd0d204433adaf4458389de9da, user_id=1061deb800dd4da5b781249e802d9da4, role_id=49d1262652b544b4aff8d009422d3617)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:17.820103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:17.862248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2419/4832] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:17 2022] PUT /identity/v3/projects/54c1bcfd0d204433adaf4458389de9da/users/1061deb800dd4da5b781249e802d9da4/roles/49d1262652b544b4aff8d009422d3617 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:17.862248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:17.884967 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2414/4833] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:17 2022] POST /identity/v3/projects => generated 367 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:17.885280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.108807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc85521-fe07-44ac-847c-6452469e4059 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:18.125227 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:18.140810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512a1de-f5a1-4d20-b262-5dccf22270b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:18.165041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:18.165760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.166054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.166335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.167127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:18.169092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:18.248018 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2415/4834] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:17 2022] GET /identity/v3/users => generated 8364 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:18.256847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.288897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abafc056-06ab-46df-994a-a86e972b340a tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '73f9b87ab9514ce0a49186c27aae6c0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a58c3f01b564d42ae10a77b54fcef5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:18.289721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc056-06ab-46df-994a-a86e972b340a tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.290012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc056-06ab-46df-994a-a86e972b340a tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.290291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abafc056-06ab-46df-994a-a86e972b340a tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.430112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-abafc056-06ab-46df-994a-a86e972b340a tempest-IdentityV3UsersTest-1707156179 tempest-IdentityV3UsersTest-1707156179-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:18.445698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2420/4835] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:31:17 2022] POST /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a/password => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:18.448120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca386fd-30c2-40f3-9f2c-6fedf3c3658e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.449093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca386fd-30c2-40f3-9f2c-6fedf3c3658e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.449844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca386fd-30c2-40f3-9f2c-6fedf3c3658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.505745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e88471a-4922-4b03-b95a-644fd549b32e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:18.517121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6ca386fd-30c2-40f3-9f2c-6fedf3c3658e None None] MFA Rules not processed for user `1061deb800dd4da5b781249e802d9da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:18.518845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ca386fd-30c2-40f3-9f2c-6fedf3c3658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:18.523658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:18.524384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.524672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.524951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.525801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:18.527754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:18.599216 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2416/4836] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:18 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:18.601949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.629474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c85d72-5329-4eab-bd9f-14c74e452ccd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:18.653585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2421/4837] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:18 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:18.661390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f49d0-d44f-4973-8471-0e172463297d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.661917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f49d0-d44f-4973-8471-0e172463297d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.662469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f49d0-d44f-4973-8471-0e172463297d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.667564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:18.668433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.668718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.668994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.669742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:18.671400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:18.692100 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:18.711071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-603f49d0-d44f-4973-8471-0e172463297d None None] MFA Rules not processed for user `1061deb800dd4da5b781249e802d9da4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:18.712409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-603f49d0-d44f-4973-8471-0e172463297d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:18.713466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2417/4838] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:18 2022] GET /identity/v3/roles => generated 1892 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:31:18.714585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.732777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260c7385-21b7-4140-ae0c-4ee4c6752a6f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:18.736811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2422/4839] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:18 2022] POST /identity/v3/auth/tokens => generated 3269 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:18.738188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f49d0-d44f-4973-8471-0e172463297d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.757029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:18.757970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.758362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.758640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] PATH_INFO: `/v3/projects/b801bc1f96c64c48bee80f8829f1cb39/users/6d1d37bb0f2445af9f31e3c2ae7bc745/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.758810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603f49d0-d44f-4973-8471-0e172463297d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:18.763187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1061deb800dd4da5b781249e802d9da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54c1bcfd0d204433adaf4458389de9da', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1951728928', 'tempest-NotDelegatedRole-830519390'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:18.763848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:18.764124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:18.764428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:18.765401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: Authorizing `identity:create_trust()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:18.766857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:18.796850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b801bc1f96c64c48bee80f8829f1cb39, user_id=6d1d37bb0f2445af9f31e3c2ae7bc745, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:18.800323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:18.842885 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2418/4840] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:18 2022] PUT /identity/v3/projects/b801bc1f96c64c48bee80f8829f1cb39/users/6d1d37bb0f2445af9f31e3c2ae7bc745/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:18.853452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.915046 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:18.957735 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2423/4841] 10.222.0.15 () {60 vars in 1173 bytes} [Tue Jul 19 11:31:18 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:31:18.959227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:18.981350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689e6aa1-ba2b-4df5-ac6a-1e549f33169b tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.045511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6bd8a-0f24-45fc-b1cc-ddf0f4f9d44b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.072848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.073560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.073894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.074134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.074920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.076917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.105581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2419/4842] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:18 2022] GET /identity/v3/roles => generated 1892 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:19.113988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.121308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1061deb800dd4da5b781249e802d9da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54c1bcfd0d204433adaf4458389de9da', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1951728928', 'tempest-NotDelegatedRole-830519390'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.122019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.122302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.122608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.123387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.124887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.145792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16a9787-4433-4332-9007-aebeb90513a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.146009 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2424/4843] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Jul 19 11:31:18 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=1061deb800dd4da5b781249e802d9da4 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:19.146799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.151994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548e034f-e3a0-4ac5-9043-6699d74345c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.153171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e034f-e3a0-4ac5-9043-6699d74345c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.154367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e034f-e3a0-4ac5-9043-6699d74345c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.154804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548e034f-e3a0-4ac5-9043-6699d74345c2 admin admin] PATH_INFO: `/v3/projects/b801bc1f96c64c48bee80f8829f1cb39/users/6d1d37bb0f2445af9f31e3c2ae7bc745/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.159730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e034f-e3a0-4ac5-9043-6699d74345c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b801bc1f96c64c48bee80f8829f1cb39, user_id=6d1d37bb0f2445af9f31e3c2ae7bc745, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.164837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548e034f-e3a0-4ac5-9043-6699d74345c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.168028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15df067a-9099-4df5-961d-15ea89123889 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.181819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1061deb800dd4da5b781249e802d9da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54c1bcfd0d204433adaf4458389de9da', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1951728928', 'tempest-NotDelegatedRole-830519390'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.182685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.182958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.183230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] PATH_INFO: `/v3/OS-TRUST/trusts/8a15c53a2d2e444285bccd76a8b8ae8b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.192917 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2420/4844] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:19 2022] PUT /identity/v3/projects/b801bc1f96c64c48bee80f8829f1cb39/users/6d1d37bb0f2445af9f31e3c2ae7bc745/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:19.204872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.205674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.206124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.206263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: Authorizing `identity:delete_trust(trust_id=8a15c53a2d2e444285bccd76a8b8ae8b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.208630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.240005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '8a15c53a2d2e444285bccd76a8b8ae8b', 'request_id': 'req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:19.255119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8a15c53a2d2e444285bccd76a8b8ae8b', 'request_id': 'req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:19.257006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '8a15c53a2d2e444285bccd76a8b8ae8b', 'request_id': 'req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:19.268677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2425/4845] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:31:19 2022] DELETE /identity/v3/OS-TRUST/trusts/8a15c53a2d2e444285bccd76a8b8ae8b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:19.272259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] MFA Rules not processed for user `6d1d37bb0f2445af9f31e3c2ae7bc745`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:19.273811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:19.276397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.278610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:19.309812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bdcdcd-5096-4686-a85e-e3e4f2f1bc93 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.440645 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2421/4846] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:19 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:19.451108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666be25e-6ab7-41b6-8257-b89f0b78b486 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1061deb800dd4da5b781249e802d9da4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '54c1bcfd0d204433adaf4458389de9da', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1951728928', 'tempest-NotDelegatedRole-830519390'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.452225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be25e-6ab7-41b6-8257-b89f0b78b486 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.452587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be25e-6ab7-41b6-8257-b89f0b78b486 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.452868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666be25e-6ab7-41b6-8257-b89f0b78b486 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] PATH_INFO: `/v3/OS-TRUST/trusts/8a15c53a2d2e444285bccd76a8b8ae8b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.454954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.468331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae842f6-7441-44fb-8f45-6cfdaa4e317b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.474258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.475218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.475884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.476319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-666be25e-6ab7-41b6-8257-b89f0b78b486 tempest-TrustsV3TestJSON-138583368 tempest-user-1326174040] Could not find trust: 8a15c53a2d2e444285bccd76a8b8ae8b.: keystone.exception.TrustNotFound: Could not find trust: 8a15c53a2d2e444285bccd76a8b8ae8b. Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 11:31:19.476707 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 8a15c53a2d2e444285bccd76a8b8ae8b. Jul 19 11:31:19.477882 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:19.479518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.481682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.483483 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2426/4847] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:19 2022] GET /identity/v3/OS-TRUST/trusts/8a15c53a2d2e444285bccd76a8b8ae8b => generated 111 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:19.484922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.485264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.487222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.525316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:19.527121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:19.538543 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2427/4848] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:19 2022] POST /identity/v3/auth/tokens => generated 353 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:19.540686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.544576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:19.567586 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2422/4849] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:19 2022] POST /identity/v3/projects => generated 360 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:19.572527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.660264 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:19.695658 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:19.726213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56259faf-db9f-48cb-9004-7498e43ef651 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.735269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.739013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.742014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab389e6a-9fc2-4e27-b078-21fb52a2fd49 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.744076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.744584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.746265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.750927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.812460 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2423/4850] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:19 2022] POST /identity/v3/users => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:19.817233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:19.864120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407c333f-4cb9-42e2-9604-c52079e426f3 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:19.872527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.873597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.874721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.875018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/0d2f11dc7bc84c1ca5b4349cc165e628` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.917836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:19.919443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:19.919758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:19.919995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/49d1262652b544b4aff8d009422d3617` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:19.922542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=49d1262652b544b4aff8d009422d3617)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.932090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.944649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:get_user(user_id=0d2f11dc7bc84c1ca5b4349cc165e628)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:19.950893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:19.981724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2424/4851] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:31:19 2022] GET /identity/v3/users/0d2f11dc7bc84c1ca5b4349cc165e628 => generated 371 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:19.985430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:20.034085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976c4f1-7e75-45fa-a734-120b7c7297d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:20.058178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:20.059797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:20.059797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:20.059797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/0d2f11dc7bc84c1ca5b4349cc165e628` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:20.063530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0d2f11dc7bc84c1ca5b4349cc165e628)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:20.067189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:20.075815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role 49d1262652b544b4aff8d009422d3617 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:20.076216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.081151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.085022 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2428/4852] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:19 2022] DELETE /identity/v3/roles/49d1262652b544b4aff8d009422d3617 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:20.090396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:20.096546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:20.191315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d2f11dc7bc84c1ca5b4349cc165e628'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.194048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d2f11dc7bc84c1ca5b4349cc165e628'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.212757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d2f11dc7bc84c1ca5b4349cc165e628'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.213624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d2f11dc7bc84c1ca5b4349cc165e628'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.232580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d2f11dc7bc84c1ca5b4349cc165e628'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.277323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136e681a-82ae-4d4f-b3c9-2a934b0e1ae1 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:20.285073 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2425/4853] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:19 2022] DELETE /identity/v3/users/0d2f11dc7bc84c1ca5b4349cc165e628 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:20.286314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:20.289411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:20.541152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:20.542571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:20.543029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:20.543457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/5236a2e4366443889de2db846b3de621` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:20.545642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5236a2e4366443889de2db846b3de621)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:20.547454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:20.561281 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:20.565689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68bd9e6-1045-428a-8d06-ce42f0165ee0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:20.573147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:20.574557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:20.575015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:20.575528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/5302fda2d622440abef6d65edaee0584` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:20.582873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5302fda2d622440abef6d65edaee0584)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:20.585565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:20.612603 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:20.640701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role 5236a2e4366443889de2db846b3de621 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:20.641299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.642172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f1afc180-9fa6-4270-b600-cb4ef4db3c64 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.645380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2429/4854] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:20 2022] DELETE /identity/v3/roles/5236a2e4366443889de2db846b3de621 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:20.647068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:20.647498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:20.647875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:20.684053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] MFA Rules not processed for user `73f9b87ab9514ce0a49186c27aae6c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:20.685748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:20.716971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5302fda2d622440abef6d65edaee0584', 'request_id': 'req-de2e699c-b4d1-44c7-bdc1-fb7459a10781'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.740444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5302fda2d622440abef6d65edaee0584', 'request_id': 'req-de2e699c-b4d1-44c7-bdc1-fb7459a10781'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.758120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5302fda2d622440abef6d65edaee0584', 'request_id': 'req-de2e699c-b4d1-44c7-bdc1-fb7459a10781'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.785830 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2430/4855] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:20.787840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:20.789817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:20.804709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] The token cache is being invalidate because project 5302fda2d622440abef6d65edaee0584 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:20.805442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.807261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:20.810827 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2426/4856] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:20 2022] DELETE /identity/v3/projects/5302fda2d622440abef6d65edaee0584 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:20.812297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:20.820248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:20.967127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62594419-0e69-47d8-a6ce-20167b928a1d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:21.004008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e699c-b4d1-44c7-bdc1-fb7459a10781 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:21.016432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:21.017201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:21.017487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:21.019128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] PATH_INFO: `/v3/users/73f9b87ab9514ce0a49186c27aae6c0a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:21.025098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73f9b87ab9514ce0a49186c27aae6c0a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:21.027540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:21.125827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:21.129450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:21.130688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:21.133149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users/1061deb800dd4da5b781249e802d9da4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:21.134662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1061deb800dd4da5b781249e802d9da4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:21.136664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:21.159838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.162099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.183594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.184227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.197270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73f9b87ab9514ce0a49186c27aae6c0a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.224488 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:21.250182 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2427/4857] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:20 2022] DELETE /identity/v3/users/73f9b87ab9514ce0a49186c27aae6c0a => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:21.251051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:21.257186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:21.272057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1061deb800dd4da5b781249e802d9da4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.290366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1061deb800dd4da5b781249e802d9da4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.318038 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:21.338929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1061deb800dd4da5b781249e802d9da4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.348761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1061deb800dd4da5b781249e802d9da4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.381697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a4e9d3a-5164-41e2-80d7-6698e6a44cf4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1061deb800dd4da5b781249e802d9da4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:21.396670 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2431/4858] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:20 2022] DELETE /identity/v3/users/1061deb800dd4da5b781249e802d9da4 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:21.398042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:21.398311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:21.398592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:21.453134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:21.454499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:21.458888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ec3ca-370d-469f-b8a3-5798ebb89e1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:21.597183 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2432/4859] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:21.598080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:21.614247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:21.681922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:21.684982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:21.685794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:21.687330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:21.688533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:21.695603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:21.782505 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2428/4860] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:21 2022] POST /identity/v3/projects => generated 359 bytes in 529 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:21.783737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:21.787889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:21.795630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44572e4b-66ab-4e10-916f-c074532edd72 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:21.902152 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:21.926474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:21.927353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:21.927637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:21.927910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/54c1bcfd0d204433adaf4458389de9da` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:21.929502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=54c1bcfd0d204433adaf4458389de9da)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:21.931494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:21.945394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922d6152-11e7-4196-bed3-8279c7f57b6a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:21.962795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:21.963838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:21.964123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:21.964427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.038672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54c1bcfd0d204433adaf4458389de9da', 'request_id': 'req-515b1a99-628c-448c-a5cb-353d71ae0ffe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:22.066325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54c1bcfd0d204433adaf4458389de9da', 'request_id': 'req-515b1a99-628c-448c-a5cb-353d71ae0ffe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:22.077365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54c1bcfd0d204433adaf4458389de9da', 'request_id': 'req-515b1a99-628c-448c-a5cb-353d71ae0ffe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:22.090626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] The token cache is being invalidate because project 54c1bcfd0d204433adaf4458389de9da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:22.091110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:22.091889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:22.102220 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2433/4861] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:21 2022] DELETE /identity/v3/projects/54c1bcfd0d204433adaf4458389de9da => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:22.103456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.110115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:22.218268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.226517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.238902 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:22.242357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b1a99-628c-448c-a5cb-353d71ae0ffe tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.263897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.264667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.265001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.265284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.265957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.267159 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2429/4862] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:22.268162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.278432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.311710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e7912-5390-4718-acfe-c4c6330d9364 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.357811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2434/4863] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/users => generated 417 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:22.366257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.394228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202c7009-ef70-4f63-b349-416f5019f095 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.409110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.410272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.410766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.411274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.412685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.414822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.478537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.478537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.478537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.479387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.479387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.479387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.501669 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2435/4864] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/roles => generated 239 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:22.505256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.538256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6fe33-4cff-4ffc-8720-10c8a363c51f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.540988 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2430/4865] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/projects => generated 328 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:22.545271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.547817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:22.685735 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:22.699900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.700848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.701136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.701413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/faf354bc71324ae58d88cb0a673b1887` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.730155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be358fc-aa03-40ab-a2cf-d956dda6e0c0 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.743090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:get_user(user_id=faf354bc71324ae58d88cb0a673b1887)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.745353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.748846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.749547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.749835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.750113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.750836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.755914 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2436/4866] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:31:22 2022] GET /identity/v3/users/faf354bc71324ae58d88cb0a673b1887 => generated 417 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:22.756170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.757362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.772115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ffcd1-dccd-4294-8cb3-c974804ccf5a tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.791758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.793169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.793561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.793937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/roles/cdce7481568344e78b00c1ce1c40b634` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.796457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:get_role(role_id=cdce7481568344e78b00c1ce1c40b634)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.798774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.801062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2437/4867] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:31:22 2022] GET /identity/v3/roles/cdce7481568344e78b00c1ce1c40b634 => generated 239 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:31:22.802917 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2431/4868] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/users => generated 413 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:22.805333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.806498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.824824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5a56de-9852-40ac-ad66-2ff698ff1a01 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.833316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca5a49-3f1d-48dd-94ee-78b689ee0c8d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.842183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.844935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.845422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.846454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.847323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.849677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.850823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:22.851547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:22.851830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:22.852109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:22.853105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:22.854765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:22.886535 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2432/4869] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/roles => generated 243 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:22.890260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:22.908523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8977bfc-cc07-48a6-898d-dce11fc5b2cf tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:22.908962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2438/4870] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/projects => generated 359 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:31:22.914662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.039831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.040878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.041170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.041443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.042204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.043854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.053720 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:23.081301 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2433/4871] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:22 2022] POST /identity/v3/roles => generated 247 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:23.082218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.084214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5788a1-0778-4393-922a-15ea708f97ab tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.090490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.091673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.092189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.092705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/0653abc303744ffc94c3d16734efc9d8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.094171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:get_project(project_id=0653abc303744ffc94c3d16734efc9d8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.097310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.101264 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2439/4872] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:31:22 2022] GET /identity/v3/projects/0653abc303744ffc94c3d16734efc9d8 => generated 359 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:23.106205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.106373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e932f2-518c-4715-967c-4f2aa1025c8c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.115815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.116833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.117118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.117562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/a6cd6955fa374dafa51cab050d3c1338/users/66d2c64f0f8d40cdbaf149e2630bfde8/roles/81e731ac302c433f9c7f377677958e7f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.122404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579c5d91-bf15-4968-8eab-88009b88599d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.132141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.133308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.133658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.134048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/0653abc303744ffc94c3d16734efc9d8/users/faf354bc71324ae58d88cb0a673b1887/roles/cdce7481568344e78b00c1ce1c40b634` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.144548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0653abc303744ffc94c3d16734efc9d8, user_id=faf354bc71324ae58d88cb0a673b1887, role_id=cdce7481568344e78b00c1ce1c40b634)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.151831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.152629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a6cd6955fa374dafa51cab050d3c1338, user_id=66d2c64f0f8d40cdbaf149e2630bfde8, role_id=81e731ac302c433f9c7f377677958e7f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.155547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.187596 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2434/4873] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:23 2022] PUT /identity/v3/projects/a6cd6955fa374dafa51cab050d3c1338/users/66d2c64f0f8d40cdbaf149e2630bfde8/roles/81e731ac302c433f9c7f377677958e7f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:23.187803 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2440/4874] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:23 2022] PUT /identity/v3/projects/0653abc303744ffc94c3d16734efc9d8/users/faf354bc71324ae58d88cb0a673b1887/roles/cdce7481568344e78b00c1ce1c40b634 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:23.191052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.191619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.339479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3798832c-197f-4330-a9a2-9d7db5c9fa0c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.346779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.355590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.356339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.356483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/a6cd6955fa374dafa51cab050d3c1338/users/66d2c64f0f8d40cdbaf149e2630bfde8/roles/cce0fec1c6d54b73875d6484551e68bb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.359503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=a6cd6955fa374dafa51cab050d3c1338, user_id=66d2c64f0f8d40cdbaf149e2630bfde8, role_id=cce0fec1c6d54b73875d6484551e68bb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.362593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.379895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5feb7-7cc0-4bfd-b4f7-9e7060d0c21b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.386830 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2435/4875] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:23 2022] PUT /identity/v3/projects/a6cd6955fa374dafa51cab050d3c1338/users/66d2c64f0f8d40cdbaf149e2630bfde8/roles/cce0fec1c6d54b73875d6484551e68bb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:23.396314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.515904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.516669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.518180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.518415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.521616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.529256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.536738 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:23.573737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1440de3-5086-446d-9fa5-803aa5e30409 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.579259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.581983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.582463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.582934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.593981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.596239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.638902 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2436/4876] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:23 2022] GET /identity/v3/users => generated 8771 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:23.638902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.639328 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2441/4877] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:23 2022] POST /identity/v3/projects => generated 360 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:23.639469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:23.640681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.718012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d595f6f-b115-46c4-a53d-6707d9fa592a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.723719 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:23.778448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9623445b-9bc8-4df9-a6c3-920e34108f74 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:23.793195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20606a7-cd8a-43e9-851e-9823f523e686 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.794118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20606a7-cd8a-43e9-851e-9823f523e686 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.794406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20606a7-cd8a-43e9-851e-9823f523e686 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.794684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20606a7-cd8a-43e9-851e-9823f523e686 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/6d1d5fd94c4848e893666bce5fa0e424` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.795999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20606a7-cd8a-43e9-851e-9823f523e686 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:get_project(project_id=6d1d5fd94c4848e893666bce5fa0e424)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.796115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:23.796933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.797216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.797489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] PATH_INFO: `/v3/projects/0a58c3f01b564d42ae10a77b54fcef5e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.798223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20606a7-cd8a-43e9-851e-9823f523e686 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.798816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a58c3f01b564d42ae10a77b54fcef5e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:23.800897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:23.803687 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2442/4878] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:31:23 2022] GET /identity/v3/projects/6d1d5fd94c4848e893666bce5fa0e424 => generated 360 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:23.805175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fab12-05dc-4e9a-85f1-e915895ae460 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:23.805462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fab12-05dc-4e9a-85f1-e915895ae460 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:23.805735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fab12-05dc-4e9a-85f1-e915895ae460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:23.863997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a58c3f01b564d42ae10a77b54fcef5e', 'request_id': 'req-09003639-12fd-487f-b5a9-608fa7bf159b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:23.873013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a58c3f01b564d42ae10a77b54fcef5e', 'request_id': 'req-09003639-12fd-487f-b5a9-608fa7bf159b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:23.880315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e25fab12-05dc-4e9a-85f1-e915895ae460 None None] MFA Rules not processed for user `66d2c64f0f8d40cdbaf149e2630bfde8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:23.882564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a58c3f01b564d42ae10a77b54fcef5e', 'request_id': 'req-09003639-12fd-487f-b5a9-608fa7bf159b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:23.882968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e25fab12-05dc-4e9a-85f1-e915895ae460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:23.909893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] The token cache is being invalidate because project 0a58c3f01b564d42ae10a77b54fcef5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:23.910178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:23.915677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:23.918054 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2437/4879] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:23 2022] DELETE /identity/v3/projects/0a58c3f01b564d42ae10a77b54fcef5e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:23.919396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:23.922507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.000696 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2443/4880] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:24.000696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.000696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.000696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.035361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09003639-12fd-487f-b5a9-608fa7bf159b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.047342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb329e68-35f8-4c12-b698-f9912fa0be44 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.048535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb329e68-35f8-4c12-b698-f9912fa0be44 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.048926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb329e68-35f8-4c12-b698-f9912fa0be44 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.049305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb329e68-35f8-4c12-b698-f9912fa0be44 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/6d1d5fd94c4848e893666bce5fa0e424/users/faf354bc71324ae58d88cb0a673b1887/roles/cdce7481568344e78b00c1ce1c40b634` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.058832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb329e68-35f8-4c12-b698-f9912fa0be44 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6d1d5fd94c4848e893666bce5fa0e424, user_id=faf354bc71324ae58d88cb0a673b1887, role_id=cdce7481568344e78b00c1ce1c40b634)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.061900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb329e68-35f8-4c12-b698-f9912fa0be44 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.073235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:24.076000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.086373 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2438/4881] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:23 2022] PUT /identity/v3/projects/6d1d5fd94c4848e893666bce5fa0e424/users/faf354bc71324ae58d88cb0a673b1887/roles/cdce7481568344e78b00c1ce1c40b634 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:24.089375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.089783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.090187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.116381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] MFA Rules not processed for user `66d2c64f0f8d40cdbaf149e2630bfde8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:24.118099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.154767 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:24.217721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2439/4882] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:24.222889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.247456 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2444/4883] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:24.248435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.287782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91ce699-9f2f-47e4-be6f-847b40d2e113 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.293881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11563815-a8f8-4cde-9934-dac1ba8b6418 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.294572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11563815-a8f8-4cde-9934-dac1ba8b6418 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.294841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11563815-a8f8-4cde-9934-dac1ba8b6418 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.295125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11563815-a8f8-4cde-9934-dac1ba8b6418 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.295872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11563815-a8f8-4cde-9934-dac1ba8b6418 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:create_trust()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.297107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11563815-a8f8-4cde-9934-dac1ba8b6418 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.308269 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:24.370605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3b11d-215c-44e5-8add-5d66ca486349 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.384787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.386854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.388157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.389923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/faf354bc71324ae58d88cb0a673b1887/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.393357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=faf354bc71324ae58d88cb0a673b1887)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.403674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.464858 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2445/4884] 10.222.0.15 () {60 vars in 1173 bytes} [Tue Jul 19 11:31:24 2022] POST /identity/v3/OS-TRUST/trusts => generated 858 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:24.464858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.464858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.464858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.490094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:24.494814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.511261 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2440/4885] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:31:24 2022] GET /identity/v3/users/faf354bc71324ae58d88cb0a673b1887/projects => generated 843 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:24.512627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.522237 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2446/4886] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:24.527096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.530223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae348e1f-61fa-4148-b7aa-77690486cabc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.542324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.543563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.545936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.546466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.547336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d213b59-e366-46f2-b0a0-0b77b953d298 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.555805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.556826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.557639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.557926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/6d1d5fd94c4848e893666bce5fa0e424` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.559265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d1d5fd94c4848e893666bce5fa0e424)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.561321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.571352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:get_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.572896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.587007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2441/4887] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:24 2022] GET /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729 => generated 858 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:24.588173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.604316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e110408-a1d1-4593-9ed6-e13a22204281 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.611283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.612038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.612599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.612946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.613977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:24.614435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.617960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.642157 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2442/4888] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:24.644303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.673853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d1d5fd94c4848e893666bce5fa0e424', 'request_id': 'req-7a66317a-3628-4181-8640-e5573f6ec5cb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:24.685943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221dc02-3c82-435f-bc43-13abd8a14262 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.690427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d1d5fd94c4848e893666bce5fa0e424', 'request_id': 'req-7a66317a-3628-4181-8640-e5573f6ec5cb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:24.704032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d1d5fd94c4848e893666bce5fa0e424', 'request_id': 'req-7a66317a-3628-4181-8640-e5573f6ec5cb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:24.729334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] The token cache is being invalidate because project 6d1d5fd94c4848e893666bce5fa0e424 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:24.729981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:24.731440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:24.733528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2447/4889] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:24 2022] DELETE /identity/v3/projects/6d1d5fd94c4848e893666bce5fa0e424 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:24.734486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.740305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.795717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.796747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.796887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.797120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.813017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.816105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.828568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a66317a-3628-4181-8640-e5573f6ec5cb tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:24.832573 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2443/4890] 10.222.0.15 () {58 vars in 1268 bytes} [Tue Jul 19 11:31:24 2022] GET /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:24.834525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.839764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.852730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:24.853488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:24.853771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:24.854052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:24.855610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:24.858444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:24.861697 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:24.897213 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2448/4891] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:24 2022] POST /identity/v3/projects => generated 395 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:24.898122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:24.901364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:24.907966 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:24.949101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc02b483-0a7e-4303-bad0-423d95e7439d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.014138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.015624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.018200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.019099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/0653abc303744ffc94c3d16734efc9d8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.019749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a5dec-1f67-411a-a4c6-8e00c6b088ad admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.021092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0653abc303744ffc94c3d16734efc9d8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.024016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.024581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.025441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.025870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.026153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/81e731ac302c433f9c7f377677958e7f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.037672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:get_role_for_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729, role_id=81e731ac302c433f9c7f377677958e7f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.044906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.067674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2449/4892] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:31:24 2022] GET /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/81e731ac302c433f9c7f377677958e7f => generated 243 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:25.069522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.120123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0653abc303744ffc94c3d16734efc9d8', 'request_id': 'req-cb94b196-fe1e-415f-909f-c10975379099'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.129501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0653abc303744ffc94c3d16734efc9d8', 'request_id': 'req-cb94b196-fe1e-415f-909f-c10975379099'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.137913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0653abc303744ffc94c3d16734efc9d8', 'request_id': 'req-cb94b196-fe1e-415f-909f-c10975379099'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.169864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] The token cache is being invalidate because project 0653abc303744ffc94c3d16734efc9d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:25.172041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.175389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.180389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2444/4893] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:24 2022] DELETE /identity/v3/projects/0653abc303744ffc94c3d16734efc9d8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:25.181638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.184146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.194709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0246fdf-8f46-4ccf-8c4f-481a7b8c9e90 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.261409 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:25.285572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb94b196-fe1e-415f-909f-c10975379099 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.293010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.293712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.293994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.294268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.294974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.298032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.301420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.302673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.302911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.303254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/81e731ac302c433f9c7f377677958e7f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.317334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:get_role_for_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729, role_id=81e731ac302c433f9c7f377677958e7f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.318740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.340451 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2445/4894] 10.222.0.15 () {58 vars in 1368 bytes} [Tue Jul 19 11:31:25 2022] HEAD /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/81e731ac302c433f9c7f377677958e7f => generated 0 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 19 11:31:25.341479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.344551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.346845 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2450/4895] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:25 2022] POST /identity/v3/users => generated 304 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:25.347792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.362835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d45f02-e75a-49d7-9608-5b5b0f611ef1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.367876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.368773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.369351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.369868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/cce0fec1c6d54b73875d6484551e68bb` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.377770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:get_role_for_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729, role_id=cce0fec1c6d54b73875d6484551e68bb)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.380606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Could not find role: cce0fec1c6d54b73875d6484551e68bb.: keystone.exception.RoleNotFound: Could not find role: cce0fec1c6d54b73875d6484551e68bb. Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 11:31:25.397914 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:31:25.398995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cce0fec1c6d54b73875d6484551e68bb. Jul 19 11:31:25.398995 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:25.403281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2451/4896] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:31:25 2022] GET /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/cce0fec1c6d54b73875d6484551e68bb => generated 110 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:25.404969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.406887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.425602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c1ed-28a8-4c4b-9db4-a5795308c17d tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.432236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.432968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.433107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e57688-0fe9-4446-a380-6e773693e57f tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.433777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.434062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.435260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.436908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.438055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.439280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.439983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.440261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/roles/cdce7481568344e78b00c1ce1c40b634` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.442223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cdce7481568344e78b00c1ce1c40b634)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.444728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.452981 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2452/4897] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:25 2022] GET /identity/v3/roles => generated 2122 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:25.453872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.464814 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:25.477855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d044be-a5a0-4433-88ce-6d6e8d5603d1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.485453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.487968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.488251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.488737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/cce0fec1c6d54b73875d6484551e68bb` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.497393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:get_role_for_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729, role_id=cce0fec1c6d54b73875d6484551e68bb)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.499591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.501208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invalidating the token cache because role cdce7481568344e78b00c1ce1c40b634 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:25.501577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.502613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.505222 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2446/4898] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:25 2022] DELETE /identity/v3/roles/cdce7481568344e78b00c1ce1c40b634 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:25.506019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.507488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Could not find role: cce0fec1c6d54b73875d6484551e68bb.: keystone.exception.RoleNotFound: Could not find role: cce0fec1c6d54b73875d6484551e68bb. Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 11:31:25.522265 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:31:25.523141 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: cce0fec1c6d54b73875d6484551e68bb. Jul 19 11:31:25.523141 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:25.523908 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2453/4899] 10.222.0.15 () {58 vars in 1368 bytes} [Tue Jul 19 11:31:25 2022] HEAD /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729/roles/cce0fec1c6d54b73875d6484551e68bb => generated 0 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 19 11:31:25.527921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.532575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.562233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a9a896-4b77-4df0-90bc-5dc0e2f1cb4a tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.585701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d0fb7-d945-47de-8c2d-9b983f0e4a32 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.590919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.592472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.592758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.593032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] PATH_INFO: `/v3/projects/5faece94fe194a38b39f1132229226a0/users/f3c1b5c11bcc4ce1ad398e89d238413e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.622863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faece94fe194a38b39f1132229226a0, user_id=f3c1b5c11bcc4ce1ad398e89d238413e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.626226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.655115 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2447/4900] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:25 2022] PUT /identity/v3/projects/5faece94fe194a38b39f1132229226a0/users/f3c1b5c11bcc4ce1ad398e89d238413e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:25.655990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.664681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.674054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.675848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.676551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.676826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/faf354bc71324ae58d88cb0a673b1887` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.679080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_user(user_id=faf354bc71324ae58d88cb0a673b1887)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.681566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.735521 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:25.788872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf354bc71324ae58d88cb0a673b1887'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.805657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e6fb4-813e-4bb1-ae81-91b40a14c231 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:25.809464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf354bc71324ae58d88cb0a673b1887'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.813810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:25.814963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:25.815762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:25.816472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:25.831932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorizing `identity:delete_trust(trust_id=04e3767b19f9462a9cb8c310c0a65729)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:25.833888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:25.842310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf354bc71324ae58d88cb0a673b1887'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.842923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf354bc71324ae58d88cb0a673b1887'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.852775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf354bc71324ae58d88cb0a673b1887'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.867533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2454/4901] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:25 2022] DELETE /identity/v3/users/faf354bc71324ae58d88cb0a673b1887 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:25.868585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.874397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '04e3767b19f9462a9cb8c310c0a65729', 'request_id': 'req-6722ce04-237d-4db7-95c1-6ed450882753'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.875752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:25.878235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '04e3767b19f9462a9cb8c310c0a65729', 'request_id': 'req-6722ce04-237d-4db7-95c1-6ed450882753'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.882013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '04e3767b19f9462a9cb8c310c0a65729', 'request_id': 'req-6722ce04-237d-4db7-95c1-6ed450882753'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:25.905357 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2448/4902] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:31:25 2022] DELETE /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:25.906942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:25.909023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.000172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47a3ce-ae54-4569-bf0f-9511017a205f tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:26.018089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6722ce04-237d-4db7-95c1-6ed450882753 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:26.018751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:26.019142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.019428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.019706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.020558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:26.022295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:26.054017 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2455/4903] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:25 2022] GET /identity/v3/roles => generated 1892 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:26.054017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:26.066837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.074689 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:26.141622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:26.143351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.143723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.144005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/3557cda81cc3428ab107301bd12c41d4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.145604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3557cda81cc3428ab107301bd12c41d4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:26.147915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:26.219093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6356dd8-269e-45a8-8975-2f5e7d8644e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:26.220118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3557cda81cc3428ab107301bd12c41d4', 'request_id': 'req-a300af56-0d85-4a55-92ef-6e05c57f5f4b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.223837 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:26.231671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3557cda81cc3428ab107301bd12c41d4', 'request_id': 'req-a300af56-0d85-4a55-92ef-6e05c57f5f4b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.247512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3557cda81cc3428ab107301bd12c41d4', 'request_id': 'req-a300af56-0d85-4a55-92ef-6e05c57f5f4b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.326640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] The token cache is being invalidate because project 3557cda81cc3428ab107301bd12c41d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:26.326846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.328105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.329970 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2449/4904] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:25 2022] DELETE /identity/v3/projects/3557cda81cc3428ab107301bd12c41d4 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:26.330880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:26.341260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.343167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66d2c64f0f8d40cdbaf149e2630bfde8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a6cd6955fa374dafa51cab050d3c1338', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1505525684', 'tempest-DelegatedRole-709792887'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:26.343917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.344508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.345013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] PATH_INFO: `/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Could not find trust: 04e3767b19f9462a9cb8c310c0a65729.: keystone.exception.TrustNotFound: Could not find trust: 04e3767b19f9462a9cb8c310c0a65729. Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 11:31:26.385286 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 04e3767b19f9462a9cb8c310c0a65729. Jul 19 11:31:26.386411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:26.390287 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2456/4905] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:26 2022] GET /identity/v3/OS-TRUST/trusts/04e3767b19f9462a9cb8c310c0a65729 => generated 111 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:26.391176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:26.397586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.487031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a300af56-0d85-4a55-92ef-6e05c57f5f4b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:26.492984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:26.494539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.495068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.495551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] PATH_INFO: `/v3/projects/5faece94fe194a38b39f1132229226a0/users/f3c1b5c11bcc4ce1ad398e89d238413e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.497876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5faece94fe194a38b39f1132229226a0, user_id=f3c1b5c11bcc4ce1ad398e89d238413e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:26.501278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:26.515870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2450/4906] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:26 2022] PUT /identity/v3/projects/5faece94fe194a38b39f1132229226a0/users/f3c1b5c11bcc4ce1ad398e89d238413e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:26.517224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:26.533233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.543279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7459140-a1f6-4dd8-b289-080ee352c680 tempest-TrustsV3TestJSON-169344773 tempest-user-310151446] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:26.626462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:26.627705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.628547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.629760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.631644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:update_user(user_id=082d4dcf80e94e4f8f4ca19feb10e6e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:26.632936 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:26.632936 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:31:26.632936 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:31:26.634511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:26.648719 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:26.701003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.704827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b22089-3612-4f5c-b784-a41ce775aa3d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:26.714280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:26.715404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.715885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.717482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invalidating the token cache because user 082d4dcf80e94e4f8f4ca19feb10e6e8 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:26.717881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.718765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-28fd8b49-bf72-4d17-bf7e-275ee3c6484d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.719351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/cce0fec1c6d54b73875d6484551e68bb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.721889 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2457/4907] 10.222.0.15 () {60 vars in 1242 bytes} [Tue Jul 19 11:31:26 2022] PATCH /identity/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8 => generated 296 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:26.723627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.725297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.726544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.727601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cce0fec1c6d54b73875d6484551e68bb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:26.730650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:26.800863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] MFA Rules not processed for user `f3c1b5c11bcc4ce1ad398e89d238413e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:26.803754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.824226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role cce0fec1c6d54b73875d6484551e68bb has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:26.825206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.828900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dd476568-2cd0-4b0e-aecc-f6e998776b26 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:26.833602 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2451/4908] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:26 2022] DELETE /identity/v3/roles/cce0fec1c6d54b73875d6484551e68bb => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:26.835389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:26.835928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:26.837484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:26.909803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] MFA Rules not processed for user `082d4dcf80e94e4f8f4ca19feb10e6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:26.913637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:26.930626 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2452/4909] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:26 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:26.933698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:26.941443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.006542 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2458/4910] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:27.007119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:27.011150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.040172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db7ab55-97b5-4df4-9671-11e17d35b040 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:27.068867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:27.200076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:27.200929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:27.201208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:27.201480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:27.203458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:update_user(user_id=082d4dcf80e94e4f8f4ca19feb10e6e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:27.207525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:27.242290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580502f-3ccc-4e02-8cfe-c67e07eb433d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:27.277850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.283998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:27.284963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:27.285274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:27.285557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/81e731ac302c433f9c7f377677958e7f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:27.288942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=81e731ac302c433f9c7f377677958e7f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:27.290837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:27.297254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invalidating the token cache because user 082d4dcf80e94e4f8f4ca19feb10e6e8 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:27.297668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.298961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.305083 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2459/4911] 10.222.0.15 () {60 vars in 1242 bytes} [Tue Jul 19 11:31:27 2022] PATCH /identity/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8 => generated 296 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:27.305083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:27.317213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.402476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role 81e731ac302c433f9c7f377677958e7f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:27.402758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.404383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.409686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2453/4912] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:26 2022] DELETE /identity/v3/roles/81e731ac302c433f9c7f377677958e7f => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:27.409686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:27.428130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.446082 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:UPDATE=2,keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:27.503670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feaed45-a0c2-4b6a-ac1a-e6440a24f5c0 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:27.621241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb49ce-baef-4d0f-9e58-44f42d768a6c tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:27.627663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:27.628902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:27.630072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:27.630442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:27.650635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:update_user(user_id=082d4dcf80e94e4f8f4ca19feb10e6e8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:27.652316 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:31:27.652316 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:31:27.652316 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:31:27.653828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:27.681209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dc0caa-b007-4c86-8cac-26d6fe699f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:27.682344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc0caa-b007-4c86-8cac-26d6fe699f7a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:27.682790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc0caa-b007-4c86-8cac-26d6fe699f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:27.683273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dc0caa-b007-4c86-8cac-26d6fe699f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:27.684395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc0caa-b007-4c86-8cac-26d6fe699f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:27.687134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dc0caa-b007-4c86-8cac-26d6fe699f7a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:27.706358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.725434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invalidating the token cache because user 082d4dcf80e94e4f8f4ca19feb10e6e8 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:27.725827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.726706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:27.731884 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2454/4913] 10.222.0.15 () {60 vars in 1242 bytes} [Tue Jul 19 11:31:27 2022] PATCH /identity/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8 => generated 296 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:27.731884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:27.734617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.753138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2460/4914] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:27 2022] POST /identity/v3/projects => generated 395 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:27.754698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:27.754972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:27.755344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:27.829880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] MFA Rules not processed for user `082d4dcf80e94e4f8f4ca19feb10e6e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:27.831352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.841541 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2461/4915] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:27 2022] POST /identity/v3/auth/tokens => generated 348 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:27.842651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:27.851117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:27.873950 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:27.897833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f689ce34-56ec-4b7d-8612-2a440b8346d4 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:27.997392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a65ef6-7b18-40aa-adde-d8f78af52599 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:28.025321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:28.026085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:28.026370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:28.026703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:28.027410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:28.028078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:28.031050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:28.031347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:28.031628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users/66d2c64f0f8d40cdbaf149e2630bfde8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:28.032646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:28.035229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=66d2c64f0f8d40cdbaf149e2630bfde8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:28.040780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:28.100831 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2462/4916] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:27 2022] POST /identity/v3/users => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:28.106170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:28.130160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:28.158255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66d2c64f0f8d40cdbaf149e2630bfde8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.159243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66d2c64f0f8d40cdbaf149e2630bfde8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.174588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66d2c64f0f8d40cdbaf149e2630bfde8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.176885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66d2c64f0f8d40cdbaf149e2630bfde8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.217343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66d2c64f0f8d40cdbaf149e2630bfde8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.271406 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2455/4917] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:27 2022] DELETE /identity/v3/users/66d2c64f0f8d40cdbaf149e2630bfde8 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:28.279548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:28.282461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:28.385651 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:28.441803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b20d920-eada-428d-9628-48c42453463d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:28.502908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd3bad5-9805-4dc5-9604-e45145b141b3 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:28.516005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:28.518669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:28.520646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:28.521962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:28.536214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:28.547650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:28.594757 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2456/4918] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:28.598229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:28.603744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:28.636651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:28.639990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:28.639990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:28.640218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:28.641585 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:28.642135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:update_user(user_id=082d4dcf80e94e4f8f4ca19feb10e6e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:28.652760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:28.727773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.748764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invalidating the token cache because user 082d4dcf80e94e4f8f4ca19feb10e6e8 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:28.749279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.751093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.757383 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2463/4919] 10.222.0.15 () {60 vars in 1242 bytes} [Tue Jul 19 11:31:28 2022] PATCH /identity/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8 => generated 296 bytes in 651 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:28.757721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:28.765405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:28.775014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b4ab2-9bc3-4df2-8987-8dc11a35a9e8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:28.780667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:28.781823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:28.782418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:28.782766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/a6cd6955fa374dafa51cab050d3c1338` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:28.785991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a6cd6955fa374dafa51cab050d3c1338)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:28.789062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:28.831818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c9619-ec52-49b7-9565-f89c66fc0a1e tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:28.851329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:28.852106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:28.853376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:28.853727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:28.855044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:28.858924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:28.886856 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2464/4920] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:28.887834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:28.896504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:28.902086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6cd6955fa374dafa51cab050d3c1338', 'request_id': 'req-bb42f462-d42d-4be5-bec7-e209677de125'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.913234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6cd6955fa374dafa51cab050d3c1338', 'request_id': 'req-bb42f462-d42d-4be5-bec7-e209677de125'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.931541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe460c8-b2d0-4dfd-ba2e-7aa76ea3f80b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:28.935895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6cd6955fa374dafa51cab050d3c1338', 'request_id': 'req-bb42f462-d42d-4be5-bec7-e209677de125'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.969211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] The token cache is being invalidate because project a6cd6955fa374dafa51cab050d3c1338 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:28.970848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.975481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:28.978046 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2457/4921] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:28 2022] DELETE /identity/v3/projects/a6cd6955fa374dafa51cab050d3c1338 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:28.979271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:28.986697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:29.077425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:29.078151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:29.078439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:29.078715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:29.079432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:29.081471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:29.155814 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2465/4922] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:28 2022] POST /identity/v3/users => generated 264 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:29.156816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:29.161368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:29.185723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42f462-d42d-4be5-bec7-e209677de125 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:29.191889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:29.193294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:29.194796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:29.195302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] PATH_INFO: `/v3/projects/f1825875b75f4f7d990c501b8c9d02a7/users/b45a524b248542f8a5bcf4ebf926a6cb/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:29.235546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1825875b75f4f7d990c501b8c9d02a7, user_id=b45a524b248542f8a5bcf4ebf926a6cb, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:29.239323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:29.271409 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2458/4923] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:28 2022] PUT /identity/v3/projects/f1825875b75f4f7d990c501b8c9d02a7/users/b45a524b248542f8a5bcf4ebf926a6cb/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:29.272471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:29.274662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:29.321806 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:29.325375 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:UPDATE=1,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:29.367192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707bab-220a-4709-b04f-49ef4016de03 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:29.394129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549028e5-145c-4fb3-a646-720eb04d9dff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:29.399902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e36409c-ce58-4671-8cf7-658257ae628b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:29.401035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36409c-ce58-4671-8cf7-658257ae628b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:29.401329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36409c-ce58-4671-8cf7-658257ae628b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:29.401610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e36409c-ce58-4671-8cf7-658257ae628b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/04ce49dd0ef94f52b19fc44bfdb285fc/password` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:29.529278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:29.530762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:29.531197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:29.532034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:29.537767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:29.544644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:29.590183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e36409c-ce58-4671-8cf7-658257ae628b tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '04ce49dd0ef94f52b19fc44bfdb285fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:29.618117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2459/4924] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:31:29 2022] POST /identity/v3/users/04ce49dd0ef94f52b19fc44bfdb285fc/password => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:29.619956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:29.620574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:29.621067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:29.639381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2466/4925] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:31:29 2022] POST /identity/v3/projects => generated 329 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:29.647137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:29.672402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] MFA Rules not processed for user `b45a524b248542f8a5bcf4ebf926a6cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:29.674076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:29.876025 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2460/4926] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:29.886186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:29.887950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:29.898739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee63f71-666a-4df4-95cb-fbb31de1263b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:29.909974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:29.909974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:29.910196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:29.910437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:29.911150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:29.916529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:29.990062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2467/4927] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:29 2022] POST /identity/v3/users => generated 413 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:29.991021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:30.018356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdcb69b-436c-4ca9-8cca-e27a05b40a54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.041335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.042041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.042326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.042605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.049320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.061939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:30.092262 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2468/4928] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:29 2022] POST /identity/v3/roles => generated 244 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:30.093427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:30.106580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4452-028a-4ab8-8279-b02f40eaedb4 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.113587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.114528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.114956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.115416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.116566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.117587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2647700b-b657-4874-9a4d-69e68c887641 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.119818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:30.128075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.129151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.129592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.130020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.134151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:30.147981 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:30.178987 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2469/4929] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:30 2022] POST /identity/v3/roles => generated 247 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:30.180075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:30.229039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3288e41-debf-47bc-8adb-195e41db1fbd tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.238863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.240194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.240631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.252897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/0ef39a37cc2b41ce85c192ef4889f092/users/b929fb6f750849e8b6e6ddf0b6fb172f/roles/e5d60a35e8454ee8bb00a7c32c3bd877` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.282350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ef39a37cc2b41ce85c192ef4889f092, user_id=b929fb6f750849e8b6e6ddf0b6fb172f, role_id=e5d60a35e8454ee8bb00a7c32c3bd877)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.285739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:30.311227 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2470/4930] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:30 2022] PUT /identity/v3/projects/0ef39a37cc2b41ce85c192ef4889f092/users/b929fb6f750849e8b6e6ddf0b6fb172f/roles/e5d60a35e8454ee8bb00a7c32c3bd877 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:30.312553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:30.326721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.328516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:30.351587 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2461/4931] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:30.378555 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:30.489279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202708d-50df-45a5-94a7-6fc7c3692f1e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.501044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01981ef4-6214-41b3-91b9-45e3c58e99d8 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.502095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981ef4-6214-41b3-91b9-45e3c58e99d8 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.502447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981ef4-6214-41b3-91b9-45e3c58e99d8 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.506964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01981ef4-6214-41b3-91b9-45e3c58e99d8 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/0ef39a37cc2b41ce85c192ef4889f092/users/b929fb6f750849e8b6e6ddf0b6fb172f/roles/2b80d28d6b6b4663b278468327d77464` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.511059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981ef4-6214-41b3-91b9-45e3c58e99d8 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0ef39a37cc2b41ce85c192ef4889f092, user_id=b929fb6f750849e8b6e6ddf0b6fb172f, role_id=2b80d28d6b6b4663b278468327d77464)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.514573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01981ef4-6214-41b3-91b9-45e3c58e99d8 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:30.554454 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2471/4932] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:30 2022] PUT /identity/v3/projects/0ef39a37cc2b41ce85c192ef4889f092/users/b929fb6f750849e8b6e6ddf0b6fb172f/roles/2b80d28d6b6b4663b278468327d77464 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:30.555970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:30.579339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b6fd03-3b5f-4d7a-b05f-679c50bac566 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.623596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.624442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.624872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.683650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] MFA Rules not processed for user `04ce49dd0ef94f52b19fc44bfdb285fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:30.695393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:30.713768 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2472/4933] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:30 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:31:30.720706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:30.825521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ed723-a0c2-4332-933b-f08c71e87b34 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.826210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ed723-a0c2-4332-933b-f08c71e87b34 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.826498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ed723-a0c2-4332-933b-f08c71e87b34 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.826777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ed723-a0c2-4332-933b-f08c71e87b34 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.827561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ed723-a0c2-4332-933b-f08c71e87b34 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.831705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ed723-a0c2-4332-933b-f08c71e87b34 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:30.942002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2462/4934] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:30 2022] GET /identity/v3/users => generated 9202 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:30.949536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.949995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.950173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.952563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece0c2fc-f047-4135-a62d-4aa9b4f55437 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:30.963637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:30.964407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:30.964785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:30.964875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:30.982815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:30.985897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:31.007856 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2473/4935] 10.222.0.15 () {56 vars in 1262 bytes} [Tue Jul 19 11:31:30 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 11:31:31.013099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:31.032709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e086b3-238a-4ea2-bb77-090794ee4679 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:31.037704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:31.039476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.039760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.040043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/04ce49dd0ef94f52b19fc44bfdb285fc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.050578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_user(user_id=04ce49dd0ef94f52b19fc44bfdb285fc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:31.052220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] MFA Rules not processed for user `b929fb6f750849e8b6e6ddf0b6fb172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:31.057329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:31.061008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:31.174576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04ce49dd0ef94f52b19fc44bfdb285fc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.196024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04ce49dd0ef94f52b19fc44bfdb285fc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.238848 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2463/4936] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:31.240131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:31.244477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04ce49dd0ef94f52b19fc44bfdb285fc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.249458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04ce49dd0ef94f52b19fc44bfdb285fc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.268336 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:31.270785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a749d6d6-3f5a-4c7a-b7b7-52619c9beb02 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04ce49dd0ef94f52b19fc44bfdb285fc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.278894 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2474/4937] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:31 2022] DELETE /identity/v3/users/04ce49dd0ef94f52b19fc44bfdb285fc => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:31.280279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.281389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.281389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.300106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] MFA Rules not processed for user `b929fb6f750849e8b6e6ddf0b6fb172f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:31.301719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:31.324603 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:31.349611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070bb93-5a36-4162-90cc-ea3b3112a0b0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:31.430264 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2475/4938] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:31.432138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:31.435596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:31.483656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:31.485834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.486205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.486555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] PATH_INFO: `/v3/users/f3c1b5c11bcc4ce1ad398e89d238413e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.488555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c1b5c11bcc4ce1ad398e89d238413e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:31.495355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:31.628231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325da038-c429-45d4-abea-d6e9c4554f16 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:31.638521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:31.640231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.640231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.640560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.640640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c1b5c11bcc4ce1ad398e89d238413e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.642313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c1b5c11bcc4ce1ad398e89d238413e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.642867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:31.648856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:31.669889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c1b5c11bcc4ce1ad398e89d238413e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.669889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c1b5c11bcc4ce1ad398e89d238413e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.685839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c1b5c11bcc4ce1ad398e89d238413e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:31.759086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2476/4939] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:31 2022] POST /identity/v3/users => generated 361 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:31.761820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:31.767149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:31.773805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2464/4940] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:31 2022] DELETE /identity/v3/users/f3c1b5c11bcc4ce1ad398e89d238413e => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:31.777787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:31.779586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:31.791051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3325706-0529-474b-a90f-b620795fb2ff tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:31.896287 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:31.900473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b929fb6f750849e8b6e6ddf0b6fb172f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0ef39a37cc2b41ce85c192ef4889f092', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1965719946', 'tempest-DelegatedRole-2008695062'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:31.902644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.903096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.903525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.904671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] RBAC: Authorizing `identity:create_trust()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:31.906417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:31.917031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cc3a15-cb8a-4999-97a8-6ff6068f3f20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:31.922805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e082502-6343-40f6-9b6d-397ce43104d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:31.923507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e082502-6343-40f6-9b6d-397ce43104d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.923809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e082502-6343-40f6-9b6d-397ce43104d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.924116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e082502-6343-40f6-9b6d-397ce43104d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.924963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e082502-6343-40f6-9b6d-397ce43104d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:31.927948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e082502-6343-40f6-9b6d-397ce43104d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:31.964639 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2465/4941] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:31 2022] POST /identity/v3/projects => generated 359 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:31.969530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:31.969824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:31.970108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:31.990766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:31.992550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.017933 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-9f0c5b97-5017-4057-9798-91ae72d51347 tempest-TrustsV3TestJSON-1266046776 tempest-user-178144869] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Jul 19 11:31:32.066623 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise ValueError(str(e)) Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Jul 19 11:31:32.067624 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:32.068704 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2477/4942] 10.222.0.15 () {60 vars in 1173 bytes} [Tue Jul 19 11:31:31 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 308 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:31:32.070101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.070397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.070767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.124814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] MFA Rules not processed for user `30494727ccea43e0a9ea4c54a1622192`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:32.126300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.133913 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2466/4943] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:32.134909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:32.285551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfb2aa6-73a9-46a5-b223-32e4bbdaa644 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:32.291583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:32.293322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.293615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.294083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/e9b4699254304ca1baadabf3045b9d28` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.319226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:update_user(user_id=e9b4699254304ca1baadabf3045b9d28)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:32.320826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:32.346678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2478/4944] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:32.348074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:32.349835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.382246 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2467/4945] 10.222.0.15 () {60 vars in 1243 bytes} [Tue Jul 19 11:31:32 2022] PATCH /identity/v3/users/e9b4699254304ca1baadabf3045b9d28 => generated 524 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:32.383352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:32.388642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.529206 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:UPDATE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:32.553494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f293a-258b-4a57-ab97-ead2714177c5 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:32.554509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fc884-dcfb-4f3f-b660-28d58a4f1684 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:32.561118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84006e19-94bf-412a-b3e3-6805be0d438c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:32.561899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006e19-94bf-412a-b3e3-6805be0d438c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.562350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006e19-94bf-412a-b3e3-6805be0d438c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.562699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84006e19-94bf-412a-b3e3-6805be0d438c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.568887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:32.570105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.570548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.570831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/2b80d28d6b6b4663b278468327d77464` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.574577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84006e19-94bf-412a-b3e3-6805be0d438c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:32.574955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2b80d28d6b6b4663b278468327d77464)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:32.576431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84006e19-94bf-412a-b3e3-6805be0d438c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:32.583753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:32.589031 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2468/4946] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:32.590938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.591285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.591576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.616235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] MFA Rules not processed for user `9ba7d6118edc4c4eb4931b8cdebcdcde`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:32.617786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.677074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role 2b80d28d6b6b4663b278468327d77464 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:32.677074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:32.678567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:32.686923 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2479/4947] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:32 2022] DELETE /identity/v3/roles/2b80d28d6b6b4663b278468327d77464 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:32.689275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:32.699596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.718991 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2469/4948] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:32 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:32.720076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:32.721947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.751162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d98e966-85a3-4562-acef-0e3eabaa98b3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:32.818275 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:32.844773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75ea89-fb46-48a1-b90f-b29bf0311447 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:32.863933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:32.865106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.865481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.866045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/e9b4699254304ca1baadabf3045b9d28` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.884565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:32.885947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:32.887931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:32.889558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/e5d60a35e8454ee8bb00a7c32c3bd877` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:32.894548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e5d60a35e8454ee8bb00a7c32c3bd877)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:32.896665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:get_user(user_id=e9b4699254304ca1baadabf3045b9d28)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:32.899756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:32.903178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:32.909215 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2480/4949] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:31:32 2022] GET /identity/v3/users/e9b4699254304ca1baadabf3045b9d28 => generated 390 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:32.910293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:32.914766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:32.997601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role e5d60a35e8454ee8bb00a7c32c3bd877 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:32.998216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:32.999129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.003197 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2470/4950] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:32 2022] DELETE /identity/v3/roles/e5d60a35e8454ee8bb00a7c32c3bd877 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:33.004465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:33.005810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:33.089702 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:33.109676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e1bee-baa3-421e-8970-2993d640a27e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:33.129217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:33.130271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:33.130559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:33.130845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/projects/2a8c973cd48449d58d7f40c68882270e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:33.133703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2a8c973cd48449d58d7f40c68882270e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:33.139094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:33.190268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fb0a26-a13e-42be-b810-2f70a096abdc tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:33.292635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8c973cd48449d58d7f40c68882270e', 'request_id': 'req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.313396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8c973cd48449d58d7f40c68882270e', 'request_id': 'req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.323097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8c973cd48449d58d7f40c68882270e', 'request_id': 'req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.344338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:33.347995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:33.349316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] The token cache is being invalidate because project 2a8c973cd48449d58d7f40c68882270e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:33.349453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:33.349871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:33.351022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.352546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.353275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:33.360156 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2471/4951] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:33 2022] DELETE /identity/v3/projects/2a8c973cd48449d58d7f40c68882270e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:33.360156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:33.363176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:33.461760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:33.465518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:33.495788 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2481/4952] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:32 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:33.498406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8058cc-e1d7-4fdb-9e0d-1df03b59e1d2 tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:33.499151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:33.501721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:33.508090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:33.512185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:33.512560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:33.512852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users/b929fb6f750849e8b6e6ddf0b6fb172f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:33.515240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b929fb6f750849e8b6e6ddf0b6fb172f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:33.521643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:33.538122 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:33.627761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b929fb6f750849e8b6e6ddf0b6fb172f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.628664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b929fb6f750849e8b6e6ddf0b6fb172f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.637316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f9ca4a-e32d-400a-95d6-3683388119c8 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:33.643292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b929fb6f750849e8b6e6ddf0b6fb172f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.643956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b929fb6f750849e8b6e6ddf0b6fb172f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.655341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b929fb6f750849e8b6e6ddf0b6fb172f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.697024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2472/4953] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:33 2022] DELETE /identity/v3/users/b929fb6f750849e8b6e6ddf0b6fb172f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:33.698451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:33.705154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:33.733995 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:33.803525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:33.804755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:33.804869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:33.805234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] PATH_INFO: `/v3/projects/5faece94fe194a38b39f1132229226a0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:33.806728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5faece94fe194a38b39f1132229226a0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:33.809798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:33.829236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c5aa1-f6a2-4b86-9c82-d71e8fd4ad04 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:33.838006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d1d37bb0f2445af9f31e3c2ae7bc745', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b801bc1f96c64c48bee80f8829f1cb39', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:33.839148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:33.839355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:33.839640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] PATH_INFO: `/v3/users/e9b4699254304ca1baadabf3045b9d28` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:33.841138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e9b4699254304ca1baadabf3045b9d28)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:33.843132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:33.887382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5faece94fe194a38b39f1132229226a0', 'request_id': 'req-ae28b871-4fc1-4ace-b8f0-7a689ce29525'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.906353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5faece94fe194a38b39f1132229226a0', 'request_id': 'req-ae28b871-4fc1-4ace-b8f0-7a689ce29525'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.929558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5faece94fe194a38b39f1132229226a0', 'request_id': 'req-ae28b871-4fc1-4ace-b8f0-7a689ce29525'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.952630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9b4699254304ca1baadabf3045b9d28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.954246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9b4699254304ca1baadabf3045b9d28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.963996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] The token cache is being invalidate because project 5faece94fe194a38b39f1132229226a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:33.964661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.965573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.971306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9b4699254304ca1baadabf3045b9d28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.971526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2482/4954] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:33 2022] DELETE /identity/v3/projects/5faece94fe194a38b39f1132229226a0 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:33.971526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:33.972417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9b4699254304ca1baadabf3045b9d28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:33.977231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:33.987069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9b4699254304ca1baadabf3045b9d28'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.035026 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2473/4955] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:33 2022] DELETE /identity/v3/users/e9b4699254304ca1baadabf3045b9d28 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:34.037458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:34.042775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:34.107053 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:34.135465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28b871-4fc1-4ace-b8f0-7a689ce29525 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:34.194259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dd35d4-0fc0-42b5-9e43-04ac4e20c23d tempest-UsersV3TestJSON-1155054811 tempest-UsersV3TestJSON-1155054811-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:34.209113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:34.210129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:34.210512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:34.210911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/0ef39a37cc2b41ce85c192ef4889f092` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:34.213184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ef39a37cc2b41ce85c192ef4889f092)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:34.215467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:34.271598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:34.272790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:34.273100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:34.273480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] PATH_INFO: `/v3/users/ec8e9dbd170a4e829e1edadbaf3c2164` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:34.275420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec8e9dbd170a4e829e1edadbaf3c2164)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:34.277864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:34.297656 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:34.326290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef39a37cc2b41ce85c192ef4889f092', 'request_id': 'req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.340260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef39a37cc2b41ce85c192ef4889f092', 'request_id': 'req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.354509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef39a37cc2b41ce85c192ef4889f092', 'request_id': 'req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.367415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec8e9dbd170a4e829e1edadbaf3c2164'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.376825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] The token cache is being invalidate because project 0ef39a37cc2b41ce85c192ef4889f092 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:34.378141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.378940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.379473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec8e9dbd170a4e829e1edadbaf3c2164'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.385107 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2474/4956] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:34 2022] DELETE /identity/v3/projects/0ef39a37cc2b41ce85c192ef4889f092 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:34.385107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:34.386529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:34.408718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec8e9dbd170a4e829e1edadbaf3c2164'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.409516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec8e9dbd170a4e829e1edadbaf3c2164'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.419251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec8e9dbd170a4e829e1edadbaf3c2164'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.429925 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2483/4957] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:33 2022] DELETE /identity/v3/users/ec8e9dbd170a4e829e1edadbaf3c2164 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:34.431154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:34.433810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:34.486878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a1de2e-7ae1-4e76-842f-02fe980b04f9 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:34.525003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b001a-68f9-4d74-bc5a-09bfd0f065ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:34.532760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:34.534176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:34.534612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:34.535037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] PATH_INFO: `/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:34.553030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=082d4dcf80e94e4f8f4ca19feb10e6e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:34.555870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:34.561353 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:34.562240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:34.563418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:34.565193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:34.565325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] PATH_INFO: `/v3/users/b45a524b248542f8a5bcf4ebf926a6cb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:34.566665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45a524b248542f8a5bcf4ebf926a6cb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:34.568666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:34.635139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.647774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.657771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45a524b248542f8a5bcf4ebf926a6cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.661546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45a524b248542f8a5bcf4ebf926a6cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.684691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.687917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45a524b248542f8a5bcf4ebf926a6cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.688094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.688709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45a524b248542f8a5bcf4ebf926a6cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.701205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45a524b248542f8a5bcf4ebf926a6cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.705021 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:34.724042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '082d4dcf80e94e4f8f4ca19feb10e6e8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:34.753467 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2475/4958] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:34 2022] DELETE /identity/v3/users/b45a524b248542f8a5bcf4ebf926a6cb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:34.756768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:34.761456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:34.764639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2484/4959] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:34 2022] DELETE /identity/v3/users/082d4dcf80e94e4f8f4ca19feb10e6e8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:34.775592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:34.779272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:34.889523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5501223d-a923-4baa-aadc-116d91394f81 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:34.895561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:34.896272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:34.896895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:34.896895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:34.897814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:34.899811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:34.923835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020b98-81d3-4389-a61a-e18e85335e86 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:34.942009 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2485/4960] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:31:34 2022] POST /identity/v3/projects => generated 326 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:34.942918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:34.948786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.015046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:35.016040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.016698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.017146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.021440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.038849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:35.042293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0ec1d-7fbd-4d70-9965-6ff32fdbf22f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:35.060230 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2476/4961] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:35.061634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.061903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.062178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.092943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:35.094285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.128572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bfa19-4c51-49a1-aac3-8e0209979692 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:35.138582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:35.139543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.139827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.140105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] PATH_INFO: `/v3/projects/3c2d4d40948b478e80da6a8c4591ae4b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.143003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c2d4d40948b478e80da6a8c4591ae4b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:35.146956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:35.188625 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:35.223215 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2477/4962] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:35.224047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:35.268907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c2d4d40948b478e80da6a8c4591ae4b', 'request_id': 'req-206f4f69-431f-4435-b3ea-496ce7a88c4d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.291802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c2d4d40948b478e80da6a8c4591ae4b', 'request_id': 'req-206f4f69-431f-4435-b3ea-496ce7a88c4d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.307345 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:35.316829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c2d4d40948b478e80da6a8c4591ae4b', 'request_id': 'req-206f4f69-431f-4435-b3ea-496ce7a88c4d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.336292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] The token cache is being invalidate because project 3c2d4d40948b478e80da6a8c4591ae4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:35.336627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.337297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.340052 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2486/4963] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:34 2022] DELETE /identity/v3/projects/3c2d4d40948b478e80da6a8c4591ae4b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:35.340713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:35.342027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.355060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3827dfa-4f79-473c-9c1c-98dbd71e872d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:35.431635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f4f69-431f-4435-b3ea-496ce7a88c4d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:35.435836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:35.436580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.436864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.437144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.439811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.447345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:35.448126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.448486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.448877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.450769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:35.454411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:35.503403 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2478/4964] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:35 2022] POST /identity/v3/users => generated 416 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:35.503403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:35.508199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.535510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:35.537805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b01799-000c-430f-b0ac-0d623c5c8569 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:35.553196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2487/4965] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:35.570770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.571077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.571931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.619519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:35.627547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.649559 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2488/4966] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:35.651811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:35.657027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.686711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc074d-6f36-4d08-8bb8-d62977ecdc40 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:35.700933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e836072-6626-4af2-a0ce-a515371144aa None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:35.701469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:35.702523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.702940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.704858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] PATH_INFO: `/v3/projects/f1825875b75f4f7d990c501b8c9d02a7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.708153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1825875b75f4f7d990c501b8c9d02a7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:35.715788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:35.716109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055b8d4-e95f-47a6-89a3-b7fa5ed5c01e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:35.717651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b8d4-e95f-47a6-89a3-b7fa5ed5c01e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.717941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b8d4-e95f-47a6-89a3-b7fa5ed5c01e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.718226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055b8d4-e95f-47a6-89a3-b7fa5ed5c01e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.723089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055b8d4-e95f-47a6-89a3-b7fa5ed5c01e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:35.726903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055b8d4-e95f-47a6-89a3-b7fa5ed5c01e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:35.779859 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2489/4967] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:35 2022] POST /identity/v3/roles => generated 243 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:35.788943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:35.789314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:35.789587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:35.851665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:35.857094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:35.910943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1825875b75f4f7d990c501b8c9d02a7', 'request_id': 'req-fecde617-178f-44f0-8bd5-406872a2afa6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.916668 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:35.938746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1825875b75f4f7d990c501b8c9d02a7', 'request_id': 'req-fecde617-178f-44f0-8bd5-406872a2afa6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.955293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1825875b75f4f7d990c501b8c9d02a7', 'request_id': 'req-fecde617-178f-44f0-8bd5-406872a2afa6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:35.978212 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2490/4968] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:35.979239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:35.999263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] The token cache is being invalidate because project f1825875b75f4f7d990c501b8c9d02a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:36.011311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.014258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.019643 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2479/4969] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:35 2022] DELETE /identity/v3/projects/f1825875b75f4f7d990c501b8c9d02a7 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:36.022663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.028337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.067875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecde617-178f-44f0-8bd5-406872a2afa6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.106042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.113732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.114695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.115137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.119897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa0f11-29c1-4607-8dfe-c41bcdf15798 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.121264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:36.122663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.128725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.130388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40e2a50-e36a-4843-9c82-afcba4519862 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.133465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e2a50-e36a-4843-9c82-afcba4519862 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.133835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e2a50-e36a-4843-9c82-afcba4519862 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.134308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40e2a50-e36a-4843-9c82-afcba4519862 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.136803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e2a50-e36a-4843-9c82-afcba4519862 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.137665 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:36.142143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40e2a50-e36a-4843-9c82-afcba4519862 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.182189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2491/4970] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:35 2022] POST /identity/v3/roles => generated 247 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:36.182383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2480/4971] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:36.182383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.184089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.185275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.186006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.217896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbad2a1-5f31-47bc-8cd1-e472b3e84e32 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.234395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c688c1-804f-4a25-a0f1-0918923f11e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.236263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c688c1-804f-4a25-a0f1-0918923f11e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.236448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:36.238143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c688c1-804f-4a25-a0f1-0918923f11e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.238293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.239594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c688c1-804f-4a25-a0f1-0918923f11e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.241147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c688c1-804f-4a25-a0f1-0918923f11e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.245995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c688c1-804f-4a25-a0f1-0918923f11e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.264763 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2492/4972] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:36.266765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.281203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.299843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2481/4973] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:36 2022] POST /identity/v3/projects => generated 381 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:36.302111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.302616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.303860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.331689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814d0f4-14d5-41dc-b3f3-66fd6c101e1c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.362061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:36.366149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.443095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.444020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.444305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.444641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/ab241fdc15df49a787febd8609cda212/users/601147bfa67d48f6a68b05a034f7e4e9/roles/3ba9c5e1f92a4499863f033a87a6934f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.487697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ab241fdc15df49a787febd8609cda212, user_id=601147bfa67d48f6a68b05a034f7e4e9, role_id=3ba9c5e1f92a4499863f033a87a6934f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.503977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.556717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2482/4974] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:36.557607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.565911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2493/4975] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:36 2022] PUT /identity/v3/projects/ab241fdc15df49a787febd8609cda212/users/601147bfa67d48f6a68b05a034f7e4e9/roles/3ba9c5e1f92a4499863f033a87a6934f => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:36.566964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.572569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641aa0f-2113-456b-baa9-ff6cafc2aa98 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.577227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.634199 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:36.650024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.650643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.651044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.651185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.652041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.654019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.661398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9adf91-c06c-4f41-9627-b348dca0e21d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.666255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.667401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.667755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.668209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] PATH_INFO: `/v3/projects/66812f6ad61242bcb1354e7a6ff368d9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.670190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66812f6ad61242bcb1354e7a6ff368d9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.673977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.682302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2483/4976] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:36 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:36.682302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.697618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b6a0-259b-4411-a05c-a232c4905a20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.704521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.705349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.705797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.706117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.706936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:36.707236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.709131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.728870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2484/4977] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:36.728870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.739305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66812f6ad61242bcb1354e7a6ff368d9', 'request_id': 'req-20ede4c5-3874-4c5e-84c4-e16aac5de911'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.749436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66812f6ad61242bcb1354e7a6ff368d9', 'request_id': 'req-20ede4c5-3874-4c5e-84c4-e16aac5de911'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.756976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66812f6ad61242bcb1354e7a6ff368d9', 'request_id': 'req-20ede4c5-3874-4c5e-84c4-e16aac5de911'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.768168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] The token cache is being invalidate because project 66812f6ad61242bcb1354e7a6ff368d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:36.768393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.769058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20ede4c5-3874-4c5e-84c4-e16aac5de911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:36.770914 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2494/4978] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:36 2022] DELETE /identity/v3/projects/66812f6ad61242bcb1354e7a6ff368d9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:36.775200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.775352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.775651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.788621 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:36.795028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:36.796246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.802775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f38254-4d6b-4aa2-9717-97bf619bb389 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.865766 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2495/4979] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:31:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:36.867341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.868779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.870734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.871654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.871969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.872247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/ab241fdc15df49a787febd8609cda212/users/601147bfa67d48f6a68b05a034f7e4e9/roles/c8debdc32d6346e388a9253032a1d54c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.875036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=ab241fdc15df49a787febd8609cda212, user_id=601147bfa67d48f6a68b05a034f7e4e9, role_id=c8debdc32d6346e388a9253032a1d54c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.878758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:36.895383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2485/4980] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:36 2022] PUT /identity/v3/projects/ab241fdc15df49a787febd8609cda212/users/601147bfa67d48f6a68b05a034f7e4e9/roles/c8debdc32d6346e388a9253032a1d54c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:36.896298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:36.897965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:36.954051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21ffe1-b842-430b-a49e-f370c76f33e7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.978663 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:36.978920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348174d8-51f3-496d-ac62-f426279e8943 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:36.984617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:36.985460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:36.985795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:36.986390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:36.987091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:36.989209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.020616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2486/4981] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:36 2022] POST /identity/v3/projects => generated 387 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:37.020616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.023584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.051493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.052991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.053412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.053842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.054727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.056542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.073436 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2496/4982] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:36 2022] GET /identity/v3/roles => generated 1892 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:37.074650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.077219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.112001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7cc88d-7ed8-4b16-b56c-d3a96776dfa2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.119328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.120370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.120939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.121323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] PATH_INFO: `/v3/users/6d1d37bb0f2445af9f31e3c2ae7bc745` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.125356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1d37bb0f2445af9f31e3c2ae7bc745)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.127738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.159396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6389764-6b77-4762-83fb-17699b272854 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.163045 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:37.190479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1d37bb0f2445af9f31e3c2ae7bc745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:37.191201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1d37bb0f2445af9f31e3c2ae7bc745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:37.200394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1d37bb0f2445af9f31e3c2ae7bc745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:37.201146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1d37bb0f2445af9f31e3c2ae7bc745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:37.208475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1d37bb0f2445af9f31e3c2ae7bc745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:37.222292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.222961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.223282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.223560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.226004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.230749 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2487/4983] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:37 2022] DELETE /identity/v3/users/6d1d37bb0f2445af9f31e3c2ae7bc745 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:37.230749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.230749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.297632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.299553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.310380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2497/4984] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:37.311193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.313156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.313402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1479260e-c00e-4a18-959c-ee24af57583c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.332677 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:37.333876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.335519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.336004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.336287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.337249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.339739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.342285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7e59c-a7e6-445e-b233-833d0a97330a service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.413912 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2488/4985] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:37 2022] GET /identity/v3/users => generated 7806 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:37.415228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.421786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.467843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.468686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.469086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.469517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.470200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.476903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.516484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2498/4986] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:37 2022] POST /identity/v3/users => generated 300 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:37.518401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.522098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.547623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26efe93-b5b1-47b0-99cb-82c2397cf399 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.558621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024719-4dfa-487d-969a-a7c444790d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.560186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024719-4dfa-487d-969a-a7c444790d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.560781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024719-4dfa-487d-969a-a7c444790d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.563081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024719-4dfa-487d-969a-a7c444790d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.564653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024719-4dfa-487d-969a-a7c444790d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.570242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024719-4dfa-487d-969a-a7c444790d6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.594846 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2489/4987] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:37 2022] GET /identity/v3/roles => generated 1892 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:37.598125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.598125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.598125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.692435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] MFA Rules not processed for user `601147bfa67d48f6a68b05a034f7e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:37.696585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633ba88b-adfc-4bba-a233-2ab1194760ac admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.699776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.706291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.706830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.707184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.707532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.711100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.725188 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:37.823954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.826066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.843394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2490/4988] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:37.844626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.859049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6eee3-c903-499f-93bd-2bb0b343bf97 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.862976 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2499/4989] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:37.863912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.865242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.866160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.866711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.867397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.868665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.871641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.876543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76b7442-9b11-4fe1-b9c8-379c85382e4a service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.883924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aeac3-7560-4521-9a9f-e6c6cf953837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.886311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aeac3-7560-4521-9a9f-e6c6cf953837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.886457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aeac3-7560-4521-9a9f-e6c6cf953837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.886799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aeac3-7560-4521-9a9f-e6c6cf953837 admin admin] PATH_INFO: `/v3/projects/5f2c76f9f4434f35b32277a0b69e312b/users/599dab32ff524b028851a6df2f9c5b33/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.889553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2491/4990] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:37 2022] GET /identity/v3/roles => generated 1892 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:37.890455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:37.894961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:37.907381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aeac3-7560-4521-9a9f-e6c6cf953837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f2c76f9f4434f35b32277a0b69e312b, user_id=599dab32ff524b028851a6df2f9c5b33, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.910311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aeac3-7560-4521-9a9f-e6c6cf953837 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.914015 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:37.915357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4d596-c99d-4dfc-b196-972495b55d8d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:37.933188 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2500/4991] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:37 2022] PUT /identity/v3/projects/5f2c76f9f4434f35b32277a0b69e312b/users/599dab32ff524b028851a6df2f9c5b33/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:37.936539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:37.937789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.940074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59550d-12da-4a1b-b510-34354f22db7a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:37.940388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59550d-12da-4a1b-b510-34354f22db7a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.940566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:37.940851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] PATH_INFO: `/v3/projects/b801bc1f96c64c48bee80f8829f1cb39` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.941719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d59550d-12da-4a1b-b510-34354f22db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:37.944130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b801bc1f96c64c48bee80f8829f1cb39)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:37.946573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:37.980273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9d59550d-12da-4a1b-b510-34354f22db7a None None] MFA Rules not processed for user `601147bfa67d48f6a68b05a034f7e4e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:37.981786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d59550d-12da-4a1b-b510-34354f22db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.023700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b801bc1f96c64c48bee80f8829f1cb39', 'request_id': 'req-b485465a-fcdf-4dc2-b569-998305a24a5d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:38.032861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b801bc1f96c64c48bee80f8829f1cb39', 'request_id': 'req-b485465a-fcdf-4dc2-b569-998305a24a5d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:38.039854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b801bc1f96c64c48bee80f8829f1cb39', 'request_id': 'req-b485465a-fcdf-4dc2-b569-998305a24a5d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:38.058559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] The token cache is being invalidate because project b801bc1f96c64c48bee80f8829f1cb39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:38.058837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:38.059662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:38.061832 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2492/4992] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:37 2022] DELETE /identity/v3/projects/b801bc1f96c64c48bee80f8829f1cb39 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:38.062945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.068835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.087792 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2501/4993] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:37 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:38.089622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5f64-0ff2-4617-b8ee-7e33db49b249 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.090062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5f64-0ff2-4617-b8ee-7e33db49b249 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.090501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8e5f64-0ff2-4617-b8ee-7e33db49b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.113226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1a8e5f64-0ff2-4617-b8ee-7e33db49b249 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:38.115472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1a8e5f64-0ff2-4617-b8ee-7e33db49b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.165456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b485465a-fcdf-4dc2-b569-998305a24a5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.172169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.173229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.173510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.173785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] PATH_INFO: `/v3/projects/3264fedd644744a7a4d9f1d1f087b295/users/c4f5cf58cb2544ae8cd690236a5b9ad4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.201406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3264fedd644744a7a4d9f1d1f087b295, user_id=c4f5cf58cb2544ae8cd690236a5b9ad4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.204613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.206946 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2502/4994] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:38.212429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.212429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.212919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.242682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2493/4995] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:38 2022] PUT /identity/v3/projects/3264fedd644744a7a4d9f1d1f087b295/users/c4f5cf58cb2544ae8cd690236a5b9ad4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:38.250234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.251570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:38.253301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.276884 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:38.399224 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2503/4996] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:38.400968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.409551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.411233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77030a1-ad1b-41d7-bc83-c975aaee5a98 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.424315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4ff508-9e48-4279-b59c-93ecb0a993a6 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.426064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff508-9e48-4279-b59c-93ecb0a993a6 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.426515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff508-9e48-4279-b59c-93ecb0a993a6 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.426943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4ff508-9e48-4279-b59c-93ecb0a993a6 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.428160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ff508-9e48-4279-b59c-93ecb0a993a6 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:create_trust()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.429908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4ff508-9e48-4279-b59c-93ecb0a993a6 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.490185 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:38.507926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27da47a-88d7-4573-8ad2-68222d19542c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.514287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.515346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.515780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.516316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.533176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.534982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.551257 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2504/4997] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:38.563451 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2494/4998] 10.222.0.15 () {60 vars in 1173 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:38.568852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc66d-7063-410e-9379-e286625513dc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.569150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc66d-7063-410e-9379-e286625513dc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.569481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daefc66d-7063-410e-9379-e286625513dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.569827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.595068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d48dc36-10af-4346-8aac-1e7492e11aad service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.610025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.610367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-daefc66d-7063-410e-9379-e286625513dc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:38.610961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.611757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-daefc66d-7063-410e-9379-e286625513dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.612482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.612831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.615203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.617411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.622665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2495/4999] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:38.623870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc66d-7063-410e-9379-e286625513dc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.637345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daefc66d-7063-410e-9379-e286625513dc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.641886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.643028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.643494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.643778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.650316 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2505/5000] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:38 2022] GET /identity/v3/roles => generated 1892 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:38.650879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:get_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.652263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.652431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.661475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2496/5001] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:38 2022] GET /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf => generated 833 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:38.662824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.670470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd68cb1-6c1a-46a5-8573-3b40d26a0c80 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.690357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.691747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501639c-83f1-4d3d-8b7b-78b7dbe8c26c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.694018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.694018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.694018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.695560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:38.695879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.700325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.707267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.708388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.708676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.708949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] PATH_INFO: `/v3/projects/3264fedd644744a7a4d9f1d1f087b295/users/c4f5cf58cb2544ae8cd690236a5b9ad4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.717369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3264fedd644744a7a4d9f1d1f087b295, user_id=c4f5cf58cb2544ae8cd690236a5b9ad4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.725143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.737202 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2506/5002] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:38.739024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.757301 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2497/5003] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:38 2022] PUT /identity/v3/projects/3264fedd644744a7a4d9f1d1f087b295/users/c4f5cf58cb2544ae8cd690236a5b9ad4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:38.758493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.768397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a463bf-8e2c-48dd-bcf7-11011ce27048 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.877076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68ed79-5318-49a3-8f4e-362a0423b52f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:38.882691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3228100-d16e-419e-a212-6b2872750ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.883404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228100-d16e-419e-a212-6b2872750ccc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.883875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228100-d16e-419e-a212-6b2872750ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.884160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228100-d16e-419e-a212-6b2872750ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.885187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228100-d16e-419e-a212-6b2872750ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.887494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228100-d16e-419e-a212-6b2872750ccc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.907941 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:38.929729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:38.930687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.931113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.931491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.932718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2498/5004] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:38.935597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:38.935942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:38.936393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:38.958759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:38.960472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:38.975684 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2507/5005] 10.222.0.15 () {58 vars in 1268 bytes} [Tue Jul 19 11:31:38 2022] GET /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:38.977209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:38.987787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] MFA Rules not processed for user `c4f5cf58cb2544ae8cd690236a5b9ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:38.989422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:38.992418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f98017-f618-478e-8816-b8a08fe92231 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.073499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.074483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.074868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.075246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.076094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.078972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.099788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2499/5006] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:39.100853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.114496 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2508/5007] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:38 2022] POST /identity/v3/users => generated 286 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:39.115588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.129351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc53a29-f50e-4175-8816-14041569cb2a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.137195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.138261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.138932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.139805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.140250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.143554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.194274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2509/5008] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:39 2022] POST /identity/v3/projects => generated 387 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:39.195600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.199229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6002f2-78af-437c-bb4e-29efc1c7a4bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.253415 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:39.289783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.290852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.292036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.292440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/3ba9c5e1f92a4499863f033a87a6934f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.300201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf, role_id=3ba9c5e1f92a4499863f033a87a6934f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.303108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.316370 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2500/5009] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:31:39 2022] GET /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/3ba9c5e1f92a4499863f033a87a6934f => generated 243 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:39.318322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.350407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fed5e16-b659-40ae-a66a-694fcdf38d17 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.352930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637f104-b060-4c65-9931-7302993de062 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.361515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.363540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.363839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.364208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.365117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.365529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.366384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.366740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.367081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.369327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.372317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.376115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.401801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2510/5010] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:39 2022] GET /identity/v3/roles => generated 1892 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:39.401801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.419889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c17d2-88ce-4b54-8df0-9e451a839d58 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.425710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.426816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.427503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.427974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/3ba9c5e1f92a4499863f033a87a6934f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.436321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf, role_id=3ba9c5e1f92a4499863f033a87a6934f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.439913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.449232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2511/5011] 10.222.0.15 () {58 vars in 1368 bytes} [Tue Jul 19 11:31:39 2022] HEAD /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/3ba9c5e1f92a4499863f033a87a6934f => generated 0 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 19 11:31:39.450377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.457328 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2501/5012] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:39 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:39.458645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.471665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e851-758b-4b3d-8b31-3a3bdbc873e2 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.480322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.481342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.481781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.482228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.483158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.485200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.491558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13382c4f-0014-4fc5-a740-a247ae6a8e1b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.498825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.499522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.499944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.500225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.503944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.504505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2512/5013] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:39 2022] GET /identity/v3/roles => generated 1892 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:39.506104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.506649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.508910 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:39.522592 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2502/5014] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:39 2022] GET /identity/v3/roles => generated 1892 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:39.523908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.527342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342743e-d93a-4575-a898-098e5f516987 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.536231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.537116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.537399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.537673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/c8debdc32d6346e388a9253032a1d54c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.545414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1097056-d54f-47ee-bcad-49bcd0b97c81 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.546690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf, role_id=c8debdc32d6346e388a9253032a1d54c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.550315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.575826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.577648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.577962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.578432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] PATH_INFO: `/v3/projects/41cb9a935d754279a091924d649339ac/users/61b920243705455db38298e76b8b6a25/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Could not find role: c8debdc32d6346e388a9253032a1d54c.: keystone.exception.RoleNotFound: Could not find role: c8debdc32d6346e388a9253032a1d54c. Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 11:31:39.589339 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:31:39.590384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c8debdc32d6346e388a9253032a1d54c. Jul 19 11:31:39.590384 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:39.596003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2513/5015] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:31:39 2022] GET /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/c8debdc32d6346e388a9253032a1d54c => generated 110 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:39.598600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.625713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41cb9a935d754279a091924d649339ac, user_id=61b920243705455db38298e76b8b6a25, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.632296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.652199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef55fe6-cf66-496b-a0ae-d7af00276a98 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.655598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2503/5016] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:39 2022] PUT /identity/v3/projects/41cb9a935d754279a091924d649339ac/users/61b920243705455db38298e76b8b6a25/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:39.667462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.773867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b50087-0de3-4e3d-8a17-eb6170946c4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.782855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.786691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.787212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.787611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/c8debdc32d6346e388a9253032a1d54c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.795158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:get_role_for_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf, role_id=c8debdc32d6346e388a9253032a1d54c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.797362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cbde83fd-ff3e-42ab-afd5-231fd7e2f15c tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Could not find role: c8debdc32d6346e388a9253032a1d54c.: keystone.exception.RoleNotFound: Could not find role: c8debdc32d6346e388a9253032a1d54c. Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 11:31:39.818034 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:31:39.819180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: c8debdc32d6346e388a9253032a1d54c. Jul 19 11:31:39.819180 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:39.824945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2504/5017] 10.222.0.15 () {58 vars in 1368 bytes} [Tue Jul 19 11:31:39 2022] HEAD /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf/roles/c8debdc32d6346e388a9253032a1d54c => generated 0 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 19 11:31:39.827594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.829132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.829494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.834853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.835557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.835876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.836160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.837187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.839040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.860252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2514/5018] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:39 2022] GET /identity/v3/roles => generated 1892 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:39.860252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:39.870523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd9df65-b01b-4cf5-aab8-52ca8fc75e27 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:39.877399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:39.878324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:39.878601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:39.878873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:39.894648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] MFA Rules not processed for user `61b920243705455db38298e76b8b6a25`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:39.896259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:39.916032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorizing `identity:delete_trust(trust_id=b3b7fc119540405daa63f4a53009e1cf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:39.918258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:39.961835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'b3b7fc119540405daa63f4a53009e1cf', 'request_id': 'req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:39.985285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b3b7fc119540405daa63f4a53009e1cf', 'request_id': 'req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:39.986707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'b3b7fc119540405daa63f4a53009e1cf', 'request_id': 'req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:39.998834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2515/5019] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:31:39 2022] DELETE /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:39.999402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.003711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.048679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1c0340-7ea1-49b1-bdc1-adaaf81f5d92 tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.056814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.058020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.058363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.065802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2505/5020] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:40.066719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.068051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.072477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] PATH_INFO: `/v3/projects/c22e9e8a83b745c78e9c5ef1b9804b01/users/967a6603db2141808d9b300bcaeb2d2b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.082987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd9c3b-862c-4d96-b116-7be2763576c1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.087255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '601147bfa67d48f6a68b05a034f7e4e9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab241fdc15df49a787febd8609cda212', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-517451915', 'tempest-NotDelegatedRole-1324105381'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.088105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.088419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.088702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] PATH_INFO: `/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.097126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c22e9e8a83b745c78e9c5ef1b9804b01, user_id=967a6603db2141808d9b300bcaeb2d2b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:40.100407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Could not find trust: b3b7fc119540405daa63f4a53009e1cf.: keystone.exception.TrustNotFound: Could not find trust: b3b7fc119540405daa63f4a53009e1cf. Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 11:31:40.105137 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: b3b7fc119540405daa63f4a53009e1cf. Jul 19 11:31:40.106424 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:40.107814 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2506/5021] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:40 2022] GET /identity/v3/OS-TRUST/trusts/b3b7fc119540405daa63f4a53009e1cf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:40.107814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.122962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2516/5022] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:39 2022] PUT /identity/v3/projects/c22e9e8a83b745c78e9c5ef1b9804b01/users/967a6603db2141808d9b300bcaeb2d2b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:40.124307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.126444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.128554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38941b1a-0130-48b8-a253-a2f7422c841d tempest-TrustsV3TestJSON-2045137 tempest-user-1247576778] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.135045 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:40.183215 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:40.194662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac4208-3261-4cc4-85ab-17fa0f917842 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.196003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4208-3261-4cc4-85ab-17fa0f917842 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.197469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4208-3261-4cc4-85ab-17fa0f917842 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.197843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac4208-3261-4cc4-85ab-17fa0f917842 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.198693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac4208-3261-4cc4-85ab-17fa0f917842 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:create_application_credential(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:40.200524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac4208-3261-4cc4-85ab-17fa0f917842 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:40.217849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af102930-ff8c-4ac1-8d0d-edda593c036a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.223795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.225507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.227313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.227631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/c8debdc32d6346e388a9253032a1d54c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.229324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c8debdc32d6346e388a9253032a1d54c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:40.239799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:40.329233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role c8debdc32d6346e388a9253032a1d54c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:40.329347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:40.330019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:40.334470 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2507/5024] 10.222.0.15 () {60 vars in 1314 bytes} [Tue Jul 19 11:31:40 2022] POST /identity/v3/users/61b920243705455db38298e76b8b6a25/application_credentials => generated 920 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:40.336598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.337064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.337186 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2517/5024] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:40 2022] DELETE /identity/v3/roles/c8debdc32d6346e388a9253032a1d54c => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:40.337629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.338376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.340235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.380324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] MFA Rules not processed for user `967a6603db2141808d9b300bcaeb2d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:40.381886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.427252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942825b-f8c3-47b0-807f-1081197151aa tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.435592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.436573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.436856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.437131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/access_rules/7382e70d64194cc3a5a5f21e63d8a4f0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.439123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:delete_access_rule(user_id=61b920243705455db38298e76b8b6a25, access_rule_id=7382e70d64194cc3a5a5f21e63d8a4f0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:40.441223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:40.472721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2508/5025] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:40.473807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.475573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-905203a0-74a7-48ed-b52c-64beca4a1c00 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application session.delete(ref) Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application next(self.gen) Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application yield resource Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application next(self.gen) Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 11:31:40.498506 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise self.value Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application session.commit() Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.session.flush() Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 11:31:40.499663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application compat.raise_( Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._synchronize( Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise AssertionError( Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Jul 19 11:31:40.500801 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:40.501935 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:40.503277 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Jul 19 11:31:40.503277 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Jul 19 11:31:40.503277 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Jul 19 11:31:40.503277 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 19 11:31:40.503277 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Jul 19 11:31:40.503277 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:40.507984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2518/5026] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Jul 19 11:31:40 2022] DELETE /identity/v3/users/61b920243705455db38298e76b8b6a25/access_rules/7382e70d64194cc3a5a5f21e63d8a4f0 => generated 89 bytes in 167 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:31:40.507984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.507984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.508809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.537709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:40.540048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.557362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103519c5-3416-4d6e-ae41-9147f05f8985 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.563972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.566571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.566851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.567055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/3ba9c5e1f92a4499863f033a87a6934f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.569940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=3ba9c5e1f92a4499863f033a87a6934f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:40.571630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:40.596185 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:40.632645 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2519/5027] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:40.633536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.638108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.639144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role 3ba9c5e1f92a4499863f033a87a6934f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:40.639596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:40.640389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:40.647043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2509/5028] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:40 2022] DELETE /identity/v3/roles/3ba9c5e1f92a4499863f033a87a6934f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:40.648262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.649827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.651817 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:40.759471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e47194-ed56-4840-a90e-a558cb56d93b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.781585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7ad962-1204-4aaa-857b-1f21edcaff08 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:40.804050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.804549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.805360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.805663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/application_credentials/547e0b31646c428a8b79d132d7b8df07` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.842404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:delete_application_credential(user_id=61b920243705455db38298e76b8b6a25, application_credential_id=547e0b31646c428a8b79d132d7b8df07)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:40.843996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:40.868678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:40.869850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:40.871381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:40.871674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:40.883520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:40.887150 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2510/5029] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:31:40 2022] DELETE /identity/v3/users/61b920243705455db38298e76b8b6a25/application_credentials/547e0b31646c428a8b79d132d7b8df07 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:40.888279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:40.891262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:41.008865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.010498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.046081 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2520/5030] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:40 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:41.046081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.069845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af491f43-2a60-4506-94b0-7cce77b2dd12 service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.078461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.079370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.079656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.080042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/access_rules` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.081469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:list_access_rules(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.082997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.094107 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2521/5031] 10.222.0.15 () {58 vars in 1259 bytes} [Tue Jul 19 11:31:41 2022] GET /identity/v3/users/61b920243705455db38298e76b8b6a25/access_rules => generated 369 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:41.096281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.131928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1f92d-81a2-4503-8eeb-fc56dadb3957 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.145919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.147214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.147736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.148173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/access_rules/7382e70d64194cc3a5a5f21e63d8a4f0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.150366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:delete_access_rule(user_id=61b920243705455db38298e76b8b6a25, access_rule_id=7382e70d64194cc3a5a5f21e63d8a4f0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.153156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.231040 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2522/5032] 10.222.0.15 () {58 vars in 1361 bytes} [Tue Jul 19 11:31:41 2022] DELETE /identity/v3/users/61b920243705455db38298e76b8b6a25/access_rules/7382e70d64194cc3a5a5f21e63d8a4f0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:41.235301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.272262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78221b4-c77b-4202-af64-7bfeb336d10a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.277155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.278059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.278342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.278621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users/601147bfa67d48f6a68b05a034f7e4e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.280183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=601147bfa67d48f6a68b05a034f7e4e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.282594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.299199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37c7b2-f3d0-4d70-91d8-0086e6bc073a tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.311889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.317529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.319107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.319588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/access_rules` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.323077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:list_access_rules(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.330078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.341908 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2523/5033] 10.222.0.15 () {58 vars in 1259 bytes} [Tue Jul 19 11:31:41 2022] GET /identity/v3/users/61b920243705455db38298e76b8b6a25/access_rules => generated 158 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:41.357365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.362799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601147bfa67d48f6a68b05a034f7e4e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.364379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601147bfa67d48f6a68b05a034f7e4e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.376558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601147bfa67d48f6a68b05a034f7e4e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.378126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601147bfa67d48f6a68b05a034f7e4e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.385851 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:41.390945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601147bfa67d48f6a68b05a034f7e4e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.399505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca72c6-b802-4f01-9df1-a7fda423fca5 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.415370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.422220 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2511/5034] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:40 2022] DELETE /identity/v3/users/601147bfa67d48f6a68b05a034f7e4e9 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:41.422473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.422473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.422473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/application_credentials` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.422473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:create_application_credential(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.423405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.424059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.428587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:41.506053 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:41.601250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831892b3-00cb-49f2-8528-0f7e765af22a tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.617637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.618737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.619130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.619517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/ab241fdc15df49a787febd8609cda212` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.620999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ab241fdc15df49a787febd8609cda212)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.627214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.704300 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2524/5035] 10.222.0.15 () {60 vars in 1314 bytes} [Tue Jul 19 11:31:41 2022] POST /identity/v3/users/61b920243705455db38298e76b8b6a25/application_credentials => generated 920 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:41.706333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.710146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:41.754668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49920b8e-4a6c-4ad8-afbb-6531cfe33b55 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.773521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab241fdc15df49a787febd8609cda212', 'request_id': 'req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.786951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab241fdc15df49a787febd8609cda212', 'request_id': 'req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.801694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab241fdc15df49a787febd8609cda212', 'request_id': 'req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.831415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] The token cache is being invalidate because project ab241fdc15df49a787febd8609cda212 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:41.831964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.832776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:41.834767 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2512/5036] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:41 2022] DELETE /identity/v3/projects/ab241fdc15df49a787febd8609cda212 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:41.835765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.837529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:41.868080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.869019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.869306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.869588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/access_rules` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.871025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:list_access_rules(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.873051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:41.885320 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2525/5037] 10.222.0.15 () {58 vars in 1259 bytes} [Tue Jul 19 11:31:41 2022] GET /identity/v3/users/61b920243705455db38298e76b8b6a25/access_rules => generated 369 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:41.886784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:41.889482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:41.971787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe45fd-5162-4048-b3a6-60ec04fcf30e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:41.980892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:41.983938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:41.984525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:41.985356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] PATH_INFO: `/v3/users/c4f5cf58cb2544ae8cd690236a5b9ad4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:41.987761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4f5cf58cb2544ae8cd690236a5b9ad4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:41.991393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.006824 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:42.079172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ccd91-3cec-4a91-bfcf-3eea52db9051 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.084582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.085361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.085651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.085933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.086687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.088863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.106172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4f5cf58cb2544ae8cd690236a5b9ad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.106866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4f5cf58cb2544ae8cd690236a5b9ad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.123701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4f5cf58cb2544ae8cd690236a5b9ad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.124715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4f5cf58cb2544ae8cd690236a5b9ad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.138377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4f5cf58cb2544ae8cd690236a5b9ad4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.144128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2526/5038] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:31:41 2022] POST /identity/v3/projects => generated 329 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:42.146551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.151235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:42.185582 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2513/5039] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:41 2022] DELETE /identity/v3/users/c4f5cf58cb2544ae8cd690236a5b9ad4 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:42.185582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.186350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:42.237901 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:42.248423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98183b-b6a9-4eb0-a9e5-b52866b0368e tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.345744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd9ec40-f487-4bcf-9eb3-8cf113bc1322 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.357087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1eca8-03a0-486e-87ca-488598c9ae54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.359091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1eca8-03a0-486e-87ca-488598c9ae54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.359398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1eca8-03a0-486e-87ca-488598c9ae54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.359694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1eca8-03a0-486e-87ca-488598c9ae54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.363846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1eca8-03a0-486e-87ca-488598c9ae54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.371807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1eca8-03a0-486e-87ca-488598c9ae54 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.404365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.405534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.407761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.411643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/application_credentials` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.412894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:create_application_credential(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.423145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.450812 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2514/5040] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:42 2022] POST /identity/v3/users => generated 416 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:42.451628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.451933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.452221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.490793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:42.491969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:42.592734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2527/5041] 10.222.0.15 () {60 vars in 1314 bytes} [Tue Jul 19 11:31:42 2022] POST /identity/v3/users/61b920243705455db38298e76b8b6a25/application_credentials => generated 920 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:42.593798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.639449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de93b23-1d70-4603-9dd4-9703c99d10ec tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.651241 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2515/5042] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:42.651241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.657048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.662776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.663200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.663497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.664307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.666036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.686974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35341c66-82b9-4100-9339-6426ef5e9ac3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.697656 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2528/5043] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:42 2022] POST /identity/v3/roles => generated 244 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:42.703437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.716646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '61b920243705455db38298e76b8b6a25', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '41cb9a935d754279a091924d649339ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.719215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.719687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.721027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25/access_rules/561cc4fd00e44d9d8846db7519b3ed2c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.727466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorizing `identity:get_access_rule(user_id=61b920243705455db38298e76b8b6a25, access_rule_id=561cc4fd00e44d9d8846db7519b3ed2c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.728544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1680043-2043-4a66-89e3-3b1083a6ea5d tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.731416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.733481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.734171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.734458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.734739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.735681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.737527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.758831 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2516/5044] 10.222.0.15 () {58 vars in 1358 bytes} [Tue Jul 19 11:31:42 2022] GET /identity/v3/users/61b920243705455db38298e76b8b6a25/access_rules/561cc4fd00e44d9d8846db7519b3ed2c => generated 229 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:42.758831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.761619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:42.772140 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2529/5045] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:31:42 2022] POST /identity/v3/roles => generated 246 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:31:42.779622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.791979 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:42.800896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2143269a-0d78-45ac-bc0e-115ceee8b769 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.807418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e26548-8939-4009-8fa0-3d256eda0854 tempest-AccessRulesV3Test-1361317930 tempest-AccessRulesV3Test-1361317930-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:42.818707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.819617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.819902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.820179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/297dd7b4fbbf45be986bf5e6e7003f1f/users/7b79f3d7d5cb4b328dadf070801df6e7/roles/e1b5923fa47c42ceaa46fbfd251abdd1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.820675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:42.822938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:42.824873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:42.825175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] PATH_INFO: `/v3/users/61b920243705455db38298e76b8b6a25` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:42.829959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b920243705455db38298e76b8b6a25)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.835852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.891703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=297dd7b4fbbf45be986bf5e6e7003f1f, user_id=7b79f3d7d5cb4b328dadf070801df6e7, role_id=e1b5923fa47c42ceaa46fbfd251abdd1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:42.894538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:42.935586 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2530/5046] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:42 2022] PUT /identity/v3/projects/297dd7b4fbbf45be986bf5e6e7003f1f/users/7b79f3d7d5cb4b328dadf070801df6e7/roles/e1b5923fa47c42ceaa46fbfd251abdd1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:42.935586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:42.937620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:42.937774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b920243705455db38298e76b8b6a25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.939068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b920243705455db38298e76b8b6a25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.953729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b920243705455db38298e76b8b6a25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.954653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b920243705455db38298e76b8b6a25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:42.968869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b920243705455db38298e76b8b6a25'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:43.127048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9aa7-8d0a-4cd9-b57a-e7d644545fe5 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:43.136051 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2517/5047] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:42 2022] DELETE /identity/v3/users/61b920243705455db38298e76b8b6a25 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:31:43.139070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:43.144687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:43.145381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.145653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.145932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:43.146362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:43.151250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:43.170507 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:43.323287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58603a21-d3e6-4775-9cf2-3488fe2c1fd3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:43.343751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f09252-91f3-4fe2-b067-7afa2460a264 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:43.346031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f09252-91f3-4fe2-b067-7afa2460a264 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.346321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f09252-91f3-4fe2-b067-7afa2460a264 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.346601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f09252-91f3-4fe2-b067-7afa2460a264 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/297dd7b4fbbf45be986bf5e6e7003f1f/users/7b79f3d7d5cb4b328dadf070801df6e7/roles/106119dae29d4bf0aa286a059b7df7c8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:43.354043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f09252-91f3-4fe2-b067-7afa2460a264 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:create_grant(project_id=297dd7b4fbbf45be986bf5e6e7003f1f, user_id=7b79f3d7d5cb4b328dadf070801df6e7, role_id=106119dae29d4bf0aa286a059b7df7c8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:43.360068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f09252-91f3-4fe2-b067-7afa2460a264 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:43.393791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2518/5048] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:43 2022] PUT /identity/v3/projects/297dd7b4fbbf45be986bf5e6e7003f1f/users/7b79f3d7d5cb4b328dadf070801df6e7/roles/106119dae29d4bf0aa286a059b7df7c8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:43.395798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.396374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.397000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:43.397878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:43.399554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:43.422357 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2531/5049] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:43.423319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:43.443901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:43.445557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:43.544421 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:43.584836 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2519/5050] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:43.599617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:43.606867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:43.647216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931ef52-6120-4da1-a604-0badba3056b3 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:43.748161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38897bb-be8a-494b-9f47-5e4b8bcd7776 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:43.754669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38897bb-be8a-494b-9f47-5e4b8bcd7776 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.754976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38897bb-be8a-494b-9f47-5e4b8bcd7776 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.755375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38897bb-be8a-494b-9f47-5e4b8bcd7776 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:43.756207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38897bb-be8a-494b-9f47-5e4b8bcd7776 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:43.760136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38897bb-be8a-494b-9f47-5e4b8bcd7776 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:43.776621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcde039a-c970-4bc8-b5e4-8843ce755f42 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:43.780850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69657bbb-71b0-402b-93be-2e02c38a347c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:43.781635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69657bbb-71b0-402b-93be-2e02c38a347c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.782012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69657bbb-71b0-402b-93be-2e02c38a347c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.782379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69657bbb-71b0-402b-93be-2e02c38a347c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:43.808150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2532/5051] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:43 2022] GET /identity/v3/users => generated 8091 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:43.812978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69657bbb-71b0-402b-93be-2e02c38a347c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:43.813633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.813913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.814309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:43.814978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69657bbb-71b0-402b-93be-2e02c38a347c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:43.858310 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2520/5052] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:43.883552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] MFA Rules not processed for user `7b79f3d7d5cb4b328dadf070801df6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:43.884857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:43.924320 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:43.977533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2533/5053] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:43.989272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:43.991901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:43.995117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.040185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] MFA Rules not processed for user `7b79f3d7d5cb4b328dadf070801df6e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:44.041950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:44.067457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2521/5054] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:44.067993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.078166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e0e76-a5dd-4cae-89da-f8d216aa31fc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.089619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.090295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.090579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.090930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.091617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:create_trust()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.092965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.226324 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2534/5055] 10.222.0.15 () {60 vars in 1173 bytes} [Tue Jul 19 11:31:44 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:44.227951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.241335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d8762-028c-4de2-9477-87676a11ad94 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.261170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.262206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.265077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.265508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.289790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:get_trust(trust_id=4885073b3652446f83690bee4392b64c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.293131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.318218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.322082 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2522/5056] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:44 2022] GET /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c => generated 835 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:44.338722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f80d-f9e5-4b48-95a9-6ea7462f4a84 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.369104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.370193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.370658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.371098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.392588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=4885073b3652446f83690bee4392b64c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.396452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.417450 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2535/5057] 10.222.0.15 () {58 vars in 1268 bytes} [Tue Jul 19 11:31:44 2022] GET /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles => generated 371 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:31:44.421769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.443105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0a6d08-ca9a-4024-9f92-1a3f87292c76 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.457880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.458736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.459017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.459292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/e1b5923fa47c42ceaa46fbfd251abdd1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.479561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4885073b3652446f83690bee4392b64c, role_id=e1b5923fa47c42ceaa46fbfd251abdd1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.480293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.510959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2523/5058] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:31:44 2022] GET /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/e1b5923fa47c42ceaa46fbfd251abdd1 => generated 244 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:44.512105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.524852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4743a-65f6-4fbf-85e9-b3d04cc08665 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.543170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.544598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.545120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.545619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/e1b5923fa47c42ceaa46fbfd251abdd1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.568326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4885073b3652446f83690bee4392b64c, role_id=e1b5923fa47c42ceaa46fbfd251abdd1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.576011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.639704 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2536/5059] 10.222.0.15 () {58 vars in 1368 bytes} [Tue Jul 19 11:31:44 2022] HEAD /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/e1b5923fa47c42ceaa46fbfd251abdd1 => generated 0 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:44.644575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.660293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a955936b-de5c-4208-a321-95bff91dd72c tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.680929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.682285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.683540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.684986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/106119dae29d4bf0aa286a059b7df7c8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.697962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4885073b3652446f83690bee4392b64c, role_id=106119dae29d4bf0aa286a059b7df7c8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.700212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Could not find role: 106119dae29d4bf0aa286a059b7df7c8.: keystone.exception.RoleNotFound: Could not find role: 106119dae29d4bf0aa286a059b7df7c8. Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 11:31:44.715936 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:31:44.717059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 106119dae29d4bf0aa286a059b7df7c8. Jul 19 11:31:44.717059 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:31:44.731212 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2524/5060] 10.222.0.15 () {58 vars in 1367 bytes} [Tue Jul 19 11:31:44 2022] GET /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/106119dae29d4bf0aa286a059b7df7c8 => generated 110 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:44.732080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.749411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9ecc6-ccfd-4375-bfbe-6f86ee77fbf2 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.761682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.763575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.763871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.765428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/106119dae29d4bf0aa286a059b7df7c8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.795653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.797704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:get_role_for_trust(trust_id=4885073b3652446f83690bee4392b64c, role_id=106119dae29d4bf0aa286a059b7df7c8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.798811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:44.802242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Could not find role: 106119dae29d4bf0aa286a059b7df7c8.: keystone.exception.RoleNotFound: Could not find role: 106119dae29d4bf0aa286a059b7df7c8. Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Jul 19 11:31:44.848751 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 19 11:31:44.849822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 106119dae29d4bf0aa286a059b7df7c8. Jul 19 11:31:44.849822 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:44.857042 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2537/5061] 10.222.0.15 () {58 vars in 1368 bytes} [Tue Jul 19 11:31:44 2022] HEAD /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c/roles/106119dae29d4bf0aa286a059b7df7c8 => generated 0 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Jul 19 11:31:44.858638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:44.881821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359afe7-4b8d-4c36-9c0f-34f53d1ea225 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:44.893655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:44.895820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:44.896175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:44.898227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:44.913631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorizing `identity:delete_trust(trust_id=4885073b3652446f83690bee4392b64c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:44.919147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:44.969178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4885073b3652446f83690bee4392b64c', 'request_id': 'req-50572e90-ef91-42bc-9f08-7454064c7bda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:44.988227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4885073b3652446f83690bee4392b64c', 'request_id': 'req-50572e90-ef91-42bc-9f08-7454064c7bda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:44.988957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4885073b3652446f83690bee4392b64c', 'request_id': 'req-50572e90-ef91-42bc-9f08-7454064c7bda'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.005387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078d46a-08be-4436-a11e-624b93e621ee tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.014007 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2538/5062] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:31:44 2022] DELETE /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:45.018654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:45.020203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:45.020722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:45.021100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:45.021227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.021816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:45.029476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.051674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50572e90-ef91-42bc-9f08-7454064c7bda tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.061849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:45.063613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:45.064782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b79f3d7d5cb4b328dadf070801df6e7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '297dd7b4fbbf45be986bf5e6e7003f1f', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-809989253', 'tempest-DelegatedRole-1400677796'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:45.065980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:45.066302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:45.066550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] PATH_INFO: `/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Could not find trust: 4885073b3652446f83690bee4392b64c.: keystone.exception.TrustNotFound: Could not find trust: 4885073b3652446f83690bee4392b64c. Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Jul 19 11:31:45.097051 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4885073b3652446f83690bee4392b64c. Jul 19 11:31:45.098150 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:31:45.101010 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2525/5063] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:45.114004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2539/5064] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:31:45 2022] GET /identity/v3/OS-TRUST/trusts/4885073b3652446f83690bee4392b64c => generated 111 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:31:45.119145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:45.120881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.157095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3070a-253c-48d8-a15e-f3281b89f1a5 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.188746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:45.189842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:45.190223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:45.190588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/106119dae29d4bf0aa286a059b7df7c8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:45.193906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=106119dae29d4bf0aa286a059b7df7c8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:45.219653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:45.234634 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:45.317333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role 106119dae29d4bf0aa286a059b7df7c8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:45.317786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.319209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.321699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2526/5065] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:45 2022] DELETE /identity/v3/roles/106119dae29d4bf0aa286a059b7df7c8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:45.327220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:45.329153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.395751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0516b2-6a99-4e66-ad37-ee0984ff9a85 tempest-TrustsV3TestJSON-1347015464 tempest-user-1435484585] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.436190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:45.437816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.438852 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:45.577083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:45.577979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:45.578280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:45.578540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/roles/e1b5923fa47c42ceaa46fbfd251abdd1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:45.584508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_role(role_id=e1b5923fa47c42ceaa46fbfd251abdd1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:45.587425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:45.612581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899521f-517d-45e3-8a9d-20ddfc8cf22b tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.620819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:45.624856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:45.625349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:45.626512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] PATH_INFO: `/v3/projects/3264fedd644744a7a4d9f1d1f087b295` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:45.628725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3264fedd644744a7a4d9f1d1f087b295)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:45.648098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:45.719909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invalidating the token cache because role e1b5923fa47c42ceaa46fbfd251abdd1 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:45.720168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.724614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.744543 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2540/5066] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:45 2022] DELETE /identity/v3/roles/e1b5923fa47c42ceaa46fbfd251abdd1 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:45.744543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:45.747324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.751215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3264fedd644744a7a4d9f1d1f087b295', 'request_id': 'req-38cb07d2-0482-4492-9c0d-f577546e1d24'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.760886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3264fedd644744a7a4d9f1d1f087b295', 'request_id': 'req-38cb07d2-0482-4492-9c0d-f577546e1d24'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.769617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3264fedd644744a7a4d9f1d1f087b295', 'request_id': 'req-38cb07d2-0482-4492-9c0d-f577546e1d24'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.803575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] The token cache is being invalidate because project 3264fedd644744a7a4d9f1d1f087b295 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:45.803938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.805378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:45.808191 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2527/5067] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:45 2022] DELETE /identity/v3/projects/3264fedd644744a7a4d9f1d1f087b295 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:45.811828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:45.813495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:45.944468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb07d2-0482-4492-9c0d-f577546e1d24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.949414 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:45.967265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54727cb6-7355-46a8-a910-fd1aa7d01047 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:45.992660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:45.992660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:45.992660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:45.992660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] PATH_INFO: `/v3/projects/41cb9a935d754279a091924d649339ac` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:45.993154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] RBAC: Authorizing `identity:delete_project(project_id=41cb9a935d754279a091924d649339ac)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:45.999699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:46.110029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41cb9a935d754279a091924d649339ac', 'request_id': 'req-a0413256-31cb-46d6-8278-1c01e823c43e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.118233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:46.120740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41cb9a935d754279a091924d649339ac', 'request_id': 'req-a0413256-31cb-46d6-8278-1c01e823c43e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.121912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:46.123093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:46.123484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/users/7b79f3d7d5cb4b328dadf070801df6e7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:46.128649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7b79f3d7d5cb4b328dadf070801df6e7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:46.135871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:46.137298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41cb9a935d754279a091924d649339ac', 'request_id': 'req-a0413256-31cb-46d6-8278-1c01e823c43e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.178980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] The token cache is being invalidate because project 41cb9a935d754279a091924d649339ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:46.179583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.181808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.184098 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2541/5068] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:45 2022] DELETE /identity/v3/projects/41cb9a935d754279a091924d649339ac => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:46.185192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:46.186770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:46.207699 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:46.256288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b79f3d7d5cb4b328dadf070801df6e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.257169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b79f3d7d5cb4b328dadf070801df6e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.271594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b79f3d7d5cb4b328dadf070801df6e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.272274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b79f3d7d5cb4b328dadf070801df6e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.289543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-10861d05-434d-48a4-817d-90296b2dca81 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b79f3d7d5cb4b328dadf070801df6e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.324383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0413256-31cb-46d6-8278-1c01e823c43e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:46.337929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:46.340865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:46.340865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:46.341127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] PATH_INFO: `/v3/users/967a6603db2141808d9b300bcaeb2d2b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:46.341823 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2528/5069] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:45 2022] DELETE /identity/v3/users/7b79f3d7d5cb4b328dadf070801df6e7 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:46.343365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:46.343491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:46.344726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:46.345811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967a6603db2141808d9b300bcaeb2d2b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:46.349511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:46.389563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:46.391155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:46.455770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967a6603db2141808d9b300bcaeb2d2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.478153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967a6603db2141808d9b300bcaeb2d2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.499673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967a6603db2141808d9b300bcaeb2d2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.500872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967a6603db2141808d9b300bcaeb2d2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.515047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-45be8a02-ab41-4dce-9b80-d1f446637d10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967a6603db2141808d9b300bcaeb2d2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.527318 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2529/5070] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:46.528228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:46.528867 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2542/5071] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:46 2022] DELETE /identity/v3/users/967a6603db2141808d9b300bcaeb2d2b => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:46.530639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:46.533394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:46.533696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:46.534063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:46.577144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:46.578197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:46.602822 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:46.684242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a7b7b-1fff-4f47-9acd-d0d126da6a9e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:46.754066 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2543/5072] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:46.758325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:46.778038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09768c46-63ae-4012-9644-b7b67465edb1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:46.779203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '448c59c9f3954b938261c297fe1c28a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9b4d8286d87449d9bcd16f593a7a6817', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:46.780371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:46.782382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:46.783278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] PATH_INFO: `/v3/projects/297dd7b4fbbf45be986bf5e6e7003f1f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:46.784987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorizing `identity:delete_project(project_id=297dd7b4fbbf45be986bf5e6e7003f1f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:46.788006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:46.804990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:46.805897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:46.806985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:46.808683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:46.810046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:46.817544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:46.819529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:46.864996 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2544/5073] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:31:46.869808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:46.874309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '297dd7b4fbbf45be986bf5e6e7003f1f', 'request_id': 'req-00fc3e8b-90bd-461e-9964-95e8433ac3d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.884921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '297dd7b4fbbf45be986bf5e6e7003f1f', 'request_id': 'req-00fc3e8b-90bd-461e-9964-95e8433ac3d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.896724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '297dd7b4fbbf45be986bf5e6e7003f1f', 'request_id': 'req-00fc3e8b-90bd-461e-9964-95e8433ac3d7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.898094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32008843-82cb-4ed5-8869-e07931fbc250 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:46.924779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] The token cache is being invalidate because project 297dd7b4fbbf45be986bf5e6e7003f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:46.925419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.926408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:46.928469 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2530/5074] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:46 2022] DELETE /identity/v3/projects/297dd7b4fbbf45be986bf5e6e7003f1f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:46.930704 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:46.935571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:46.943288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.038735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.039768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.040203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.040767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.065750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.072748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.107501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc3e8b-90bd-461e-9964-95e8433ac3d7 tempest-TrustsV3TestJSON-1892175228 tempest-TrustsV3TestJSON-1892175228-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.121794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.129641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.130517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.131980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] PATH_INFO: `/v3/users/31ca494d389446e88225205e57e5884f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.137612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ca494d389446e88225205e57e5884f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.143103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.149475 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2545/5075] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:46 2022] POST /identity/v3/projects => generated 379 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:31:47.152812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:47.156443 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:47.159262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.245093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ca494d389446e88225205e57e5884f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.245801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ca494d389446e88225205e57e5884f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.262110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ca494d389446e88225205e57e5884f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.262760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ca494d389446e88225205e57e5884f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.287381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-be09041f-850d-489e-bc3b-3fe4d954849d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ca494d389446e88225205e57e5884f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.313959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2531/5076] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:46 2022] DELETE /identity/v3/users/31ca494d389446e88225205e57e5884f => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:47.315501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.315792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.316068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.351158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:47.353894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.373803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc66423-3645-4e78-b9f6-a9095ef3d365 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.504123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2532/5077] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:47.510947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.512515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.512977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.513409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.514438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.514618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:47.517102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.518122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.543819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2546/5078] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:47 2022] POST /identity/v3/users => generated 290 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:47.547373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:47.549541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.565963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc39146-2148-4410-b6fc-8334aaa736f3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.572387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.573588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.574013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.574389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.575739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.579426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.594770 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2547/5079] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:31:47.605943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:47.632994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d19d3c2-2163-4cc0-8fa6-81cb6b3892f4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.649350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4204d-a4eb-41b0-b7ba-d8a7f1273839 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.654478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.655154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.655330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.655596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.656375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.657765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.658105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.658599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.658891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.659171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.674020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.674735 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2548/5080] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:47.676124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.676727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:47.679159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.690521 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2533/5081] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:47.691914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:47.705906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99304a58-6da5-4585-8f06-260c52657957 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.712667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77cb8b2-a5b0-4d66-995c-f504124da171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.715167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f9499-1513-4ea0-88f4-18da7c07da3c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:47.724117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:47.725123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb8b2-a5b0-4d66-995c-f504124da171 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.725426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb8b2-a5b0-4d66-995c-f504124da171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.725530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.725709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77cb8b2-a5b0-4d66-995c-f504124da171 admin admin] PATH_INFO: `/v3/projects/eee2d196d1464d52b83f69a708b475ea/users/c3fa32ea957b4824822f7de50b8fe042/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.725834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.726036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] PATH_INFO: `/v3/projects/c22e9e8a83b745c78e9c5ef1b9804b01` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.733757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c22e9e8a83b745c78e9c5ef1b9804b01)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.735769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.749146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cb8b2-a5b0-4d66-995c-f504124da171 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eee2d196d1464d52b83f69a708b475ea, user_id=c3fa32ea957b4824822f7de50b8fe042, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:47.753372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77cb8b2-a5b0-4d66-995c-f504124da171 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:47.763813 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:47.781108 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:47.790441 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2534/5082] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:47 2022] PUT /identity/v3/projects/eee2d196d1464d52b83f69a708b475ea/users/c3fa32ea957b4824822f7de50b8fe042/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:47.898803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.899089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.899373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:47.899728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c22e9e8a83b745c78e9c5ef1b9804b01', 'request_id': 'req-42b5819b-9366-432e-905f-1b2ba42452e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.915905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c22e9e8a83b745c78e9c5ef1b9804b01', 'request_id': 'req-42b5819b-9366-432e-905f-1b2ba42452e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.931537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c22e9e8a83b745c78e9c5ef1b9804b01', 'request_id': 'req-42b5819b-9366-432e-905f-1b2ba42452e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.938878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] MFA Rules not processed for user `c3fa32ea957b4824822f7de50b8fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:47.940184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:47.955691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] The token cache is being invalidate because project c22e9e8a83b745c78e9c5ef1b9804b01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:47.958228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.961250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-42b5819b-9366-432e-905f-1b2ba42452e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:47.974353 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2549/5083] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:47 2022] DELETE /identity/v3/projects/c22e9e8a83b745c78e9c5ef1b9804b01 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:47.983278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8690ea-22e1-4afb-92c8-21a10f7e9f8a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:47.983909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8690ea-22e1-4afb-92c8-21a10f7e9f8a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:47.984496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8690ea-22e1-4afb-92c8-21a10f7e9f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.078150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a8690ea-22e1-4afb-92c8-21a10f7e9f8a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:48.080772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a8690ea-22e1-4afb-92c8-21a10f7e9f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.121029 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2535/5084] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:48.122654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.124547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.193277 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2550/5085] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:48.201658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.202482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.202482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.250844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:48.255700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.276055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2551/5086] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:48.280397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.286145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.325815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4d26eb-28c4-4752-acf8-b18015604df2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:48.350356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd1fc94-0185-4b84-8b90-92cc917e40bd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:48.354393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:48.357066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.357472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.358345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.360641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:48.368424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:48.369703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.369703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.369947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:48.370052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] PATH_INFO: `/v3/projects/baeb261bf4574cbfa09891e81567d30a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.375770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baeb261bf4574cbfa09891e81567d30a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:48.378566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:48.443563 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2536/5087] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:48 2022] POST /identity/v3/projects => generated 379 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:48.444642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.507536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baeb261bf4574cbfa09891e81567d30a', 'request_id': 'req-0eb6a848-ffed-4171-8970-efc872935320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.524704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baeb261bf4574cbfa09891e81567d30a', 'request_id': 'req-0eb6a848-ffed-4171-8970-efc872935320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.542651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baeb261bf4574cbfa09891e81567d30a', 'request_id': 'req-0eb6a848-ffed-4171-8970-efc872935320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.573690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] The token cache is being invalidate because project baeb261bf4574cbfa09891e81567d30a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:48.573993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.576366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.580577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2552/5088] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:48 2022] DELETE /identity/v3/projects/baeb261bf4574cbfa09891e81567d30a => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:48.580958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.583927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.622258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bfd32c-5a6c-4d75-a351-8295eee1c83d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:48.636044 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:48.685795 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:48.754261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:48.755425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.756590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.757156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.758607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:48.759237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:48.761700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb6a848-ffed-4171-8970-efc872935320 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:48.762133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:48.767565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:48.768465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.769908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.769908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.770134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:48.773089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:48.786352 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2537/5089] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:48.787623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.790120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.812116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e8baf-f64f-49d0-b991-1cdb10a75064 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:48.812426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2553/5090] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:48 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:48.818912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:48.820240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.820711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.821205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] PATH_INFO: `/v3/users/448c59c9f3954b938261c297fe1c28a6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.822652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=448c59c9f3954b938261c297fe1c28a6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:48.826842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:48.829292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.839750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:48.872336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b882da4-57e8-4c7d-aac5-3fe4d94906d2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:48.880388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:48.881114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:48.881380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:48.881661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:48.882373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:48.884707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:48.928242 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2554/5091] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:48 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:48.929501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:48.943583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448c59c9f3954b938261c297fe1c28a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.944720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448c59c9f3954b938261c297fe1c28a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.963949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448c59c9f3954b938261c297fe1c28a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.965108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448c59c9f3954b938261c297fe1c28a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:48.976863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448c59c9f3954b938261c297fe1c28a6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:49.018458 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2538/5092] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:48 2022] DELETE /identity/v3/users/448c59c9f3954b938261c297fe1c28a6 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:49.018458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.019928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:49.117940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abacea25-aed9-4095-a176-6ed09219ab2b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.135771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.138255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90063541-f3f1-4525-bb9a-e5c286696080 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.139401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.140043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.140819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.144707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.149777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.161398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.163161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.164599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.164893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.167209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.171079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.183336 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2555/5093] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:49.187542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.190884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:49.220318 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2539/5094] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:49 2022] POST /identity/v3/users => generated 294 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:49.223145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.225380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10bd5b-5f6b-4b92-919f-5f4176469ea5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.239176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.243014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.243345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.243581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.245529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.248627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246e0e6-1deb-4dd2-b8fd-5b5d88c726a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.250650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.263747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.264553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.264861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.265177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.266615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.271484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.277056 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2556/5095] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:49.280030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.301534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2540/5096] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:49.305024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.308091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2972d5-e54b-4410-94c0-c9a53a7f0ed6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.322949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b93944-d02c-457f-8768-f166030d80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.327462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93944-d02c-457f-8768-f166030d80f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.328210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93944-d02c-457f-8768-f166030d80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.328538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b93944-d02c-457f-8768-f166030d80f4 admin admin] PATH_INFO: `/v3/projects/3faa765d7be845eeaa5bd781d85c8533/users/1cf5a46b49dc4d89b3864fbd4af3f7d1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.332443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe20b8-12e3-4e49-83c8-1a99633ba1e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.346357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.347053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.347577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.347577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.348372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.350058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.351793 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:49.367882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93944-d02c-457f-8768-f166030d80f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3faa765d7be845eeaa5bd781d85c8533, user_id=1cf5a46b49dc4d89b3864fbd4af3f7d1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.372265 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2541/5097] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:49.377219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.381313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b93944-d02c-457f-8768-f166030d80f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.391307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b978c-b565-4b3e-b3ce-a90be2476d9b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.398935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c04d4f-5290-49b2-85be-7ee1e058b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.399983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04d4f-5290-49b2-85be-7ee1e058b15b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.401032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04d4f-5290-49b2-85be-7ee1e058b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.405528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c04d4f-5290-49b2-85be-7ee1e058b15b admin admin] PATH_INFO: `/v3/projects/c3619d0559db4d378482e581e7fb2189/users/c60c694e6e0f4bceb1ea7260f1064439/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.413405 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2557/5098] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:49 2022] PUT /identity/v3/projects/3faa765d7be845eeaa5bd781d85c8533/users/1cf5a46b49dc4d89b3864fbd4af3f7d1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:49.433290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.436197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.436727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04d4f-5290-49b2-85be-7ee1e058b15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3619d0559db4d378482e581e7fb2189, user_id=c60c694e6e0f4bceb1ea7260f1064439, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.438257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.453427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c04d4f-5290-49b2-85be-7ee1e058b15b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.508929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2542/5099] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:49 2022] PUT /identity/v3/projects/c3619d0559db4d378482e581e7fb2189/users/c60c694e6e0f4bceb1ea7260f1064439/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:49.509319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] MFA Rules not processed for user `1cf5a46b49dc4d89b3864fbd4af3f7d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:49.509319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:49.511027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.511319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.511610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.590693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] MFA Rules not processed for user `c60c694e6e0f4bceb1ea7260f1064439`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:49.592243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:49.625644 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:49.734479 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2558/5100] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:49.735644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.746653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:49.769312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2543/5101] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:49.771652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:49.776692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:49.931094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9afc9-2807-48ac-bdd2-61b96037f39d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.937744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1a5b0-2027-421d-8701-0ece89677548 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:49.948250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c3fa32ea957b4824822f7de50b8fe042', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eee2d196d1464d52b83f69a708b475ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.949227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.949520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.949799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] PATH_INFO: `/v3/users/c3fa32ea957b4824822f7de50b8fe042/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.953825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:49.955477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:49.955477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:49.955790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] PATH_INFO: `/v3/projects/9b4d8286d87449d9bcd16f593a7a6817` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:49.957674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4d8286d87449d9bcd16f593a7a6817)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.958667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] RBAC: Authorizing `identity:list_user_projects(user_id=c3fa32ea957b4824822f7de50b8fe042)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:49.959873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:49.960893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:50.055390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2544/5102] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:31:49 2022] GET /identity/v3/users/c3fa32ea957b4824822f7de50b8fe042/projects => generated 515 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:50.056304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:50.060057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.094225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4d8286d87449d9bcd16f593a7a6817', 'request_id': 'req-5423f9fd-081b-49f4-aaa2-08d5000b2137'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.114488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4d8286d87449d9bcd16f593a7a6817', 'request_id': 'req-5423f9fd-081b-49f4-aaa2-08d5000b2137'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.129370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4d8286d87449d9bcd16f593a7a6817', 'request_id': 'req-5423f9fd-081b-49f4-aaa2-08d5000b2137'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.134507 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:50.178442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] The token cache is being invalidate because project 9b4d8286d87449d9bcd16f593a7a6817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:50.178848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.180259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5423f9fd-081b-49f4-aaa2-08d5000b2137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.185563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2559/5103] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:49 2022] DELETE /identity/v3/projects/9b4d8286d87449d9bcd16f593a7a6817 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:50.189743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97b5c-77e7-41bc-893e-079d645df9cd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.190251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97b5c-77e7-41bc-893e-079d645df9cd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.190637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f97b5c-77e7-41bc-893e-079d645df9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.223216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd80c6-8c9e-4a58-9a51-57526c9c82a6 tempest-IdentityV3ProjectsTest-186867565 tempest-IdentityV3ProjectsTest-186867565-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:50.268981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c5f97b5c-77e7-41bc-893e-079d645df9cd None None] MFA Rules not processed for user `c3fa32ea957b4824822f7de50b8fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:50.272150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c5f97b5c-77e7-41bc-893e-079d645df9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.334490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:50.335264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.335663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.336026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.338511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.421287 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2560/5104] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:50.435519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1d1a5-0f6d-439a-b7dd-4eb750696181 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.435815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1d1a5-0f6d-439a-b7dd-4eb750696181 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.436097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b1d1a5-0f6d-439a-b7dd-4eb750696181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.460498 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:50.485875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-07b1d1a5-0f6d-439a-b7dd-4eb750696181 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:50.487135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07b1d1a5-0f6d-439a-b7dd-4eb750696181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.509640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:50.511567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e3b9ca-747c-472d-8e40-bd858fcb6eab service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:50.533904 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2545/5105] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:50.535295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.535664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.535874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.572416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] MFA Rules not processed for user `c3fa32ea957b4824822f7de50b8fe042`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:50.573663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.631421 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2561/5106] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:50.639090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.639448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.639673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.675917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:50.676880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.689154 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2562/5107] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:50.695707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:50.714682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7aeee8-8b86-4d06-9412-b0e5cf110cdc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:50.716062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.models.token_model [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] User c3fa32ea957b4824822f7de50b8fe042 has no access to project 3faa765d7be845eeaa5bd781d85c8533 {{(pid=80581) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Jul 19 11:31:50.720435 n-d-master-1 devstack@keystone.service[80581]: WARNING keystone.server.flask.application [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.15: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 11:31:50.722923 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2546/5108] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 188 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 11:31:50.727655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:50.729750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.729884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:50.730711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.730943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.731214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.733634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:50.733891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:50.737800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:50.758025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0ee09c-dc31-4095-9b08-32078512f7b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:50.764499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:50.765497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.765764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.766932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] PATH_INFO: `/v3/users/c3fa32ea957b4824822f7de50b8fe042` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.767455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fa32ea957b4824822f7de50b8fe042)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:50.769595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:50.771278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2563/5109] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:50.776049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:50.798672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fe273f-2531-41a6-a0ce-8163cfa72fe8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:50.817235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048c6236-6283-4dc2-b788-e85750a2507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:50.818907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6236-6283-4dc2-b788-e85750a2507d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.819207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6236-6283-4dc2-b788-e85750a2507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.819491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048c6236-6283-4dc2-b788-e85750a2507d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.822826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c6236-6283-4dc2-b788-e85750a2507d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:50.826922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048c6236-6283-4dc2-b788-e85750a2507d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:50.878207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fa32ea957b4824822f7de50b8fe042'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.879902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fa32ea957b4824822f7de50b8fe042'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.889311 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:50.892917 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2564/5110] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:50.903205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fa32ea957b4824822f7de50b8fe042'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.904097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fa32ea957b4824822f7de50b8fe042'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.910493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb1ad-b9fa-498f-b9e6-08e226600aa3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:50.910753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb1ad-b9fa-498f-b9e6-08e226600aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:50.911031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2bb1ad-b9fa-498f-b9e6-08e226600aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:50.919616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fa32ea957b4824822f7de50b8fe042'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:50.952577 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2547/5111] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:50 2022] DELETE /identity/v3/users/c3fa32ea957b4824822f7de50b8fe042 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:50.953814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:50.956150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2d2bb1ad-b9fa-498f-b9e6-08e226600aa3 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:50.958005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:50.962041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2d2bb1ad-b9fa-498f-b9e6-08e226600aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:51.125632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37830d00-1336-45a3-a3ef-60dc9a4e98f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.131277 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2565/5112] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:51.135298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.135735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.136243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.137034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.137377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.137697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.137962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.138753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.141109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.181421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:51.183547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:51.200222 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2566/5113] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:51.200222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.200222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:51.208195 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2548/5114] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:50 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:51.214741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.235774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc55b4f-f439-483a-ad1a-1adebe9d6928 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.250947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.252614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.254079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.255249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.256231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.262064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.292669 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2549/5115] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:51.293889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.296183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:51.348732 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:51.367981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d433bad-050c-4282-82ac-39b2c5490e89 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.387712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8b540-72fe-4bd8-bd2f-43f01d4e9ed4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.388381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.389407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.389858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.390146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.393981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.395237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.395740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.396247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.409228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.411523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.412384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.420017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.434353 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2550/5116] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:51.435670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.438355 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2567/5117] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:51.454437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1796d363-43d9-4c32-b5b4-5f341be4f819 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.461848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4943bd4-a1e9-418e-a5ca-fb9df322dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.462652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943bd4-a1e9-418e-a5ca-fb9df322dafd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.463102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943bd4-a1e9-418e-a5ca-fb9df322dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.463450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4943bd4-a1e9-418e-a5ca-fb9df322dafd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.464785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943bd4-a1e9-418e-a5ca-fb9df322dafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.466882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4943bd4-a1e9-418e-a5ca-fb9df322dafd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.483350 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2551/5118] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:51 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:51.488551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.503514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e65768-56d8-4fdb-9957-396fceab6010 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.517958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca2f38-6553-4454-910e-4fa7ab354f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.518926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2f38-6553-4454-910e-4fa7ab354f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.519213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2f38-6553-4454-910e-4fa7ab354f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.519490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca2f38-6553-4454-910e-4fa7ab354f8f admin admin] PATH_INFO: `/v3/projects/e92271d3ebfc415e92ee60312414597b/users/a3c680fdc3454853a7e7b8fd7ff780fc/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.561685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2f38-6553-4454-910e-4fa7ab354f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e92271d3ebfc415e92ee60312414597b, user_id=a3c680fdc3454853a7e7b8fd7ff780fc, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.573597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca2f38-6553-4454-910e-4fa7ab354f8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.629514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2568/5119] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:51 2022] PUT /identity/v3/projects/e92271d3ebfc415e92ee60312414597b/users/a3c680fdc3454853a7e7b8fd7ff780fc/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:51.647907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.648813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.648813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.693259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] MFA Rules not processed for user `a3c680fdc3454853a7e7b8fd7ff780fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:51.694673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:51.735102 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:51.813754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0d77-8656-41af-9313-35135b201752 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.814354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0d77-8656-41af-9313-35135b201752 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.814707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae0d77-8656-41af-9313-35135b201752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.822701 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2552/5120] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:51.836081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.865184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-23ae0d77-8656-41af-9313-35135b201752 None None] MFA Rules not processed for user `599dab32ff524b028851a6df2f9c5b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:51.867044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-23ae0d77-8656-41af-9313-35135b201752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:51.871333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7760b9fa-b186-458c-aecf-1c2ac26c1616 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:51.878065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3c680fdc3454853a7e7b8fd7ff780fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e92271d3ebfc415e92ee60312414597b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:51.878740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:51.879033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:51.879310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] PATH_INFO: `/v3/auth/catalog` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:51.880279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:51.881415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:51.883688 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2553/5121] 10.222.0.15 () {58 vars in 1142 bytes} [Tue Jul 19 11:31:51 2022] GET /identity/v3/auth/catalog => generated 2648 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:51.888725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:51.997264 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2569/5122] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:31:52.012482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.012871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.013289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.044636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] MFA Rules not processed for user `599dab32ff524b028851a6df2f9c5b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:52.046020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.052076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363aac8-9e7b-4500-ad71-5d8f815007fe tempest-IdentityCatalogTest-1452798390 tempest-IdentityCatalogTest-1452798390-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:52.055532 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2570/5123] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:52.067645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:52.070227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.075407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:52.076455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.076725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.077054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] PATH_INFO: `/v3/users/a3c680fdc3454853a7e7b8fd7ff780fc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.078475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c680fdc3454853a7e7b8fd7ff780fc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:52.080511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:52.183363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c680fdc3454853a7e7b8fd7ff780fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.184135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c680fdc3454853a7e7b8fd7ff780fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.198476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c680fdc3454853a7e7b8fd7ff780fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.199473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c680fdc3454853a7e7b8fd7ff780fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.225901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2382c865-908f-46c4-9656-733ab0167ccf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:52.233752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:52.234450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c680fdc3454853a7e7b8fd7ff780fc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.235515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.236081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.236575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.238666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.254469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:52.259585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770b4a5-247b-4419-87d4-f28ac5309afa service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:52.271986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2571/5124] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:52.273924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a25d0-5c65-4ea2-909b-e641e9c80787 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.274216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a25d0-5c65-4ea2-909b-e641e9c80787 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.276436 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2554/5125] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:51 2022] DELETE /identity/v3/users/a3c680fdc3454853a7e7b8fd7ff780fc => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:52.277442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:52.279927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.285491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a25d0-5c65-4ea2-909b-e641e9c80787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.325527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f52a25d0-5c65-4ea2-909b-e641e9c80787 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:52.334962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f52a25d0-5c65-4ea2-909b-e641e9c80787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.415867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:52.435632 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:52.501705 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2572/5126] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:52.505990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971ececc-f838-4bbb-9c5b-c0f8b29e2422 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:52.506285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.506621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.506906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.527260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:52.532790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.533125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.534626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] PATH_INFO: `/v3/projects/eee2d196d1464d52b83f69a708b475ea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.537084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eee2d196d1464d52b83f69a708b475ea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:52.539614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:52.578576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:52.581808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.610641 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2573/5127] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:52.610641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:52.613483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.618441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eee2d196d1464d52b83f69a708b475ea', 'request_id': 'req-5af2a899-b075-44cf-83e2-283772fa1392'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.630822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eee2d196d1464d52b83f69a708b475ea', 'request_id': 'req-5af2a899-b075-44cf-83e2-283772fa1392'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.645468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eee2d196d1464d52b83f69a708b475ea', 'request_id': 'req-5af2a899-b075-44cf-83e2-283772fa1392'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.667712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] The token cache is being invalidate because project eee2d196d1464d52b83f69a708b475ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:52.668110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.670296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:52.677771 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2555/5128] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:52 2022] DELETE /identity/v3/projects/eee2d196d1464d52b83f69a708b475ea => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:52.678998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:52.681800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.774927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8d2b02-a31c-4194-963b-7c2b0c8d85ab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:52.826255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af2a899-b075-44cf-83e2-283772fa1392 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:52.835120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:52.836099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.836652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.837084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.852020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.902846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:52.904718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:52.905159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:52.905579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:52.908174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:52.956261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:52.957784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:52.982621 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2556/5129] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:52.992080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:53.000056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:53.020809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e44526b-9c4f-41e7-aef8-cc92bb35ebbd service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:53.027567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:53.028646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:53.029424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:53.029424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] PATH_INFO: `/v3/users/1cf5a46b49dc4d89b3864fbd4af3f7d1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:53.031877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cf5a46b49dc4d89b3864fbd4af3f7d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:53.033564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:53.047615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:53.047615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:53.058973 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2574/5130] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:53.068180 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:53.127335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cf5a46b49dc4d89b3864fbd4af3f7d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:53.127865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cf5a46b49dc4d89b3864fbd4af3f7d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:53.141135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cf5a46b49dc4d89b3864fbd4af3f7d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:53.141880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cf5a46b49dc4d89b3864fbd4af3f7d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:53.158941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-351d3a12-8ff8-493f-80d3-b9b55d072829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cf5a46b49dc4d89b3864fbd4af3f7d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:53.209409 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2557/5131] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:52 2022] DELETE /identity/v3/users/1cf5a46b49dc4d89b3864fbd4af3f7d1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:53.576127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:53.577760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:53.612147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d677e-9cc5-474b-8f96-ec08e6644878 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:53.671300 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:53.749791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:53.750866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:53.751469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:53.810434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:53.816167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:53.840301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:53.841577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:53.842944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:53.844406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] PATH_INFO: `/v3/projects/e92271d3ebfc415e92ee60312414597b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:53.852998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e92271d3ebfc415e92ee60312414597b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:53.859110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:53.983593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e92271d3ebfc415e92ee60312414597b', 'request_id': 'req-4cc54347-8162-455e-a369-512fb361bce1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.003675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e92271d3ebfc415e92ee60312414597b', 'request_id': 'req-4cc54347-8162-455e-a369-512fb361bce1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.013465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e92271d3ebfc415e92ee60312414597b', 'request_id': 'req-4cc54347-8162-455e-a369-512fb361bce1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.033908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] The token cache is being invalidate because project e92271d3ebfc415e92ee60312414597b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:54.033908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.036017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.038287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2558/5132] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:54.048883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:54.059488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2575/5133] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:53 2022] DELETE /identity/v3/projects/e92271d3ebfc415e92ee60312414597b => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:54.059488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:54.060030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.060224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.101378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1529422-390f-4b79-af0e-b6e2b3eea58b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:54.181094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc54347-8162-455e-a369-512fb361bce1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:54.187572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:54.191020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.198327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.198990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.202364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.221292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:54.222417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.222707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.222984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] PATH_INFO: `/v3/projects/3faa765d7be845eeaa5bd781d85c8533` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.224773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3faa765d7be845eeaa5bd781d85c8533)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:54.227801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:54.322823 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:54.340683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3faa765d7be845eeaa5bd781d85c8533', 'request_id': 'req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.364263 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:54.368722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3faa765d7be845eeaa5bd781d85c8533', 'request_id': 'req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.412542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3faa765d7be845eeaa5bd781d85c8533', 'request_id': 'req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.415341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:54.417052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419faa73-9cee-4297-8504-0e82aeb87c86 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:54.431006 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2576/5134] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:54.438632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] The token cache is being invalidate because project 3faa765d7be845eeaa5bd781d85c8533 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:31:54.439032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.439592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ddbdbecd-5c69-4b60-a9a5-3f51ff0ee34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:54.441784 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2559/5135] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:31:54 2022] DELETE /identity/v3/projects/3faa765d7be845eeaa5bd781d85c8533 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:54.442513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.442804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.443084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.453616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9875d-ffd6-4eb8-bd86-b2068948a83c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.454060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9875d-ffd6-4eb8-bd86-b2068948a83c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.454337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9875d-ffd6-4eb8-bd86-b2068948a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.503117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-76c9875d-ffd6-4eb8-bd86-b2068948a83c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:54.504371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76c9875d-ffd6-4eb8-bd86-b2068948a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.506382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:54.507611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.687800 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2577/5136] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:54.692057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:54.695116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.724389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2560/5137] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:54.726066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14057c-2443-4d0c-8cab-83e4d10efb06 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.728648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14057c-2443-4d0c-8cab-83e4d10efb06 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.730155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14057c-2443-4d0c-8cab-83e4d10efb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.795985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e14057c-2443-4d0c-8cab-83e4d10efb06 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:54.800681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e14057c-2443-4d0c-8cab-83e4d10efb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.837654 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2561/5138] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:54.841331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.844244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.845231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.909212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:54.910842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.933976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31873f53-51bf-4c13-98e0-1cce6a0f1bf8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:54.938861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2562/5139] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:54.944125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:54.954062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:54.955133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.955598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.956026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.959150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:54.965381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c351a-c62c-491e-b73c-1d0b3c721cc9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:54.981230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:54.982122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:54.982517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:54.982895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:54.983915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:54.984669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:54.986593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34917655-6fcd-4a06-8040-f748b76062b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.019658 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2563/5140] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:55.024051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.024703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.025215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.068783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:55.070863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:55.132274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:55.134752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.160516 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2564/5141] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:55.161650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.176984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2578/5142] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:54 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:55.177990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.186466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6222d769-8202-4c57-91a4-da4a6a86f086 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:55.193412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:55.194646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.195137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.195780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.197053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:31:55.197734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:55.199734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.211942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7badc0-decf-489d-85e8-c305fb04f39e service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:55.218969 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2565/5143] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:31:55.221315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.223339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:55.237093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:55.238281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.238719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.239146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.241103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:55.243281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.275090 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:55.320076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95243b42-9136-4054-9ce6-b5bec29ca278 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:55.327229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:55.328013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.328305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.328849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.335016 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2579/5144] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:55 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:55.336939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.353283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:55.358190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.372446 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:55.373638 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2566/5145] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:55.381556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.417092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0525ae-0a6c-4506-b942-eb3d641ec218 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:55.504305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da66c297-37b7-4bc5-9f14-e5c90d5e798e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:55.516385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e175662a-3c36-4cfd-ab8c-e0e2c85912f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:55.516725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175662a-3c36-4cfd-ab8c-e0e2c85912f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.517040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175662a-3c36-4cfd-ab8c-e0e2c85912f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.517214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e175662a-3c36-4cfd-ab8c-e0e2c85912f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.517893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175662a-3c36-4cfd-ab8c-e0e2c85912f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:55.520666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e175662a-3c36-4cfd-ab8c-e0e2c85912f5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.613703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:55.614519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.614874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.615168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.616058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:55.619286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:55.630012 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2580/5146] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:55 2022] POST /identity/v3/projects => generated 371 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:55.632827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:55.633438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:55.633924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:55.662679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:55.664593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:55.696610 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2567/5147] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:55 2022] POST /identity/v3/users => generated 305 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:55.700225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.717051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:55.855752 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2581/5148] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:55.858141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:55.943379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45fb89f-8e7c-4a87-862c-369800a1394c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.038817 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:56.069739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa7f2a-d1e0-454f-892a-8718d0ffd89a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.091231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.091976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.092269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.092577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.107131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:56.112881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.113702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.114113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.114401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.115233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.118113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.132284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.134831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.157736 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2582/5149] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:55 2022] POST /identity/v3/users => generated 286 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:56.157736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.165915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee08ad45-b56b-4054-b312-5650fa3dab4a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.170929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2568/5150] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:56.171097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75e346-6f6e-41e2-9a54-b2789acda00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.171698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75e346-6f6e-41e2-9a54-b2789acda00e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.171818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.171985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75e346-6f6e-41e2-9a54-b2789acda00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.172249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75e346-6f6e-41e2-9a54-b2789acda00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.173376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75e346-6f6e-41e2-9a54-b2789acda00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.175396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75e346-6f6e-41e2-9a54-b2789acda00e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.191894 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2583/5151] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:56.199483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.199483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.199483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.232024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:56.233674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:56.262251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2584/5152] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:56.264923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.284793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9030c0-7bed-4167-bd8e-f7c8e3f22bb3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.306007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.306854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.307241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.307480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.308247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.314906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.317570 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:56.361449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8588720f-48a2-42c7-bb87-edc36fe53887 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.363409 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2585/5153] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:56.365003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.388035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.388035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.388035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.388035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.388396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396c6fd2-4db9-4706-85c7-c4e98feff9ed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.407789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.410278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.419592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.420662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.421256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.421745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.430650 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2569/5154] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:56.431710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.455862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.461924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41063a68-6db3-4774-9a71-60385c01e209 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.462972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.475720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.478596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.478918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.479393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.532557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.535759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.540429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2586/5155] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:56.549397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.568062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8f4664-7422-42f2-98a3-28ad49eff7f7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.573717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.574726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.575013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.575596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.576472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.578904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.593522 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2587/5156] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:56.596115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.614788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e8c95d-0f17-4d6a-a11e-fd9f07e2a509 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.616857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2570/5157] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:56.620626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:56.629585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8dffb0-6fa2-45ff-a7ff-d40f4ff99402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.632795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dffb0-6fa2-45ff-a7ff-d40f4ff99402 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.634220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dffb0-6fa2-45ff-a7ff-d40f4ff99402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.635480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8dffb0-6fa2-45ff-a7ff-d40f4ff99402 admin admin] PATH_INFO: `/v3/projects/4e86a68df7f84bf48a8b15e843da8578/users/a8c6abbf038c4ac5a574a77fb174b8f9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.678239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dffb0-6fa2-45ff-a7ff-d40f4ff99402 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e86a68df7f84bf48a8b15e843da8578, user_id=a8c6abbf038c4ac5a574a77fb174b8f9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.692252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8dffb0-6fa2-45ff-a7ff-d40f4ff99402 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.694941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea4afb-8fb8-4829-888a-bd99cc02b580 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:56.743219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2588/5158] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:56 2022] PUT /identity/v3/projects/4e86a68df7f84bf48a8b15e843da8578/users/a8c6abbf038c4ac5a574a77fb174b8f9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:56.746759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.746994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91e3f5-701a-49a8-abf9-f6e987883ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:56.747683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e3f5-701a-49a8-abf9-f6e987883ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.747959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e3f5-701a-49a8-abf9-f6e987883ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.748233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91e3f5-701a-49a8-abf9-f6e987883ed4 admin admin] PATH_INFO: `/v3/projects/7da75cfaf86149f597d672a9c01691f6/users/dd3d1479cccf440fb84501a38eb6ad65/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.748513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.749440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.816598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91e3f5-701a-49a8-abf9-f6e987883ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7da75cfaf86149f597d672a9c01691f6, user_id=dd3d1479cccf440fb84501a38eb6ad65, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:56.824760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec91e3f5-701a-49a8-abf9-f6e987883ed4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:56.843116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] MFA Rules not processed for user `a8c6abbf038c4ac5a574a77fb174b8f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:56.849598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:56.861668 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2571/5159] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:56 2022] PUT /identity/v3/projects/7da75cfaf86149f597d672a9c01691f6/users/dd3d1479cccf440fb84501a38eb6ad65/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:56.878433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26d6b-2556-4c35-8c5e-c5b6a308f631 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:56.880950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26d6b-2556-4c35-8c5e-c5b6a308f631 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:56.881502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d26d6b-2556-4c35-8c5e-c5b6a308f631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:56.974523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b9d26d6b-2556-4c35-8c5e-c5b6a308f631 None None] MFA Rules not processed for user `dd3d1479cccf440fb84501a38eb6ad65`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:56.980167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9d26d6b-2556-4c35-8c5e-c5b6a308f631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:57.116090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2589/5160] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:57.125363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:57.218875 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2572/5161] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:57.218875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:57.218875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:57.218875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:57.253900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:57.256970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:57.278895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329cddf-200b-46a7-a1de-f69513577b95 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:57.300563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:57.317705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:57.317705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:57.317705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:57.317705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:57.317705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:57.322439 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:57.382975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2590/5162] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:31:57 2022] POST /identity/v3/projects => generated 409 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:57.386909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:57.401032 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2573/5163] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:31:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:57.443431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:57.445723 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:57.559200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893b9c5-7461-45a8-902a-f6d2b1ef5301 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:57.581870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:57.584061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:57.584537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:57.585095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:57.586171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:57.592170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:57.624814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973e978b-ec77-484d-bbf7-81198385a236 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:57.660431 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2591/5164] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:31:57 2022] POST /identity/v3/users => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:31:57.661285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:57.687511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c86416-a7be-4baf-bf9f-b9f7e00573d2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:57.701239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:57.701888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:57.702165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:57.705249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:57.706036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:57.708087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:57.747075 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2592/5165] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:57.750759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:57.773442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458806-4611-4ac1-a596-c38908bf7ba9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:57.782937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:57.785168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:57.785939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:57.786541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] PATH_INFO: `/v3/projects/4017073da4f44a62ae02af4461b84a97/users/fb43f598630144778e113974a7e955b7/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:57.822260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4017073da4f44a62ae02af4461b84a97, user_id=fb43f598630144778e113974a7e955b7, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:57.829656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:57.852409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:57.853288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:57.856117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:57.856626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:57.857943 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2593/5166] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:57 2022] PUT /identity/v3/projects/4017073da4f44a62ae02af4461b84a97/users/fb43f598630144778e113974a7e955b7/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:57.861598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:58.063745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:58.064427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e0f87-7659-444c-afbf-b82fd045b362 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:58.069487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:58.081730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb6abea-6db3-4518-8185-2014b39e0ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:58.083999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6abea-6db3-4518-8185-2014b39e0ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:58.084582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6abea-6db3-4518-8185-2014b39e0ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:58.085016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb6abea-6db3-4518-8185-2014b39e0ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:58.087586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6abea-6db3-4518-8185-2014b39e0ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:58.091404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2574/5167] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:58.092023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb6abea-6db3-4518-8185-2014b39e0ef9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:58.111251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2594/5168] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:31:57 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:31:58.123269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:58.145045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5fc0c-c207-4dd8-a8d9-dac71013022e service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:58.166519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:58.167552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:58.167951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:58.169367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] PATH_INFO: `/v3/projects/4017073da4f44a62ae02af4461b84a97/users/fb43f598630144778e113974a7e955b7/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:58.178544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4017073da4f44a62ae02af4461b84a97, user_id=fb43f598630144778e113974a7e955b7, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:58.188384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:58.218897 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2575/5169] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:31:58 2022] PUT /identity/v3/projects/4017073da4f44a62ae02af4461b84a97/users/fb43f598630144778e113974a7e955b7/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:58.231760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:58.232308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:58.232441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:58.270816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] MFA Rules not processed for user `fb43f598630144778e113974a7e955b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:58.272167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:58.348006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:58.350509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:58.359430 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:58.428071 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:58.438383 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2595/5170] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:58 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:58.465664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:58.467466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:58.597567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0800e250-28d7-4d39-a2dd-3cdefc962da1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:58.610462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371c7b-6724-41f3-85b3-8eb0f162a6f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:58.611050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371c7b-6724-41f3-85b3-8eb0f162a6f1 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:58.611379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371c7b-6724-41f3-85b3-8eb0f162a6f1 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:58.611610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371c7b-6724-41f3-85b3-8eb0f162a6f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:58.657332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef7d15-0c72-4827-b9b3-b016200248b5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:58.670630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:58.671305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:58.671585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:58.671855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:58.694030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:58.698989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:58.720824 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2596/5171] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:31:58.784406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96371c7b-6724-41f3-85b3-8eb0f162a6f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:58.786204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96371c7b-6724-41f3-85b3-8eb0f162a6f1 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:58.804838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2576/5172] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:58 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:31:58.952802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:58.954483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:59.097240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:59.098039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:59.098415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:59.170578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:59.172601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:59.252997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5e805-7de4-4e72-adb6-11d88758eb58 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:59.275911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:59.277008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:59.277282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:59.277420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] PATH_INFO: `/v3/users/c60c694e6e0f4bceb1ea7260f1064439` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:59.279192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c60c694e6e0f4bceb1ea7260f1064439)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:59.281291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:59.318820 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2577/5173] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:31:59 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:59.339409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:59.441890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c60c694e6e0f4bceb1ea7260f1064439'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:59.456226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c60c694e6e0f4bceb1ea7260f1064439'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:59.505289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c60c694e6e0f4bceb1ea7260f1064439'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:59.507729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c60c694e6e0f4bceb1ea7260f1064439'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:59.522177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ae7d0627-7107-46c4-8257-9c142115dc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c60c694e6e0f4bceb1ea7260f1064439'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:31:59.533257 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2597/5174] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:31:58 2022] DELETE /identity/v3/users/c60c694e6e0f4bceb1ea7260f1064439 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:31:59.537115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:59.537493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:59.538064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:59.563755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:31:59.563994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fe1b6-3ac2-4616-a4eb-77e20d273898 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:31:59.572030 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:59.572303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:59.598900 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:31:59.721388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:31:59.722224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:31:59.722784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:31:59.723102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:31:59.725740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:31:59.881444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:31:59.883165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c854f5-edb4-4ab3-a8e9-a32b8db897ac service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:31:59.890445 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2598/5175] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:31:59.909647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2578/5176] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:31:59.939031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:31:59.942152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:00.194714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dbdae-cc25-402e-9b62-e4267ecca537 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:00.210131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:00.210737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:00.211588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:00.211917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:00.237759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:00.239456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:00.271937 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2599/5177] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:00.560871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eddcdb-e24b-433d-832c-1046305107e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:00.561441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eddcdb-e24b-433d-832c-1046305107e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:00.562297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eddcdb-e24b-433d-832c-1046305107e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:00.590643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2eddcdb-e24b-433d-832c-1046305107e1 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:00.592810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2eddcdb-e24b-433d-832c-1046305107e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:00.621785 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2579/5178] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:32:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:00.661602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:00.663376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:00.693804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03eca3-8d2e-435c-a34c-83e176e81ae4 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:00.709787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:00.710903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:00.711339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:00.711773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:00.727651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:00.729003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:00.741744 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2600/5179] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:01.280118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fa83-d966-4446-891c-2c92f5268f96 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:01.280747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fa83-d966-4446-891c-2c92f5268f96 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:01.281247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f07fa83-d966-4446-891c-2c92f5268f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:01.318374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6f07fa83-d966-4446-891c-2c92f5268f96 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:01.320630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f07fa83-d966-4446-891c-2c92f5268f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:01.340988 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2580/5180] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:32:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:32:01.360516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:01.380886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7264cb9-5d87-4b5b-a506-6dd1ad5de46a service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:01.393395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:01.393983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:01.394268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:01.394547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:01.418286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:01.420663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:01.442052 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2601/5181] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:01.963978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:01.964931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:01.965476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:02.003056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:02.006109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:02.035796 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2581/5182] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:32:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:02.054305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:02.077011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eac3b3-3976-4aa3-95f9-14dfde6c0602 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:02.088839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5252b9-b900-401b-a5a5-f314e2a5230c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:02.089867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5252b9-b900-401b-a5a5-f314e2a5230c service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:02.090652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5252b9-b900-401b-a5a5-f314e2a5230c service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:02.091141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5252b9-b900-401b-a5a5-f314e2a5230c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:02.102556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5252b9-b900-401b-a5a5-f314e2a5230c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:02.105246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5252b9-b900-401b-a5a5-f314e2a5230c service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:02.122223 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2602/5183] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:02.731138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:02.732766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:02.743029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:02.743555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:02.743555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:02.779424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c389fe-1031-455e-a303-87ae5049bb51 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:02.783591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:02.785358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:02.789945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:02.791715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:02.793125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:02.793563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] PATH_INFO: `/v3/projects/c3619d0559db4d378482e581e7fb2189` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:02.798709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3619d0559db4d378482e581e7fb2189)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:02.803986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:02.824014 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2603/5184] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:32:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 19 11:32:02.833336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:02.890823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e819e0-48da-4463-ad48-3a91f73bd399 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:02.897458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7b02d-75cb-4edd-9a8d-1a1647a4f28b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:02.899542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7b02d-75cb-4edd-9a8d-1a1647a4f28b service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:02.901914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7b02d-75cb-4edd-9a8d-1a1647a4f28b service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:02.902488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7b02d-75cb-4edd-9a8d-1a1647a4f28b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:02.943074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7b02d-75cb-4edd-9a8d-1a1647a4f28b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:02.944770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7b02d-75cb-4edd-9a8d-1a1647a4f28b service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:02.990221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3619d0559db4d378482e581e7fb2189', 'request_id': 'req-63295a19-a481-4827-8559-f0d9c517117b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:03.008447 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2604/5185] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:03.016997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3619d0559db4d378482e581e7fb2189', 'request_id': 'req-63295a19-a481-4827-8559-f0d9c517117b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:03.038489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3619d0559db4d378482e581e7fb2189', 'request_id': 'req-63295a19-a481-4827-8559-f0d9c517117b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:03.079461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] The token cache is being invalidate because project c3619d0559db4d378482e581e7fb2189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:03.080088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:03.082255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63295a19-a481-4827-8559-f0d9c517117b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:03.089349 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2582/5186] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:02 2022] DELETE /identity/v3/projects/c3619d0559db4d378482e581e7fb2189 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:03.100084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:03.100643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:03.101249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:03.139748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:03.143000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:03.275083 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2605/5187] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:03.284102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:03.284665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:03.285389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:03.330640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:03.331896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:03.353500 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2583/5188] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:03.355204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:03.391124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5936f77-9dec-4cda-b3ac-f62f12bf4d9a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:03.404326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:03.405220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:03.405331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:03.405615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:03.406424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:03.406943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:03.408758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:03.410630 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:03.439738 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2606/5189] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:03.446128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:03.460971 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:03.469313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c255dc-6e36-4c99-8619-6c030958990b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:03.479498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba3957-0c65-4b86-892c-1006b6de8906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:03.480424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3957-0c65-4b86-892c-1006b6de8906 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:03.487144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3957-0c65-4b86-892c-1006b6de8906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:03.488824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba3957-0c65-4b86-892c-1006b6de8906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:03.490090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba3957-0c65-4b86-892c-1006b6de8906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:03.495564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba3957-0c65-4b86-892c-1006b6de8906 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:03.572732 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2584/5190] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:03 2022] POST /identity/v3/projects => generated 367 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:03.578140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:03.590575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:03.591065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:03.591911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:03.593171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dea579-8113-436c-ba49-3c2378281d05 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:03.635136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:03.637938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:03.900300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:03.908537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:03.909454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:03.911299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:03.912738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:03.926075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:03.961825 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2585/5191] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:32:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:03.987592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:03.989517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:04.021606 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2607/5192] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:03 2022] POST /identity/v3/users => generated 284 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:32:04.025601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:04.083332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dccda4b-fb3c-4f38-8647-38dcb270bf69 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:04.101077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:04.101993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:04.102560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:04.102994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:04.104080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:04.106207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:04.138755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2608/5193] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:04.140036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:04.156552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d831f8c-a3af-474b-9680-d3fc158d6290 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:04.169492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:04.170634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:04.172716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:04.174195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:04.176201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:04.178342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:04.214863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e6b91f-9543-4299-a2e1-7b8991dbe68b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:04.215686 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2609/5194] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:04.217275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:04.230863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5108dec4-3d27-4956-b99a-47b63a16d4cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:04.231837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108dec4-3d27-4956-b99a-47b63a16d4cd service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:04.232300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108dec4-3d27-4956-b99a-47b63a16d4cd service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:04.232756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5108dec4-3d27-4956-b99a-47b63a16d4cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:04.248390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b3465c-2a47-4790-9191-583be0867c98 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:04.276662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108dec4-3d27-4956-b99a-47b63a16d4cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:04.278624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5108dec4-3d27-4956-b99a-47b63a16d4cd service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:04.281100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:04.282332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:04.282771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:04.285177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] PATH_INFO: `/v3/projects/5d8680d55dce4ee286f6bebfcd0311ba/users/dd917cbd8ab246b282d05bc59ae191c0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:04.308989 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2586/5195] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:04.333584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d8680d55dce4ee286f6bebfcd0311ba, user_id=dd917cbd8ab246b282d05bc59ae191c0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:04.336185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:04.383053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2610/5196] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:04 2022] PUT /identity/v3/projects/5d8680d55dce4ee286f6bebfcd0311ba/users/dd917cbd8ab246b282d05bc59ae191c0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:04.385255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:04.385533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:04.385815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:04.460430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] MFA Rules not processed for user `dd917cbd8ab246b282d05bc59ae191c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:04.461821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:04.652949 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2587/5197] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:04 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:04.655176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:04.789818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709f42-851c-416b-9242-d728ed6327d1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:04.803577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:04.805548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:04.805879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:04.806304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:04.806878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:04.811283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:04.881796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:04.889772 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2611/5198] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:04 2022] POST /identity/v3/projects => generated 369 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:04.898837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22e8a4-11be-4585-ac67-67067219fe87 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:04.908215 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:05.063995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:05.064857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:05.065913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:05.067608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:05.071488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:05.077185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:05.111766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2588/5199] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:04 2022] POST /identity/v3/users => generated 285 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:05.116679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:05.133767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ade4e6-9588-4291-87fb-b5a2c2ce8a86 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:05.147944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:05.148692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:05.152985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:05.156726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:05.159758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:05.167352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:05.185399 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2612/5200] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:05.186865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:05.201245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dadeda-d955-41d1-adef-b8e10bcafaa7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:05.214791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea744f5b-bb58-4979-b6cb-728ef344d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:05.215672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744f5b-bb58-4979-b6cb-728ef344d923 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:05.216239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744f5b-bb58-4979-b6cb-728ef344d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:05.216780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea744f5b-bb58-4979-b6cb-728ef344d923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:05.218768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea744f5b-bb58-4979-b6cb-728ef344d923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:05.221395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea744f5b-bb58-4979-b6cb-728ef344d923 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:05.252283 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2589/5201] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:05.254448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:05.271745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc008-394c-49ca-90fd-e619b181f9b3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:05.289173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:05.290530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:05.290818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:05.291089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] PATH_INFO: `/v3/projects/3cc9831a89744ce9b770de95b99653e9/users/87b5bb91eef34631917954e670d19105/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:05.309395 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:05.332924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc9831a89744ce9b770de95b99653e9, user_id=87b5bb91eef34631917954e670d19105, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:05.335736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:05.363254 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2613/5202] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:05 2022] PUT /identity/v3/projects/3cc9831a89744ce9b770de95b99653e9/users/87b5bb91eef34631917954e670d19105/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:05.374158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:05.374503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:05.374814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:05.480328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] MFA Rules not processed for user `87b5bb91eef34631917954e670d19105`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:05.481641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:05.658252 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2590/5203] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:05.905893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:05.909774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:06.073512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6cfbe-72b2-4712-ad04-3060d623139b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:06.078415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931e38-de37-4bea-bb54-7b6298977e3a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:06.079284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931e38-de37-4bea-bb54-7b6298977e3a service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:06.079580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931e38-de37-4bea-bb54-7b6298977e3a service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:06.079870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931e38-de37-4bea-bb54-7b6298977e3a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:06.245665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32931e38-de37-4bea-bb54-7b6298977e3a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:06.250252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32931e38-de37-4bea-bb54-7b6298977e3a service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:06.289402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2614/5204] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:06.647564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:06.662535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb3e37-6aae-4c54-b0f8-3317d8383a33 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:06.668548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:06.669717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:06.670247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:06.670753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:06.682832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:06.684791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:06.699846 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2591/5205] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:06 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:07.589937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84a18-f9e3-4c7b-b72f-99522a7535ce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:07.590503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84a18-f9e3-4c7b-b72f-99522a7535ce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:07.590590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b84a18-f9e3-4c7b-b72f-99522a7535ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:07.619557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b2b84a18-f9e3-4c7b-b72f-99522a7535ce None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:07.621185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b2b84a18-f9e3-4c7b-b72f-99522a7535ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:07.732979 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2615/5206] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:32:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:07.780685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:07.959287 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:07.991641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4860b-93da-4d84-9bd8-f5dca4678bb8 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:08.013634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:08.014317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:08.014597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:08.014877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:08.041254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:08.042895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:08.072831 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2592/5207] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:08.498009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:08.498409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:08.498738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:08.530702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:08.533875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:08.557574 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2616/5208] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:32:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:08.588657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:08.606686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a474-a0d1-4a4c-8128-a4b59f43db32 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:08.633409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe22fb-0a00-41cc-b93a-716d85dc36c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:08.633781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe22fb-0a00-41cc-b93a-716d85dc36c8 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:08.634051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe22fb-0a00-41cc-b93a-716d85dc36c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:08.634326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe22fb-0a00-41cc-b93a-716d85dc36c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:08.664741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe22fb-0a00-41cc-b93a-716d85dc36c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:08.666381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe22fb-0a00-41cc-b93a-716d85dc36c8 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:08.695378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2593/5209] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:08.937697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:08.939269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:09.031253 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:09.166857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ab2f2-0107-4512-b547-191d0f8e5e2a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:09.181427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:09.182348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:09.182627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:09.182903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] PATH_INFO: `/v3/users/a8c6abbf038c4ac5a574a77fb174b8f9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:09.192531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8c6abbf038c4ac5a574a77fb174b8f9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:09.194540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:09.257297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:09.257857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:09.257857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:09.291034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:09.292517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:09.326502 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2594/5210] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:32:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:09.328606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8c6abbf038c4ac5a574a77fb174b8f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:09.341776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8c6abbf038c4ac5a574a77fb174b8f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:09.345642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:09.378604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc6627f-03c7-467e-ae24-ba718e070654 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:09.394097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8c6abbf038c4ac5a574a77fb174b8f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:09.394670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:09.396197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:09.396742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8c6abbf038c4ac5a574a77fb174b8f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:09.397785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:09.398213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:09.418003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:09.425079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ff110b2a-22b2-43a8-b1dd-8367b66346cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8c6abbf038c4ac5a574a77fb174b8f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:09.441022 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2617/5211] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:08 2022] DELETE /identity/v3/users/a8c6abbf038c4ac5a574a77fb174b8f9 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:09.445884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b487d-b468-4a67-9b52-0a055d057200 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:09.446355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b487d-b468-4a67-9b52-0a055d057200 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:09.448255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b487d-b468-4a67-9b52-0a055d057200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:09.450691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:09.452653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:09.466042 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2595/5212] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:09.511347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-882b487d-b468-4a67-9b52-0a055d057200 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:09.512702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-882b487d-b468-4a67-9b52-0a055d057200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:09.712649 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2618/5213] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:09.734650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:09.736277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:09.893380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983a514-5e14-4d6c-8cdb-e136d2a33605 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:10.039735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:10.062057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:10.062057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:10.062057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:10.090694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:10.093249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:10.134523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2596/5214] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:10.166034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767630-bca9-497f-8b4a-c71fa127a73b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:10.166600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767630-bca9-497f-8b4a-c71fa127a73b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:10.166804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81767630-bca9-497f-8b4a-c71fa127a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:10.290282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-81767630-bca9-497f-8b4a-c71fa127a73b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:10.293513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-81767630-bca9-497f-8b4a-c71fa127a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:10.481769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2619/5215] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:32:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:10.506428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:10.508242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:10.683321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c05118-ac4a-47ce-bfc4-16207e0f337f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:10.695526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:10.697504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:10.699897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:10.700555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:10.812998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:10.824821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:10.873506 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2597/5216] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:11.371533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:11.372085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:11.372085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:11.381208 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:11.425787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:11.427435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:11.473291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2620/5217] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:32:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:11.501673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:11.529954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558e5bdf-5c93-426d-8314-51fe5babd775 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:11.557521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:11.559382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:11.560165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:11.560935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:11.583324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:11.585063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:11.591713 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:11.601901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:11.606220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:11.617718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296049e8-f497-422e-bcc0-c13f2ba15b8b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:11.641184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:11.642300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:11.644826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:11.651013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] PATH_INFO: `/v3/projects/4e86a68df7f84bf48a8b15e843da8578` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:11.654032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e86a68df7f84bf48a8b15e843da8578)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:11.661184 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2598/5218] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:11.665878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:11.805084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e86a68df7f84bf48a8b15e843da8578', 'request_id': 'req-9ad645cd-1dae-41d1-917c-5f8444c98d1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:11.834779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e86a68df7f84bf48a8b15e843da8578', 'request_id': 'req-9ad645cd-1dae-41d1-917c-5f8444c98d1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:11.845382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e86a68df7f84bf48a8b15e843da8578', 'request_id': 'req-9ad645cd-1dae-41d1-917c-5f8444c98d1b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:11.891037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] The token cache is being invalidate because project 4e86a68df7f84bf48a8b15e843da8578 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:11.892338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:11.895836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ad645cd-1dae-41d1-917c-5f8444c98d1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:11.901010 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2621/5219] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:11 2022] DELETE /identity/v3/projects/4e86a68df7f84bf48a8b15e843da8578 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:11.905011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:11.931509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a3795b-94f7-4af9-9123-a378d178dc4c service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:12.271527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:12.279394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:12.280270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:12.280772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] PATH_INFO: `/v3/users/fb43f598630144778e113974a7e955b7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:12.282963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb43f598630144778e113974a7e955b7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:12.293669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:12.537338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:12.537896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:12.537896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:12.573603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb43f598630144778e113974a7e955b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:12.586981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb43f598630144778e113974a7e955b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:12.590221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:12.598635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:12.607046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb43f598630144778e113974a7e955b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:12.607852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb43f598630144778e113974a7e955b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:12.618671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb43f598630144778e113974a7e955b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:12.645640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2599/5220] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:11 2022] DELETE /identity/v3/users/fb43f598630144778e113974a7e955b7 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:12.846526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2622/5221] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:32:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:32:12.868916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:12.870773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:12.979115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44239594-9cb1-40cc-a722-fafeb7741cf5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:12.986154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:12.986844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:12.987132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:12.987410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.019444 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:13.105130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.107155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.126107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.128065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.153320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2600/5222] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:13.160244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2e32a-34cf-4ece-9c1f-4529c56bafa4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.344368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.344905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.345191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.345470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] PATH_INFO: `/v3/projects/4017073da4f44a62ae02af4461b84a97` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.346772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4017073da4f44a62ae02af4461b84a97)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.348898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.429744 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:13.476468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4017073da4f44a62ae02af4461b84a97', 'request_id': 'req-c410d781-3472-4a5d-9992-28177f1b2ec9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.490264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4017073da4f44a62ae02af4461b84a97', 'request_id': 'req-c410d781-3472-4a5d-9992-28177f1b2ec9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.502488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4017073da4f44a62ae02af4461b84a97', 'request_id': 'req-c410d781-3472-4a5d-9992-28177f1b2ec9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.513425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.516022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.522185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] The token cache is being invalidate because project 4017073da4f44a62ae02af4461b84a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:13.522393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.522988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c410d781-3472-4a5d-9992-28177f1b2ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.531356 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2623/5223] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:13 2022] DELETE /identity/v3/projects/4017073da4f44a62ae02af4461b84a97 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:13.533082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84dee-3faf-4ac4-8f53-ac6e22aeba1c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.533373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84dee-3faf-4ac4-8f53-ac6e22aeba1c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.533649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf84dee-3faf-4ac4-8f53-ac6e22aeba1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.558069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-abf84dee-3faf-4ac4-8f53-ac6e22aeba1c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:13.559154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa06799-42c9-4ec7-b64c-c5881282e02d service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.561948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-abf84dee-3faf-4ac4-8f53-ac6e22aeba1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.736003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2624/5224] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:13.739854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.740159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.740472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.780444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:13.780680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.781223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:13.781312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.781312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.781667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] PATH_INFO: `/v3/users/dd3d1479cccf440fb84501a38eb6ad65` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.785211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd3d1479cccf440fb84501a38eb6ad65)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.789886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.835172 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2625/5225] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:13.839583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.870711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaf0648-1e06-4cfb-9538-a1b92f01ec92 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.885547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.886765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.888364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.890650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.893923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:13.895166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:13.906292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:13.942569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2626/5226] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:13.947202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:13.973278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd3d1479cccf440fb84501a38eb6ad65'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.974632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd3d1479cccf440fb84501a38eb6ad65'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:13.976637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82458f09-a1f4-4579-8bac-2ccc7a91a97f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:13.989194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:13.990266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:13.991141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:13.991721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:13.995061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.000441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd3d1479cccf440fb84501a38eb6ad65'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.001759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.002186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd3d1479cccf440fb84501a38eb6ad65'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.032011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa6bb1d8-8d5d-442d-8692-e5759980de3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd3d1479cccf440fb84501a38eb6ad65'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:14.084010 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2627/5227] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:13 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:14.101904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:14.108243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:14.130525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2601/5228] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:13 2022] DELETE /identity/v3/users/dd3d1479cccf440fb84501a38eb6ad65 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:14.139844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.140088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.140486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.224283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:14.246852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:14.389188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64753586-36e3-4e3e-a4cf-76bbe389a72b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:14.423193 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:14.482100 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:14.576586 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2602/5229] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:14.586040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:14.591512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.592072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.592729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.594891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.598651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.641028 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2628/5230] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:14 2022] POST /identity/v3/users => generated 292 bytes in 540 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:14.645181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:14.649182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:14.653441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:14.661462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d425b8-3ae6-4528-bc8e-60745637f3cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:14.690774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:14.695653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.699185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.699796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.703743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.711463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.757556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2603/5231] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:14.769528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:14.783672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:14.865133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8850734f-063d-4a6b-b167-55cf12bde6cc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:14.869949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf6457-374c-45d0-b0ca-6995268a82eb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:14.874308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:14.875842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.877858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.878137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] PATH_INFO: `/v3/users/dd917cbd8ab246b282d05bc59ae191c0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.881456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd917cbd8ab246b282d05bc59ae191c0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.885353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:14.886121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:14.886417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:14.886704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:14.887331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.912040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:14.914907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:14.951641 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2629/5232] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:14.953071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:15.005428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c259c5-fe55-45b5-98f9-f22eb7788914 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:15.009983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd917cbd8ab246b282d05bc59ae191c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:15.011142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd917cbd8ab246b282d05bc59ae191c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:15.020184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:15.020993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.021278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.031818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.035524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd917cbd8ab246b282d05bc59ae191c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:15.036483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:15.037154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd917cbd8ab246b282d05bc59ae191c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:15.041150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:15.059287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3308468f-a1cf-4469-acea-a7abf832dc6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd917cbd8ab246b282d05bc59ae191c0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:15.086256 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2630/5233] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:14 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:15.087643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:15.089532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:15.118013 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2604/5234] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:14 2022] DELETE /identity/v3/users/dd917cbd8ab246b282d05bc59ae191c0 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:15.122844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0555547f-0e42-4fcc-b09d-30d6ed63227b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:15.125130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d71ef-1315-4ae8-a5ae-ebdde37991ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.128114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d71ef-1315-4ae8-a5ae-ebdde37991ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.128859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d71ef-1315-4ae8-a5ae-ebdde37991ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.207611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-767d71ef-1315-4ae8-a5ae-ebdde37991ca None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:15.209231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-767d71ef-1315-4ae8-a5ae-ebdde37991ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:15.274879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:15.276553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.276904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.277187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] PATH_INFO: `/v3/projects/fadbefd9337c4881a8cd23d90b92534f/users/98f0f05b8e5f42d58d7ee5d0b0bfeb3d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.323046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fadbefd9337c4881a8cd23d90b92534f, user_id=98f0f05b8e5f42d58d7ee5d0b0bfeb3d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:15.325992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:15.364405 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2605/5235] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:15.364725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2631/5236] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:15 2022] PUT /identity/v3/projects/fadbefd9337c4881a8cd23d90b92534f/users/98f0f05b8e5f42d58d7ee5d0b0bfeb3d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:15.376153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.376630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.377014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.416912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] MFA Rules not processed for user `98f0f05b8e5f42d58d7ee5d0b0bfeb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:15.418539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:15.466740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:15.469752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:15.481271 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:15.592837 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:15.625730 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2606/5237] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:15.627824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:15.681328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e1412-85c0-405e-bbf6-b4756dcee1e6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:15.688652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:15.689539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.689926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.690453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.823617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e2280-06ea-4730-a268-f3339acea763 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:15.827149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:15.830195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:15.830988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:15.831846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.832285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.832739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.833906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:15.836022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:15.856224 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2632/5238] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:15.892590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:15.892938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2607/5239] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:15 2022] POST /identity/v3/projects => generated 381 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:15.910136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359338-9c5b-4c00-9363-a26be163df3b service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:15.984443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:15.985073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:15.985354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:15.985626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:15.986386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:15.988643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:16.031962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:16.047738 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2633/5240] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:15 2022] POST /identity/v3/users => generated 291 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:16.047957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e593ab-ff15-4248-98fc-172da5db28ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:16.067145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:16.068048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:16.068356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:16.068870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:16.072137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:16.078753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:16.107851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2608/5241] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:16.109580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:16.129721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6474be86-33dd-4514-a82c-5cda0162d13f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:16.144184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e141209-ecfe-41e7-b911-f143ba79254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:16.146188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e141209-ecfe-41e7-b911-f143ba79254e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:16.148575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e141209-ecfe-41e7-b911-f143ba79254e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:16.149033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e141209-ecfe-41e7-b911-f143ba79254e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:16.150147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e141209-ecfe-41e7-b911-f143ba79254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:16.156025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e141209-ecfe-41e7-b911-f143ba79254e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:16.194347 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2634/5242] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:16.195557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:16.213105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5473980-1b23-4b3c-81e3-9a8d42d6671d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:16.225398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:16.226332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:16.227131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:16.227422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] PATH_INFO: `/v3/projects/83ec840a6b2c4f66b5c97413d93d8726/users/d507ceecfc1f4a8498df513bfb028d38/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:16.277374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83ec840a6b2c4f66b5c97413d93d8726, user_id=d507ceecfc1f4a8498df513bfb028d38, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:16.284199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:16.345700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2609/5243] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:16 2022] PUT /identity/v3/projects/83ec840a6b2c4f66b5c97413d93d8726/users/d507ceecfc1f4a8498df513bfb028d38/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:16.358680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:16.360034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:16.360383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:16.397549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] MFA Rules not processed for user `d507ceecfc1f4a8498df513bfb028d38`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:16.414921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:16.536781 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:16.591846 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2635/5244] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:16.596103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:16.716760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01849ed8-d5a6-4645-a60d-f069863dd295 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:16.731696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:16.736661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:16.737152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:16.737987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:16.738840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:16.744985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:16.806301 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:16.828400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2610/5245] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:16 2022] POST /identity/v3/projects => generated 383 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:16.831033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:16.845720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fb836-2dff-41e4-9ac2-cb8ed99984a0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:17.004544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:17.005152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.005892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.006227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.007112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:17.009794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:17.041499 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2636/5246] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:16 2022] POST /identity/v3/users => generated 298 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:17.045429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:17.067905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:17.073091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08f87d-e77a-4e2f-937f-10135dd0583e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:17.075366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:17.079702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:17.080975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.081503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.082027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.083412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:17.086225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:17.101913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e610e1-6438-486f-a079-8749d2cef396 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:17.113955 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2611/5247] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:17.114721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:17.115730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.115932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.116170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] PATH_INFO: `/v3/projects/5d8680d55dce4ee286f6bebfcd0311ba` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.119278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:17.122272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d8680d55dce4ee286f6bebfcd0311ba)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:17.124271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:17.125334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:17.151325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c820d5df-ca0a-45ae-a4c2-7ab0037e3bad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:17.166402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:17.167322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.168271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.168554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] PATH_INFO: `/v3/projects/7da75cfaf86149f597d672a9c01691f6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.170648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7da75cfaf86149f597d672a9c01691f6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:17.172758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:17.275054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d8680d55dce4ee286f6bebfcd0311ba', 'request_id': 'req-359a04e4-b6be-4f05-8258-8b55d2e802f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.306232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d8680d55dce4ee286f6bebfcd0311ba', 'request_id': 'req-359a04e4-b6be-4f05-8258-8b55d2e802f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.334482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d8680d55dce4ee286f6bebfcd0311ba', 'request_id': 'req-359a04e4-b6be-4f05-8258-8b55d2e802f5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.337024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7da75cfaf86149f597d672a9c01691f6', 'request_id': 'req-49b66da6-6a5d-41bf-8430-21b7a557ff52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.380788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] The token cache is being invalidate because project 5d8680d55dce4ee286f6bebfcd0311ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:17.381115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.381864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.384521 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2637/5248] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:17 2022] DELETE /identity/v3/projects/5d8680d55dce4ee286f6bebfcd0311ba => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:17.385462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:17.390865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7da75cfaf86149f597d672a9c01691f6', 'request_id': 'req-49b66da6-6a5d-41bf-8430-21b7a557ff52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.391285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:17.401754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7da75cfaf86149f597d672a9c01691f6', 'request_id': 'req-49b66da6-6a5d-41bf-8430-21b7a557ff52'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.442405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] The token cache is being invalidate because project 7da75cfaf86149f597d672a9c01691f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:17.442698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.446113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.449670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2612/5249] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:17 2022] DELETE /identity/v3/projects/7da75cfaf86149f597d672a9c01691f6 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:17.454937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:17.457479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:17.649421 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:17.668249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a04e4-b6be-4f05-8258-8b55d2e802f5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:17.737149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b66da6-6a5d-41bf-8430-21b7a557ff52 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:17.757071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:17.758619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.759135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.759642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] PATH_INFO: `/v3/users/87b5bb91eef34631917954e670d19105` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.766401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=87b5bb91eef34631917954e670d19105)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:17.772501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:17.897295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc5177-17dc-46a6-bf13-d08dd73a8431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:17.903605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5177-17dc-46a6-bf13-d08dd73a8431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.904133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5177-17dc-46a6-bf13-d08dd73a8431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.906678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc5177-17dc-46a6-bf13-d08dd73a8431 admin admin] PATH_INFO: `/v3/projects/904acbc1132746efbe5284d4807d110c/users/fe7273b0a8ab418da970e54a43a68d58/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.949501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5177-17dc-46a6-bf13-d08dd73a8431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904acbc1132746efbe5284d4807d110c, user_id=fe7273b0a8ab418da970e54a43a68d58, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:17.953349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc5177-17dc-46a6-bf13-d08dd73a8431 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:17.966126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87b5bb91eef34631917954e670d19105'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.967449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87b5bb91eef34631917954e670d19105'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.985140 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2638/5250] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:17 2022] PUT /identity/v3/projects/904acbc1132746efbe5284d4807d110c/users/fe7273b0a8ab418da970e54a43a68d58/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:17.988169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c8b2-57fe-4b38-b11d-1b53f96ab181 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:17.988521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c8b2-57fe-4b38-b11d-1b53f96ab181 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:17.988742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e01c8b2-57fe-4b38-b11d-1b53f96ab181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:17.992873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87b5bb91eef34631917954e670d19105'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:17.994013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87b5bb91eef34631917954e670d19105'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:18.016188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87b5bb91eef34631917954e670d19105'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:18.018252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0e01c8b2-57fe-4b38-b11d-1b53f96ab181 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:18.019942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0e01c8b2-57fe-4b38-b11d-1b53f96ab181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:18.042480 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:18.067930 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2613/5251] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:17 2022] DELETE /identity/v3/users/87b5bb91eef34631917954e670d19105 => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:18.076888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:18.080837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:18.206306 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2639/5252] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:18.216443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.216847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.217075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.327240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aaa0f0-c090-42e6-8de5-aef482dd6ebf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:18.333788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:18.335834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:18.346403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:18.347657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.348143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.348663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.352023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:18.361841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:18.377088 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2640/5253] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:18.389220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:18.425017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf1381-861d-4bba-9d79-9415ad865c45 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:18.426553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2614/5254] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:18.428136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:18.451205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:18.452332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.452885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.453368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.455051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:18.455591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:18.459412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:18.465632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3563b7-b0d0-47d8-93fa-b8cf88a16418 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:18.487452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cad497-1c7b-4172-8f4e-d8f8aaae7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:18.489070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cad497-1c7b-4172-8f4e-d8f8aaae7901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.489549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cad497-1c7b-4172-8f4e-d8f8aaae7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.490016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cad497-1c7b-4172-8f4e-d8f8aaae7901 admin admin] PATH_INFO: `/v3/projects/904acbc1132746efbe5284d4807d110c/users/fe7273b0a8ab418da970e54a43a68d58/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.498170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cad497-1c7b-4172-8f4e-d8f8aaae7901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=904acbc1132746efbe5284d4807d110c, user_id=fe7273b0a8ab418da970e54a43a68d58, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:18.506709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cad497-1c7b-4172-8f4e-d8f8aaae7901 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:18.521880 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2641/5255] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:18.523576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:18.557812 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2615/5256] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:18 2022] PUT /identity/v3/projects/904acbc1132746efbe5284d4807d110c/users/fe7273b0a8ab418da970e54a43a68d58/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:18.571683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1692c8c1-ed7c-4b89-a670-14531c7fc446 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:18.591682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.592201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.592504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.684596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] MFA Rules not processed for user `fe7273b0a8ab418da970e54a43a68d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:18.688002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:18.692238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:18.693101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.693514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.693857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.696668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:18.701730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:18.740765 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:18.780719 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2642/5257] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:18 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:18.781773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:18.895717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2616/5258] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:18.915280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:18.917125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:18.972394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8945de6f-61d4-420c-86b2-632773b3685e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:18.989482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:18.991062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:18.991378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:18.991661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:18.994178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:18.997851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.085345 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2643/5259] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:18 2022] POST /identity/v3/users => generated 286 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:19.086577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:19.092798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:19.117915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03d9f31-6a46-4a79-9ceb-9a925dd44263 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.137551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:19.140000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.141399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.141954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] PATH_INFO: `/v3/projects/3cc9831a89744ce9b770de95b99653e9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.142771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6c7b3-0152-49c1-9635-2689bbdb8813 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.143947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc9831a89744ce9b770de95b99653e9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:19.147741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.156811 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:19.236471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:19.238266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.238948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.239442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.241597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:19.278399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc9831a89744ce9b770de95b99653e9', 'request_id': 'req-ce10a0f9-ca0a-4b3e-9967-85447478373f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:19.301186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc9831a89744ce9b770de95b99653e9', 'request_id': 'req-ce10a0f9-ca0a-4b3e-9967-85447478373f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:19.313275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc9831a89744ce9b770de95b99653e9', 'request_id': 'req-ce10a0f9-ca0a-4b3e-9967-85447478373f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:19.342538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] The token cache is being invalidate because project 3cc9831a89744ce9b770de95b99653e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:19.343522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:19.346046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:19.352475 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2644/5260] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:19 2022] DELETE /identity/v3/projects/3cc9831a89744ce9b770de95b99653e9 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:19.356588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:19.362489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:19.375843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:19.379391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaca396-53a5-4156-8f18-4615f2123aeb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.409539 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2617/5261] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:19.413628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bedc7a-a98a-4321-b184-aec3467439b0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.415240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bedc7a-a98a-4321-b184-aec3467439b0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.415838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bedc7a-a98a-4321-b184-aec3467439b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.475925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c1bedc7a-a98a-4321-b184-aec3467439b0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:19.481358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c1bedc7a-a98a-4321-b184-aec3467439b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:19.519018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce10a0f9-ca0a-4b3e-9967-85447478373f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.524890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:19.525697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.526571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.526571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.527187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:19.528898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.562952 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2645/5262] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:19.566363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:19.572131 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:19.598788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae64e6-f9d7-4f63-9eb9-ce91f88a926f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.615384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:19.619305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.619601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.623365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.624220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:19.636632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.679797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2646/5263] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:32:19.686698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:19.710460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e5d61f-2ac0-4470-9964-06fc5040ea01 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.733956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8fa3-f85d-4c49-9f10-41e4e4c367b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:19.738019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8fa3-f85d-4c49-9f10-41e4e4c367b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.738597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8fa3-f85d-4c49-9f10-41e4e4c367b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.739545 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2618/5264] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:19.740092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8fa3-f85d-4c49-9f10-41e4e4c367b8 admin admin] PATH_INFO: `/v3/projects/0a1d8baa8032429bbf0de092cfd0f004/users/9a8792b1fc5a424eb5917236cbc572c3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.750132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.750462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.754849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.815505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:19.816202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8fa3-f85d-4c49-9f10-41e4e4c367b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1d8baa8032429bbf0de092cfd0f004, user_id=9a8792b1fc5a424eb5917236cbc572c3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:19.816694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:19.820812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f8fa3-f85d-4c49-9f10-41e4e4c367b8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.841985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2619/5265] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:19.848963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:19.877203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1a786-43e4-4ce8-acc7-ef709bacc0e0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.885144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:19.885860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.886146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.886428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.887206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:19.887518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:19.890318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:19.928337 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2647/5266] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:19 2022] PUT /identity/v3/projects/0a1d8baa8032429bbf0de092cfd0f004/users/9a8792b1fc5a424eb5917236cbc572c3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:19.937074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2620/5267] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:19.944135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:19.946103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea09b-cdfd-435d-9693-37049c6ad808 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:19.946501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea09b-cdfd-435d-9693-37049c6ad808 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:19.946877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927ea09b-cdfd-435d-9693-37049c6ad808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:19.967051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6029ea23-97ad-488b-b7bb-3255b7b03600 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:19.999409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-927ea09b-cdfd-435d-9693-37049c6ad808 None None] MFA Rules not processed for user `9a8792b1fc5a424eb5917236cbc572c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:20.000683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-927ea09b-cdfd-435d-9693-37049c6ad808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:20.073065 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:20.095377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.095641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.095928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.096188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.096935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.099564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.127953 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2648/5268] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:20.130353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.130654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.131564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.138853 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2621/5269] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:19 2022] POST /identity/v3/projects => generated 389 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:20.143037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:20.146059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:20.169131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] MFA Rules not processed for user `f35d623b786740f08b362ad2e393a042`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:20.170400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:20.290738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6d4fc-9103-4608-ab43-f9669ad0c6e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:20.301866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.302966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.304846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.306926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.340197 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2649/5270] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:20.341095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:20.418138 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:20.447458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4c935-b242-49fd-aa13-a5d779f64bb4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:20.455162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.456492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.456993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.457486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.458396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.460838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.494987 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2650/5271] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:20 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:20.499057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:20.515724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.519089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.532788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded62565-bc0b-460c-ac4a-25d5b5b7e7dd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:20.545300 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2622/5272] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:20.558404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.559489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.559489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.559723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.566007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.574357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.593549 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2651/5273] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:20.598616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:20.638065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b2e9af-5b0b-45e6-9b4c-6c47aef16721 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:20.654221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.654934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.655220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.655695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.656957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.658931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.719937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2623/5274] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:20.726413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:20.756935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d84d11-7fd6-463e-8888-4c3710415ccf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:20.765751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0c957-faf5-48ef-9f64-b5a84942ff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.766763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0c957-faf5-48ef-9f64-b5a84942ff86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.767044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0c957-faf5-48ef-9f64-b5a84942ff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.767321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0c957-faf5-48ef-9f64-b5a84942ff86 admin admin] PATH_INFO: `/v3/projects/7923e556ad6e4e129950789d08085d5d/users/e16017620f454c5194f11f12736e0011/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.767744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:20.782127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44c4e2-9d91-42c5-b654-cfe68659bb8c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:20.788064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:20.789313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.789707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.789947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] PATH_INFO: `/v3/users/9a8792b1fc5a424eb5917236cbc572c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.791477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8792b1fc5a424eb5917236cbc572c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.797711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.806839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0c957-faf5-48ef-9f64-b5a84942ff86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7923e556ad6e4e129950789d08085d5d, user_id=e16017620f454c5194f11f12736e0011, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:20.810124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef0c957-faf5-48ef-9f64-b5a84942ff86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:20.872550 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2652/5275] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:20 2022] PUT /identity/v3/projects/7923e556ad6e4e129950789d08085d5d/users/e16017620f454c5194f11f12736e0011/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:20.883305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:20.883888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:20.884333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:20.912328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8792b1fc5a424eb5917236cbc572c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:20.915113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8792b1fc5a424eb5917236cbc572c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:20.932873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8792b1fc5a424eb5917236cbc572c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:20.933703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8792b1fc5a424eb5917236cbc572c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:20.948585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-27e52484-81ae-4323-be3a-37c8b4e1be05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8792b1fc5a424eb5917236cbc572c3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:20.951557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] MFA Rules not processed for user `e16017620f454c5194f11f12736e0011`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:20.954290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:20.972258 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:20.998937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2624/5276] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:20 2022] DELETE /identity/v3/users/9a8792b1fc5a424eb5917236cbc572c3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:21.003298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:21.003755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:21.004047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:21.044553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:21.045558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:21.161001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2653/5277] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:32:21.181254 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2625/5278] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:21.195687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:21.197826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:21.244331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:21.247134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:21.303575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f24b6c-2ba6-487e-b47a-051b00cfa48b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:21.405029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0fb430-8eff-4bde-a9c7-e8e2e0661dfd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:21.421130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f62362-8327-469e-8562-ff26ae99d757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:21.421130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f62362-8327-469e-8562-ff26ae99d757 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:21.421130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f62362-8327-469e-8562-ff26ae99d757 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:21.421130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f62362-8327-469e-8562-ff26ae99d757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:21.421461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:21.421461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:21.421741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:21.422463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:21.434775 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:21.444236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f62362-8327-469e-8562-ff26ae99d757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:21.445573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f62362-8327-469e-8562-ff26ae99d757 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:21.474802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2626/5279] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:32:21.537467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:21.539713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:21.554325 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2654/5280] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:32:22.417963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cb1d6-6439-4635-b22b-7bcad52cd1a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.425429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cb1d6-6439-4635-b22b-7bcad52cd1a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.425429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cb1d6-6439-4635-b22b-7bcad52cd1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.456247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2a3cb1d6-6439-4635-b22b-7bcad52cd1a1 None None] MFA Rules not processed for user `599dab32ff524b028851a6df2f9c5b33`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:22.457643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a3cb1d6-6439-4635-b22b-7bcad52cd1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:22.542352 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2627/5281] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:22.911274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:22.913669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:22.943638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9716bb3-6139-40f4-a869-b3f6f89b5401 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:22.959094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:22.960731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:22.961239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:22.961732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] PATH_INFO: `/v3/projects/0a1d8baa8032429bbf0de092cfd0f004` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:22.964246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1d8baa8032429bbf0de092cfd0f004)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:22.970933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:23.068505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1d8baa8032429bbf0de092cfd0f004', 'request_id': 'req-bf73d076-2ead-4c3e-813e-cd9dfb441580'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:23.081375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1d8baa8032429bbf0de092cfd0f004', 'request_id': 'req-bf73d076-2ead-4c3e-813e-cd9dfb441580'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:23.093753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1d8baa8032429bbf0de092cfd0f004', 'request_id': 'req-bf73d076-2ead-4c3e-813e-cd9dfb441580'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:23.110892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] The token cache is being invalidate because project 0a1d8baa8032429bbf0de092cfd0f004 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:23.111596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:23.112480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf73d076-2ead-4c3e-813e-cd9dfb441580 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:23.114333 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2655/5282] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:22 2022] DELETE /identity/v3/projects/0a1d8baa8032429bbf0de092cfd0f004 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:23.121887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.122631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.123220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.157024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:23.161667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:23.240656 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:23.327476 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2628/5283] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:23.335705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.336154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.336559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.367323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:23.372057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:23.396652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2656/5284] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:23.400961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:23.427312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a6cd8-9e8f-4c87-8a58-4e7a55e35433 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:23.447874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:23.448676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.449188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.449505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.450286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:23.450631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:23.452860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:23.485579 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2629/5285] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:23.489769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:23.512859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6be0b0-12b4-4b7c-aec1-29b0d4983646 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:23.534015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:23.535149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.538560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.540571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.542548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:23.554348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:23.659885 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2657/5286] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:23 2022] POST /identity/v3/projects => generated 367 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:23.663572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:23.684194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add74cb0-8851-4ac0-a183-7646291f474a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:23.850652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:23.851625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.852252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.852568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.854224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:23.858035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:23.917933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:23.919075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2630/5287] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:23 2022] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:23.936410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51a634-ffae-47fb-a2bd-e761b9e17644 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:23.966114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:23.966909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:23.967187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:23.967460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:23.968430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:23.971771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.001584 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2658/5288] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:32:24.002922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.029226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef78f4f7-6352-4584-adfb-d8c44fdc51f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:24.037934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd7c8fb-7863-4c1a-aa1d-7dfadca23846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:24.038300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7c8fb-7863-4c1a-aa1d-7dfadca23846 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.038542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7c8fb-7863-4c1a-aa1d-7dfadca23846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.038884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd7c8fb-7863-4c1a-aa1d-7dfadca23846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.040010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7c8fb-7863-4c1a-aa1d-7dfadca23846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:24.041750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd7c8fb-7863-4c1a-aa1d-7dfadca23846 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.071569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.072699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2631/5289] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:24.089616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa4809-63d7-4170-a443-a9bc5e8a8998 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:24.099379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:24.101091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.101525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.102084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] PATH_INFO: `/v3/projects/b79d9e21947343ccac5c43af068e8bf9/users/e7ca3ab30fee44b3b5f0786edcc54d47/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.126101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79d9e21947343ccac5c43af068e8bf9, user_id=e7ca3ab30fee44b3b5f0786edcc54d47, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:24.133748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.176450 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2659/5290] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:24 2022] PUT /identity/v3/projects/b79d9e21947343ccac5c43af068e8bf9/users/e7ca3ab30fee44b3b5f0786edcc54d47/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:24.181250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.181779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.182382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.241676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] MFA Rules not processed for user `e7ca3ab30fee44b3b5f0786edcc54d47`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:24.243114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:24.375189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2632/5291] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:24 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:24.381573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.434454 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:24.508187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86274b04-68c9-449d-8763-217a2983001b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:24.514298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:24.515150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.515496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.515835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.516652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:24.518800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.575339 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2660/5292] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:24 2022] POST /identity/v3/projects => generated 369 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:24.579770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.605200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa801f7-a19f-47c0-9bbd-640da06e3e22 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:24.682881 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:24.717443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:24.718782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.719046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.719465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.720593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:24.723521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.756806 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2633/5293] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:24 2022] POST /identity/v3/users => generated 291 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:24.758370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.772169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54067876-96f6-44e7-869a-c4f33a338235 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:24.777174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:24.778295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.778680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.779513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.781999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:24.782614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.800410 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2661/5294] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:24.801043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.813021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a65b39-a4e0-444e-b0ec-ae3df73346d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:24.818226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:24.819287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:24.819575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:24.819926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] PATH_INFO: `/v3/projects/38f7c768c9a648638e0e600da661f725/users/2859bf41ac4f478395b520f8021f0b48/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:24.859079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7c768c9a648638e0e600da661f725, user_id=2859bf41ac4f478395b520f8021f0b48, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:24.863822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:24.909418 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2634/5295] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:24 2022] PUT /identity/v3/projects/38f7c768c9a648638e0e600da661f725/users/2859bf41ac4f478395b520f8021f0b48/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:24.911001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:24.945283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12851a06-791c-47ee-b05c-4cbc7df4a35b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:25.169743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f603ee1-c78d-45e3-a40b-1d645c70a1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:25.170610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603ee1-c78d-45e3-a40b-1d645c70a1df admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:25.171219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603ee1-c78d-45e3-a40b-1d645c70a1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:25.171705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f603ee1-c78d-45e3-a40b-1d645c70a1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:25.172737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603ee1-c78d-45e3-a40b-1d645c70a1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:25.175105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f603ee1-c78d-45e3-a40b-1d645c70a1df admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:25.223208 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2662/5296] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:25.227513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:25.246135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c08fc0-c96f-4c89-9bf4-24463f8581b6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:25.265613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:25.268180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:25.268180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:25.268180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] PATH_INFO: `/v3/projects/38f7c768c9a648638e0e600da661f725/users/2859bf41ac4f478395b520f8021f0b48/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:25.275985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=38f7c768c9a648638e0e600da661f725, user_id=2859bf41ac4f478395b520f8021f0b48, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:25.284196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:25.332894 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2635/5297] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:25 2022] PUT /identity/v3/projects/38f7c768c9a648638e0e600da661f725/users/2859bf41ac4f478395b520f8021f0b48/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:25.337380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:25.337780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:25.338136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:25.373973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] MFA Rules not processed for user `2859bf41ac4f478395b520f8021f0b48`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:25.375326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:25.512316 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2663/5298] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:25 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:25.571874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:25.574283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:25.750044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b87fff-abd5-4613-b8bd-faa7ee9fef6c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:25.759147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:25.770194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:25.771486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:25.772789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:25.802338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:25.805083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:25.836178 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2636/5299] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:25 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:32:29.970080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:29.972664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:30.048843 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:30.134980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e5cb2a-2ade-465b-a8cf-5d76d109c7f4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:30.144116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:30.145633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:30.146197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:30.147091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] PATH_INFO: `/v3/users/9ba7d6118edc4c4eb4931b8cdebcdcde` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:30.151379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ba7d6118edc4c4eb4931b8cdebcdcde)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:30.154137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:30.229099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ba7d6118edc4c4eb4931b8cdebcdcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:30.239904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ba7d6118edc4c4eb4931b8cdebcdcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:30.258484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ba7d6118edc4c4eb4931b8cdebcdcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:30.259691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ba7d6118edc4c4eb4931b8cdebcdcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:30.273963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ba7d6118edc4c4eb4931b8cdebcdcde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:30.289069 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2664/5300] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:29 2022] DELETE /identity/v3/users/9ba7d6118edc4c4eb4931b8cdebcdcde => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:31.832806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:31.851249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ecdac-9012-43ae-a797-1276db5f8b4a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:32.039596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:32.040669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:32.044558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:32.048931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] PATH_INFO: `/v3/projects/ff6c4c81832d49fc8fcd1f809730d632` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:32.050812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6c4c81832d49fc8fcd1f809730d632)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:32.058228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:32.160382 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:32.181867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6c4c81832d49fc8fcd1f809730d632', 'request_id': 'req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.196881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6c4c81832d49fc8fcd1f809730d632', 'request_id': 'req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.212534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6c4c81832d49fc8fcd1f809730d632', 'request_id': 'req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.238251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] The token cache is being invalidate because project ff6c4c81832d49fc8fcd1f809730d632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:32.238879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.243669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.246350 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2637/5301] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:31 2022] DELETE /identity/v3/projects/ff6c4c81832d49fc8fcd1f809730d632 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:32.250676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:32.252845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:32.279249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62192052-d501-4e22-8701-f35df659c90c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:32.423378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:32.424642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:32.425098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:32.425511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] PATH_INFO: `/v3/users/30494727ccea43e0a9ea4c54a1622192` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:32.428205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30494727ccea43e0a9ea4c54a1622192)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:32.431537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:32.944085 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:32.954198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30494727ccea43e0a9ea4c54a1622192'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.970018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30494727ccea43e0a9ea4c54a1622192'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.991054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30494727ccea43e0a9ea4c54a1622192'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:32.991808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30494727ccea43e0a9ea4c54a1622192'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:33.001384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-71095d8d-f431-40b1-815f-8592c6cd398a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30494727ccea43e0a9ea4c54a1622192'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:33.009057 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2665/5302] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:32 2022] DELETE /identity/v3/users/30494727ccea43e0a9ea4c54a1622192 => generated 0 bytes in 759 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:34.065321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:34.069080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:34.135877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7fad-e253-4cfe-b630-6bfd50afa5b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:34.306286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:34.307209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:34.307515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:34.307797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] PATH_INFO: `/v3/projects/10fd55360b63440eaa930565461e64a5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:34.311629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10fd55360b63440eaa930565461e64a5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:34.317760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:34.499707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10fd55360b63440eaa930565461e64a5', 'request_id': 'req-3679dd01-b60e-4b77-9122-17ac88f2b913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:34.529890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10fd55360b63440eaa930565461e64a5', 'request_id': 'req-3679dd01-b60e-4b77-9122-17ac88f2b913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:34.550967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10fd55360b63440eaa930565461e64a5', 'request_id': 'req-3679dd01-b60e-4b77-9122-17ac88f2b913'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:34.587040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] The token cache is being invalidate because project 10fd55360b63440eaa930565461e64a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:34.587315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:34.589657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3679dd01-b60e-4b77-9122-17ac88f2b913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:34.596712 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2638/5303] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:34 2022] DELETE /identity/v3/projects/10fd55360b63440eaa930565461e64a5 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:34.598626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:34.599087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:34.599545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:34.636649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:34.640511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:34.771495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2666/5304] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:34.779837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:34.780131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:34.780467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:34.818366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:34.819416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:34.838531 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2639/5305] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:34.842581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:34.856250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53c249c-c151-4a78-bd64-c51168e6a450 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:34.868924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:34.870128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:34.870416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:34.870692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:34.871449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:34.871763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:34.873527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:34.919504 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2667/5306] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:34.923745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:34.934262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fdf946-7b55-4c6f-9c3a-fcd86094897e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:34.942161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:34.943204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:34.943204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:34.943515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:34.944379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:34.948028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:34.983850 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2640/5307] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:34 2022] POST /identity/v3/projects => generated 363 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:34.989362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.005524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2126b-3110-439c-b0a4-65f95bc86b0d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.102155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.103364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.103741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.104069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.104900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.107038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.134868 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2668/5308] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:34 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:35.144385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.172082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36395ba-b8de-4c01-8442-655fa5679712 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.179792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.180838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.181371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.181861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.182849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.185724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.205868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2641/5309] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:35.207771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.220572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27add2a3-48ce-432c-a153-96e5ae9314d0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.227625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a54c60-6aa5-45eb-b1a7-32392ed37c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.229159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a54c60-6aa5-45eb-b1a7-32392ed37c2f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.229763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a54c60-6aa5-45eb-b1a7-32392ed37c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.230276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a54c60-6aa5-45eb-b1a7-32392ed37c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.233031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a54c60-6aa5-45eb-b1a7-32392ed37c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.236251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a54c60-6aa5-45eb-b1a7-32392ed37c2f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.251250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2669/5310] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:35.256699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.275185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20cc49-964f-407d-9be1-a26581790eba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.290813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.291780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.292028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.292309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f/users/3ebe86cceb4d4ef8a57784bd74d9a51a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.329441 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:35.341721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=792e4d3cf52640a59a6d3078c052554f, user_id=3ebe86cceb4d4ef8a57784bd74d9a51a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.344919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.392854 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2642/5311] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:35 2022] PUT /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f/users/3ebe86cceb4d4ef8a57784bd74d9a51a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:35.398437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62584-c75e-4cc9-b959-cf976016d03e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.399037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62584-c75e-4cc9-b959-cf976016d03e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.399530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb62584-c75e-4cc9-b959-cf976016d03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.438197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7fb62584-c75e-4cc9-b959-cf976016d03e None None] MFA Rules not processed for user `3ebe86cceb4d4ef8a57784bd74d9a51a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:35.441613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7fb62584-c75e-4cc9-b959-cf976016d03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:35.472111 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:35.628834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2670/5312] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:35.691035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:35.692915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:35.879109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb0823-fdeb-4408-b046-acd7fe759f23 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:35.893565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:35.894525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.894912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.895291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.906921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:35.908942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:35.938028 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2643/5313] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:35.955606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aac62-41c6-4fb0-893e-201deccb1822 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:35.955912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aac62-41c6-4fb0-893e-201deccb1822 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:35.956308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25aac62-41c6-4fb0-893e-201deccb1822 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:35.958553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2671/5314] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:35.968639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:35.994846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:36.017428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ae99d-fa91-4d4e-b7dd-33484cb6a30c service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:36.027330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebe86cceb4d4ef8a57784bd74d9a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792e4d3cf52640a59a6d3078c052554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:36.030359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.031512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.032225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.034202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorizing `identity:get_project(project_id=792e4d3cf52640a59a6d3078c052554f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:36.037246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:36.046164 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2644/5315] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:35 2022] GET /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f => generated 363 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:36.081493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb22d2-8cab-44b1-9399-ef5a79543cc4 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.082169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb22d2-8cab-44b1-9399-ef5a79543cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.082598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb22d2-8cab-44b1-9399-ef5a79543cc4 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.084179 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2672/5316] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:36.091013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:36.092963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:36.136934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:36.159523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b4ec39-9717-4614-bb4c-202036804e31 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:36.167488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebe86cceb4d4ef8a57784bd74d9a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792e4d3cf52640a59a6d3078c052554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:36.168857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.170139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.170668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.172539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorizing `identity:get_project(project_id=792e4d3cf52640a59a6d3078c052554f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:36.175305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:36.182577 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2645/5317] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:36 2022] GET /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f => generated 363 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:36.241022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d65b-d4c0-4923-bfcc-2d7164228ea9 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.241590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d65b-d4c0-4923-bfcc-2d7164228ea9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.242100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880d65b-d4c0-4923-bfcc-2d7164228ea9 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.244041 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2673/5318] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:32:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:36.250921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:36.291738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:36.332113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90323ef3-05b8-4dbd-985b-01467ba29938 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:36.340833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebe86cceb4d4ef8a57784bd74d9a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792e4d3cf52640a59a6d3078c052554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:36.343752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.344045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.344843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.348612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorizing `identity:get_project(project_id=792e4d3cf52640a59a6d3078c052554f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:36.352162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:36.374189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2646/5319] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:36 2022] GET /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f => generated 363 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:36.493861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35ce1-3bba-44e6-928d-be5a0b66d6ee None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.494146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35ce1-3bba-44e6-928d-be5a0b66d6ee None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.494420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a35ce1-3bba-44e6-928d-be5a0b66d6ee None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.495903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2674/5320] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:32:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:36.512648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:36.551490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:36.581811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de87eb-038e-4bb0-ac19-d90082468965 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:36.597920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebe86cceb4d4ef8a57784bd74d9a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792e4d3cf52640a59a6d3078c052554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:36.602371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.602705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.603402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.605722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorizing `identity:get_project(project_id=792e4d3cf52640a59a6d3078c052554f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:36.611936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:36.616323 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2647/5321] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:36 2022] GET /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f => generated 363 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:36.930567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9737-ac3a-4604-b4ae-0abe808e9fb1 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:36.931110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9737-ac3a-4604-b4ae-0abe808e9fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:36.932072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2c9737-ac3a-4604-b4ae-0abe808e9fb1 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:36.934705 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2675/5322] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 11:32:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:32:36.946548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 11:32:36.984065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:37.000277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96b05a-90ed-4d16-ba5d-05da59bd8cc1 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:37.006295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001a9fa9-ee5e-4f27-83f2-16298da8d129 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3ebe86cceb4d4ef8a57784bd74d9a51a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '792e4d3cf52640a59a6d3078c052554f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:37.007599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9fa9-ee5e-4f27-83f2-16298da8d129 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:37.007789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9fa9-ee5e-4f27-83f2-16298da8d129 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:37.008145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001a9fa9-ee5e-4f27-83f2-16298da8d129 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:37.009470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a9fa9-ee5e-4f27-83f2-16298da8d129 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorizing `identity:get_project(project_id=792e4d3cf52640a59a6d3078c052554f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:37.011391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001a9fa9-ee5e-4f27-83f2-16298da8d129 tempest-QuotasTestJSON-662611006 tempest-QuotasTestJSON-662611006-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:37.013613 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2648/5323] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 11:32:36 2022] GET /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f => generated 363 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:37.060363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9737-ac3a-4604-b4ae-0abe808e9fb1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:37.153194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2c9737-ac3a-4604-b4ae-0abe808e9fb1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:37.159654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:37.160875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:37.161150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:37.161420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] PATH_INFO: `/v3/users/3ebe86cceb4d4ef8a57784bd74d9a51a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:37.163862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ebe86cceb4d4ef8a57784bd74d9a51a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:37.166627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:37.240709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ebe86cceb4d4ef8a57784bd74d9a51a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:37.250793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ebe86cceb4d4ef8a57784bd74d9a51a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:37.269724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ebe86cceb4d4ef8a57784bd74d9a51a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:37.270599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ebe86cceb4d4ef8a57784bd74d9a51a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:37.279799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ebe86cceb4d4ef8a57784bd74d9a51a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:37.286271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2676/5324] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:37 2022] DELETE /identity/v3/users/3ebe86cceb4d4ef8a57784bd74d9a51a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:37.292310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:37.294186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:37.295281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:37.318974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:37.320402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:37.394103 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2649/5325] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:37.440706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:37.442736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:37.505370 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:37.544039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda72d9e-7e0d-42e1-8c85-b4f7a90f0d21 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:37.552701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bf9bfe-a3a6-44f9-bc87-4d2704cb578a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:37.553635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9bfe-a3a6-44f9-bc87-4d2704cb578a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:37.553994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9bfe-a3a6-44f9-bc87-4d2704cb578a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:37.554339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf9bfe-a3a6-44f9-bc87-4d2704cb578a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:37.568602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9bfe-a3a6-44f9-bc87-4d2704cb578a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:37.572937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bf9bfe-a3a6-44f9-bc87-4d2704cb578a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:37.622290 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2677/5326] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:39.010574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:39.012803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:39.045072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc84ca-97c1-4927-adae-48ff9b890366 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:39.052272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:39.053206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.053490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.053763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] PATH_INFO: `/v3/projects/792e4d3cf52640a59a6d3078c052554f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.063884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] RBAC: Authorizing `identity:delete_project(project_id=792e4d3cf52640a59a6d3078c052554f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:39.070100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:39.114403 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:39.168985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '792e4d3cf52640a59a6d3078c052554f', 'request_id': 'req-a19ac130-6daf-4873-998e-a2e8048d742c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:39.178189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '792e4d3cf52640a59a6d3078c052554f', 'request_id': 'req-a19ac130-6daf-4873-998e-a2e8048d742c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:39.186437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '792e4d3cf52640a59a6d3078c052554f', 'request_id': 'req-a19ac130-6daf-4873-998e-a2e8048d742c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:39.216122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] The token cache is being invalidate because project 792e4d3cf52640a59a6d3078c052554f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:39.217096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:39.219915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a19ac130-6daf-4873-998e-a2e8048d742c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:39.224698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2650/5327] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:39 2022] DELETE /identity/v3/projects/792e4d3cf52640a59a6d3078c052554f => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:39.231661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.232252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.232496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.267465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:39.268877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:39.388655 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2678/5328] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:39.394863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.395158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.395438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.415673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:39.417051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:39.438569 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2651/5329] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:39.447942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:39.460940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e63ff-d4c9-4801-9390-949fd9945493 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:39.473086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:39.474313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.474829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.475257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.476417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:39.476878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:39.480991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:39.503874 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2679/5330] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:39.508464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:39.522435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f362789e-af4f-457b-9ffd-a835160f1c9c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:39.529289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bf9c1-43de-4620-a1c1-e5b48c351ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:39.530990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf9c1-43de-4620-a1c1-e5b48c351ba2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.532290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf9c1-43de-4620-a1c1-e5b48c351ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.532742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bf9c1-43de-4620-a1c1-e5b48c351ba2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.546256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf9c1-43de-4620-a1c1-e5b48c351ba2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:39.549315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4bf9c1-43de-4620-a1c1-e5b48c351ba2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:39.616311 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2652/5331] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:39 2022] POST /identity/v3/projects => generated 361 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:39.617563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:39.644753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b055c9-02f0-4bf6-ae85-4919f875c4a5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:39.784791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.785095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.785381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.809051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:39.809827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.810109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.810487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.811339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:39.813369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] MFA Rules not processed for user `0269af8ef32d4551b772630c02e32702`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:39.814555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:39.814692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:39.858429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2680/5332] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:39 2022] POST /identity/v3/users => generated 281 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:39.863115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:39.878462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b801f-c449-42c8-af2b-300d5ce14dfa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:39.890581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:39.892870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.893217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.895497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.896443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:39.898992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:39.926845 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2681/5333] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:39.929049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:39.957462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2653/5334] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 19 11:32:39.972552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c458bf5-c388-4f83-ae4c-307bb4d5544c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:39.988641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9ee51-3364-4ac2-9b2f-13600ceb5720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:39.989547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9ee51-3364-4ac2-9b2f-13600ceb5720 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:39.989924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9ee51-3364-4ac2-9b2f-13600ceb5720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:39.990489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9ee51-3364-4ac2-9b2f-13600ceb5720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:39.991354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9ee51-3364-4ac2-9b2f-13600ceb5720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:39.997531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9ee51-3364-4ac2-9b2f-13600ceb5720 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:40.015453 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2682/5335] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:40.019869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:40.037608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ca62b4-3035-4ad0-8504-cfc6777449d9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:40.053350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf24f39-ba07-4a9d-a2a5-eb2c6d8ae386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:40.054899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf24f39-ba07-4a9d-a2a5-eb2c6d8ae386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.055577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf24f39-ba07-4a9d-a2a5-eb2c6d8ae386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.056073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf24f39-ba07-4a9d-a2a5-eb2c6d8ae386 admin admin] PATH_INFO: `/v3/projects/60d0801237f244fdacb4596118173839/users/8e745e54cf8a4ef4b310bd975bc4b6aa/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.113705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf24f39-ba07-4a9d-a2a5-eb2c6d8ae386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d0801237f244fdacb4596118173839, user_id=8e745e54cf8a4ef4b310bd975bc4b6aa, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:40.119144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf24f39-ba07-4a9d-a2a5-eb2c6d8ae386 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:40.142788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2654/5336] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:40 2022] PUT /identity/v3/projects/60d0801237f244fdacb4596118173839/users/8e745e54cf8a4ef4b310bd975bc4b6aa/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:40.158928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.159788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.160580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.208024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] MFA Rules not processed for user `8e745e54cf8a4ef4b310bd975bc4b6aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:40.211264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:40.256333 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:40.343290 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2683/5337] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:40.777967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:40.778978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:40.779445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:40.826447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:40.829687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:40.938227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2655/5338] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:32:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:40.960861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:40.965707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:41.084062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275bb41d-1173-4fb5-bea2-3752ec1c6716 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:41.097276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f873b5-1459-4056-a4dc-3a2e2bebc142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:41.097971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f873b5-1459-4056-a4dc-3a2e2bebc142 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:41.098254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f873b5-1459-4056-a4dc-3a2e2bebc142 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:41.098528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f873b5-1459-4056-a4dc-3a2e2bebc142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:41.108728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f873b5-1459-4056-a4dc-3a2e2bebc142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:41.110371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f873b5-1459-4056-a4dc-3a2e2bebc142 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:41.142725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2684/5339] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:32:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:32:42.880741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:42.896999 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:43.113704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bba68d-1ce1-4d95-a624-961dd9fd594a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:43.131136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:43.133502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:43.133502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:43.133502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] PATH_INFO: `/v3/users/8e745e54cf8a4ef4b310bd975bc4b6aa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:43.134098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e745e54cf8a4ef4b310bd975bc4b6aa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:43.136094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:43.294287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e745e54cf8a4ef4b310bd975bc4b6aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:43.295332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e745e54cf8a4ef4b310bd975bc4b6aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:43.318294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e745e54cf8a4ef4b310bd975bc4b6aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:43.319263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e745e54cf8a4ef4b310bd975bc4b6aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:43.328977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e745e54cf8a4ef4b310bd975bc4b6aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:43.403989 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2656/5340] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:42 2022] DELETE /identity/v3/users/8e745e54cf8a4ef4b310bd975bc4b6aa => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:43.410820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:43.411701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:43.412159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:43.452831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:43.454115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:43.702167 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2685/5341] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:43.804862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:43.807669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:43.946203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0152e84d-9ee5-41de-8779-23df6ade3e93 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:43.952522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:43.953555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:43.953998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:43.954495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:43.969661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:43.971463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:43.984788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2657/5342] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:45.898525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:45.900436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:45.944220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff823b8f-7a18-4769-8ce3-9220d3fea9fb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:45.982998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:45.984191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:45.987514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:45.988074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:45.997815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:46.195629 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:46.240612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:46.246547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27a2c-c6b2-4fb5-94fc-76b18291531f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:46.283032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2686/5343] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:45 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:47.110256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:47.112524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:47.132907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3079fc5-4bd9-4b3d-87f5-6ab7e17d176d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:47.219604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:47.233576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:47.236934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:47.239169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] PATH_INFO: `/v3/projects/60d0801237f244fdacb4596118173839` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:47.246137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d0801237f244fdacb4596118173839)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:47.252187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:47.360867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:47.430794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d0801237f244fdacb4596118173839', 'request_id': 'req-bc5a969e-98cc-44c1-8229-caae27f5b248'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:47.447354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d0801237f244fdacb4596118173839', 'request_id': 'req-bc5a969e-98cc-44c1-8229-caae27f5b248'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:47.472467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d0801237f244fdacb4596118173839', 'request_id': 'req-bc5a969e-98cc-44c1-8229-caae27f5b248'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:47.524153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] The token cache is being invalidate because project 60d0801237f244fdacb4596118173839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:47.526374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:47.529921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc5a969e-98cc-44c1-8229-caae27f5b248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:47.535114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2658/5344] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:47 2022] DELETE /identity/v3/projects/60d0801237f244fdacb4596118173839 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:47.542665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:47.543732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:47.544289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:47.584048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:47.592465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:47.843001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2687/5345] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:47.852167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:47.852491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:47.853455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:47.886035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:47.887302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:47.906625 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2659/5346] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:47.910648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:47.923178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426c1029-9500-499e-9c3f-5929e17ab93b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:47.942952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:47.943774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:47.944058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:47.944501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:47.946558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:47.946880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:47.953193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:47.979554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:48.004797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2688/5347] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:48.010298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bf4ec-0308-4625-b23a-989eecf8a1be None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:48.050653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:48.051367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.051657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.062071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.063039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:48.065028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:48.154625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:48.158131 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2660/5348] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:47 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:48.183852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcb009-ef45-481d-8c40-0b742da4eea7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:48.368572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:48.369989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.370393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.370783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.371835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:48.374362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:48.451375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:48.469991 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2689/5349] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:48 2022] POST /identity/v3/users => generated 286 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:32:48.488448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cb8b79-909b-4a6b-bdf4-50b511208283 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:48.510660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:48.514459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.515100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.515591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.518407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:48.536949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:48.572143 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2661/5350] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:48.576943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:48.592464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857624a6-251b-47bd-9756-539e6353581e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:48.598645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e828f1b-5185-40cb-a398-413c14f71c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:48.600645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828f1b-5185-40cb-a398-413c14f71c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.601238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828f1b-5185-40cb-a398-413c14f71c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.601681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e828f1b-5185-40cb-a398-413c14f71c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.602880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e828f1b-5185-40cb-a398-413c14f71c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:48.604995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e828f1b-5185-40cb-a398-413c14f71c7c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:48.637957 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2690/5351] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:32:48.642205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:48.661133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11eb2c-8832-4895-9b08-329c36a2dc7d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:48.673219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:48.675661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.676496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.677006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] PATH_INFO: `/v3/projects/d4b9fc2f751843b4a68219311756b43f/users/c537aa11cf804f8c9f0ff1012c4ead44/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.712766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4b9fc2f751843b4a68219311756b43f, user_id=c537aa11cf804f8c9f0ff1012c4ead44, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:48.716787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:48.770248 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2662/5352] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:48 2022] PUT /identity/v3/projects/d4b9fc2f751843b4a68219311756b43f/users/c537aa11cf804f8c9f0ff1012c4ead44/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:48.782587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:48.782957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:48.783187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:48.854026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] MFA Rules not processed for user `c537aa11cf804f8c9f0ff1012c4ead44`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:48.857310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:48.970827 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:49.011284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2691/5353] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:49.016526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:49.155619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db36d1-3910-4afb-bbc7-bb39719c97ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:49.171705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:49.177035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:49.177748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:49.178036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:49.180409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:49.189416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:49.284115 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2663/5354] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:49 2022] POST /identity/v3/projects => generated 373 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:49.285951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:49.337190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c840b1-15e6-4316-b32e-157b6675efe5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:49.561044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:49.562249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:49.562749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:49.563251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:49.564538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:49.579490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:49.626417 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2692/5355] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:49 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:49.628328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:49.650652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9aaf3b-6a27-4aa5-a354-6ba8974d4224 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:49.667886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:49.672077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:49.675606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:49.677175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:49.679901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:49.691183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:49.735093 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2664/5356] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:49.736921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:49.765243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7211a-1dd6-40b7-8d74-f0ee7a2af81b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:49.775638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:49.776909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:49.778161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:49.778670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] PATH_INFO: `/v3/projects/99854c1184304159b05fac5b74b04a0b/users/4e844c558908498aa7ec18e272bf1bd9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:49.821960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] RBAC: Authorizing `identity:create_grant(project_id=99854c1184304159b05fac5b74b04a0b, user_id=4e844c558908498aa7ec18e272bf1bd9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:49.826518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:49.862281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2693/5357] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:49 2022] PUT /identity/v3/projects/99854c1184304159b05fac5b74b04a0b/users/4e844c558908498aa7ec18e272bf1bd9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:49.863986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:49.891903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10134a79-afd4-4369-9429-a46f08400ac2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:49.929646 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:50.055325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a874159a-8dda-4344-9576-ef613f9bd673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:50.059028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874159a-8dda-4344-9576-ef613f9bd673 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.061338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874159a-8dda-4344-9576-ef613f9bd673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.064677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a874159a-8dda-4344-9576-ef613f9bd673 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.064677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874159a-8dda-4344-9576-ef613f9bd673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:50.068172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a874159a-8dda-4344-9576-ef613f9bd673 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:50.102209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:50.102618 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2665/5358] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:50.117943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dcdba-5113-4ceb-ac79-b2b34bf6f57f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:50.138028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:50.139062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.139343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.139659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] PATH_INFO: `/v3/projects/99854c1184304159b05fac5b74b04a0b/users/4e844c558908498aa7ec18e272bf1bd9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.146898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99854c1184304159b05fac5b74b04a0b, user_id=4e844c558908498aa7ec18e272bf1bd9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:50.158343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:50.190584 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2694/5359] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:50 2022] PUT /identity/v3/projects/99854c1184304159b05fac5b74b04a0b/users/4e844c558908498aa7ec18e272bf1bd9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:50.205803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.206323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.206410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.313074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] MFA Rules not processed for user `4e844c558908498aa7ec18e272bf1bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:50.314362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:50.560162 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2666/5360] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:50 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:50.564281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:50.594066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6a15e-738f-43c0-926e-2808802b8072 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:50.628461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:50.629994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.630393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.630828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.631703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:50.633194 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:50.633194 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:50.633194 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:50.634572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:50.689542 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2695/5361] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:50 2022] POST /identity/v3/services => generated 288 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:50.697152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:50.722857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a22d0-6932-4acd-8d19-42f177a9718d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:50.786343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:50.787398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.787850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.788305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.789369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:50.790632 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:50.790632 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:32:50.790632 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:32:50.791925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:50.809993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2667/5362] 10.222.0.15 () {60 vars in 1212 bytes} [Tue Jul 19 11:32:50 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:50.815042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:50.833124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1950e06c-7f0d-4a24-abff-4ea58ed61fd3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:50.845036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:50.845805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.846263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.846585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.847476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:50.856537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:50.890157 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2696/5363] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:50 2022] POST /identity/v3/services => generated 287 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:50.894066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:50.907681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f144bf-31b7-4348-a2ad-6d9013c10fa8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:50.950078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:50.951004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:50.951276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:50.951555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:50.952308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:50.954030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:50.972577 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2668/5364] 10.222.0.15 () {60 vars in 1212 bytes} [Tue Jul 19 11:32:50 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 334 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:50.976966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.003355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79112183-1bad-45a3-b289-26b62c1818cb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.030078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.030767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.031076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.031344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.032042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.033202 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.033202 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:51.033202 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:51.034109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.077742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.078291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2697/5365] 10.222.0.15 () {58 vars in 1190 bytes} [Tue Jul 19 11:32:50 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 765 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:51.104126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea795932-2696-42a9-992b-540eb11e4e82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.118302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.119196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.119480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.119760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.120471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e73c76d8608a430b83034e3e0e38c1f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.121553 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.121553 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:32:51.121553 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:32:51.122506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.134305 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2669/5366] 10.222.0.15 () {58 vars in 1289 bytes} [Tue Jul 19 11:32:51 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5 => generated 334 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:32:51.140072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.157374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f25f24a-2ae9-4bc0-9fda-95480f2f59c4 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.167149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.169356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `HEAD` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.170052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.170563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.172483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=e73c76d8608a430b83034e3e0e38c1f5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.175648 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.175648 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:51.175648 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:51.177478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.187440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2698/5367] 10.222.0.15 () {58 vars in 1290 bytes} [Tue Jul 19 11:32:51 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5 => generated 0 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Jul 19 11:32:51.192099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.215851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6279047-5a3b-4c64-9d25-6de460cdfad3 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.224934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.226371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.226903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.227403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.228319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e73c76d8608a430b83034e3e0e38c1f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.230064 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.230064 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:32:51.230064 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:32:51.231762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.249131 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2670/5368] 10.222.0.15 () {58 vars in 1292 bytes} [Tue Jul 19 11:32:51 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:51.256523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.278151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec8929-b458-4a0b-aed1-2e5a6022f67a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.296128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.297894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.298417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.298919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.300536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.305914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.321603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2699/5369] 10.222.0.15 () {58 vars in 1190 bytes} [Tue Jul 19 11:32:51 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 450 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:51.327207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.368451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc03733-d8a8-4b06-b669-bff8d9fe68e9 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.385141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.386040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.386730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.386730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.387273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=e73c76d8608a430b83034e3e0e38c1f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.389110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Could not find Endpoint Group: e73c76d8608a430b83034e3e0e38c1f5.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e73c76d8608a430b83034e3e0e38c1f5. Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Jul 19 11:32:51.415731 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Jul 19 11:32:51.416971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Jul 19 11:32:51.416971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Jul 19 11:32:51.416971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Jul 19 11:32:51.416971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Jul 19 11:32:51.416971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: e73c76d8608a430b83034e3e0e38c1f5. Jul 19 11:32:51.416971 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:32:51.419184 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2671/5370] 10.222.0.15 () {58 vars in 1292 bytes} [Tue Jul 19 11:32:51 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/e73c76d8608a430b83034e3e0e38c1f5 => generated 120 bytes in 93 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:32:51.424307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.441071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d762ff7-b406-468a-af4d-53c57f5e1b2f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.450830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.451733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.452006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.452270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services/39236e974ad64e199f2ff46ceeb5e540` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.452986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_service(service_id=39236e974ad64e199f2ff46ceeb5e540)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.454105 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.454105 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:51.454105 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:51.454943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.516245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2700/5371] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:51 2022] DELETE /identity/v3/services/39236e974ad64e199f2ff46ceeb5e540 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:51.524380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.544911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be77d5-1c8a-4abc-836a-a1c27db00c3a tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.581773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.583121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.583620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.584071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.585357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.587153 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.587153 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:32:51.587153 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:32:51.589487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.628326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.638772 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2672/5372] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:51 2022] POST /identity/v3/services => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:51.649736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77360a89-f4bc-4f3c-a31e-194c545b3c13 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.693055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.694225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.694786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.695276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.696365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.697669 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.697669 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:51.697669 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:51.700155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.705932 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:INSERT=8,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:51.730277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.730631 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2701/5373] 10.222.0.15 () {60 vars in 1212 bytes} [Tue Jul 19 11:32:51 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:51.763975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c57e6b-a304-43a0-b2e1-4bc88782e49f tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.770630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.771574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.771990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.772387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.773409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.775276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.796913 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2673/5374] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:51 2022] POST /identity/v3/services => generated 288 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:51.802584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.826216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7edcc6-80a3-425a-b5ff-1a21593d7acf tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.868675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.871284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.871576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.873527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/20ecb56b8bc84806b51450149851a0ef` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.874417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=20ecb56b8bc84806b51450149851a0ef)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.877149 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.877149 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:51.877149 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:51.881056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:51.907866 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2702/5375] 10.222.0.15 () {60 vars in 1312 bytes} [Tue Jul 19 11:32:51 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/20ecb56b8bc84806b51450149851a0ef => generated 335 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:51.913664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:51.921201 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:51.931571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8645d-d72b-4eb6-990b-3af2fe76ca74 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:51.949302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:51.954009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:51.955281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:51.955564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services/883dc6d8841d46cc95fb025900460f7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:51.963368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_service(service_id=883dc6d8841d46cc95fb025900460f7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:51.964782 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:51.964782 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:32:51.964782 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:32:51.966649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:52.033938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2674/5376] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:51 2022] DELETE /identity/v3/services/883dc6d8841d46cc95fb025900460f7a => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:52.039657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:52.055477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bed6399-5abb-4e77-b84c-45e2b5873dc7 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:52.096102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:52.097367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:52.097717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:52.098046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/20ecb56b8bc84806b51450149851a0ef` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:52.098770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=20ecb56b8bc84806b51450149851a0ef)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:52.099873 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:32:52.099873 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:32:52.099873 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:32:52.106572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:52.140796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2703/5377] 10.222.0.15 () {58 vars in 1292 bytes} [Tue Jul 19 11:32:52 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/20ecb56b8bc84806b51450149851a0ef => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:52.142538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:52.165390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece7646d-9dc9-4713-9025-932d75741fcb tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:52.192792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:52.193752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:52.194122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:52.194409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services/e99553f8298243999f37320174ba2c30` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:52.195177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e99553f8298243999f37320174ba2c30)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:52.205674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:52.285634 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2675/5378] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:52 2022] DELETE /identity/v3/services/e99553f8298243999f37320174ba2c30 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:52.291177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:52.313866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267158fe-9b91-49b2-902c-2fa5adf302d8 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:52.365184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:52.368062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:52.368062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:52.368062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/8e66a0688a2147f5bb15dd50ea1db3a0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:52.370318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=8e66a0688a2147f5bb15dd50ea1db3a0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:52.373005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:52.390536 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2704/5379] 10.222.0.15 () {58 vars in 1292 bytes} [Tue Jul 19 11:32:52 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/8e66a0688a2147f5bb15dd50ea1db3a0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:52.395147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:52.432403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e218637-2e98-43ea-bf71-c76039921569 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:52.440755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9628a280-fd8d-4ff1-8b89-e2489b283a82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e844c558908498aa7ec18e272bf1bd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99854c1184304159b05fac5b74b04a0b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:52.442251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a280-fd8d-4ff1-8b89-e2489b283a82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:52.443243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a280-fd8d-4ff1-8b89-e2489b283a82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:52.444299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9628a280-fd8d-4ff1-8b89-e2489b283a82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] PATH_INFO: `/v3/services/e7a1af5bba964e62a0864f433ed5587d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:52.445382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a280-fd8d-4ff1-8b89-e2489b283a82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e7a1af5bba964e62a0864f433ed5587d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:52.448104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9628a280-fd8d-4ff1-8b89-e2489b283a82 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:52.512198 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2676/5380] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:52 2022] DELETE /identity/v3/services/e7a1af5bba964e62a0864f433ed5587d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:52.513863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:52.836678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542586b5-ee22-4cc9-8616-f3b14b130203 tempest-EndPointGroupsTest-1608727750 tempest-EndPointGroupsTest-1608727750-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:52.879166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:52.880696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:52.881107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:52.881553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] PATH_INFO: `/v3/users/c537aa11cf804f8c9f0ff1012c4ead44` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:52.883546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c537aa11cf804f8c9f0ff1012c4ead44)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:52.885950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:52.966089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c537aa11cf804f8c9f0ff1012c4ead44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:52.983637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c537aa11cf804f8c9f0ff1012c4ead44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:53.005393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c537aa11cf804f8c9f0ff1012c4ead44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:53.006636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c537aa11cf804f8c9f0ff1012c4ead44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:53.025192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c537aa11cf804f8c9f0ff1012c4ead44'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:53.027754 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:UPDATE=1,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:53.048930 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2705/5381] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:52 2022] DELETE /identity/v3/users/c537aa11cf804f8c9f0ff1012c4ead44 => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:53.051170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:53.051457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:53.051734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:53.111249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:53.112578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:53.361252 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2677/5382] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:53.427109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:53.430014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:53.579748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:53.583108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:53.761087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d961b-a515-4aca-a77e-91d9ebbd47ee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:53.784323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:53.786288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:53.786580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:53.792808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:53.846744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:53.854193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:53.893436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2161f3-0063-44df-9549-d99339cc7b99 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:53.899622 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2706/5383] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:53.903456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2859bf41ac4f478395b520f8021f0b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38f7c768c9a648638e0e600da661f725', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:53.904334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:53.904883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:53.905286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:53.906341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:53.907357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:53.909348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:53.928407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2678/5384] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:53.933836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:53.952710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a4f39-96d1-475d-948e-cc8ef4524914 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:53.959294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2859bf41ac4f478395b520f8021f0b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38f7c768c9a648638e0e600da661f725', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:53.960617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:53.961225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:53.961976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:53.963254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:53.966439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:54.018196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2707/5385] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:53 2022] POST /identity/v3/projects => generated 348 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:54.022392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:54.040325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85878f0-469b-4d31-9d71-0596df6a8714 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:54.060204 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:54.206340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2859bf41ac4f478395b520f8021f0b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38f7c768c9a648638e0e600da661f725', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:54.206340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:54.206340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:54.207386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:54.207386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:54.207386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:54.208704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:54.251174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2679/5386] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:54.605249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:54.607553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:54.868748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6880e058-d640-43e5-b62c-ccfbe8f9f417 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:54.884467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:54.885160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:54.885451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:54.885735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:54.887701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:54.999251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:55.001985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:55.006493 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:55.029611 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2708/5387] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:56.302459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:56.318739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8e6eb2-b8f7-40d9-a02e-3d19204b0778 tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:56.329237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2859bf41ac4f478395b520f8021f0b48', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38f7c768c9a648638e0e600da661f725', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:56.330136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:56.330422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:56.330701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] PATH_INFO: `/v3/projects/028cbe95d80845f7b19abe78b7f278f2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:56.333362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorizing `identity:delete_project(project_id=028cbe95d80845f7b19abe78b7f278f2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:56.335333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:56.448790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '028cbe95d80845f7b19abe78b7f278f2', 'request_id': 'req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.460626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '028cbe95d80845f7b19abe78b7f278f2', 'request_id': 'req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.467952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '028cbe95d80845f7b19abe78b7f278f2', 'request_id': 'req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.495170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] The token cache is being invalidate because project 028cbe95d80845f7b19abe78b7f278f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:56.495846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.499074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.504937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2680/5388] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:56 2022] DELETE /identity/v3/projects/028cbe95d80845f7b19abe78b7f278f2 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:56.520121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:56.613641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:56.616057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:56.621051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c4f4a-4de2-41c9-b6d8-e177d93a5186 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:56.694341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:56.694972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:56.695260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:56.695538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:56.697803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:56.751360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3b5c4-8c21-4a45-84c9-d1ec6176136f tempest-RoutersAdminTest-1791275601 tempest-RoutersAdminTest-1791275601-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:56.758092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:56.759641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:56.759935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:56.760217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] PATH_INFO: `/v3/projects/d4b9fc2f751843b4a68219311756b43f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:56.761631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4b9fc2f751843b4a68219311756b43f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:56.764711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:56.768615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:56.771987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:56.804060 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2709/5389] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:56.840651 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:56.854166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4b9fc2f751843b4a68219311756b43f', 'request_id': 'req-de722753-0f43-49c7-a678-47adb9b7f84a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.865406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4b9fc2f751843b4a68219311756b43f', 'request_id': 'req-de722753-0f43-49c7-a678-47adb9b7f84a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.879614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4b9fc2f751843b4a68219311756b43f', 'request_id': 'req-de722753-0f43-49c7-a678-47adb9b7f84a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.926058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] The token cache is being invalidate because project d4b9fc2f751843b4a68219311756b43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:56.927119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.927859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:56.937980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:56.938183 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2681/5390] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:56 2022] DELETE /identity/v3/projects/d4b9fc2f751843b4a68219311756b43f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:56.961750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3efbd13-d8dd-472e-9814-cb11a6ac495e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:57.077261 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:57.097973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:57.099046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:57.099415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:57.099729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] PATH_INFO: `/v3/users/4e844c558908498aa7ec18e272bf1bd9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:57.113405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e844c558908498aa7ec18e272bf1bd9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:57.116379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:57.193894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e844c558908498aa7ec18e272bf1bd9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:57.203458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e844c558908498aa7ec18e272bf1bd9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:57.223758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e844c558908498aa7ec18e272bf1bd9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:57.224614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e844c558908498aa7ec18e272bf1bd9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:57.233392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d4f45987-ed50-4270-a91a-f0fcb9210959 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e844c558908498aa7ec18e272bf1bd9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:57.242917 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2710/5391] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:32:56 2022] DELETE /identity/v3/users/4e844c558908498aa7ec18e272bf1bd9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:57.955084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:57.956924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:57.978058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de722753-0f43-49c7-a678-47adb9b7f84a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.075862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.077517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.078038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.078521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] PATH_INFO: `/v3/projects/99854c1184304159b05fac5b74b04a0b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.079996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99854c1184304159b05fac5b74b04a0b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.082079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.162615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99854c1184304159b05fac5b74b04a0b', 'request_id': 'req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:58.172454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99854c1184304159b05fac5b74b04a0b', 'request_id': 'req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:58.180960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99854c1184304159b05fac5b74b04a0b', 'request_id': 'req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:58.203733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] The token cache is being invalidate because project 99854c1184304159b05fac5b74b04a0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:32:58.204000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:58.204958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-17e7e776-b0ee-44cb-9760-6df9bc36bfc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:32:58.210924 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2682/5392] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:32:57 2022] DELETE /identity/v3/projects/99854c1184304159b05fac5b74b04a0b => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:58.214237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.214730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.214839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.257486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:58.258761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:58.347187 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2711/5393] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:32:58.350439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.350904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.351645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.378922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:58.380650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:58.391170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2683/5394] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:58.395379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:58.407309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d28905-32a1-4ad3-8a24-22e5acd6b472 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.413519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.414602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.414602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.414853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.415585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:32:58.415905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.418187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.433240 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2712/5395] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:32:58.438066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:58.460301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd710f-8d99-43fa-a13e-f68836b2d522 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.466697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.467578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.467947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.468202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.469355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.472484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.517102 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2684/5396] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:58 2022] POST /identity/v3/projects => generated 389 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:58.518513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:58.529496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880bf981-6221-4f8e-9325-b2ed9dfa93df admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.616719 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:58.634583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.635611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.636097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.636901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.637700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.641037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.675277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:58.675873 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2713/5397] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:58 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:58.711432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda36caa-4de9-41dc-ba88-8678288a43c7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.718880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.719683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.720043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.720556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.721446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.723273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.740941 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2685/5398] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:58.745564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:58.761892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cfc11-7f1f-481f-a9c3-06890ef21ba0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.782581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953a508-98cb-4c39-9772-18697cf703b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.784213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953a508-98cb-4c39-9772-18697cf703b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.785238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953a508-98cb-4c39-9772-18697cf703b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.785858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953a508-98cb-4c39-9772-18697cf703b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.786837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953a508-98cb-4c39-9772-18697cf703b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.789428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953a508-98cb-4c39-9772-18697cf703b7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.809837 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2714/5399] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:58.810849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:58.822273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd75ada1-5e20-41d1-971e-7ba035216726 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:58.828002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:58.829810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.830106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.830391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] PATH_INFO: `/v3/projects/c59ac56cabe84495a6972713fb37e2f3/users/ed75c55846d9490fb03ca660538bb6e1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.849038 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:58.853918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c59ac56cabe84495a6972713fb37e2f3, user_id=ed75c55846d9490fb03ca660538bb6e1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:58.871107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:58.891724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2686/5400] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:58 2022] PUT /identity/v3/projects/c59ac56cabe84495a6972713fb37e2f3/users/ed75c55846d9490fb03ca660538bb6e1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:58.902419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:58.902741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:58.903133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:58.934457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] MFA Rules not processed for user `ed75c55846d9490fb03ca660538bb6e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:58.935691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:59.046000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2715/5401] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:59.058106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.158595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43b068-b0e1-4b51-b7ef-f12bb251929c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.167787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.169254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.169254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.169254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.170142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.173171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.222234 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2687/5402] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:32:59 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:59.222935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.244852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c86e5-4d40-4247-8e97-33a5df16bfe7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.284244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.286886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:59.368447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.369261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.369614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.370079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.371809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.374900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.397940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753358f-d1c0-4a7c-8411-9b6c1f627cbf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.403927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.404948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.405235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.405738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.407973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:59.412153 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2716/5403] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:32:59 2022] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:32:59.416221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.429494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d0a764-97bd-45d1-bbe3-54ba6e2d4b39 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.436971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.438585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.439045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.441946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.442998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.445369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.460782 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2717/5404] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:59.467142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.484441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296c942-e709-41cc-aa6b-d2e598fdb846 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.490327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.491380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.491813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.492164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] PATH_INFO: `/v3/projects/9d711798e8574b5e933616423ffbeab6/users/c62133a10e9e434da5e29f3b91a97e90/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.519203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d711798e8574b5e933616423ffbeab6, user_id=c62133a10e9e434da5e29f3b91a97e90, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.524175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.538576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.540521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.543768 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2718/5405] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:59 2022] PUT /identity/v3/projects/9d711798e8574b5e933616423ffbeab6/users/c62133a10e9e434da5e29f3b91a97e90/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:32:59.548665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.583583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2688/5406] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:32:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:32:59.588567 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:32:59.657912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f563f-d6a4-4260-b7c1-5652dbbd3ac6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.666097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b386d3-9fab-412c-81f1-1db3108aa7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.666980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b386d3-9fab-412c-81f1-1db3108aa7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.667358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b386d3-9fab-412c-81f1-1db3108aa7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.668076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b386d3-9fab-412c-81f1-1db3108aa7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.671169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b386d3-9fab-412c-81f1-1db3108aa7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.674074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b386d3-9fab-412c-81f1-1db3108aa7cc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.708749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2719/5407] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:32:59.713864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.740911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ad58c-3ddf-4ccf-8a49-b1ee4accdb08 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.755603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.756591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.756878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.757157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] PATH_INFO: `/v3/projects/9d711798e8574b5e933616423ffbeab6/users/c62133a10e9e434da5e29f3b91a97e90/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.761850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d711798e8574b5e933616423ffbeab6, user_id=c62133a10e9e434da5e29f3b91a97e90, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.767692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.785805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2689/5408] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:32:59 2022] PUT /identity/v3/projects/9d711798e8574b5e933616423ffbeab6/users/c62133a10e9e434da5e29f3b91a97e90/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:32:59.797461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.797887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.798233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.833703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] MFA Rules not processed for user `c62133a10e9e434da5e29f3b91a97e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:32:59.835011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:32:59.921551 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2720/5409] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:32:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:32:59.933108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.944715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5794dc48-0ca8-4e20-be82-40eab0d3fc9f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.950238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.951387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.951770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.952119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects/c59ac56cabe84495a6972713fb37e2f3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.953509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:get_project(project_id=c59ac56cabe84495a6972713fb37e2f3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.955712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:32:59.957863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2690/5410] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:32:59 2022] GET /identity/v3/projects/c59ac56cabe84495a6972713fb37e2f3 => generated 389 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:32:59.963064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:32:59.976758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9647d39-ea1b-4928-b6fc-ca39bad36553 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:32:59.986429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:32:59.987718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:32:59.987718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:32:59.990358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:32:59.994628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:32:59.999437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.083642 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2721/5411] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:32:59 2022] POST /identity/v3/projects => generated 339 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:00.088180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.097532 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:00.104562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57e099b-e378-4d68-9ec0-71ade070fce1 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.197770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.198513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.198806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.199087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.199929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.201148 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:33:00.201148 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:33:00.201148 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:33:00.202302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.235075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2691/5412] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects => generated 7324 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:00.236660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.312284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666ed792-ac59-40bb-8ff7-2d3f349c7836 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.317565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.331634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.331812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.332094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects/c59ac56cabe84495a6972713fb37e2f3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.334238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:get_project(project_id=c59ac56cabe84495a6972713fb37e2f3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.337258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.343109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2722/5413] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects/c59ac56cabe84495a6972713fb37e2f3 => generated 389 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:00.344784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.359103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22496462-8fb1-47e5-9a5f-3608bd51bce2 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.367173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.368753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.369391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.370256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects/39b630569a7f493f864b018dec8c7249` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.371949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:get_project(project_id=39b630569a7f493f864b018dec8c7249)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.374367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.383114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.392404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2692/5414] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects/39b630569a7f493f864b018dec8c7249 => generated 339 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:00.398213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fc7f13-f220-4c21-82dd-270d752ab67d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.405081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.406088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.406772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.407297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.408300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.410507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.438312 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2723/5415] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects => generated 7324 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:00.447843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.462751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7abcd0-70da-4c50-be67-e6e207d40d0b tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.478443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.479647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.480588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.481758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.483702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:00.484326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.486568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.517551 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2693/5416] 10.222.0.15 () {58 vars in 1165 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects?domain_id=default => generated 6993 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:00.521930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.533211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee14665-e9fb-48d7-9b9e-b20fd7d5eaf0 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.539831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.541076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.541299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.541752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.542587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.544858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.568667 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2724/5417] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects => generated 7324 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:00.573887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.584799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e03b7b-8962-48f9-b36b-9e191822f34d tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.593072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.594056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.594962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.594962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.596305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:00.596305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.601114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.650975 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2694/5418] 10.222.0.15 () {58 vars in 1165 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects?domain_id=default => generated 6993 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:00.651624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.686664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bb134-5a5b-4468-be70-dd002aca6195 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.695057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.696881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.697512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.698070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.699220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.702973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.751690 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2725/5419] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects => generated 7324 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:00.757620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.772143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f515934-f415-4d87-8b47-f92ce5163c05 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.782551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.783330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.783644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.784223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.785123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1668213908) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:00.785481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.787820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.816086 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2695/5420] 10.222.0.15 () {58 vars in 1231 bytes} [Tue Jul 19 11:33:00 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1668213908 => generated 537 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:00.821970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:00.837068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025562de-6682-43ba-92e3-2809a9e7d3cc tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:00.845140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c62133a10e9e434da5e29f3b91a97e90', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d711798e8574b5e933616423ffbeab6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:00.849027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:00.856632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:00.858034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] PATH_INFO: `/v3/projects/39b630569a7f493f864b018dec8c7249` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:00.860282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorizing `identity:delete_project(project_id=39b630569a7f493f864b018dec8c7249)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:00.862853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:00.938003 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:00.967473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b630569a7f493f864b018dec8c7249', 'request_id': 'req-705c5397-4c11-4c2a-9684-4033e5769f24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:00.987550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b630569a7f493f864b018dec8c7249', 'request_id': 'req-705c5397-4c11-4c2a-9684-4033e5769f24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:00.998631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b630569a7f493f864b018dec8c7249', 'request_id': 'req-705c5397-4c11-4c2a-9684-4033e5769f24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.020998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] The token cache is being invalidate because project 39b630569a7f493f864b018dec8c7249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:01.022018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.023197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-705c5397-4c11-4c2a-9684-4033e5769f24 tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.032509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2726/5421] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:00 2022] DELETE /identity/v3/projects/39b630569a7f493f864b018dec8c7249 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:01.032784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:01.034823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:01.150242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe963d-084d-4c3d-b864-c171c3c2100a tempest-ListProjectsStaticTestJSON-855986374 tempest-ListProjectsStaticTestJSON-855986374-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:01.266245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:01.267440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:01.267899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:01.268185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] PATH_INFO: `/v3/users/ed75c55846d9490fb03ca660538bb6e1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:01.269700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed75c55846d9490fb03ca660538bb6e1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:01.272032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:01.275023 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:01.331609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed75c55846d9490fb03ca660538bb6e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.333054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed75c55846d9490fb03ca660538bb6e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.343985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed75c55846d9490fb03ca660538bb6e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.344684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed75c55846d9490fb03ca660538bb6e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.364989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed75c55846d9490fb03ca660538bb6e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:01.388123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2696/5422] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:01 2022] DELETE /identity/v3/users/ed75c55846d9490fb03ca660538bb6e1 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:01.392275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e2b3-3889-46dc-93aa-0a2ac2818c5b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:01.392831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e2b3-3889-46dc-93aa-0a2ac2818c5b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:01.392933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e2e2b3-3889-46dc-93aa-0a2ac2818c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:01.415406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-92e2e2b3-3889-46dc-93aa-0a2ac2818c5b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:01.416771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-92e2e2b3-3889-46dc-93aa-0a2ac2818c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:01.481560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2727/5423] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:01.503616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:01.509860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:01.602851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba2baca-68ef-4a64-b40c-cfd974750625 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:01.606995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:01.607903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:01.608303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:01.609654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:01.627899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:01.630631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:01.660947 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2697/5424] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:01.936820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:01.937256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:01.938129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:01.942980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:01.944930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.058016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:02.063817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.139196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fa27d6-3e28-48b3-830b-428b67bef7d7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.149486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.150759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.151476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.151845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.155441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.187208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:02.197321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:02.223722 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2698/5425] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:33:02.226673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:02.229095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.230061 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2728/5426] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:33:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:02.242682 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:02.248008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:02.249167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d415df-832b-44a7-ba12-1542c40e04e4 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.249853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.259683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.264467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.266433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.267519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] PATH_INFO: `/v3/users/e16017620f454c5194f11f12736e0011` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.274485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e16017620f454c5194f11f12736e0011)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:02.277437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:02.348726 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:02.420952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e16017620f454c5194f11f12736e0011'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:02.423135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e16017620f454c5194f11f12736e0011'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:02.435700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc76cbd-7c9e-47ea-a96b-c2a0dab159da None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.441128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e16017620f454c5194f11f12736e0011'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:02.443191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e16017620f454c5194f11f12736e0011'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:02.443951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.444776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.445067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.445681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.448302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.461024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e16017620f454c5194f11f12736e0011'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:02.470407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:02.478670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0fb6a-07ab-4f5a-a834-b8f5715a8bac service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:02.497144 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2729/5427] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:33:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:33:02.523619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2699/5428] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:02 2022] DELETE /identity/v3/users/e16017620f454c5194f11f12736e0011 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:02.532426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.532693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.532982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:02.594548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:02.596129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.773053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2730/5429] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:02.806927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:02.809012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:02.962936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a661c3-26e6-468a-ae11-97fd77a53117 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:02.972153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:02.973129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:02.973459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:02.973746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:03.001863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:03.003554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:03.028096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2700/5430] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:03.406255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:03.408012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:03.430058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46862a2f-0cdb-45c7-8665-b5125f83bf76 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:03.445447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:03.447237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:03.447520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:03.447807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] PATH_INFO: `/v3/projects/c59ac56cabe84495a6972713fb37e2f3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:03.449740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c59ac56cabe84495a6972713fb37e2f3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:03.452240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:03.534546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c59ac56cabe84495a6972713fb37e2f3', 'request_id': 'req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.551175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c59ac56cabe84495a6972713fb37e2f3', 'request_id': 'req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.565726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c59ac56cabe84495a6972713fb37e2f3', 'request_id': 'req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.581236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] The token cache is being invalidate because project c59ac56cabe84495a6972713fb37e2f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:03.582591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.583389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.590382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2731/5431] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:03 2022] DELETE /identity/v3/projects/c59ac56cabe84495a6972713fb37e2f3 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:03.591925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:03.605896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94594c-b412-44c4-b30e-d5b4ca76c59c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:03.705901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:03.706901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:03.707263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:03.707620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] PATH_INFO: `/v3/users/c62133a10e9e434da5e29f3b91a97e90` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:03.709103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c62133a10e9e434da5e29f3b91a97e90)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:03.712363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:03.750960 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:03.807735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c62133a10e9e434da5e29f3b91a97e90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.808527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c62133a10e9e434da5e29f3b91a97e90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.829093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c62133a10e9e434da5e29f3b91a97e90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.829755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c62133a10e9e434da5e29f3b91a97e90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.842334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fe3e134f-7cc6-4f2a-95f4-cb3be71c9e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c62133a10e9e434da5e29f3b91a97e90'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:03.857033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:03.858482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:03.881168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c719946d-b3a9-44ca-b1f1-ae51b5250d6e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:03.890346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:03.892130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:03.892651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:03.894137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] PATH_INFO: `/v3/projects/7923e556ad6e4e129950789d08085d5d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:03.897031 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2701/5432] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:03 2022] DELETE /identity/v3/users/c62133a10e9e434da5e29f3b91a97e90 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:03.897993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7923e556ad6e4e129950789d08085d5d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:03.901256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.020403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7923e556ad6e4e129950789d08085d5d', 'request_id': 'req-7f3323ba-8374-4010-8ed0-e8619d4d3408'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:04.028712 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:04.039053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7923e556ad6e4e129950789d08085d5d', 'request_id': 'req-7f3323ba-8374-4010-8ed0-e8619d4d3408'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:04.053390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7923e556ad6e4e129950789d08085d5d', 'request_id': 'req-7f3323ba-8374-4010-8ed0-e8619d4d3408'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:04.083973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] The token cache is being invalidate because project 7923e556ad6e4e129950789d08085d5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:04.084538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:04.085606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7f3323ba-8374-4010-8ed0-e8619d4d3408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:04.093611 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2732/5433] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:03 2022] DELETE /identity/v3/projects/7923e556ad6e4e129950789d08085d5d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:04.094851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.096684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.096684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.124928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:04.127041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:04.228153 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2702/5434] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:04.231501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.232669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.233186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.262651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:04.266476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:04.286687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:04.287069 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2733/5435] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:04.300774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da80f32-44fb-4f1a-82fb-ef284106b6ae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:04.306651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:04.307492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.308684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.308684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.309372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:04.309768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:04.312061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.326870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2703/5436] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:04.332143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:04.348704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35a815-a83c-45d0-8d10-c2e42492e9a0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:04.355738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:04.357004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.357004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.357497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.359125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:04.365194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.447850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:04.447989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2734/5437] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:04 2022] POST /identity/v3/projects => generated 361 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:04.486285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92162cd-f182-43d3-b237-d1a968f35119 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:04.646818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:04.648541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.648905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.649256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.650071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:04.652465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.690433 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2704/5438] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:04 2022] POST /identity/v3/users => generated 281 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:04.693956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:04.708505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24633b5-0771-41ac-86da-c2999c3c7951 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:04.713969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:04.714996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.715338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.715822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.716826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:04.718893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.735734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2735/5439] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:04.736872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:04.755339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54d625-c3f0-4638-af6a-38a8b77ebfe9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:04.764131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664bf28-e6d1-4541-a0bd-042e0e5037af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:04.764957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664bf28-e6d1-4541-a0bd-042e0e5037af admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.766056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664bf28-e6d1-4541-a0bd-042e0e5037af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.766056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664bf28-e6d1-4541-a0bd-042e0e5037af admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.767257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664bf28-e6d1-4541-a0bd-042e0e5037af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:04.769141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664bf28-e6d1-4541-a0bd-042e0e5037af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.798948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:04.804448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2705/5440] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:33:04.812721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5f4ea5-97ce-4918-bb73-bc62aa760553 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:04.819148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:04.821375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.821836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.822267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] PATH_INFO: `/v3/projects/23dcb297a79843598037b362676558a4/users/58f678771a2345d4b2d1efab22062b92/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.847854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=23dcb297a79843598037b362676558a4, user_id=58f678771a2345d4b2d1efab22062b92, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:04.852031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:04.874420 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2736/5441] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:04 2022] PUT /identity/v3/projects/23dcb297a79843598037b362676558a4/users/58f678771a2345d4b2d1efab22062b92/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:04.885747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:04.886180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:04.886477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:04.893944 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:04.930420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] MFA Rules not processed for user `58f678771a2345d4b2d1efab22062b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:04.931761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:05.031841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2706/5442] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:05.091607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.093837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:05.121314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.127364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:05.226530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475a3801-0ba0-4ea0-8d66-bbcc517178ec None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.239147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.240228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.240524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.240807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] PATH_INFO: `/v3/projects/9d711798e8574b5e933616423ffbeab6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.242091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d711798e8574b5e933616423ffbeab6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.246905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:05.265330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e65e8-b0a5-4137-956a-5693bb440dad admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.272063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d5d94c-3012-4deb-9c56-0b58f0462f07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.273496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d94c-3012-4deb-9c56-0b58f0462f07 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.274183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d94c-3012-4deb-9c56-0b58f0462f07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.274659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d5d94c-3012-4deb-9c56-0b58f0462f07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.292689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5d94c-3012-4deb-9c56-0b58f0462f07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.294572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d5d94c-3012-4deb-9c56-0b58f0462f07 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:05.306552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2737/5443] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:05 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:05.330574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d711798e8574b5e933616423ffbeab6', 'request_id': 'req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:05.340294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d711798e8574b5e933616423ffbeab6', 'request_id': 'req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:05.359485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d711798e8574b5e933616423ffbeab6', 'request_id': 'req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:05.383178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] The token cache is being invalidate because project 9d711798e8574b5e933616423ffbeab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:05.383557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:05.384302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ca66ddc-645e-47f2-8bf8-ea63af1ada10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:05.393128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.393586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.393949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.396001 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2707/5444] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:05 2022] DELETE /identity/v3/projects/9d711798e8574b5e933616423ffbeab6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:05.417785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:05.419289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:05.512689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.513305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.513684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.515676 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2738/5445] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:05.537256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:05.539222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:05.553721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.561883 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2708/5446] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:05.568746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba620987-9ec3-4939-b6ac-d4dc9437a5ab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.575200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.576188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.576756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.577237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.578290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:05.579191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.581006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:05.603150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2739/5447] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:05.609331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.624752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b9dd-4b80-4a76-8384-87a390d84b7f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.631029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.631821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.632164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.632535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.633299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.635439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:05.662332 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:05.690588 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2709/5448] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:05 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:05.703048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.715489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb245df-1ebc-4417-96ba-17252a2b44f0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.722496 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:05.838722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.839514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.839930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.840297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.841202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.843858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:05.879775 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2740/5449] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:05 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:05.884832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.929701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59405a2-66e2-4d5a-b55c-e3bbd0b2d975 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.942281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.942992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.943271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.943559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.945960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.949196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:05.969292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2710/5450] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:05.973469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:05.987247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe03082-5c57-4602-8d84-f7103d7ff384 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:05.994239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc8016-65a7-49b5-8ae3-e9294bddaa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:05.995046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8016-65a7-49b5-8ae3-e9294bddaa5f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:05.995822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8016-65a7-49b5-8ae3-e9294bddaa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:05.995822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc8016-65a7-49b5-8ae3-e9294bddaa5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:05.996774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc8016-65a7-49b5-8ae3-e9294bddaa5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:05.998869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc8016-65a7-49b5-8ae3-e9294bddaa5f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:06.022982 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2741/5451] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:06.032996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:06.057405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828b617-b0f1-4a49-be9f-9a571692786c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:06.070782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:06.071538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:06.071916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:06.072289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] PATH_INFO: `/v3/projects/0d0f64395de34555940c1d8d83decf7b/users/26209bb1064743a2bc57be3033a6f958/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:06.103308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d0f64395de34555940c1d8d83decf7b, user_id=26209bb1064743a2bc57be3033a6f958, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:06.106460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:06.125032 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2711/5452] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:06 2022] PUT /identity/v3/projects/0d0f64395de34555940c1d8d83decf7b/users/26209bb1064743a2bc57be3033a6f958/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:06.136707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:06.137090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:06.137381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:06.175790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] MFA Rules not processed for user `26209bb1064743a2bc57be3033a6f958`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:06.177368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:06.322882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2742/5453] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:06.327603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:06.452512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3018ff7-6eb5-4fa7-96d0-a5d748f39455 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:06.467981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:06.468720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:06.469012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:06.469286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:06.470006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:06.472164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:06.513459 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2712/5454] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:06 2022] POST /identity/v3/projects => generated 369 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:06.517497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:06.538082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dec371-8f65-4fe9-a0af-609e7dc2bb3f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:06.646409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:06.650897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:06.651312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:06.651951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:06.652863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:06.656243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:06.710125 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2743/5455] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:06 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:06.711823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:06.730160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcd52c3-5275-49ad-8e68-6b27fc904f22 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:06.744897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:06.746793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:06.748000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:06.748651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:06.749678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:06.751966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:06.799378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2713/5456] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:06.808005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:06.819891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de90f2-6ddf-4e9a-a6d6-b0fa5cc22dc9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:06.837324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:06.838474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:06.838858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:06.839236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] PATH_INFO: `/v3/projects/60fd67e2590d44c1841c53ac25c97839/users/25a8f4a77baa4cabbd3cfceefb432a1a/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:06.847251 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:06.879323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fd67e2590d44c1841c53ac25c97839, user_id=25a8f4a77baa4cabbd3cfceefb432a1a, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:06.883276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:06.920060 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2744/5457] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:06 2022] PUT /identity/v3/projects/60fd67e2590d44c1841c53ac25c97839/users/25a8f4a77baa4cabbd3cfceefb432a1a/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:06.921237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:06.932434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556dcd9-3588-4c31-9cd0-0b7bebbcf05d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.023559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4777f73-0539-4cde-a6e9-4ec57d07d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.024979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777f73-0539-4cde-a6e9-4ec57d07d712 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.025588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777f73-0539-4cde-a6e9-4ec57d07d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.026023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4777f73-0539-4cde-a6e9-4ec57d07d712 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.029229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4777f73-0539-4cde-a6e9-4ec57d07d712 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.032828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4777f73-0539-4cde-a6e9-4ec57d07d712 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.055369 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2714/5458] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:33:07.060222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.098672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e1c9e-e152-4de6-b2da-7747658bb9cf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.104891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.106320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.106320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.106560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] PATH_INFO: `/v3/projects/60fd67e2590d44c1841c53ac25c97839/users/25a8f4a77baa4cabbd3cfceefb432a1a/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.108606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=60fd67e2590d44c1841c53ac25c97839, user_id=25a8f4a77baa4cabbd3cfceefb432a1a, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.111381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.126863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2745/5459] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:07 2022] PUT /identity/v3/projects/60fd67e2590d44c1841c53ac25c97839/users/25a8f4a77baa4cabbd3cfceefb432a1a/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:07.139169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.139945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.140177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.182844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] MFA Rules not processed for user `25a8f4a77baa4cabbd3cfceefb432a1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:07.184335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:07.206511 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:07.277350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.280268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:07.292725 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2715/5460] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:07.298418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.310838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e265d3-6737-4549-9a91-3c796ade2ff4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.317187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.318666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.319099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.319636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.320715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.322671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.343144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2716/5461] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:33:07 2022] POST /identity/v3/services => generated 238 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:07.344609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.369698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddec16c-e053-4de1-9060-7cf740921a52 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.369937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ed68-c34d-42e7-8f0f-96b36bef0a0a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.375640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.376777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.377171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.377551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/a9fe8d6e20db474aab483970a35166e3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.378340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a9fe8d6e20db474aab483970a35166e3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.380107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.387732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.388858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.389509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.389785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] PATH_INFO: `/v3/users/599dab32ff524b028851a6df2f9c5b33` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.391075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] RBAC: Authorizing `identity:delete_user(user_id=599dab32ff524b028851a6df2f9c5b33)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.393825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.407516 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2717/5462] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:07 2022] DELETE /identity/v3/services/a9fe8d6e20db474aab483970a35166e3 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:07.412408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.436730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fc1f3-214e-498b-9423-ce9a30eeeecd tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.441973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.442821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.443217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.443602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.444482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.446251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.456377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '599dab32ff524b028851a6df2f9c5b33'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.463709 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2718/5463] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:07 2022] POST /identity/v3/services => generated 287 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:07.468572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.470052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '599dab32ff524b028851a6df2f9c5b33'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.487387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '599dab32ff524b028851a6df2f9c5b33'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.488188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '599dab32ff524b028851a6df2f9c5b33'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.494255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b5263-76cf-4e3e-bc46-e8ccc81a520d tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.496804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '599dab32ff524b028851a6df2f9c5b33'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.499349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.500493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.500853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.501285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/778a9339c6cb4dda85b365f7956ecaab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.502010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:update_service(service_id=778a9339c6cb4dda85b365f7956ecaab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.503111 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:33:07.503111 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:33:07.503111 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:33:07.504224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.504724 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2746/5464] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:07 2022] DELETE /identity/v3/users/599dab32ff524b028851a6df2f9c5b33 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:07.528415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2719/5465] 10.222.0.15 () {60 vars in 1251 bytes} [Tue Jul 19 11:33:07 2022] PATCH /identity/v3/services/778a9339c6cb4dda85b365f7956ecaab => generated 281 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:07.531996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.533631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:07.582650 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:07.619264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b200e0-0574-4061-a37e-58faeb5703df admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.635741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.636735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.637054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.637335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/778a9339c6cb4dda85b365f7956ecaab` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.638005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:get_service(service_id=778a9339c6cb4dda85b365f7956ecaab)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.639035 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:33:07.639035 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:33:07.639035 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:33:07.639929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.650054 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2747/5466] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:33:07 2022] GET /identity/v3/services/778a9339c6cb4dda85b365f7956ecaab => generated 281 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:07.651428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.662935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee31f0e-0be0-4ba3-bbe2-6ba1e697f84c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.668088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.669107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.669502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.669889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/778a9339c6cb4dda85b365f7956ecaab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.670662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:delete_service(service_id=778a9339c6cb4dda85b365f7956ecaab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.672815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.702430 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2720/5467] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:07 2022] DELETE /identity/v3/services/778a9339c6cb4dda85b365f7956ecaab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:07.707286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.718837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.721301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:07.725598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea1ff3d-acda-488f-a743-ad2fb1d39208 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.754939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.755831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.756694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.756990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/778a9339c6cb4dda85b365f7956ecaab` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.757808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:get_service(service_id=778a9339c6cb4dda85b365f7956ecaab)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.761539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Could not find service: 778a9339c6cb4dda85b365f7956ecaab.: keystone.exception.ServiceNotFound: Could not find service: 778a9339c6cb4dda85b365f7956ecaab. Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 778a9339c6cb4dda85b365f7956ecaab. Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:33:07.778468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:33:07.779640 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: 778a9339c6cb4dda85b365f7956ecaab. Jul 19 11:33:07.781466 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:33:07.785275 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2748/5468] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:33:07 2022] GET /identity/v3/services/778a9339c6cb4dda85b365f7956ecaab => generated 113 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:33:07.785799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.797257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ec9e-9204-4c47-82b6-cd6933475c79 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.802233 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:07.802713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.806127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.806127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.806127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.806127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.806796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.831605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaee34-51d5-4ef2-bfc2-5b9afe22f76f tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.838150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2749/5469] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:07 2022] POST /identity/v3/services => generated 274 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:07.840043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.858008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.859314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.859813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.860383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] PATH_INFO: `/v3/projects/5f2c76f9f4434f35b32277a0b69e312b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.861967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f2c76f9f4434f35b32277a0b69e312b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.864284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.870830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8612b2a0-b310-4ffa-b3be-37e0b6231a1e tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.876083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:07.877589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:07.878134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:07.878550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:07.880087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:07.882600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:07.910513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2750/5470] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:07 2022] POST /identity/v3/services => generated 273 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:07.911502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:07.948304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f3386-99a5-4baa-8375-67a7858c7e41 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:07.948528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f2c76f9f4434f35b32277a0b69e312b', 'request_id': 'req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.958510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f2c76f9f4434f35b32277a0b69e312b', 'request_id': 'req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.967540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f2c76f9f4434f35b32277a0b69e312b', 'request_id': 'req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.994537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] The token cache is being invalidate because project 5f2c76f9f4434f35b32277a0b69e312b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:07.994902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:07.999519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5beb5197-bd62-4c30-b2c2-0d7dc1a7c4e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:08.001710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2721/5471] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:07 2022] DELETE /identity/v3/projects/5f2c76f9f4434f35b32277a0b69e312b => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:08.011898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b4df-12b7-4e69-89f4-22c57c36cbaf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.012188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b4df-12b7-4e69-89f4-22c57c36cbaf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.018422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5b4df-12b7-4e69-89f4-22c57c36cbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.040225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.041475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.041835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.042174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.043144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.044826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.063000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2fe5b4df-12b7-4e69-89f4-22c57c36cbaf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:08.064262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fe5b4df-12b7-4e69-89f4-22c57c36cbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:08.075262 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2751/5472] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:07 2022] POST /identity/v3/services => generated 274 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:08.076758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.080099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:08.110319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffccca25-72ba-4e1b-a0fa-c2a55c618a04 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.117346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.118173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.118761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.120042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.120940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.122484 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:33:08.122484 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:33:08.122484 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:33:08.124116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.139451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2752/5473] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/services => generated 2976 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:08.141844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.155778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd6419-8969-431a-949a-28566eb0eae3 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.163666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.164669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.165177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.165668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.166500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-581123683) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:08.166972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.172394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2722/5474] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:08 2022] POST /identity/v3/auth/tokens => generated 3729 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:08.172584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.176689 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2753/5475] 10.222.0.15 () {58 vars in 1219 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-581123683 => generated 416 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:08.178116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.178430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.178720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.180872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.197037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5991722-acd9-4f4e-80d4-51fb782870b5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.203705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:08.205007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:08.206773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.208135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.208622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.209068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.210102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-666389531) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:08.210887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.213109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.218461 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2723/5476] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:08 2022] POST /identity/v3/auth/tokens => generated 3729 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:08.219504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.234031 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2754/5477] 10.222.0.15 () {58 vars in 1219 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-666389531 => generated 415 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:08.234317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a62a95-bbbb-4341-992b-2a12fbc579df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.236979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.242390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.243471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.243922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.244814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.245137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:08.245784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.247683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.258227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7926dc-c634-4f1f-943e-39c4d00f46a5 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.264458 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2724/5478] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:08.268904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.269489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.270670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.271143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.271605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.272575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-189085218) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:08.273250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.276773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.284043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d31422-33ec-41b3-8d11-6c303402d94b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.291215 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2755/5479] 10.222.0.15 () {58 vars in 1219 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-189085218 => generated 416 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:08.291465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.292825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.293591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.293944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.294372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.295645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.300105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.327672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a953034-aa07-4bd9-99e3-9007a74e3c8a tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.336046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.337872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.338286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.338669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/341532a04641410b8d9109b01a34e185` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.339490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:delete_service(service_id=341532a04641410b8d9109b01a34e185)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.342712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.362663 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:08.380856 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2725/5480] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:08 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:08.381955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.397304 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2756/5481] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:08 2022] DELETE /identity/v3/services/341532a04641410b8d9109b01a34e185 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:08.402579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.431185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967643f-c5c0-4b98-8640-ce48d9a5d8ba tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.447814 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:08.506951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.509088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.509548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.509892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/2a218333f21843c998e4276f786d3ac9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.510682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:delete_service(service_id=2a218333f21843c998e4276f786d3ac9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.512603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.533418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526a1edb-9c7a-4e87-bceb-1a41d96e4975 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.555473 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2757/5482] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:08 2022] DELETE /identity/v3/services/2a218333f21843c998e4276f786d3ac9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:08.556761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.557204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.557640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.557956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.558359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.559514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.562134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.597900 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2726/5483] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:08 2022] POST /identity/v3/users => generated 291 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:08.599148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.606919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deff4eaf-c58e-470a-b8d2-bfb03f86ce7c tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.613886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17933ec4-b718-45b1-a7bc-ebc5b9c6c9d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.621425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '25a8f4a77baa4cabbd3cfceefb432a1a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60fd67e2590d44c1841c53ac25c97839', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.622319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.622606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.622871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] PATH_INFO: `/v3/services/3e2545a94d1546c18e0da0e07bdc6a6b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.623553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorizing `identity:delete_service(service_id=3e2545a94d1546c18e0da0e07bdc6a6b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.625225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.642283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.643560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.644055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.644329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.645644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.646767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.667640 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2758/5484] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:08 2022] DELETE /identity/v3/services/3e2545a94d1546c18e0da0e07bdc6a6b => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:08.674124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2727/5485] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:08.674450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.675187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.676478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:08.688030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2628b0f1-8239-42f2-9d49-a6d2a93ec9ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.720606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd621eb-4849-47d3-a90e-e9108c1aebb2 tempest-ServicesTestJSON-1635408424 tempest-ServicesTestJSON-1635408424-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.722848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.723780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.724666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.724966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.726503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.728048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.728355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.728649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] PATH_INFO: `/v3/users/26209bb1064743a2bc57be3033a6f958` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.729556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.730194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26209bb1064743a2bc57be3033a6f958)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.731361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.732456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.762066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2728/5486] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:08.770103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:08.832731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9763ba2-7a14-47ca-b0bf-da424457b7a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:08.837299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26209bb1064743a2bc57be3033a6f958'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:08.853874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2ef9ca-2a5a-480e-9ec1-1cf897584835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:08.855935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ef9ca-2a5a-480e-9ec1-1cf897584835 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.856267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ef9ca-2a5a-480e-9ec1-1cf897584835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.856666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2ef9ca-2a5a-480e-9ec1-1cf897584835 admin admin] PATH_INFO: `/v3/projects/13ade64c602047c9a96b22734e65caa1/users/77d6c3c9aa554c4495312c6040afb4d5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.857479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26209bb1064743a2bc57be3033a6f958'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:08.884128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26209bb1064743a2bc57be3033a6f958'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:08.888958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26209bb1064743a2bc57be3033a6f958'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:08.908233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a09a99f-0ba7-434f-9e85-29f50a731b9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26209bb1064743a2bc57be3033a6f958'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:08.910854 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:08.915582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ef9ca-2a5a-480e-9ec1-1cf897584835 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13ade64c602047c9a96b22734e65caa1, user_id=77d6c3c9aa554c4495312c6040afb4d5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:08.918445 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2759/5487] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:08 2022] DELETE /identity/v3/users/26209bb1064743a2bc57be3033a6f958 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:08.922238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2ef9ca-2a5a-480e-9ec1-1cf897584835 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:08.923465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.923817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.924052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.954002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2729/5488] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:08 2022] PUT /identity/v3/projects/13ade64c602047c9a96b22734e65caa1/users/77d6c3c9aa554c4495312c6040afb4d5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:08.963825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:08.964663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:08.965231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:08.965623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:08.966840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:08.992493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:08.993914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:09.090886 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2730/5489] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:09.101622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:09.104083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:09.105841 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2760/5490] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:09.121899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:09.123215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:09.218806 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:09.266262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af1672-43c4-46b5-8993-1d9e48feb6ce None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:09.270173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:09.270483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7a53fe-61d4-42a4-aafb-fd5048319d1f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:09.270853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:09.271141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:09.271416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:09.283311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:09.284000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:09.284307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:09.284581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:09.288872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:09.290441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:09.304283 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2761/5491] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:09.306858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:09.309619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:09.322600 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2731/5492] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:11.060752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:11.064894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:11.106903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab3f944-0a45-4653-bf46-0a435d2283d1 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:11.121356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:11.125146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:11.125471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:11.126713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] PATH_INFO: `/v3/projects/0d0f64395de34555940c1d8d83decf7b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:11.129759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d0f64395de34555940c1d8d83decf7b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:11.138875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:11.260924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d0f64395de34555940c1d8d83decf7b', 'request_id': 'req-d1f93d4f-5b7f-4075-a143-480a113db9c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.280505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d0f64395de34555940c1d8d83decf7b', 'request_id': 'req-d1f93d4f-5b7f-4075-a143-480a113db9c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.291295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d0f64395de34555940c1d8d83decf7b', 'request_id': 'req-d1f93d4f-5b7f-4075-a143-480a113db9c9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.315544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] The token cache is being invalidate because project 0d0f64395de34555940c1d8d83decf7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:11.315843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.320548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.325997 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2762/5493] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:11 2022] DELETE /identity/v3/projects/0d0f64395de34555940c1d8d83decf7b => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:11.330110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:11.342762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3e16e-13d0-4217-aa34-528dce88e67a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:11.448118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:11.449430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:11.449861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:11.450250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] PATH_INFO: `/v3/users/25a8f4a77baa4cabbd3cfceefb432a1a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:11.451685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a8f4a77baa4cabbd3cfceefb432a1a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:11.454342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:11.533964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a8f4a77baa4cabbd3cfceefb432a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.535243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a8f4a77baa4cabbd3cfceefb432a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.551654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a8f4a77baa4cabbd3cfceefb432a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.552629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a8f4a77baa4cabbd3cfceefb432a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.569461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb66c6e-3290-4609-9dc1-c15cf9f3e2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a8f4a77baa4cabbd3cfceefb432a1a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:11.625371 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2732/5494] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:11 2022] DELETE /identity/v3/users/25a8f4a77baa4cabbd3cfceefb432a1a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:14.261725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:14.263345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:14.288468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f93d4f-5b7f-4075-a143-480a113db9c9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:14.347161 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:14.585879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:14.586791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:14.587076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:14.587351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] PATH_INFO: `/v3/projects/60fd67e2590d44c1841c53ac25c97839` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:14.589104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60fd67e2590d44c1841c53ac25c97839)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:14.591169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:14.718699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60fd67e2590d44c1841c53ac25c97839', 'request_id': 'req-b83ee69b-2455-44e4-b62c-1fddfeec7e61'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:14.742271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60fd67e2590d44c1841c53ac25c97839', 'request_id': 'req-b83ee69b-2455-44e4-b62c-1fddfeec7e61'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:14.764535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60fd67e2590d44c1841c53ac25c97839', 'request_id': 'req-b83ee69b-2455-44e4-b62c-1fddfeec7e61'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:14.789664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] The token cache is being invalidate because project 60fd67e2590d44c1841c53ac25c97839 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:14.790041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:14.791366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b83ee69b-2455-44e4-b62c-1fddfeec7e61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:14.795683 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2763/5495] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:14 2022] DELETE /identity/v3/projects/60fd67e2590d44c1841c53ac25c97839 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:14.804242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:14.809053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:14.809053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:14.838096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:14.841080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:14.953589 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:14.983795 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2733/5496] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:14.986886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:14.987727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:14.988582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.017887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:15.019297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:15.029250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2764/5497] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:15.033374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.048827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a9def-91e9-41d4-970a-e17a1f2b7608 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:15.063968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:15.064692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:15.064990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:15.065255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.066005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:15.066311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:15.067983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:15.103792 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2734/5498] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:15.104773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.118974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a664252-3815-41e0-a74b-6d005f70b45d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:15.132137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:15.134028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:15.134028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:15.146781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.147788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:15.149872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:15.219081 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2765/5499] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:15 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:15.223494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.237982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f852a6-489e-43ed-a7c8-07032bcf468a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:15.470828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:15.472705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:15.472980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:15.474762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.477694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:15.488227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:15.537110 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2735/5500] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:15 2022] POST /identity/v3/users => generated 296 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:15.541658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.556748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf9308-648b-423a-8dc4-4ff152e310e9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:15.568385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:15.569921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:15.570547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:15.571606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.572871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:15.576420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:15.596136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.607108 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2766/5501] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:15.610243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f1549-f7c9-4f8f-81d9-1efd433f0894 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:15.622238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:15.623543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:15.623920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:15.624287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] PATH_INFO: `/v3/projects/2ec19171632a4d7fbdbf0c7465aed5ef/users/afc81130edc94a259ad0296647100ed8/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.648310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec19171632a4d7fbdbf0c7465aed5ef, user_id=afc81130edc94a259ad0296647100ed8, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:15.653253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:15.686542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2736/5502] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:15 2022] PUT /identity/v3/projects/2ec19171632a4d7fbdbf0c7465aed5ef/users/afc81130edc94a259ad0296647100ed8/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:15.690754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.714331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:15.717889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9998abe5-f50c-4e2a-a722-0f9ff9add360 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:15.721602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:15.955489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:15.956108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:15.959611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:15.959941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:15.960760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:15.965818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:15.991131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f34b10-89a0-4756-8240-6993e702ba43 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.006823 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2767/5503] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:15 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:16.009081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:16.009198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.010076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.010831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.012072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.018453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:16.026770 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:16.050460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17afdc16-9fa1-4536-9d3d-745e1923fffa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.061980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:16.064006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d873a54-7ede-4165-8e54-c43d917e152a service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:16.074285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.075289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.075511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.075703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] PATH_INFO: `/v3/projects/2ec19171632a4d7fbdbf0c7465aed5ef/users/afc81130edc94a259ad0296647100ed8/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.082001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ec19171632a4d7fbdbf0c7465aed5ef, user_id=afc81130edc94a259ad0296647100ed8, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:16.088652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:16.107320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2737/5505] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:16.115956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.116859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.117930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.125291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2768/5505] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:16 2022] PUT /identity/v3/projects/2ec19171632a4d7fbdbf0c7465aed5ef/users/afc81130edc94a259ad0296647100ed8/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:16.157742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] MFA Rules not processed for user `afc81130edc94a259ad0296647100ed8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:16.161282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:16.210861 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:16.325480 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2738/5506] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:16.329310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:16.410214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9f1223-75f8-498b-9de4-38133d7328ff admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.418208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.419113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.419368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.419744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.420554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:16.423964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:16.483457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2769/5507] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:16 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:16.487967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:16.506342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e2b95-5af7-418c-9eae-ad14bd5aefc5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.690530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.691103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.691390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.691670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.692468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:16.694378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:16.739511 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2739/5508] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:16 2022] POST /identity/v3/users => generated 290 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:16.743681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:16.758191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01a83-d67b-4ae0-8794-906902b406e6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.774421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.775130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.775415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.775692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.776525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:16.778204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:16.802818 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2770/5509] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:16.807093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:16.826626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d08e29-d6a5-4dc8-94ae-159f11d409de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.845520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569da27-319a-4be7-a6bd-c9c9a496de60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.846474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569da27-319a-4be7-a6bd-c9c9a496de60 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.847061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569da27-319a-4be7-a6bd-c9c9a496de60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.847503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569da27-319a-4be7-a6bd-c9c9a496de60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.848595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569da27-319a-4be7-a6bd-c9c9a496de60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:16.856672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3569da27-319a-4be7-a6bd-c9c9a496de60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:16.897141 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2740/5510] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:16.901769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:16.929629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177821b6-1839-4c60-8cc8-6b41e644e81c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:16.944887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:16.945825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:16.946402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:16.946402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] PATH_INFO: `/v3/projects/f7a3dcdc4d144947b037023ee46e4137/users/58c684aa3e9c40b396c15b28f5f39c6d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:16.997580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7a3dcdc4d144947b037023ee46e4137, user_id=58c684aa3e9c40b396c15b28f5f39c6d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:17.001292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:17.025695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2771/5511] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:16 2022] PUT /identity/v3/projects/f7a3dcdc4d144947b037023ee46e4137/users/58c684aa3e9c40b396c15b28f5f39c6d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:17.037732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:17.038217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:17.038325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:17.086110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] MFA Rules not processed for user `58c684aa3e9c40b396c15b28f5f39c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:17.087459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:17.246211 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2741/5512] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:17.275368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:17.277869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:17.306745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:17.308458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:17.360782 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:17.545852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd73913-ed0c-4942-bf24-692183b1f6bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:17.554687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb577c1-8d03-4266-8d2d-e9e01b8b7ae1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:17.558164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:17.561963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f9dd34-fea9-45a1-b95d-f8cdda26f199 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:17.562810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9dd34-fea9-45a1-b95d-f8cdda26f199 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:17.563091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9dd34-fea9-45a1-b95d-f8cdda26f199 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:17.563373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f9dd34-fea9-45a1-b95d-f8cdda26f199 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:17.565501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:17.565974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:17.566407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] PATH_INFO: `/v3/users/98f0f05b8e5f42d58d7ee5d0b0bfeb3d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:17.570731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98f0f05b8e5f42d58d7ee5d0b0bfeb3d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:17.578271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:17.643914 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:17.673151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9dd34-fea9-45a1-b95d-f8cdda26f199 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:17.675172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f9dd34-fea9-45a1-b95d-f8cdda26f199 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:17.693955 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2772/5513] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:17.747000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98f0f05b8e5f42d58d7ee5d0b0bfeb3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:17.748120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98f0f05b8e5f42d58d7ee5d0b0bfeb3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:17.760569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98f0f05b8e5f42d58d7ee5d0b0bfeb3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:17.766699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98f0f05b8e5f42d58d7ee5d0b0bfeb3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:17.782140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98f0f05b8e5f42d58d7ee5d0b0bfeb3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:17.871502 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2742/5514] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:17 2022] DELETE /identity/v3/users/98f0f05b8e5f42d58d7ee5d0b0bfeb3d => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:17.875867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:17.876395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:17.876523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:17.914525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:17.918949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:18.152535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2773/5515] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:18.177393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:18.178975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:18.267797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13706301-461c-4d92-bd26-5468ef025f4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:18.272924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f563dd-2948-4a58-a054-d26578d6cb64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:18.274155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f563dd-2948-4a58-a054-d26578d6cb64 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:18.274155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f563dd-2948-4a58-a054-d26578d6cb64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:18.274528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f563dd-2948-4a58-a054-d26578d6cb64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:18.301724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f563dd-2948-4a58-a054-d26578d6cb64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:18.303367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f563dd-2948-4a58-a054-d26578d6cb64 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:18.321844 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2743/5516] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:18.869694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:18.872129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:18.895908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad213b-74c1-4970-8131-6ec8593da6b7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:18.909276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:18.913074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:18.914673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:18.915034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] PATH_INFO: `/v3/users/afc81130edc94a259ad0296647100ed8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:18.918297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afc81130edc94a259ad0296647100ed8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:18.924736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:19.069292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afc81130edc94a259ad0296647100ed8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.084719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afc81130edc94a259ad0296647100ed8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.105400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afc81130edc94a259ad0296647100ed8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.108087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afc81130edc94a259ad0296647100ed8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.147937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afc81130edc94a259ad0296647100ed8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.171640 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2774/5517] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:18 2022] DELETE /identity/v3/users/afc81130edc94a259ad0296647100ed8 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:19.177144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:19.177435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:19.177956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:19.225131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:19.226392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:19.279963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:19.281654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:19.326225 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:19.407571 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2744/5518] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:19.440389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:19.442185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:19.455822 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:19.486832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad6ae67-b99f-4df8-867c-444a378fa400 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:19.501874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:19.502801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:19.503087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:19.503366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] PATH_INFO: `/v3/projects/fadbefd9337c4881a8cd23d90b92534f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:19.504689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fadbefd9337c4881a8cd23d90b92534f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:19.506643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:19.565522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54021c3-d74e-494f-91b9-104a1970593c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:19.571335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:19.572311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:19.572717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:19.573095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:19.600604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:19.602264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:19.615721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fadbefd9337c4881a8cd23d90b92534f', 'request_id': 'req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.620717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2745/5519] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:33:19.637605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fadbefd9337c4881a8cd23d90b92534f', 'request_id': 'req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.647454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fadbefd9337c4881a8cd23d90b92534f', 'request_id': 'req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.666226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] The token cache is being invalidate because project fadbefd9337c4881a8cd23d90b92534f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:19.666701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.668863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.673333 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2775/5520] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:19 2022] DELETE /identity/v3/projects/fadbefd9337c4881a8cd23d90b92534f => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:19.677390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:19.691565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28fb76-e121-4428-bafb-440745cbc7e4 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:19.779860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:19.781455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:19.781879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:19.782431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] PATH_INFO: `/v3/users/d507ceecfc1f4a8498df513bfb028d38` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:19.783890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] RBAC: Authorizing `identity:delete_user(user_id=d507ceecfc1f4a8498df513bfb028d38)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:19.786947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:19.871170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd507ceecfc1f4a8498df513bfb028d38'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.875130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd507ceecfc1f4a8498df513bfb028d38'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.887464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd507ceecfc1f4a8498df513bfb028d38'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.888731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd507ceecfc1f4a8498df513bfb028d38'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.913519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd507ceecfc1f4a8498df513bfb028d38'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:19.972750 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2746/5521] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:19 2022] DELETE /identity/v3/users/d507ceecfc1f4a8498df513bfb028d38 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:20.784724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:20.786825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:20.841210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df27b4e-2eb9-43fa-ad07-d6d8340e074a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:21.016091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:21.017324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:21.018060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:21.018499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:21.019322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] PATH_INFO: `/v3/projects/2ec19171632a4d7fbdbf0c7465aed5ef` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:21.021824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:21.022918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ec19171632a4d7fbdbf0c7465aed5ef)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:21.026326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:21.044251 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:21.054220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc8746b-2c82-4a3e-9907-257404ac7fca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:21.085693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:21.086973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:21.089512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:21.099112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] PATH_INFO: `/v3/projects/83ec840a6b2c4f66b5c97413d93d8726` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:21.102271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83ec840a6b2c4f66b5c97413d93d8726)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:21.118553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:21.312048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ec19171632a4d7fbdbf0c7465aed5ef', 'request_id': 'req-61a5721b-5339-422b-a461-6ae70f517705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.333270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83ec840a6b2c4f66b5c97413d93d8726', 'request_id': 'req-d3a1086c-328a-4ec9-adf8-60c6d851a702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.336581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ec19171632a4d7fbdbf0c7465aed5ef', 'request_id': 'req-61a5721b-5339-422b-a461-6ae70f517705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.356916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ec19171632a4d7fbdbf0c7465aed5ef', 'request_id': 'req-61a5721b-5339-422b-a461-6ae70f517705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.360369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83ec840a6b2c4f66b5c97413d93d8726', 'request_id': 'req-d3a1086c-328a-4ec9-adf8-60c6d851a702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.382080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83ec840a6b2c4f66b5c97413d93d8726', 'request_id': 'req-d3a1086c-328a-4ec9-adf8-60c6d851a702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.390704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] The token cache is being invalidate because project 2ec19171632a4d7fbdbf0c7465aed5ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:21.390949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.392677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.399630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2776/5522] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:20 2022] DELETE /identity/v3/projects/2ec19171632a4d7fbdbf0c7465aed5ef => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:21.402199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:21.413295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:21.421717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] The token cache is being invalidate because project 83ec840a6b2c4f66b5c97413d93d8726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:21.422025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.422885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.431373 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2747/5523] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:21 2022] DELETE /identity/v3/projects/83ec840a6b2c4f66b5c97413d93d8726 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:21.432677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:21.435069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:21.464077 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:21.664258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1086c-328a-4ec9-adf8-60c6d851a702 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:21.672550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5721b-5339-422b-a461-6ae70f517705 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:21.677363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:21.679821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:21.680409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:21.680409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] PATH_INFO: `/v3/users/fe7273b0a8ab418da970e54a43a68d58` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:21.683219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:21.684541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe7273b0a8ab418da970e54a43a68d58)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:21.686596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:21.688521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:21.689048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:21.690286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] PATH_INFO: `/v3/users/58c684aa3e9c40b396c15b28f5f39c6d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:21.694621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] RBAC: Authorizing `identity:delete_user(user_id=58c684aa3e9c40b396c15b28f5f39c6d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:21.697363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:21.829187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe7273b0a8ab418da970e54a43a68d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.831496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe7273b0a8ab418da970e54a43a68d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.836436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58c684aa3e9c40b396c15b28f5f39c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.853784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe7273b0a8ab418da970e54a43a68d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.854617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe7273b0a8ab418da970e54a43a68d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.871600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58c684aa3e9c40b396c15b28f5f39c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.888655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe7273b0a8ab418da970e54a43a68d58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.913658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58c684aa3e9c40b396c15b28f5f39c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.917229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58c684aa3e9c40b396c15b28f5f39c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.930350 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2748/5524] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:21 2022] DELETE /identity/v3/users/fe7273b0a8ab418da970e54a43a68d58 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:21.937377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58c684aa3e9c40b396c15b28f5f39c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:21.956711 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2777/5525] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:21 2022] DELETE /identity/v3/users/58c684aa3e9c40b396c15b28f5f39c6d => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:22.903965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:22.907733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:22.931275 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:23.086849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c3912-aa11-401e-8e60-5917e23ea9f1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:23.221619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:23.223633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:23.243432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:23.245016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.249901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.251019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] PATH_INFO: `/v3/projects/f7a3dcdc4d144947b037023ee46e4137` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.255698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7a3dcdc4d144947b037023ee46e4137)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:23.257832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:23.259354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bfb53c-e822-44fa-a29a-d988740d285c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:23.275256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:23.276539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.276784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.277199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] PATH_INFO: `/v3/projects/904acbc1132746efbe5284d4807d110c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.279909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=904acbc1132746efbe5284d4807d110c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:23.284262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:23.377261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7a3dcdc4d144947b037023ee46e4137', 'request_id': 'req-3af5eba9-c168-4778-b182-fa56780839f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.395687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7a3dcdc4d144947b037023ee46e4137', 'request_id': 'req-3af5eba9-c168-4778-b182-fa56780839f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.404583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '904acbc1132746efbe5284d4807d110c', 'request_id': 'req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.412276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7a3dcdc4d144947b037023ee46e4137', 'request_id': 'req-3af5eba9-c168-4778-b182-fa56780839f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.417660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '904acbc1132746efbe5284d4807d110c', 'request_id': 'req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.428732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '904acbc1132746efbe5284d4807d110c', 'request_id': 'req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.436580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] The token cache is being invalidate because project f7a3dcdc4d144947b037023ee46e4137 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:23.436966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.439459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3af5eba9-c168-4778-b182-fa56780839f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.441727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2749/5526] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:22 2022] DELETE /identity/v3/projects/f7a3dcdc4d144947b037023ee46e4137 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:23.448190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e09a0-f8b5-4278-afe0-661c0d08b00b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.448627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e09a0-f8b5-4278-afe0-661c0d08b00b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.448917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e09a0-f8b5-4278-afe0-661c0d08b00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.457936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] The token cache is being invalidate because project 904acbc1132746efbe5284d4807d110c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:23.458237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.471379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b7e006e-33c9-4dd6-9623-ff1fd82da54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:23.473728 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2778/5527] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:23 2022] DELETE /identity/v3/projects/904acbc1132746efbe5284d4807d110c => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:23.486888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5db35-376e-4d1d-95c1-24bac8354abb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.486888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5db35-376e-4d1d-95c1-24bac8354abb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.486888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5db35-376e-4d1d-95c1-24bac8354abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.515409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-440e09a0-f8b5-4278-afe0-661c0d08b00b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:23.516702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-440e09a0-f8b5-4278-afe0-661c0d08b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:23.561720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b6a5db35-376e-4d1d-95c1-24bac8354abb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:23.561720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b6a5db35-376e-4d1d-95c1-24bac8354abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:23.605928 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:23.610077 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:23.665721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2750/5528] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:23.674687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.674981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.675264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.768716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:23.776766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:23.797194 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2779/5529] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:23.803618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139f01-86da-4400-8939-d0efdb256114 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.803905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139f01-86da-4400-8939-d0efdb256114 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.804256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5139f01-86da-4400-8939-d0efdb256114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.804938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2751/5530] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:23.808433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:23.839375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f3a39-0e66-446c-899e-25d522d0bdac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:23.859613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d5139f01-86da-4400-8939-d0efdb256114 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:23.860894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:23.864871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.865289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.865670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.866557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:23.868103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:23.870995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d5139f01-86da-4400-8939-d0efdb256114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:23.872040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:23.902227 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2780/5531] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:23.903948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.905103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.905563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.919857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2752/5532] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:23.921484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:23.949988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e658f1-69de-46c4-8e5d-81e84f00f967 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:23.962469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:23.963226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:23.963561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:23.963892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:23.964660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:23.964967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:23.970131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:23.992632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] MFA Rules not processed for user `77d6c3c9aa554c4495312c6040afb4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:23.994272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:24.002077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2753/5533] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:24.003332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.044586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c78f7ef-2a65-4a1c-a49a-e44b0239f969 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.064307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.065032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.069091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.069490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.072314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.074475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.156196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2754/5534] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:23 2022] POST /identity/v3/projects => generated 361 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:24.157305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.226125 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2781/5535] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:24.229022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.260862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42714adf-d0d1-4055-93b0-bc9272485ffc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.366562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4f801-fa57-4f2b-ad7e-7eb600a5c8b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.372284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49f13a-10d2-4bfa-8189-1d74fb87a6b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.373048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49f13a-10d2-4bfa-8189-1d74fb87a6b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.373340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49f13a-10d2-4bfa-8189-1d74fb87a6b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.373938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49f13a-10d2-4bfa-8189-1d74fb87a6b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.374703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49f13a-10d2-4bfa-8189-1d74fb87a6b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.377961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49f13a-10d2-4bfa-8189-1d74fb87a6b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.422600 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2755/5536] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:24 2022] POST /identity/v3/projects => generated 399 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:24.425264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.425842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.427027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.438888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.440224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.440768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.441273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.442407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.444655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.459543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] MFA Rules not processed for user `77d6c3c9aa554c4495312c6040afb4d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:24.460864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:24.512113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2782/5537] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:24 2022] POST /identity/v3/users => generated 281 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:24.512570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.518351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:24.617987 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2756/5538] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:24.617987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.626015 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:24.653840 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:24.697149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b4d1b6-e43a-4755-9d76-8ce6d406c093 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.711460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4a3ed-083b-4b21-afa7-05f7c816f2af None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.717477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.718175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.718463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.718741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.719602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.722590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.779788 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2757/5539] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:24 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:24.785064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.813392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed44055-c240-48f1-901e-28279fbecc0a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.819197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.820043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.820464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.821305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.826042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:24.826818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.827569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.827856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.828128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.828902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.835312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.858257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.859868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.878678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2758/5540] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:24.879926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.883303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:24.885622 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2783/5541] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:24.889509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.916874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaa1073-990c-4983-b3bf-d6eb2195771a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:24.923677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:24.924621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:24.925008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:24.925387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:24.926240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:24.928205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:24.968872 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2784/5542] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:24.973062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:24.994737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bf953-e774-44cb-b370-bf01044d335b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.007713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.008570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.009120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.009242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5c311-99d2-4cb9-8b21-2afa684e1d78 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.009680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.010621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.014762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.032243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.033109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.033398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.033680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.046480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.046480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.058572 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2785/5543] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:24 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:25.059730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:25.076161 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2759/5544] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:25.077162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:25.097114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bfbe8-5b1e-4b42-9bb6-f3145143e621 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.097417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f728032-c54b-4fbe-9057-5da5e33504ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.107321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.108273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.109085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.110091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.110483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.110864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.111242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.112585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.113019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] PATH_INFO: `/v3/projects/9a074a68d9be45efa4230be09f641931/users/fd423b00b4184da692ada70177fa18ab/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.115513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.145995 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2786/5545] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:25.147935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:25.153198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a074a68d9be45efa4230be09f641931, user_id=fd423b00b4184da692ada70177fa18ab, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.158779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.169124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c507dd6-ca8f-4750-961a-fbdb9a761622 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.185772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3008297f-65f5-466d-8256-0d297f99945e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.188191 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2760/5546] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:25 2022] PUT /identity/v3/projects/9a074a68d9be45efa4230be09f641931/users/fd423b00b4184da692ada70177fa18ab/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:25.189367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008297f-65f5-466d-8256-0d297f99945e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.190446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:25.190846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008297f-65f5-466d-8256-0d297f99945e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.191564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3008297f-65f5-466d-8256-0d297f99945e admin admin] PATH_INFO: `/v3/projects/3dc8b2e7786e46adbce6fc040eefd7fb/users/d969ffc833d74c8bbf65188f9d598c58/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.199200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:25.247605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008297f-65f5-466d-8256-0d297f99945e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dc8b2e7786e46adbce6fc040eefd7fb, user_id=d969ffc833d74c8bbf65188f9d598c58, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.255323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3008297f-65f5-466d-8256-0d297f99945e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.291068 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2787/5547] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:25 2022] PUT /identity/v3/projects/3dc8b2e7786e46adbce6fc040eefd7fb/users/d969ffc833d74c8bbf65188f9d598c58/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:25.299934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0339a-1055-470f-bf23-374c0e0fb9fa None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.302440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0339a-1055-470f-bf23-374c0e0fb9fa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.303153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0339a-1055-470f-bf23-374c0e0fb9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.380566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fcb0339a-1055-470f-bf23-374c0e0fb9fa None None] MFA Rules not processed for user `fd423b00b4184da692ada70177fa18ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:25.382422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fcb0339a-1055-470f-bf23-374c0e0fb9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:25.391159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408ec14-d276-4fc3-b444-0aea055ae498 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.405584 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:25.521542 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2788/5548] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:25.523580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.525484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.525983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.564423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.565218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.566043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.566043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.568240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:25.595600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] MFA Rules not processed for user `d969ffc833d74c8bbf65188f9d598c58`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:25.599316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:25.626051 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:25.681206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.684026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.714521 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2761/5549] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:25.716402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:25.736403 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2789/5550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:25.740588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:25.901991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c8b4d2-1256-4e12-beda-f71c29584e2a service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.918538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.923936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.924249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.924571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] PATH_INFO: `/v3/users/fd423b00b4184da692ada70177fa18ab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.933574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd423b00b4184da692ada70177fa18ab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.937886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4539fb4-5ed7-4b9e-a038-40fd9825de10 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:25.938073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:25.949560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:25.950834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:25.951126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:25.951411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:25.952294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:25.958284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.022210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd423b00b4184da692ada70177fa18ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:26.026072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd423b00b4184da692ada70177fa18ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:26.031043 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:26.031279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2790/5551] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:25 2022] POST /identity/v3/projects => generated 399 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:26.035601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:26.037844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:26.047206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd423b00b4184da692ada70177fa18ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:26.052709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd423b00b4184da692ada70177fa18ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:26.067776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-662c09ec-aeec-4821-8eee-5408582fa287 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd423b00b4184da692ada70177fa18ab'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:26.109059 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2762/5552] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:25 2022] DELETE /identity/v3/users/fd423b00b4184da692ada70177fa18ab => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:26.111259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.111627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.111979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.156713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:26.159959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:26.173794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f95def-2c86-4e2f-afb1-64bab14682d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:26.270039 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:26.292723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:26.293390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.293678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.294005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.295416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:26.298612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.333669 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2763/5553] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:26.340253 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2791/5554] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:26 2022] POST /identity/v3/users => generated 306 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:33:26.342150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:26.358785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb020988-1ec7-4b22-9766-dfcb60b89288 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:26.377892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:26.378713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.379332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.380548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.383658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:26.385761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.407172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:26.409095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:26.414857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2764/5555] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:26.418598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:26.447946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83d142-9a0d-4b00-b566-ecf768b52011 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:26.465459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:26.467001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.467718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.468228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] PATH_INFO: `/v3/projects/843c3425ae994861a735033053d1a9a0/users/e5fd1ea39edf46babf82ffac70fb2394/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.502424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] RBAC: Authorizing `identity:create_grant(project_id=843c3425ae994861a735033053d1a9a0, user_id=e5fd1ea39edf46babf82ffac70fb2394, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:26.506054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.540994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622fcb1-f8a2-4bbb-8172-b097d492b5f4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:26.544599 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2765/5556] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:26 2022] PUT /identity/v3/projects/843c3425ae994861a735033053d1a9a0/users/e5fd1ea39edf46babf82ffac70fb2394/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:26.547912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:26.654539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc5ec9-851a-43b6-b014-e42a325f0611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:26.655353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc5ec9-851a-43b6-b014-e42a325f0611 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.655642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc5ec9-851a-43b6-b014-e42a325f0611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.655920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc5ec9-851a-43b6-b014-e42a325f0611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.701530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a04451-b02b-4229-bc15-e2ab1e67405c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:26.714170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:26.715336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.715626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.715904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.716821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:26.721204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.752415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2766/5557] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:26 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:26.755194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:26.777360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31692729-b789-4547-ade7-565ab7ec3ac0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:26.785529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc5ec9-851a-43b6-b014-e42a325f0611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:26.787196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc5ec9-851a-43b6-b014-e42a325f0611 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.791156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:26.796442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.796442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.796442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] PATH_INFO: `/v3/projects/843c3425ae994861a735033053d1a9a0/users/e5fd1ea39edf46babf82ffac70fb2394/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.799216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843c3425ae994861a735033053d1a9a0, user_id=e5fd1ea39edf46babf82ffac70fb2394, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:26.802302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:26.812393 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2792/5558] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:33:26.826841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2767/5559] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:26 2022] PUT /identity/v3/projects/843c3425ae994861a735033053d1a9a0/users/e5fd1ea39edf46babf82ffac70fb2394/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:26.838626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:26.838999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:26.839200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:26.893583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] MFA Rules not processed for user `e5fd1ea39edf46babf82ffac70fb2394`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:26.894828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:26.956734 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:27.080165 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2793/5560] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:26 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:27.141469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:27.176325 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:27.285661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4aa32-de88-4926-aa5a-3fb328ecf271 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:27.297935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:27.299320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:27.299600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:27.299889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:27.307950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:27.461688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:27.468787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:27.487736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2768/5561] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:27.761812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:27.764012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:27.800047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa4e81-6e96-4030-a0cc-4cd0434b270f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:27.819671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:27.820411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:27.820703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:27.820978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:27.836923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:28.024382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:28.025932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:28.061144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:28.062755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a55d7-de50-4ce7-b7db-80ae65d36e6d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:28.090190 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2794/5562] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:28.207808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdd96f-478b-4860-842b-6e850a610f4b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:28.226218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:28.230616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:28.231113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:28.231468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] PATH_INFO: `/v3/projects/9a074a68d9be45efa4230be09f641931` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:28.246379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a074a68d9be45efa4230be09f641931)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:28.250506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:28.398615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a074a68d9be45efa4230be09f641931', 'request_id': 'req-90a35587-70bf-4327-ac7c-81ac1c99abac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:28.411306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a074a68d9be45efa4230be09f641931', 'request_id': 'req-90a35587-70bf-4327-ac7c-81ac1c99abac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:28.417746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a074a68d9be45efa4230be09f641931', 'request_id': 'req-90a35587-70bf-4327-ac7c-81ac1c99abac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:28.434093 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:28.442926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] The token cache is being invalidate because project 9a074a68d9be45efa4230be09f641931 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:28.443287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:28.443881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-90a35587-70bf-4327-ac7c-81ac1c99abac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:28.457268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:28.457635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:28.457870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:28.459220 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2769/5563] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:28 2022] DELETE /identity/v3/projects/9a074a68d9be45efa4230be09f641931 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:28.490117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:28.495710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:28.659452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:28.659752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:28.660027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:28.663961 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2795/5564] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:28.692133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:28.696317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:28.720228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:28.726475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2770/5565] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:28.731252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59ed23-0d93-48f3-8cc0-45c189f3c1e4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:28.749272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:28.750262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:28.750540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:28.750815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:28.751585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:28.752242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:28.753841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:28.783624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:28.791569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2796/5566] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:28.794062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ab0147-809a-437e-9168-94204eb7b43b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:28.813441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:28.814326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:28.814614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:28.814887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:28.815597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:28.817589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:28.894818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:28.903918 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2771/5567] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:28 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:28.907184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305427ab-0052-4ddd-81e4-0a8847430c10 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:29.005832 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:29.084176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:29.084929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:29.085212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:29.091414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:29.095296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:29.102365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:29.167568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2797/5568] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:28 2022] POST /identity/v3/users => generated 285 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:29.167859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:29.182925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638a006b-0d6e-48bc-ae53-8d4e1282ede1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:29.197317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:29.199735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:29.200028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:29.200307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:29.204129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:29.209274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:29.257717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2772/5569] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:33:29.262727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:29.309336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86e4199-4455-4e0f-8760-050bbcd887cf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:29.316678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b235ef94-41c7-4891-8445-4ca2182f490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:29.320682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ef94-41c7-4891-8445-4ca2182f490f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:29.321548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ef94-41c7-4891-8445-4ca2182f490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:29.322039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b235ef94-41c7-4891-8445-4ca2182f490f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:29.323368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235ef94-41c7-4891-8445-4ca2182f490f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:29.327084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b235ef94-41c7-4891-8445-4ca2182f490f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:29.349621 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2798/5570] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:29.353597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:29.368427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f13c7-386e-40d1-9b2e-b728cc954002 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:29.382401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:29.383501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:29.383957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:29.384409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] PATH_INFO: `/v3/projects/66d943ee249c4d19803ff62107d1e543/users/e5d87d0d94c74c2fa8d7f97f19018019/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:29.432262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=66d943ee249c4d19803ff62107d1e543, user_id=e5d87d0d94c74c2fa8d7f97f19018019, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:29.440545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:29.475817 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2773/5571] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:29 2022] PUT /identity/v3/projects/66d943ee249c4d19803ff62107d1e543/users/e5d87d0d94c74c2fa8d7f97f19018019/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:29.486684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:29.486978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:29.487267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:29.588322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] MFA Rules not processed for user `e5d87d0d94c74c2fa8d7f97f19018019`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:29.590144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:29.824838 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2799/5572] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:29.828019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:29.985644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f156e9bc-f169-498d-9c6d-eb177c156a7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:29.999269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:30.000223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.000827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.001108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.008648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:30.013801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:30.071171 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2774/5573] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:29 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:30.073168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:30.086588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1102d7c-7fa9-4d44-9fd7-c3b06df3c9aa None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:30.185625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:30.187602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.189475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.190059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.192323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:30.198088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:30.253901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2800/5574] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:30 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:30.258174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:30.281275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff92c-0a81-4995-b273-b5f48c5e306e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:30.299639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:30.302430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.302743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.305035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.305973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:30.308332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:30.352172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2775/5575] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:30.355522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:30.378013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ac49f-4fdf-41bd-894c-a610b40561dd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:30.388067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:30.389301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.389801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.390307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] PATH_INFO: `/v3/projects/88ee85c75862482597694648f0029401/users/3169566e7f9641719cb10bd44b6ae1f0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.432771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ee85c75862482597694648f0029401, user_id=3169566e7f9641719cb10bd44b6ae1f0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:30.438283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:30.487642 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2801/5576] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:30 2022] PUT /identity/v3/projects/88ee85c75862482597694648f0029401/users/3169566e7f9641719cb10bd44b6ae1f0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:30.491661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:30.521785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b996c-ff81-4e05-ae8c-b17c4cf4cbea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:30.678967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29127e5f-3f0f-473f-be46-f7707d8ce648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:30.679559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29127e5f-3f0f-473f-be46-f7707d8ce648 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.679851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29127e5f-3f0f-473f-be46-f7707d8ce648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.680129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29127e5f-3f0f-473f-be46-f7707d8ce648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.680917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29127e5f-3f0f-473f-be46-f7707d8ce648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:30.682655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29127e5f-3f0f-473f-be46-f7707d8ce648 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:30.716411 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2776/5577] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:30 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:30.719390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:30.736219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d827b00-4b12-4340-877c-87e34f135574 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:30.751496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:30.752483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.752768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.753042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] PATH_INFO: `/v3/projects/88ee85c75862482597694648f0029401/users/3169566e7f9641719cb10bd44b6ae1f0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.755629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] RBAC: Authorizing `identity:create_grant(project_id=88ee85c75862482597694648f0029401, user_id=3169566e7f9641719cb10bd44b6ae1f0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:30.758340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:30.773008 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:30.786319 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2802/5578] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:30 2022] PUT /identity/v3/projects/88ee85c75862482597694648f0029401/users/3169566e7f9641719cb10bd44b6ae1f0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:30.798018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:30.798524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:30.798933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:30.822550 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:30.858915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] MFA Rules not processed for user `3169566e7f9641719cb10bd44b6ae1f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:30.860422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:31.059177 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2777/5579] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:30 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:31.145217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:31.151828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:31.165741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:31.169358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:31.326144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2861610-e5a6-4772-94c8-35de48e4342a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:31.341044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:31.342450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:31.342757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:31.343081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:31.365936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:31.367940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:31.384159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e30e9-a281-4519-a9a1-0715a45921b6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:31.396254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:31.397040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:31.397336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:31.397619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:31.398452 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2803/5580] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:31 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:31.405605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:31.565731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:31.567441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e749fa-d181-4d57-9550-2cdce8fb4e05 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:31.593822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2778/5581] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:31 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:35.900683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:36.057728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed1c50e-daed-4ad8-be99-a61f03d131ec service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:36.074664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:36.077097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:36.077671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:36.078031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] PATH_INFO: `/v3/users/e5d87d0d94c74c2fa8d7f97f19018019` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:36.079584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5d87d0d94c74c2fa8d7f97f19018019)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:36.083205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:36.181767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5d87d0d94c74c2fa8d7f97f19018019'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:36.219118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5d87d0d94c74c2fa8d7f97f19018019'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:36.249069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5d87d0d94c74c2fa8d7f97f19018019'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:36.249865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5d87d0d94c74c2fa8d7f97f19018019'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:36.262914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5d87d0d94c74c2fa8d7f97f19018019'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:36.271784 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2804/5582] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:35 2022] DELETE /identity/v3/users/e5d87d0d94c74c2fa8d7f97f19018019 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:36.277433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:36.279025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:36.279879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:36.305073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:36.307505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:36.340669 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:36.445209 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2779/5583] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:36.561823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:36.565118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:36.614826 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:36.676677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5277c4a4-dd53-468e-82ef-d51b1053744b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:36.686310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:36.688069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:36.688911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:36.690203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:36.728642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:36.741937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:36.777073 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2805/5584] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:38.097100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:38.098647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:38.115865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35a1b56-4bc2-42be-8556-a76444276a20 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:38.117046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:38.118829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:38.122094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:38.123052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:38.124098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:38.124596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] PATH_INFO: `/v3/users/0269af8ef32d4551b772630c02e32702` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:38.131245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0269af8ef32d4551b772630c02e32702)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:38.134170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:38.142302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae384ca1-3779-42c5-a457-fa4d748dc093 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:38.158157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:38.159263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:38.159549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:38.159841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] PATH_INFO: `/v3/projects/66d943ee249c4d19803ff62107d1e543` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:38.161450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66d943ee249c4d19803ff62107d1e543)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:38.164379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:38.272239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66d943ee249c4d19803ff62107d1e543', 'request_id': 'req-6dcb798b-769e-4d51-814c-e882e7815533'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.291328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66d943ee249c4d19803ff62107d1e543', 'request_id': 'req-6dcb798b-769e-4d51-814c-e882e7815533'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.300272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66d943ee249c4d19803ff62107d1e543', 'request_id': 'req-6dcb798b-769e-4d51-814c-e882e7815533'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.316998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0269af8ef32d4551b772630c02e32702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.317883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0269af8ef32d4551b772630c02e32702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.325736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] The token cache is being invalidate because project 66d943ee249c4d19803ff62107d1e543 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:38.326300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.327589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.329803 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2806/5585] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:38 2022] DELETE /identity/v3/projects/66d943ee249c4d19803ff62107d1e543 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:38.334112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:38.336636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:38.342073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0269af8ef32d4551b772630c02e32702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.342876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0269af8ef32d4551b772630c02e32702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.361990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0269af8ef32d4551b772630c02e32702'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.467236 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2780/5586] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:38 2022] DELETE /identity/v3/users/0269af8ef32d4551b772630c02e32702 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:38.525622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb798b-769e-4d51-814c-e882e7815533 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:38.608639 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:38.625445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:38.626548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:38.627650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:38.627650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] PATH_INFO: `/v3/users/3169566e7f9641719cb10bd44b6ae1f0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:38.629400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3169566e7f9641719cb10bd44b6ae1f0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:38.631808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:38.696996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3169566e7f9641719cb10bd44b6ae1f0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.705248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3169566e7f9641719cb10bd44b6ae1f0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.719350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3169566e7f9641719cb10bd44b6ae1f0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.720100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3169566e7f9641719cb10bd44b6ae1f0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.728819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-450c0f44-948a-4585-a365-98cf11d97aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3169566e7f9641719cb10bd44b6ae1f0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:38.737531 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2807/5587] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:38 2022] DELETE /identity/v3/users/3169566e7f9641719cb10bd44b6ae1f0 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:39.736305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:39.737957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:39.777837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0ad20b-c1b2-4cee-9e66-c9e692126054 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:39.853738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:39.854996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:39.855294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:39.855605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] PATH_INFO: `/v3/projects/f67dc2a8785543bcb1bdaf04688df7a4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:39.859846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f67dc2a8785543bcb1bdaf04688df7a4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:39.863221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:39.926968 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:39.939456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f67dc2a8785543bcb1bdaf04688df7a4', 'request_id': 'req-22baeac0-7489-486c-9551-98c5c99d824e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:39.952954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f67dc2a8785543bcb1bdaf04688df7a4', 'request_id': 'req-22baeac0-7489-486c-9551-98c5c99d824e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:39.960841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f67dc2a8785543bcb1bdaf04688df7a4', 'request_id': 'req-22baeac0-7489-486c-9551-98c5c99d824e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:39.979626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] The token cache is being invalidate because project f67dc2a8785543bcb1bdaf04688df7a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:39.980511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:39.981498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-22baeac0-7489-486c-9551-98c5c99d824e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:39.986841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2781/5588] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:39 2022] DELETE /identity/v3/projects/f67dc2a8785543bcb1bdaf04688df7a4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:39.992497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:39.993541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:39.994043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.029113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:40.030644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:40.180042 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2808/5589] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:40.181710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.182304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.182664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.204917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:40.206824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:40.218377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2782/5590] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:40.222405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:40.235767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9729b062-646a-4fed-a8b2-e5c17b22a305 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:40.244055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:40.245235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.245766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.246324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.247751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:40.248320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:40.250621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:40.270603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2809/5591] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:40.275052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:40.289551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e2b425-ac5c-450a-8918-87419efdb181 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:40.297697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:40.299471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.299925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.300502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.302002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:40.318008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:40.375359 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2783/5592] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:40 2022] POST /identity/v3/projects => generated 395 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:40.380989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:40.387643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:40.389517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:40.409778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6379ac-f586-47a3-bc12-5f53c9b48883 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:40.547746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a45204-2a91-46f2-8680-cbc2df1f620d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:40.561129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:40.562204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.563054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.563394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] PATH_INFO: `/v3/projects/88ee85c75862482597694648f0029401` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.574567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88ee85c75862482597694648f0029401)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:40.576969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:40.617671 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:40.631707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:40.634081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.635640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.638000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.639733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:40.643536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:40.695076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2810/5593] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:40 2022] POST /identity/v3/users => generated 298 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:40.699792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:40.711418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88ee85c75862482597694648f0029401', 'request_id': 'req-d5aab097-d1c0-46e2-8a19-23eb0182094c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:40.724336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25c0b4-a370-42c5-bf4c-95393d0bcf99 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:40.731612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88ee85c75862482597694648f0029401', 'request_id': 'req-d5aab097-d1c0-46e2-8a19-23eb0182094c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:40.751967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88ee85c75862482597694648f0029401', 'request_id': 'req-d5aab097-d1c0-46e2-8a19-23eb0182094c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:40.810756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] The token cache is being invalidate because project 88ee85c75862482597694648f0029401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:40.811083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:40.813603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d5aab097-d1c0-46e2-8a19-23eb0182094c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:40.823541 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2784/5594] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:40 2022] DELETE /identity/v3/projects/88ee85c75862482597694648f0029401 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:40.829427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a586a-3c66-4a79-951e-375da7ac1797 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.829784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a586a-3c66-4a79-951e-375da7ac1797 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.830620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a586a-3c66-4a79-951e-375da7ac1797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.894080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4d9a586a-3c66-4a79-951e-375da7ac1797 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:40.901698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d9a586a-3c66-4a79-951e-375da7ac1797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:40.913395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:40.917153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.917572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.918549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.918802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:40.923598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:40.955427 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2785/5595] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:40.960033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2811/5596] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:40.964739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:40.965368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:40.965981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:40.973049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:40.981947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.032967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b2af73-974d-4681-b3a3-e154030fe29e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.045426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:41.050048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.084726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.084999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2786/5597] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:41.085990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.087137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.087735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.088853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.090709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.091956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.116632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75432122-e78b-434d-a4e8-f55820dc8c6b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.135266 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2812/5598] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:41.140709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.142366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.144788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.145334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.145613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.146475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:41.148859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.153712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.176523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c67f9f-5c3d-4154-878f-1a314661f87c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.208652 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2787/5599] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:41.210096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.218462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa55d72-eec8-42c8-92ef-ef895e060086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.219533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa55d72-eec8-42c8-92ef-ef895e060086 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.219837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa55d72-eec8-42c8-92ef-ef895e060086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.220191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa55d72-eec8-42c8-92ef-ef895e060086 admin admin] PATH_INFO: `/v3/projects/7c1c6406e3274ac98aa34d7744afdacc/users/c52883c1ab6a4dc2aa920785c1772c6d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.220912 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:41.235351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948bb88-93cc-4f4f-990c-4930d733e29e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.252083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa55d72-eec8-42c8-92ef-ef895e060086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1c6406e3274ac98aa34d7744afdacc, user_id=c52883c1ab6a4dc2aa920785c1772c6d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.256371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.257078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.257364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.257642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.258347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.260693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.269423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa55d72-eec8-42c8-92ef-ef895e060086 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.309436 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2813/5600] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:41 2022] PUT /identity/v3/projects/7c1c6406e3274ac98aa34d7744afdacc/users/c52883c1ab6a4dc2aa920785c1772c6d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:41.317835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.318329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.318752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.322457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2788/5601] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:41 2022] POST /identity/v3/projects => generated 357 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:41.326950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.366904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:41.368902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.416884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508cfde-c530-4837-a507-d851f80b5bdc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.424179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.425749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.426341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.427068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.428109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.430923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.461810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2789/5602] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:41 2022] POST /identity/v3/users => generated 279 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:41.465659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.484713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c582e5d-18ba-4338-b51b-804ec7b9103c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.498002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.498999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.499791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.500376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.503166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.506917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.510384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2814/5603] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:41.529756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2790/5604] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:33:41.534162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.559258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4d5be-de45-48de-9411-b4ce4915207d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.565489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.567897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.581673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.583227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.583511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.583784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.584556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.589682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.622512 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2815/5605] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:41.630016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:41.671362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32770095-3132-490f-86b0-04a3256e0817 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.686396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c0e3bb-1de6-48b2-9213-b1a14c94eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.688547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e3bb-1de6-48b2-9213-b1a14c94eaba admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.688830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e3bb-1de6-48b2-9213-b1a14c94eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.689105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c0e3bb-1de6-48b2-9213-b1a14c94eaba admin admin] PATH_INFO: `/v3/projects/b8de4ecb17914905ae9d95a689dcabc1/users/c3f1e335b4464a4ab65159fdd0df9da2/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.725913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0e3bb-1de6-48b2-9213-b1a14c94eaba admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8de4ecb17914905ae9d95a689dcabc1, user_id=c3f1e335b4464a4ab65159fdd0df9da2, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.737690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c0e3bb-1de6-48b2-9213-b1a14c94eaba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.746698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f29d82b-1879-41ec-902f-fa5ae1458695 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:41.751580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:41.752294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.754911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.755946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.762825 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2816/5606] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:41 2022] PUT /identity/v3/projects/b8de4ecb17914905ae9d95a689dcabc1/users/c3f1e335b4464a4ab65159fdd0df9da2/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:41.773485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:41.775977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:41.777436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:41.789959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:41.791813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:41.806896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2791/5607] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:41.824959 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:41.829734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] MFA Rules not processed for user `c3f1e335b4464a4ab65159fdd0df9da2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:41.832278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:41.977850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2817/5608] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:41 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:41.982878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:42.015162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7012b-5b6b-46f2-a0e4-6e574034a9b9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:42.190078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:42.190967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.191359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.191735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.192573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:42.195355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:42.202278 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:42.257766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2792/5609] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:41 2022] POST /identity/v3/projects => generated 357 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:42.259711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:42.278392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d3a48-dac8-4f27-bafd-597ac4e93f3d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:42.405459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:42.406817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.407319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.407771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.408692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:42.410999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:42.447071 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2818/5610] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:42 2022] POST /identity/v3/users => generated 285 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:42.451023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:42.465079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e5bace-7bee-43fb-8e6e-075c416d3810 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:42.470266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:42.471064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.471419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.471761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.473192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:42.474398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:42.496398 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2793/5611] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:42.501639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:42.522215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8ef593-5a12-4d26-83e7-a69529512e28 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:42.528330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:42.529762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.530636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.531529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] PATH_INFO: `/v3/projects/55538b2d192e47b6b4332122004bcdf1/users/933feb5b9b3946f0879c7d91a4a4bfe0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.567225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] RBAC: Authorizing `identity:create_grant(project_id=55538b2d192e47b6b4332122004bcdf1, user_id=933feb5b9b3946f0879c7d91a4a4bfe0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:42.571403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:42.589827 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2819/5612] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:42 2022] PUT /identity/v3/projects/55538b2d192e47b6b4332122004bcdf1/users/933feb5b9b3946f0879c7d91a4a4bfe0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:42.594355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:42.619486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ffbe7-d70a-4f7a-80f1-07ef9b4e12d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:42.716911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88096a-10c3-4717-82ac-5f7afc6a1e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:42.717967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88096a-10c3-4717-82ac-5f7afc6a1e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.718325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88096a-10c3-4717-82ac-5f7afc6a1e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.718757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88096a-10c3-4717-82ac-5f7afc6a1e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.719641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88096a-10c3-4717-82ac-5f7afc6a1e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:42.721549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88096a-10c3-4717-82ac-5f7afc6a1e1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:42.739507 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2794/5613] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:42.743352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:42.755135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4555006a-da32-4d7a-b1a9-409ef98916df admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:42.770580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:42.771856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.772244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.772684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] PATH_INFO: `/v3/projects/55538b2d192e47b6b4332122004bcdf1/users/933feb5b9b3946f0879c7d91a4a4bfe0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.775249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55538b2d192e47b6b4332122004bcdf1, user_id=933feb5b9b3946f0879c7d91a4a4bfe0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:42.778799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:42.796093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2820/5614] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:42 2022] PUT /identity/v3/projects/55538b2d192e47b6b4332122004bcdf1/users/933feb5b9b3946f0879c7d91a4a4bfe0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:42.807715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:42.808122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:42.808279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:42.845751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] MFA Rules not processed for user `933feb5b9b3946f0879c7d91a4a4bfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:42.848566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:43.018904 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2795/5615] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:42 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:43.020433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:43.037448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca389a70-356c-43be-8c04-c219fbb1d108 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:43.055476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933feb5b9b3946f0879c7d91a4a4bfe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55538b2d192e47b6b4332122004bcdf1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:43.057010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:43.058533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:43.059270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:43.061688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:43.063323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:43.067864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:43.092953 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2821/5616] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:43.096575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:43.123355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d6de8d-a562-47c5-a1e9-8d2af6a5eeae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:43.141654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933feb5b9b3946f0879c7d91a4a4bfe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55538b2d192e47b6b4332122004bcdf1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:43.143218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:43.144607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:43.145635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:43.147165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:43.152401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:43.202552 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2796/5617] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:43 2022] POST /identity/v3/projects => generated 349 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:43.207001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:43.220449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0df54-d488-4bb1-8935-e8f27c2fca9c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:43.277772 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:43.309836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933feb5b9b3946f0879c7d91a4a4bfe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55538b2d192e47b6b4332122004bcdf1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:43.310855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:43.311233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:43.311640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:43.312905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:43.313510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:43.316719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:43.335732 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2822/5618] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:43.375943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:43.513246 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:43.550031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c7710-ed6c-404f-9d92-d2d1035f50b0 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:43.556471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:43.557934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:43.558478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:43.558964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:43.573789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:43.575304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:43.587647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2797/5619] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:43 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:44.846261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:44.865849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fec7c85-f1e4-4884-9954-c00eb0d7671c tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:44.874793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '933feb5b9b3946f0879c7d91a4a4bfe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '55538b2d192e47b6b4332122004bcdf1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:44.876396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:44.876706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:44.877030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] PATH_INFO: `/v3/projects/11fdae8adc844564a7030b7beff7f553` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:44.879660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11fdae8adc844564a7030b7beff7f553)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:44.888019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:44.997044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11fdae8adc844564a7030b7beff7f553', 'request_id': 'req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:45.008658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11fdae8adc844564a7030b7beff7f553', 'request_id': 'req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:45.022956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11fdae8adc844564a7030b7beff7f553', 'request_id': 'req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:45.068632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] The token cache is being invalidate because project 11fdae8adc844564a7030b7beff7f553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:45.069807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:45.070974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f47f8a9-c9a7-45a4-bf44-1c011ad1e604 tempest-QuotasTest-1727844560 tempest-QuotasTest-1727844560-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:45.074461 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2823/5620] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:44 2022] DELETE /identity/v3/projects/11fdae8adc844564a7030b7beff7f553 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:46.522242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:46.740717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5e3d9a-025c-45f1-9511-954044ffc199 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:46.879760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:46.880737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:46.881106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:46.881273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] PATH_INFO: `/v3/users/c3f1e335b4464a4ab65159fdd0df9da2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:46.882618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f1e335b4464a4ab65159fdd0df9da2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:46.886834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:47.049002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f1e335b4464a4ab65159fdd0df9da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.051299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f1e335b4464a4ab65159fdd0df9da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.093205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f1e335b4464a4ab65159fdd0df9da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.093205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f1e335b4464a4ab65159fdd0df9da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.137593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f1e335b4464a4ab65159fdd0df9da2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:47.209338 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2798/5621] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:46 2022] DELETE /identity/v3/users/c3f1e335b4464a4ab65159fdd0df9da2 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:47.213880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e09097-892e-4514-9fd2-101384b68649 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.214411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e09097-892e-4514-9fd2-101384b68649 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.214411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e09097-892e-4514-9fd2-101384b68649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.249081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-77e09097-892e-4514-9fd2-101384b68649 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:47.252510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77e09097-892e-4514-9fd2-101384b68649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:47.385337 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2824/5622] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:47.594002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:47.595492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:47.603013 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:47.774385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98488811-c5b7-4183-adce-b0d432edb9ae admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:47.788513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:47.789870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:47.790199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:47.790471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:47.819953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:47.821612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:47.839144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2799/5623] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:49.761341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e09097-892e-4514-9fd2-101384b68649 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:49.764564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77e09097-892e-4514-9fd2-101384b68649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:49.816633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e09097-892e-4514-9fd2-101384b68649 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:49.835017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:49.835942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:49.836222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:49.843884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] PATH_INFO: `/v3/projects/b8de4ecb17914905ae9d95a689dcabc1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:49.846918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8de4ecb17914905ae9d95a689dcabc1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:49.850818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:50.012895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8de4ecb17914905ae9d95a689dcabc1', 'request_id': 'req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.034242 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:50.047927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8de4ecb17914905ae9d95a689dcabc1', 'request_id': 'req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.082108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8de4ecb17914905ae9d95a689dcabc1', 'request_id': 'req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.119014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] The token cache is being invalidate because project b8de4ecb17914905ae9d95a689dcabc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:50.119477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.124444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.129357 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2825/5624] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:49 2022] DELETE /identity/v3/projects/b8de4ecb17914905ae9d95a689dcabc1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:50.134987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:50.152589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf6e30-2c1b-42a9-90c7-d4c45bd0cce3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:50.348146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:50.349469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:50.350630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:50.351108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] PATH_INFO: `/v3/users/933feb5b9b3946f0879c7d91a4a4bfe0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:50.353414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=933feb5b9b3946f0879c7d91a4a4bfe0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:50.357717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:50.518087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '933feb5b9b3946f0879c7d91a4a4bfe0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.521235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '933feb5b9b3946f0879c7d91a4a4bfe0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.542318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '933feb5b9b3946f0879c7d91a4a4bfe0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.543162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '933feb5b9b3946f0879c7d91a4a4bfe0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.558425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dbcba116-5945-4d4f-bfc9-bff9d2b659f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '933feb5b9b3946f0879c7d91a4a4bfe0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:50.604517 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2800/5625] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:50 2022] DELETE /identity/v3/users/933feb5b9b3946f0879c7d91a4a4bfe0 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:51.453546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:51.455190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:51.471434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc51f9-c23e-4a36-b9d8-773053c9ad39 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:51.637190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:51.638782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:51.639246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:51.640169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] PATH_INFO: `/v3/users/d969ffc833d74c8bbf65188f9d598c58` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:51.642311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d969ffc833d74c8bbf65188f9d598c58)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:51.645048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:51.743245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd969ffc833d74c8bbf65188f9d598c58'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:51.757132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd969ffc833d74c8bbf65188f9d598c58'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:51.782015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd969ffc833d74c8bbf65188f9d598c58'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:51.783562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd969ffc833d74c8bbf65188f9d598c58'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:51.798697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd969ffc833d74c8bbf65188f9d598c58'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:51.807781 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2826/5626] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:51 2022] DELETE /identity/v3/users/d969ffc833d74c8bbf65188f9d598c58 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:51.814699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:51.815286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:51.815286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:51.891406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:51.896564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:51.997034 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:52.106300 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2801/5627] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:52.137074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:52.139292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:52.372130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49a7b5-3c30-4c15-8cb8-796a4faee98e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:52.393948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:52.395158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:52.395694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:52.396211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:52.463864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:52.470461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:52.498003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2827/5628] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:53.156776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:53.160166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:53.200517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6659b-8e7c-4e85-b455-16b3d5c5c582 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:53.264106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:53.267530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:53.269036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:53.271710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] PATH_INFO: `/v3/projects/3dc8b2e7786e46adbce6fc040eefd7fb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:53.282857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dc8b2e7786e46adbce6fc040eefd7fb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:53.292903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:53.322782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:53.324248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:53.339286 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:53.344064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4523024-3738-4cf7-adbe-82dcf0b4fb89 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:53.350423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:53.351834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:53.352915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:53.353597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] PATH_INFO: `/v3/projects/55538b2d192e47b6b4332122004bcdf1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:53.355461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55538b2d192e47b6b4332122004bcdf1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:53.357892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:53.412880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dc8b2e7786e46adbce6fc040eefd7fb', 'request_id': 'req-f543ee2a-cb03-4b7e-87be-b10bbe379959'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.436432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55538b2d192e47b6b4332122004bcdf1', 'request_id': 'req-09ca817d-3aca-4d92-9234-403c3bbf1737'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.440462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dc8b2e7786e46adbce6fc040eefd7fb', 'request_id': 'req-f543ee2a-cb03-4b7e-87be-b10bbe379959'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.449546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55538b2d192e47b6b4332122004bcdf1', 'request_id': 'req-09ca817d-3aca-4d92-9234-403c3bbf1737'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.467648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55538b2d192e47b6b4332122004bcdf1', 'request_id': 'req-09ca817d-3aca-4d92-9234-403c3bbf1737'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.476282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dc8b2e7786e46adbce6fc040eefd7fb', 'request_id': 'req-f543ee2a-cb03-4b7e-87be-b10bbe379959'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.498235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] The token cache is being invalidate because project 55538b2d192e47b6b4332122004bcdf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:53.501991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.502994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09ca817d-3aca-4d92-9234-403c3bbf1737 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.509577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2828/5629] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:53 2022] DELETE /identity/v3/projects/55538b2d192e47b6b4332122004bcdf1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:53.517917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebee2a-b2df-4c52-ad9d-af22457b5dfc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:53.518866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebee2a-b2df-4c52-ad9d-af22457b5dfc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:53.519244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdebee2a-b2df-4c52-ad9d-af22457b5dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:53.559265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] The token cache is being invalidate because project 3dc8b2e7786e46adbce6fc040eefd7fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:53.559549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.560285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.560966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fdebee2a-b2df-4c52-ad9d-af22457b5dfc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:53.562460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fdebee2a-b2df-4c52-ad9d-af22457b5dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:53.565952 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2802/5630] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:53 2022] DELETE /identity/v3/projects/3dc8b2e7786e46adbce6fc040eefd7fb => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:53.570392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:53.575545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:53.726841 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2829/5631] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:53.757162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f543ee2a-cb03-4b7e-87be-b10bbe379959 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:53.781942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:53.796287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:53.798206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:53.799809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] PATH_INFO: `/v3/users/e5fd1ea39edf46babf82ffac70fb2394` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:53.803682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5fd1ea39edf46babf82ffac70fb2394)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:53.811796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:53.847730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:53.848376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:53.848910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:53.913694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:53.924873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:53.953173 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2830/5632] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:53.957237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:53.975082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5fd1ea39edf46babf82ffac70fb2394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.978904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5fd1ea39edf46babf82ffac70fb2394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:53.988467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e1a2b-91d9-4a6c-a612-e8dec0700ea6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:53.993283 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:54.007332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5fd1ea39edf46babf82ffac70fb2394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:54.010976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5fd1ea39edf46babf82ffac70fb2394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:54.019486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.022119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.023793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.024674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.026576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:54.028908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.034030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.040249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5fd1ea39edf46babf82ffac70fb2394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:54.090037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2831/5633] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:33:54.093094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.096619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:54.124619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2803/5634] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:53 2022] DELETE /identity/v3/users/e5fd1ea39edf46babf82ffac70fb2394 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:54.146665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c851534-fb8b-48f0-87fb-35b9faadf0f0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.363598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.364757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.365241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.365688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.366968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.371545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.422776 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:54.466352 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2832/5635] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:54 2022] POST /identity/v3/projects => generated 393 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:54.467962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.482743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b725bd4-5440-47d4-81f9-7d636f7a974e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.678007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.678810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.679292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.679772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.681115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.684893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.741794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2804/5636] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:54 2022] POST /identity/v3/users => generated 297 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:54.746564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.769787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f54c7d-9ed6-4873-80c7-b18b191b7622 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.780048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.781382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.781877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.782363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.783775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.786979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.812535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2833/5637] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:54.816466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.838505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e21666-c796-4512-bcff-d4737660d807 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.852515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bf614-b4c9-4ae4-b9e1-64e32bbb65de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.854140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bf614-b4c9-4ae4-b9e1-64e32bbb65de admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.854503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bf614-b4c9-4ae4-b9e1-64e32bbb65de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.854994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bf614-b4c9-4ae4-b9e1-64e32bbb65de admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.857360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bf614-b4c9-4ae4-b9e1-64e32bbb65de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.861189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bf614-b4c9-4ae4-b9e1-64e32bbb65de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:54.923970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:54.927432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2805/5638] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:54.950029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ceda7-3d4d-4b41-b3c8-9520507c6730 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:54.955138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:54.956070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:54.956379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:54.956653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] PATH_INFO: `/v3/projects/8bf9c8f8252243b3b56600b384bbb724/users/2c060a45451b456a8543680c72ec79ea/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:54.994927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf9c8f8252243b3b56600b384bbb724, user_id=2c060a45451b456a8543680c72ec79ea, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:54.998974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:55.032933 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2834/5639] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:54 2022] PUT /identity/v3/projects/8bf9c8f8252243b3b56600b384bbb724/users/2c060a45451b456a8543680c72ec79ea/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:55.057676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:55.058130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:55.058572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:55.202605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] MFA Rules not processed for user `2c060a45451b456a8543680c72ec79ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:55.203914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:55.363971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:55.366765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:55.425972 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2806/5640] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:55.427140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:55.547915 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:55.613523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707087c-9adf-4cf0-9b5c-60887f16a6b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:55.630529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:55.631251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:55.631541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:55.631900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:55.633496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:55.635844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:55.690052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa737da1-679b-4fa1-ac40-4506f67c198f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:55.701059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:55.701887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:55.702171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:55.702591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] PATH_INFO: `/v3/projects/843c3425ae994861a735033053d1a9a0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:55.704435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=843c3425ae994861a735033053d1a9a0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:55.705953 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2807/5641] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:55 2022] POST /identity/v3/projects => generated 391 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:55.706915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:55.707353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:55.859917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843c3425ae994861a735033053d1a9a0', 'request_id': 'req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:55.875168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f95b4-10a5-47cf-ad4e-a37cdd7a22cd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:55.879005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843c3425ae994861a735033053d1a9a0', 'request_id': 'req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:55.901242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843c3425ae994861a735033053d1a9a0', 'request_id': 'req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:55.930540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] The token cache is being invalidate because project 843c3425ae994861a735033053d1a9a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:33:55.931432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:55.932595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-12fbd6cb-24ba-42a7-a816-a6ba25c2c318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:55.943233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2835/5642] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:33:55 2022] DELETE /identity/v3/projects/843c3425ae994861a735033053d1a9a0 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:55.948101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa95d42-cedd-423b-83c1-91baaba1369a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:55.948815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa95d42-cedd-423b-83c1-91baaba1369a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:55.949303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa95d42-cedd-423b-83c1-91baaba1369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:55.996127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:55.998534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4aa95d42-cedd-423b-83c1-91baaba1369a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:56.001187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.001505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.001782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.002880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.009292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4aa95d42-cedd-423b-83c1-91baaba1369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:56.020947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.066100 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2836/5643] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:56.074233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.074678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.075055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.114872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2808/5644] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:55 2022] POST /identity/v3/users => generated 302 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:56.116062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.117135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:56.117985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:56.121018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:56.143318 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2837/5645] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:33:56.143509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84f031-92c5-4966-848b-96e22343c817 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.148303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.153684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.154522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.154859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.155138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.155913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.158721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.165516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea754b-3978-4068-974a-e44c768743f4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.176053 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2809/5646] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:56.179467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.179714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.180604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.180991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.181388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.182252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:33:56.182746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.185026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.209582 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2838/5647] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:33:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:33:56.212442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe1f7b-da99-430d-89af-6178f7913229 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.217872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.238129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.241595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.244821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.248743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] PATH_INFO: `/v3/projects/f44ce862eab24702bb3a7dc62914a3e3/users/c45a88f9ad044b838a94faba6b10ffb1/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.257661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a119a24-4aa6-41d6-ad2a-a59a9f2927de admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.279231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.280232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.280549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.280831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.281620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.283854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.310601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44ce862eab24702bb3a7dc62914a3e3, user_id=c45a88f9ad044b838a94faba6b10ffb1, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.317732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.336567 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:56.346484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2839/5648] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:56 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:56.350640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.357481 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2810/5649] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:56 2022] PUT /identity/v3/projects/f44ce862eab24702bb3a7dc62914a3e3/users/c45a88f9ad044b838a94faba6b10ffb1/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:56.359498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.436293 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:56.539141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd0ea2-ad9f-4d2d-9556-aeefe88aeac1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.555950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.556704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.556988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.557265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.557992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.560044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.562770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4062d8-1fad-4fd5-983a-caaa607df490 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.580290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.582940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.583379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.584271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.585341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.592690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.603357 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2840/5650] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:56 2022] POST /identity/v3/users => generated 283 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:56.611570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.626924 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2811/5651] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:56.628863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da12e427-b2db-4dc2-a867-22fbcf9d4b5e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.629074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.644174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.644950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.645232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.645512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.646295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.647987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.669995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe2f26a-caf4-417d-8acd-8091975c62e3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.682351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdbf195-ba4f-47af-8640-420f0b769dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.687720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbf195-ba4f-47af-8640-420f0b769dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.688112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbf195-ba4f-47af-8640-420f0b769dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.689163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdbf195-ba4f-47af-8640-420f0b769dbb admin admin] PATH_INFO: `/v3/projects/f44ce862eab24702bb3a7dc62914a3e3/users/c45a88f9ad044b838a94faba6b10ffb1/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.689721 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2841/5652] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:33:56.697130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.706348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbf195-ba4f-47af-8640-420f0b769dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f44ce862eab24702bb3a7dc62914a3e3, user_id=c45a88f9ad044b838a94faba6b10ffb1, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.709561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdbf195-ba4f-47af-8640-420f0b769dbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.714903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ab5ff-3a26-482a-b058-37a6f20a4dd6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.732153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.732909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.733198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.733479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.733716 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2812/5653] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:56 2022] PUT /identity/v3/projects/f44ce862eab24702bb3a7dc62914a3e3/users/c45a88f9ad044b838a94faba6b10ffb1/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:56.746650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.746650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:56.750207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70de05-dbf6-452a-a536-c01f1a6dbf43 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.765013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70de05-dbf6-452a-a536-c01f1a6dbf43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.765833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70de05-dbf6-452a-a536-c01f1a6dbf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.767502 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2842/5654] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:56.774361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:56.797066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e60811-0fa7-44ac-83f8-e526c8ec6851 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:56.858080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c70de05-dbf6-452a-a536-c01f1a6dbf43 None None] MFA Rules not processed for user `c45a88f9ad044b838a94faba6b10ffb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:56.861087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c70de05-dbf6-452a-a536-c01f1a6dbf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:56.955298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:56.956247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:56.956572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:56.956846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] PATH_INFO: `/v3/projects/4a5e082bc9ce4b2c9eb2d7e55e8afe7a/users/cc566ed91a8f4fef9334d39e07b038a6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:56.995736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a5e082bc9ce4b2c9eb2d7e55e8afe7a, user_id=cc566ed91a8f4fef9334d39e07b038a6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:56.998680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:57.047411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2843/5655] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:56 2022] PUT /identity/v3/projects/4a5e082bc9ce4b2c9eb2d7e55e8afe7a/users/cc566ed91a8f4fef9334d39e07b038a6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:57.047411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:57.049244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:57.067984 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2813/5656] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:56 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:57.069971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.069971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.070189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:57.158497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] MFA Rules not processed for user `cc566ed91a8f4fef9334d39e07b038a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:57.159765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:57.231516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903bce5-e731-4ec4-b1ca-8bf07c659f1b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:57.237154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:57.238011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.238286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.238557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:57.241885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:57.251372 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:57.412559 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2814/5657] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:57 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:57.413486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:57.417093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:57.422037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:57.423652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:57.437424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6b534f-9a82-451f-8b9b-35f6270d3ef0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:57.443323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:57.445762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.446392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.446785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:57.454886 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2844/5658] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:57.455877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:57.474690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d615f365-f396-416f-9cb3-8009b1692ac3 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:57.478883 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:57.483387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:57.486402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.487104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.488036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:57.489270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:57.491625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:57.544703 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2845/5659] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:33:57 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:57.550742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:57.631005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:57.633346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:57.661002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2815/5660] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:57.748968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4809fd9-f65a-4117-a7fd-76b0c8941a49 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:57.764090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:57.765406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.767700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.768218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:57.769210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:57.777239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:57.844076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2846/5661] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:33:57 2022] POST /identity/v3/users => generated 288 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:33:57.847917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:57.878537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda1721-de75-4bfa-9965-97a7c01c6bb4 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:57.901871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:57.902789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.903270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.903767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:57.905112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:57.907509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:57.946871 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2816/5662] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:57 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:57.947490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:57.967001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d778ef-7531-4868-ae68-022df7c59426 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:57.976633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:57.977769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:57.978047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:57.978320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] PATH_INFO: `/v3/projects/46581db34ad24eb7ba00db8edd398300/users/d9d9fda079d74e53a0756cf4e4e8c5a9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:58.023200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=46581db34ad24eb7ba00db8edd398300, user_id=d9d9fda079d74e53a0756cf4e4e8c5a9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:58.031195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:58.088773 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2847/5663] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:57 2022] PUT /identity/v3/projects/46581db34ad24eb7ba00db8edd398300/users/d9d9fda079d74e53a0756cf4e4e8c5a9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:58.094399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:58.139154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829fc45-5d3c-4dfd-941c-2abc98b961c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:58.373936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17715c39-db73-4cdd-bcc9-79436ac39421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:58.374832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17715c39-db73-4cdd-bcc9-79436ac39421 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:58.375118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17715c39-db73-4cdd-bcc9-79436ac39421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:58.375593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17715c39-db73-4cdd-bcc9-79436ac39421 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:58.376767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17715c39-db73-4cdd-bcc9-79436ac39421 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:58.379456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17715c39-db73-4cdd-bcc9-79436ac39421 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:58.405111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:58.405690 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2817/5664] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:33:58.463343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f4bd9-cfab-4c7a-9ecf-2ee1711c76ac admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:58.501137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:58.502604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:58.503546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:58.504050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] PATH_INFO: `/v3/projects/46581db34ad24eb7ba00db8edd398300/users/d9d9fda079d74e53a0756cf4e4e8c5a9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:58.511468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46581db34ad24eb7ba00db8edd398300, user_id=d9d9fda079d74e53a0756cf4e4e8c5a9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:58.515813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:58.532585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2848/5665] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:33:58 2022] PUT /identity/v3/projects/46581db34ad24eb7ba00db8edd398300/users/d9d9fda079d74e53a0756cf4e4e8c5a9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:33:58.553725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:58.556672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:58.557491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:58.607726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] MFA Rules not processed for user `d9d9fda079d74e53a0756cf4e4e8c5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:58.611606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:58.780822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2818/5666] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:58 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:58.842420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:58.998751 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:59.109562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ca34b-a423-49ce-b283-6ce9b1a71f00 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:59.121785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd301c-29c2-4795-85c6-cc58b7108aa2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:59.122339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd301c-29c2-4795-85c6-cc58b7108aa2 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:59.122621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd301c-29c2-4795-85c6-cc58b7108aa2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:59.122900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd301c-29c2-4795-85c6-cc58b7108aa2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:59.142344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd301c-29c2-4795-85c6-cc58b7108aa2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:59.143778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd301c-29c2-4795-85c6-cc58b7108aa2 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:59.176128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2849/5667] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:33:59.211985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:59.215835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:59.288320 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:33:59.360948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccac368-3b9a-4ccf-98a0-34d6e5b851a6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:33:59.366631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:33:59.367735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:59.368245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:59.368640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] PATH_INFO: `/v3/users/77d6c3c9aa554c4495312c6040afb4d5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:59.370266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] RBAC: Authorizing `identity:delete_user(user_id=77d6c3c9aa554c4495312c6040afb4d5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:33:59.372511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:33:59.446498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77d6c3c9aa554c4495312c6040afb4d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:59.447383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77d6c3c9aa554c4495312c6040afb4d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:59.460983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77d6c3c9aa554c4495312c6040afb4d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:59.468948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77d6c3c9aa554c4495312c6040afb4d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:59.483002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c3df964c-4ae0-4242-b88c-f25efe75883e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77d6c3c9aa554c4495312c6040afb4d5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:33:59.535271 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2819/5668] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:33:59 2022] DELETE /identity/v3/users/77d6c3c9aa554c4495312c6040afb4d5 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:33:59.702405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880390b-2195-4926-9478-4058b8f1100b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:59.702886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880390b-2195-4926-9478-4058b8f1100b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:59.703319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1880390b-2195-4926-9478-4058b8f1100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:59.737775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1880390b-2195-4926-9478-4058b8f1100b None None] MFA Rules not processed for user `c52883c1ab6a4dc2aa920785c1772c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:59.740278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1880390b-2195-4926-9478-4058b8f1100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:59.869272 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2850/5669] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:59.881849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:33:59.882391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:33:59.882754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:33:59.911273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] MFA Rules not processed for user `c52883c1ab6a4dc2aa920785c1772c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:33:59.916493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:33:59.929445 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2820/5670] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:33:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:33:59.940699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880390b-2195-4926-9478-4058b8f1100b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:33:59.942130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1880390b-2195-4926-9478-4058b8f1100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:00.036428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:00.038105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:00.160400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1880390b-2195-4926-9478-4058b8f1100b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:00.171152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb23ae7-ddce-4948-abc8-6820ba81ce15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:00.171999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb23ae7-ddce-4948-abc8-6820ba81ce15 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:00.172415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb23ae7-ddce-4948-abc8-6820ba81ce15 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:00.172795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb23ae7-ddce-4948-abc8-6820ba81ce15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:00.186004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb23ae7-ddce-4948-abc8-6820ba81ce15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:00.188392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb23ae7-ddce-4948-abc8-6820ba81ce15 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:00.198960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e56a3-5769-4d52-bdfb-b2857673f4d1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:00.206168 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2851/5671] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:33:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:00.221064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:00.221976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:00.222258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:00.222537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] PATH_INFO: `/v3/projects/13ade64c602047c9a96b22734e65caa1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:00.225907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] RBAC: Authorizing `identity:delete_project(project_id=13ade64c602047c9a96b22734e65caa1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:00.227924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:00.324574 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:00.350518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13ade64c602047c9a96b22734e65caa1', 'request_id': 'req-1c287536-5b3f-4aad-9c29-16d7e94ea56e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:00.365968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13ade64c602047c9a96b22734e65caa1', 'request_id': 'req-1c287536-5b3f-4aad-9c29-16d7e94ea56e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:00.377180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13ade64c602047c9a96b22734e65caa1', 'request_id': 'req-1c287536-5b3f-4aad-9c29-16d7e94ea56e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:00.404339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] The token cache is being invalidate because project 13ade64c602047c9a96b22734e65caa1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:00.404687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:00.405431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1c287536-5b3f-4aad-9c29-16d7e94ea56e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:00.410963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2821/5672] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:00 2022] DELETE /identity/v3/projects/13ade64c602047c9a96b22734e65caa1 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:00.421085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:00.421452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:00.421754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:00.481958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:00.484192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:00.603697 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:00.629941 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2852/5673] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:00.729815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:00.730107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:00.730389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:00.750997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:00.752289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:00.765547 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2822/5674] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:00.766760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:00.780785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020eab93-2244-40d5-8256-f792e3c04e1c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:00.793224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:00.794817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:00.795260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:00.795706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:00.797711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:00.798358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:00.800691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:00.820084 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2853/5675] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:34:00.826263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:00.837549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbbe1e-3c25-437a-bd2a-822ed4cf6612 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:00.847190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:00.848039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:00.848659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:00.849067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:00.849875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:00.853748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:00.903918 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2823/5676] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:00 2022] POST /identity/v3/projects => generated 379 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:00.906017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:00.922511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fddc8f-dcc2-4ab1-acef-1b8b0e62071d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:01.088813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:01.089661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:01.090047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:01.090436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:01.091684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:01.093614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:01.121677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2854/5677] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:00 2022] POST /identity/v3/users => generated 290 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:01.125278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:01.141231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd01e87-d066-461b-8cf1-45634fea18f0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:01.155670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:01.156475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:01.156835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:01.157536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:01.158299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:01.160561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:01.188928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2824/5678] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:34:01.192007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:01.208269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6642c92e-d7a6-4769-a195-ffdd61cbfd8f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:01.217969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cc8e61-1525-4308-94ec-7ae44fc5f93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:01.219173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc8e61-1525-4308-94ec-7ae44fc5f93f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:01.219592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc8e61-1525-4308-94ec-7ae44fc5f93f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:01.220070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cc8e61-1525-4308-94ec-7ae44fc5f93f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:01.221379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc8e61-1525-4308-94ec-7ae44fc5f93f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:01.224113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cc8e61-1525-4308-94ec-7ae44fc5f93f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:01.243456 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2855/5679] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:34:01.245107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:01.260182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d2ec4-8ef1-4052-ae4a-1f32adc07787 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:01.265963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:01.267154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:01.267588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:01.267996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] PATH_INFO: `/v3/projects/ec45030fdc6c4842b62458766f8dd076/users/6186adfcd67b4091b1d88acbfd35dcba/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:01.304062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec45030fdc6c4842b62458766f8dd076, user_id=6186adfcd67b4091b1d88acbfd35dcba, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:01.308482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:01.332722 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2825/5680] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:01 2022] PUT /identity/v3/projects/ec45030fdc6c4842b62458766f8dd076/users/6186adfcd67b4091b1d88acbfd35dcba/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:01.336576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61811091-8cdf-4613-901a-69396f81900f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:01.336951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61811091-8cdf-4613-901a-69396f81900f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:01.337159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61811091-8cdf-4613-901a-69396f81900f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:01.360242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-61811091-8cdf-4613-901a-69396f81900f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:01.361724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61811091-8cdf-4613-901a-69396f81900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:01.515884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2856/5681] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:01.533941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:01.535781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:01.654271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10646d6d-e3d8-4989-9356-41e8d5381d16 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:01.659208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:01.659898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:01.660184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:01.660500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:01.677550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:01.679325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:01.696140 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2826/5682] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:05.865693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61811091-8cdf-4613-901a-69396f81900f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:05.873718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61811091-8cdf-4613-901a-69396f81900f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:05.890671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:05.893588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:05.903149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61811091-8cdf-4613-901a-69396f81900f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:05.911738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:05.913843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:05.915711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:05.916406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:05.917453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64036e1-6b2e-48c6-a529-338622d6608a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:05.921939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:05.930873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:05.932442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:05.937353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:05.938486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] PATH_INFO: `/v3/users/58785d156c0c4c76ab6c607f98d120d3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:05.940317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58785d156c0c4c76ab6c607f98d120d3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:05.942805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:06.008260 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:06.011891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58785d156c0c4c76ab6c607f98d120d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:06.012967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58785d156c0c4c76ab6c607f98d120d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:06.015410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:06.018637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:06.025102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58785d156c0c4c76ab6c607f98d120d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:06.026211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58785d156c0c4c76ab6c607f98d120d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:06.035284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2857/5683] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:06.036020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7d0629-953a-4727-9133-1d69da9df489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58785d156c0c4c76ab6c607f98d120d3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:06.037662 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:06.071194 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2827/5684] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:05 2022] DELETE /identity/v3/users/58785d156c0c4c76ab6c607f98d120d3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:06.846077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:06.864631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9e412-eb68-4649-8846-eb4d267c3844 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:06.967097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:06.968138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:06.968516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:06.968845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] PATH_INFO: `/v3/projects/670985e06d7d4850a50b8d851cc451cf` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:06.970532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] RBAC: Authorizing `identity:delete_project(project_id=670985e06d7d4850a50b8d851cc451cf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:06.973477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.090156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670985e06d7d4850a50b8d851cc451cf', 'request_id': 'req-1b67fee4-92ee-4918-943d-765fcc58b98d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.101367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670985e06d7d4850a50b8d851cc451cf', 'request_id': 'req-1b67fee4-92ee-4918-943d-765fcc58b98d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.111106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670985e06d7d4850a50b8d851cc451cf', 'request_id': 'req-1b67fee4-92ee-4918-943d-765fcc58b98d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.125992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] The token cache is being invalidate because project 670985e06d7d4850a50b8d851cc451cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:07.126282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.126944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1b67fee4-92ee-4918-943d-765fcc58b98d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.128903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2858/5685] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:06 2022] DELETE /identity/v3/projects/670985e06d7d4850a50b8d851cc451cf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:07.133804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.134680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.135176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.181189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:07.182802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:07.286291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.286492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.286803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.287211 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2828/5686] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:07.315844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:07.317631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:07.327001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2859/5687] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:07.334802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.346829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae848b-717d-48b1-b6a0-c738bda72666 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.354245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.354942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.355280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.355574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.357044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:07.357044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.358732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.380665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2829/5688] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:07.382121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.399920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23b454a-0378-4a7e-8fd7-c20c92e99c61 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.406332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.408172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.408172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.408172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.409757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.412446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.452803 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2860/5689] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:07 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:07.454188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.469912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653eb1d-245c-4a15-8fc3-2bcebcceba6c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.592783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.594468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.594975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.595587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.596830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.603495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.659629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.662036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:07.689583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56609d9-855d-452e-8e14-b57dd8c34a75 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.702679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.703711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.703979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.704288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] PATH_INFO: `/v3/users/cc566ed91a8f4fef9334d39e07b038a6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.710365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc566ed91a8f4fef9334d39e07b038a6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.711721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2830/5690] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:07 2022] POST /identity/v3/users => generated 285 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:07.712790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.718353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.747671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b4899-c27d-4413-ad10-bda85348d0ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.754960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.756110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.756916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.757198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.758232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.761094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.802718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2831/5691] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:07.805779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc566ed91a8f4fef9334d39e07b038a6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.809464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.810114 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:07.829054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865034b3-49ab-4464-84ed-39189825d325 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.832585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc566ed91a8f4fef9334d39e07b038a6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.839762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.840928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.841220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.842987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.842987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.844008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.860599 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2832/5692] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:07 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:07.865651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:07.878094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc566ed91a8f4fef9334d39e07b038a6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.878927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc566ed91a8f4fef9334d39e07b038a6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.879146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e609cc90-8e5b-4f4a-98c6-8ff38498c831 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:07.885524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447ff18-8be0-4684-9df0-8f0f492b82ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:07.886701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447ff18-8be0-4684-9df0-8f0f492b82ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.887050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447ff18-8be0-4684-9df0-8f0f492b82ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.887714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447ff18-8be0-4684-9df0-8f0f492b82ac admin admin] PATH_INFO: `/v3/projects/8a5e5a03efc740aea554daf5ae3e31f5/users/c71037ca5b604aec959d9882d4064bc1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.889251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b450d9ff-6e83-4f44-9622-666f616b72b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc566ed91a8f4fef9334d39e07b038a6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:07.897432 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2861/5693] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:07 2022] DELETE /identity/v3/users/cc566ed91a8f4fef9334d39e07b038a6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:07.902170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.902556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.902923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.912900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447ff18-8be0-4684-9df0-8f0f492b82ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5e5a03efc740aea554daf5ae3e31f5, user_id=c71037ca5b604aec959d9882d4064bc1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:07.916076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4447ff18-8be0-4684-9df0-8f0f492b82ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:07.927847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:07.930112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:07.948414 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2833/5694] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:07 2022] PUT /identity/v3/projects/8a5e5a03efc740aea554daf5ae3e31f5/users/c71037ca5b604aec959d9882d4064bc1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:07.959491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:07.960112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:07.960649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:07.999157 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:08.019395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] MFA Rules not processed for user `c71037ca5b604aec959d9882d4064bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:08.021018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.039259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2862/5695] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:08.102936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.111933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.220932 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2834/5696] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:08.223321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.226368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.268899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d48c9f-053a-499b-b08e-488234b48090 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.319514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12965b53-b779-4dea-8ef1-e54b24c36693 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.326988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.327660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.328230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.328230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.328524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] PATH_INFO: `/v3/users/2c060a45451b456a8543680c72ec79ea` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.328745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.329123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.329561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.329734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c060a45451b456a8543680c72ec79ea)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.331876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.344183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.347459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.373809 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2863/5697] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:08.375227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.377691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.397161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c060a45451b456a8543680c72ec79ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:08.397916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c060a45451b456a8543680c72ec79ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:08.407945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d4bd4-58e6-4b37-844c-008ce1f6915c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.412601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c060a45451b456a8543680c72ec79ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:08.415158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c060a45451b456a8543680c72ec79ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:08.420446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.421790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.422339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.422918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.424241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.426991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4e168d70-0448-4de8-aeb2-04fa72f2c3ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c060a45451b456a8543680c72ec79ea'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:08.428109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.478382 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2835/5698] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:08 2022] DELETE /identity/v3/users/2c060a45451b456a8543680c72ec79ea => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:08.485148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.485908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.486734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.494643 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2864/5699] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:08 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:08.503571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.507128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.515349 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:08.522151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:08.524107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.546503 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:08.627185 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2836/5700] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:08.632782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.634323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.692837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56a679-38cf-4487-99cf-0db7417d6455 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.708907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.709792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.710208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.710660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.711756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.716377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.747889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd535c7c-c7a0-4c1f-b9b9-726d7a6aaa57 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.755873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.758695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.759477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.760479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.767262 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2865/5701] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:08 2022] POST /identity/v3/users => generated 290 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:08.768321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.774118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.794684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.796189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.809439 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2837/5702] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:08.809752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e78b1a0-5e56-4e18-a078-9caa75346970 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.810401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.820032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.820032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.820032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.820032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.828103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:08.828329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d497addc-3b8f-4a6f-bb9f-6dad2bc8325e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.861801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.867019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.867309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.867567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.871356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.874338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.875915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.878973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.902964 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2838/5703] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:08.903663 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2866/5704] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:08.906909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:08.921701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62f4dc-2147-4043-aaa6-1b6a90b6378c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:08.928101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:08.929756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:08.930115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:08.930460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] PATH_INFO: `/v3/projects/018f609df44344abab313c3e7cbfdade/users/9a044a07e9f44e86b42953dad2521a5e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:08.951352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018f609df44344abab313c3e7cbfdade, user_id=9a044a07e9f44e86b42953dad2521a5e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:08.954905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:08.980195 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2839/5705] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:08 2022] PUT /identity/v3/projects/018f609df44344abab313c3e7cbfdade/users/9a044a07e9f44e86b42953dad2521a5e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:08.984117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.006279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c83556-5460-43fb-a88b-58755b880595 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:09.192883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc5915-c502-4fdb-92ec-affdc4a07454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:09.194436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5915-c502-4fdb-92ec-affdc4a07454 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.195042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5915-c502-4fdb-92ec-affdc4a07454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.195549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc5915-c502-4fdb-92ec-affdc4a07454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.196802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc5915-c502-4fdb-92ec-affdc4a07454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:09.199354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc5915-c502-4fdb-92ec-affdc4a07454 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:09.222188 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2867/5706] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:08 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:09.227460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.275775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bda5b-620b-401f-a86a-9948746c3633 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:09.294563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:09.295546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.295833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.296109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] PATH_INFO: `/v3/projects/018f609df44344abab313c3e7cbfdade/users/9a044a07e9f44e86b42953dad2521a5e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.303298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=018f609df44344abab313c3e7cbfdade, user_id=9a044a07e9f44e86b42953dad2521a5e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:09.308968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:09.327504 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2840/5707] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:09 2022] PUT /identity/v3/projects/018f609df44344abab313c3e7cbfdade/users/9a044a07e9f44e86b42953dad2521a5e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:09.338916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.339224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.339476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.370070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.373410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:09.407668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] MFA Rules not processed for user `9a044a07e9f44e86b42953dad2521a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:09.413747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:09.521712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73043bf-653e-4420-b0fa-289ac2d25a33 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:09.536316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:09.537275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.537565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.537844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] PATH_INFO: `/v3/projects/4a5e082bc9ce4b2c9eb2d7e55e8afe7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.539521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a5e082bc9ce4b2c9eb2d7e55e8afe7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:09.543325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:09.576168 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:09.595007 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2868/5708] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:09 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:09.596039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.604804 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:09.624541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7d373e-da29-49da-8554-bb421d515785 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:09.655643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a5e082bc9ce4b2c9eb2d7e55e8afe7a', 'request_id': 'req-50c79ff8-b0da-4132-a807-2135e9fb454c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:09.678176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a5e082bc9ce4b2c9eb2d7e55e8afe7a', 'request_id': 'req-50c79ff8-b0da-4132-a807-2135e9fb454c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:09.701438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a5e082bc9ce4b2c9eb2d7e55e8afe7a', 'request_id': 'req-50c79ff8-b0da-4132-a807-2135e9fb454c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:09.728588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] The token cache is being invalidate because project 4a5e082bc9ce4b2c9eb2d7e55e8afe7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:09.730614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:09.745037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:09.755961 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2841/5709] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:09 2022] DELETE /identity/v3/projects/4a5e082bc9ce4b2c9eb2d7e55e8afe7a => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:09.760241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.762888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:09.832707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:09.833911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.834466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.834950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.836257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:09.838901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:09.892833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c79ff8-b0da-4132-a807-2135e9fb454c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:09.901913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:09.903453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:09.903941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:09.904410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] PATH_INFO: `/v3/users/d9d9fda079d74e53a0756cf4e4e8c5a9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:09.906542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d9fda079d74e53a0756cf4e4e8c5a9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:09.911320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:09.925547 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2869/5710] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:09 2022] POST /identity/v3/projects => generated 359 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:09.926837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:09.936257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:10.021346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d9fda079d74e53a0756cf4e4e8c5a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.025254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d9fda079d74e53a0756cf4e4e8c5a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.060793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d9fda079d74e53a0756cf4e4e8c5a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.061849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d9fda079d74e53a0756cf4e4e8c5a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.085140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d9fda079d74e53a0756cf4e4e8c5a9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.102588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274fc835-13e9-4292-8e23-1a71b5cc2e7b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:10.121897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:10.123389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:10.126056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:10.126926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:10.127454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:10.134335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:10.183714 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2842/5711] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:09 2022] DELETE /identity/v3/users/d9d9fda079d74e53a0756cf4e4e8c5a9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:10.183714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:10.185972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:10.198900 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2870/5712] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:09 2022] POST /identity/v3/users => generated 416 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:10.201993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:10.207605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:10.242567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11952492-e2ba-48aa-b58d-0b2af568521d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:10.255752 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:10.321979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10da361-6f61-4fbc-bf86-3f21ba1b6d35 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:10.328400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:10.329329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:10.329602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:10.330050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] PATH_INFO: `/v3/projects/8bf9c8f8252243b3b56600b384bbb724` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:10.333067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf9c8f8252243b3b56600b384bbb724)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:10.335125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:10.398206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:10.399460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:10.399833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:10.400255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/users/d268df77327f4a0b8380e91d2073b0a3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:10.403868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf9c8f8252243b3b56600b384bbb724', 'request_id': 'req-1beadf2f-09a6-4396-8f18-4f53a83fa268'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.436581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_user(user_id=d268df77327f4a0b8380e91d2073b0a3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:10.440530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf9c8f8252243b3b56600b384bbb724', 'request_id': 'req-1beadf2f-09a6-4396-8f18-4f53a83fa268'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.440780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:10.457414 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2871/5713] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:34:10 2022] GET /identity/v3/users/d268df77327f4a0b8380e91d2073b0a3 => generated 416 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:10.457619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:10.469705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf9c8f8252243b3b56600b384bbb724', 'request_id': 'req-1beadf2f-09a6-4396-8f18-4f53a83fa268'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.481667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65b309f-4882-4450-8f11-9e29971c092e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:10.502528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] The token cache is being invalidate because project 8bf9c8f8252243b3b56600b384bbb724 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:10.504318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.509080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.513079 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:10.513998 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2843/5714] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:10 2022] DELETE /identity/v3/projects/8bf9c8f8252243b3b56600b384bbb724 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:10.518729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:10.521709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:10.621658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:10.622683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:10.623342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:10.623765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/users/d268df77327f4a0b8380e91d2073b0a3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:10.627867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d268df77327f4a0b8380e91d2073b0a3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:10.631283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:10.664986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beadf2f-09a6-4396-8f18-4f53a83fa268 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:10.671437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:10.672731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:10.673260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:10.673719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] PATH_INFO: `/v3/users/c45a88f9ad044b838a94faba6b10ffb1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:10.675321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45a88f9ad044b838a94faba6b10ffb1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:10.678070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:10.792651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45a88f9ad044b838a94faba6b10ffb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.795478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45a88f9ad044b838a94faba6b10ffb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.800329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd268df77327f4a0b8380e91d2073b0a3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.818575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45a88f9ad044b838a94faba6b10ffb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.823294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45a88f9ad044b838a94faba6b10ffb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.825552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd268df77327f4a0b8380e91d2073b0a3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.831649 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:10.858934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45a88f9ad044b838a94faba6b10ffb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.859222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd268df77327f4a0b8380e91d2073b0a3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.860788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd268df77327f4a0b8380e91d2073b0a3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.884144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd268df77327f4a0b8380e91d2073b0a3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:10.896732 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2844/5716] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:10 2022] DELETE /identity/v3/users/c45a88f9ad044b838a94faba6b10ffb1 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:10.897015 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2872/5716] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:10 2022] DELETE /identity/v3/users/d268df77327f4a0b8380e91d2073b0a3 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:10.905152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:10.907843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:11.022641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844198d1-9530-4fe4-9d18-882f64a2ffac tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:11.106799 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:11.156285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:11.158119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:11.158580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:11.159620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/732f7a6450c0485baad9c54d9ff6bf32` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:11.161682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=732f7a6450c0485baad9c54d9ff6bf32)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:11.166343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:11.272471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732f7a6450c0485baad9c54d9ff6bf32', 'request_id': 'req-7b3fa193-6af4-4414-bf6d-8fd15d368f86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.292388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732f7a6450c0485baad9c54d9ff6bf32', 'request_id': 'req-7b3fa193-6af4-4414-bf6d-8fd15d368f86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.303014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732f7a6450c0485baad9c54d9ff6bf32', 'request_id': 'req-7b3fa193-6af4-4414-bf6d-8fd15d368f86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.322369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 732f7a6450c0485baad9c54d9ff6bf32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:11.322737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.323560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.325374 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2873/5717] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:10 2022] DELETE /identity/v3/projects/732f7a6450c0485baad9c54d9ff6bf32 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:11.331140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:11.333831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:11.353710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8592e84d-ee93-4b27-bbdf-94b8d121f6f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:11.441227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:11.441536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:11.441942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:11.442498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:11.444735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:11.447061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:11.478363 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2845/5718] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:11 2022] POST /identity/v3/projects => generated 349 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:11.479986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:11.481512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:11.502224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3fa193-6af4-4414-bf6d-8fd15d368f86 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:11.592529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:11.593446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:11.593963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:11.594399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:11.595372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:11.595847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:11.598018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:11.624854 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2874/5719] 10.222.0.15 () {58 vars in 1159 bytes} [Tue Jul 19 11:34:11 2022] GET /identity/v3/projects?is_domain=True => generated 1021 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:34:11.628494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:11.647639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054de110-7fd0-46b5-8bed-a0694c2c344e tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:11.659690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:11.661131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:11.661421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:11.661701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:11.662560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:11.664186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:11.715201 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2846/5720] 10.222.0.15 () {58 vars in 1127 bytes} [Tue Jul 19 11:34:11 2022] GET /identity/v3/domains => generated 830 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:11.716855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:11.735242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a64fb-54a9-4edf-a8dc-e115c8e06c1a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:11.749848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:11.751096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:11.751397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:11.751692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/bb70497f38b646b587227728876c3142` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:11.754114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:update_project(project_id=bb70497f38b646b587227728876c3142)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:11.755198 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:34:11.755198 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:34:11.755198 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:34:11.758510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:11.792370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'bb70497f38b646b587227728876c3142'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.795268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'bb70497f38b646b587227728876c3142'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.851408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'bb70497f38b646b587227728876c3142'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.852096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'bb70497f38b646b587227728876c3142'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:11.857636 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2875/5721] 10.222.0.15 () {60 vars in 1251 bytes} [Tue Jul 19 11:34:11 2022] PATCH /identity/v3/projects/bb70497f38b646b587227728876c3142 => generated 363 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:11.862163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:11.863993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:11.878873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae711898-346e-4e39-b37e-5e65c941a1cd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:11.959091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:11.960966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:11.961449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:11.962034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/bb70497f38b646b587227728876c3142` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:11.984653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bb70497f38b646b587227728876c3142)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:11.988228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:12.043227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'bb70497f38b646b587227728876c3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.049565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'bb70497f38b646b587227728876c3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.109590 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:12.163421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb70497f38b646b587227728876c3142', 'request_id': 'req-a41bf97f-d357-415c-9d4f-d752b5171274'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.189244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb70497f38b646b587227728876c3142', 'request_id': 'req-a41bf97f-d357-415c-9d4f-d752b5171274'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.204833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb70497f38b646b587227728876c3142', 'request_id': 'req-a41bf97f-d357-415c-9d4f-d752b5171274'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.233781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project bb70497f38b646b587227728876c3142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:12.235384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.237395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.252359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'bb70497f38b646b587227728876c3142', 'request_id': 'req-a41bf97f-d357-415c-9d4f-d752b5171274'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.253495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'bb70497f38b646b587227728876c3142', 'request_id': 'req-a41bf97f-d357-415c-9d4f-d752b5171274'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.258636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'bb70497f38b646b587227728876c3142', 'request_id': 'req-a41bf97f-d357-415c-9d4f-d752b5171274'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.272524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:12.275018 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2847/5722] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:11 2022] DELETE /identity/v3/projects/bb70497f38b646b587227728876c3142 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:12.290219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb38467-ac5f-4258-a3fe-01aad63ee120 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:12.338364 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:12.412882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:12.414320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:12.414825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:12.415365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:12.416713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:12.419601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:12.494084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:12.496334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:12.508850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2876/5723] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:12 2022] POST /identity/v3/projects => generated 359 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:12.531456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bf97f-d357-415c-9d4f-d752b5171274 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:12.536953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:12.540027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:12.663588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:12.665467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:12.666206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:12.689354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/a162064136c5403a93d69de6c46594c0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:12.696876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=a162064136c5403a93d69de6c46594c0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:12.708452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc557660-43f2-44f7-be0d-7c12ecf04630 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:12.721155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:12.727649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2848/5724] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:12 2022] GET /identity/v3/projects/a162064136c5403a93d69de6c46594c0 => generated 359 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:12.731673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:12.733387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:12.733918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:12.734233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:12.734511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] PATH_INFO: `/v3/projects/f44ce862eab24702bb3a7dc62914a3e3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:12.736702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:12.739664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f44ce862eab24702bb3a7dc62914a3e3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:12.745795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:12.780216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d145e32-1319-4ba2-95cb-ef693f1f6ba6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:12.794333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:12.796141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:12.797871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:12.801285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] PATH_INFO: `/v3/projects/46581db34ad24eb7ba00db8edd398300` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:12.805311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=46581db34ad24eb7ba00db8edd398300)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:12.807452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:12.933690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46581db34ad24eb7ba00db8edd398300', 'request_id': 'req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.935484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f44ce862eab24702bb3a7dc62914a3e3', 'request_id': 'req-7ce7b146-24cb-41c4-b148-b1f812be07c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.962252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46581db34ad24eb7ba00db8edd398300', 'request_id': 'req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.962492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f44ce862eab24702bb3a7dc62914a3e3', 'request_id': 'req-7ce7b146-24cb-41c4-b148-b1f812be07c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.978202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f44ce862eab24702bb3a7dc62914a3e3', 'request_id': 'req-7ce7b146-24cb-41c4-b148-b1f812be07c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.982351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46581db34ad24eb7ba00db8edd398300', 'request_id': 'req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.997249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] The token cache is being invalidate because project f44ce862eab24702bb3a7dc62914a3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:12.997576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:12.998313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.004451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2877/5725] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:12 2022] DELETE /identity/v3/projects/f44ce862eab24702bb3a7dc62914a3e3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:13.004451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:13.007830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] The token cache is being invalidate because project 46581db34ad24eb7ba00db8edd398300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:13.010220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.010376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.011882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a8acc1-e2c4-4187-9f47-c5c51821dbdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.019831 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2849/5726] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:12 2022] DELETE /identity/v3/projects/46581db34ad24eb7ba00db8edd398300 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:13.023317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d44de-6e04-486e-a4de-cfcb74a6f62d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.023609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d44de-6e04-486e-a4de-cfcb74a6f62d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.026054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625d44de-6e04-486e-a4de-cfcb74a6f62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.105475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-625d44de-6e04-486e-a4de-cfcb74a6f62d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:13.114028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-625d44de-6e04-486e-a4de-cfcb74a6f62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.128414 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:13.154237 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:13.178080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce7b146-24cb-41c4-b148-b1f812be07c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:13.246407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2850/5727] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:13.246407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7add-f4cd-4f37-bf95-e113c2c5f809 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.246407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7add-f4cd-4f37-bf95-e113c2c5f809 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.246407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71f7add-f4cd-4f37-bf95-e113c2c5f809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.284398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f71f7add-f4cd-4f37-bf95-e113c2c5f809 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:13.285042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f71f7add-f4cd-4f37-bf95-e113c2c5f809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.308615 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2851/5728] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:13.310147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1ac0-79bc-43dd-a67d-5e24af6b01b9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.310439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1ac0-79bc-43dd-a67d-5e24af6b01b9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.310718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4e1ac0-79bc-43dd-a67d-5e24af6b01b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.328857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:13.330966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.331690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.332579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/a162064136c5403a93d69de6c46594c0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.334619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a162064136c5403a93d69de6c46594c0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:13.337843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:13.364295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ad4e1ac0-79bc-43dd-a67d-5e24af6b01b9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:13.366196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad4e1ac0-79bc-43dd-a67d-5e24af6b01b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.390431 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2852/5729] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:13.392080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.392407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.392694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.423527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a162064136c5403a93d69de6c46594c0', 'request_id': 'req-35cd44f4-d569-4ba4-a54e-8855175e45bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.443838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a162064136c5403a93d69de6c46594c0', 'request_id': 'req-35cd44f4-d569-4ba4-a54e-8855175e45bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.445478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:13.447612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.455631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a162064136c5403a93d69de6c46594c0', 'request_id': 'req-35cd44f4-d569-4ba4-a54e-8855175e45bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.486618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project a162064136c5403a93d69de6c46594c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:13.487569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.491970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:13.497934 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2878/5730] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:13 2022] DELETE /identity/v3/projects/a162064136c5403a93d69de6c46594c0 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:13.499088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:13.505362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.539406 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2853/5731] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:13.541315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:13.543902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:13.615058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd44f4-d569-4ba4-a54e-8855175e45bd tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:13.634293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:13.635741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.636128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.636608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.638050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:13.638769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:13.644402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:13.662000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2879/5732] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:13.662000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:13.673818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc23f06-ab42-41e0-861d-176bcb5c965d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:13.684844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d1cad-4748-4c7f-9adf-3071d876c805 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:13.690416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:13.692318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.693598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.694377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.696827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:13.701127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:13.704627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:13.708125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.709411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.710706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.711612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:13.712826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:13.717926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:13.749015 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:13.761746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2880/5733] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:13.761746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:13.776133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98a8ff-555a-46d9-b22b-9e3e9e45e3f2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:13.777769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2854/5734] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/projects => generated 359 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:13.779564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:13.864374 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:13.918249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:13.919221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.919507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.919800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.921237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:13.925068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:13.927224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d13633-886d-4b6e-8ea3-88996e9893e0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:13.936104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:13.937459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:13.937958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:13.938573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:13.940103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:13.943891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:13.992272 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2881/5735] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/projects => generated 373 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:13.992272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.026811 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2855/5736] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:13 2022] POST /identity/v3/projects => generated 391 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:14.029673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.113220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3e62b-9138-468f-85c2-a86a2f81aafa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.165944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e006f0f-74b9-4c06-9f56-ef7c4b7b978a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.171702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.172544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.172903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.173255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.174524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.176670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.204874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.206879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.207365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.207996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/bb68a66c98744cd1b8398b3c26ae8707` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.209824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=bb68a66c98744cd1b8398b3c26ae8707)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.214208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.216697 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2882/5737] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:13 2022] GET /identity/v3/projects/bb68a66c98744cd1b8398b3c26ae8707 => generated 359 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:14.221399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.226046 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2856/5738] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:14 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:14.229538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.243566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb8766b-6344-45e9-92e1-e2394712914b tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.253400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.254184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.255675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.257386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.259794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.264151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.269453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09e26b-c875-4ac9-ae95-469f31e6aa61 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.275410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.276749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.277200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.277816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/bb68a66c98744cd1b8398b3c26ae8707` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.279525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bb68a66c98744cd1b8398b3c26ae8707)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.281892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.301546 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2883/5739] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:14 2022] POST /identity/v3/users => generated 296 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:14.301546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.322141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a70893-a0f7-4900-895c-cc7031957f7c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.332243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.334686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.336711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.339303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.348646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.348646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.402084 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2884/5740] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:14.403214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.411674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb68a66c98744cd1b8398b3c26ae8707', 'request_id': 'req-cf24faa0-f9ab-451f-881f-36087392b7de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:14.421489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb68a66c98744cd1b8398b3c26ae8707', 'request_id': 'req-cf24faa0-f9ab-451f-881f-36087392b7de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:14.428518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb68a66c98744cd1b8398b3c26ae8707', 'request_id': 'req-cf24faa0-f9ab-451f-881f-36087392b7de'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:14.430821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d7652-c65f-4488-ac0b-9d1e24e6863f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.440708 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:14.465081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project bb68a66c98744cd1b8398b3c26ae8707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:14.467506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:14.468795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:14.472869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2857/5741] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:14 2022] DELETE /identity/v3/projects/bb68a66c98744cd1b8398b3c26ae8707 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:14.477310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.481259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:14.538518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.539490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.540189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.540664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.541667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.544208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.551169 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:14.563568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2885/5742] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:14.563568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.573362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:14.604531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24faa0-f9ab-451f-881f-36087392b7de tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.610787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.611509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.612075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.612375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.613138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.615080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.630124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2858/5743] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:14.633451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.635446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:14.652514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca7c08-cdea-4bb1-9d45-15c7cb890438 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.657712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.658576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.659039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.659324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.660065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.662060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.670833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f43b3a5-f00d-4d8f-a0a3-918de6af2105 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.676982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.677234 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2859/5744] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:14.678286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.678410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.678744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.679559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.680791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.683282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.693968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fd6ad-8b34-4291-bc0f-f7e04f91469d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.702138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.703489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.704149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.704389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] PATH_INFO: `/v3/projects/7d0dc7636df94bea8042325415db8ca0/users/7e1f471a538c49a2ac44d9a7a0b59109/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.722660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d0dc7636df94bea8042325415db8ca0, user_id=7e1f471a538c49a2ac44d9a7a0b59109, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.725326 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2886/5745] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:34:14 2022] POST /identity/v3/projects => generated 345 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:14.725991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.727008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.751102 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2860/5746] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:14 2022] PUT /identity/v3/projects/7d0dc7636df94bea8042325415db8ca0/users/7e1f471a538c49a2ac44d9a7a0b59109/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:14.752284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.821301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b2d68-d608-48f1-9b9c-b0863576d158 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.839376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbd614-d30d-48fd-9d62-af12dd834acb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:14.845041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d955ec-175b-466c-9f35-531b5a4665c0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.845990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d955ec-175b-466c-9f35-531b5a4665c0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.846280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d955ec-175b-466c-9f35-531b5a4665c0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.846555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d955ec-175b-466c-9f35-531b5a4665c0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/7ac23bdc64c741f998ba604a8454d70e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.847807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d955ec-175b-466c-9f35-531b5a4665c0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=7ac23bdc64c741f998ba604a8454d70e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.850069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d955ec-175b-466c-9f35-531b5a4665c0 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.852229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2861/5747] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:14 2022] GET /identity/v3/projects/7ac23bdc64c741f998ba604a8454d70e => generated 345 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:14.858111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee2551-0214-4264-9078-0d877975b492 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.858410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee2551-0214-4264-9078-0d877975b492 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.858691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee2551-0214-4264-9078-0d877975b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.878279 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:14.894572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-35ee2551-0214-4264-9078-0d877975b492 None None] MFA Rules not processed for user `7e1f471a538c49a2ac44d9a7a0b59109`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:14.895862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35ee2551-0214-4264-9078-0d877975b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:14.911140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:14.912375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.912749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.913173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] PATH_INFO: `/v3/projects/e06eb800914e46918b722c98245ec477/users/8bbfd79146564bf790882b01159e142c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:14.937254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e06eb800914e46918b722c98245ec477, user_id=8bbfd79146564bf790882b01159e142c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:14.940646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:14.968449 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2887/5748] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:14 2022] PUT /identity/v3/projects/e06eb800914e46918b722c98245ec477/users/8bbfd79146564bf790882b01159e142c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:14.969551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:14.972244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2862/5749] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:14.979757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:14.980031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:14.980412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.017675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] MFA Rules not processed for user `8bbfd79146564bf790882b01159e142c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:15.021075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.045113 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:15.122429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f32e1-b228-462b-8a30-6f95366ec783 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.141666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.142671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.142959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.143239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/7ac23bdc64c741f998ba604a8454d70e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.146030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7ac23bdc64c741f998ba604a8454d70e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.148072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.165343 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2863/5750] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:15.166600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.169287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.265858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac23bdc64c741f998ba604a8454d70e', 'request_id': 'req-143be4da-e7ad-4979-8649-bcfec907c4ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:15.283203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac23bdc64c741f998ba604a8454d70e', 'request_id': 'req-143be4da-e7ad-4979-8649-bcfec907c4ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:15.293721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac23bdc64c741f998ba604a8454d70e', 'request_id': 'req-143be4da-e7ad-4979-8649-bcfec907c4ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:15.324775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 7ac23bdc64c741f998ba604a8454d70e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:15.326791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:15.327691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:15.333510 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2888/5751] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:14 2022] DELETE /identity/v3/projects/7ac23bdc64c741f998ba604a8454d70e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:15.333510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.333510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.334923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33723b13-d8cb-4dcc-9490-c3306713abdc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.439316 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:15.450362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be4da-e7ad-4979-8649-bcfec907c4ba tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.456817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.464699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.465017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.465473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.467914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.483150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.484179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.484590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.484967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.493212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.590034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.591766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.617890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.620081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.621096 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2889/5752] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:15.625164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.631415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.635077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2864/5753] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:15.636053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.637768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.659293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e29aa9-f6ca-4ba4-808a-9f77aaee8691 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.673474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.675566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.675758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.676014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.681865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.685104 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:15.723487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.727706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.743974 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2890/5754] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:15.746352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.761027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78752b-d708-4894-a005-270d0d0ec847 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.761518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a222045-f79c-42b6-97e4-4d9a31bf3547 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.765747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.766926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.767401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.767893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.778158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.778864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.779154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.779439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.780198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.781229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.782379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.783273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.801246 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2891/5755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:15.805849 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2865/5756] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:34:15 2022] POST /identity/v3/domains => generated 275 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:15.810219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.828977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233165ae-9465-429f-a3c0-8287c77f9ae2 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.844681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:15.846859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:15.933312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d1cb9a-5d9a-432b-b946-0b632ba9a745 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:15.934200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.935240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.935798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.936370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.938125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.940746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:15.940933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.941967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:15.942331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:15.942683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] PATH_INFO: `/v3/users/8bbfd79146564bf790882b01159e142c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:15.944833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbfd79146564bf790882b01159e142c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:15.948368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:15.997851 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2892/5757] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:15 2022] POST /identity/v3/projects => generated 405 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:16.002577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:16.025416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbfd79146564bf790882b01159e142c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.026214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbfd79146564bf790882b01159e142c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.039893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbfd79146564bf790882b01159e142c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.041171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbfd79146564bf790882b01159e142c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.068871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b3b8272-e6de-4693-8249-c12d67f514ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbfd79146564bf790882b01159e142c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.102396 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2866/5758] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:15 2022] DELETE /identity/v3/users/8bbfd79146564bf790882b01159e142c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:16.109202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:16.110788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:16.111681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:16.135572 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:16.137918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:16.139962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:16.172951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1bce24-d042-43e8-a314-5a0d9c2b1338 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:16.186881 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:16.227410 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2867/5759] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:16.300203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:16.301718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:16.302234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:16.302725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/0ddf9abf757c4d5987ccf1b0aeda899d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:16.304670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=0ddf9abf757c4d5987ccf1b0aeda899d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:16.307586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:16.309618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:16.311239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:16.311472 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2893/5760] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:16 2022] GET /identity/v3/projects/0ddf9abf757c4d5987ccf1b0aeda899d => generated 405 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:16.317143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:16.320752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:16.337421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df2994-0af4-44df-9504-bf1ad93d670c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:16.344569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:16.345941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:16.346450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:16.347382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/0ddf9abf757c4d5987ccf1b0aeda899d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:16.349315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0ddf9abf757c4d5987ccf1b0aeda899d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:16.352276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:16.429980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddf9abf757c4d5987ccf1b0aeda899d', 'request_id': 'req-8e8545f8-0033-4d60-acd5-6326edcd6b98'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.442787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6e74-7331-4079-9b5e-276c1f314966 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:16.445589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddf9abf757c4d5987ccf1b0aeda899d', 'request_id': 'req-8e8545f8-0033-4d60-acd5-6326edcd6b98'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.461254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddf9abf757c4d5987ccf1b0aeda899d', 'request_id': 'req-8e8545f8-0033-4d60-acd5-6326edcd6b98'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.479430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 0ddf9abf757c4d5987ccf1b0aeda899d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:16.480101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.481781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.484802 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2894/5761] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:16 2022] DELETE /identity/v3/projects/0ddf9abf757c4d5987ccf1b0aeda899d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:16.500002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:16.501720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:16.600861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:16.602982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:16.604240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:16.605339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:16.611621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:16.623677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8545f8-0033-4d60-acd5-6326edcd6b98 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:16.629446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:16.630582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:16.630877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:16.632274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains/367b73cfc1dc4cd9af0d1a82d4dc0145` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:16.633847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=367b73cfc1dc4cd9af0d1a82d4dc0145)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:16.636289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:16.666704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.667496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.688437 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:16.719288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.720742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.726800 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2895/5762] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:34:16 2022] PATCH /identity/v3/domains/367b73cfc1dc4cd9af0d1a82d4dc0145 => generated 276 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:16.731971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:16.737484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:16.770858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:16.773454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:16.789712 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2868/5763] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:16.878986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919c72-d404-4b4c-b870-e6dd4e4ad628 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:16.891909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:16.892296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:16.892630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:16.892907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains/367b73cfc1dc4cd9af0d1a82d4dc0145` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:16.912709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=367b73cfc1dc4cd9af0d1a82d4dc0145)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:16.914640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:16.963936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:16.972036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.099050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145', 'request_id': 'req-de4669bf-7c12-4e52-b9c3-2c5cd241469d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.121128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145', 'request_id': 'req-de4669bf-7c12-4e52-b9c3-2c5cd241469d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.132197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145', 'request_id': 'req-de4669bf-7c12-4e52-b9c3-2c5cd241469d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.149606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 367b73cfc1dc4cd9af0d1a82d4dc0145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:17.150201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.151134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.161794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145', 'request_id': 'req-de4669bf-7c12-4e52-b9c3-2c5cd241469d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.162703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145', 'request_id': 'req-de4669bf-7c12-4e52-b9c3-2c5cd241469d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.163388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '367b73cfc1dc4cd9af0d1a82d4dc0145', 'request_id': 'req-de4669bf-7c12-4e52-b9c3-2c5cd241469d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.179176 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2896/5764] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:16 2022] DELETE /identity/v3/domains/367b73cfc1dc4cd9af0d1a82d4dc0145 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:17.184651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:17.205085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988e3396-fcff-4c12-8b4d-e16b8592b219 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:17.286615 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:17.311248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:17.311944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:17.312389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:17.312983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:17.314383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:17.316597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:17.347410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:17.350610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:17.360588 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2869/5765] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:34:17 2022] POST /identity/v3/domains => generated 276 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:17.367782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4669bf-7c12-4e52-b9c3-2c5cd241469d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:17.412994 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:17.469473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:17.470829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:17.471400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:17.471904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:17.473010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:17.475840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:17.569685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:17.570900 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2897/5766] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:17 2022] POST /identity/v3/projects => generated 407 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:17.582799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509d26c-e58a-4652-a983-2880348cf489 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:17.666873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:17.667909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:17.668863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:17.669268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:17.670092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:17.682206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:17.729671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2870/5767] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:17 2022] POST /identity/v3/projects => generated 404 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:17.734323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:17.758706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe738f-3334-4395-816d-ee4630433317 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:17.844050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:17.844857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:17.845144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:17.845423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/513ad0f9f936446387ee4d06682e0130` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:17.847038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=513ad0f9f936446387ee4d06682e0130)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:17.849535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:17.925827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513ad0f9f936446387ee4d06682e0130', 'request_id': 'req-7ca61458-2b86-4908-acad-41be65696879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.945739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513ad0f9f936446387ee4d06682e0130', 'request_id': 'req-7ca61458-2b86-4908-acad-41be65696879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.963878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513ad0f9f936446387ee4d06682e0130', 'request_id': 'req-7ca61458-2b86-4908-acad-41be65696879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.983886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 513ad0f9f936446387ee4d06682e0130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:17.984334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.985869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:17.991275 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2898/5768] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:17 2022] DELETE /identity/v3/projects/513ad0f9f936446387ee4d06682e0130 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:17.992769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:17.997994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:18.040213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43100511-95fc-4a24-8bfc-226af21ccd46 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:18.188628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:18.190922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:18.191263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:18.191550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/5b2b5c5c841541cab41cba19a1d129fb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:18.193034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b2b5c5c841541cab41cba19a1d129fb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:18.196159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:18.309109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b2b5c5c841541cab41cba19a1d129fb', 'request_id': 'req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.326887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b2b5c5c841541cab41cba19a1d129fb', 'request_id': 'req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.331186 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:18.340922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b2b5c5c841541cab41cba19a1d129fb', 'request_id': 'req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.364763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 5b2b5c5c841541cab41cba19a1d129fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:18.365183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.367251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.375150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:18.388862 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2871/5769] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:17 2022] DELETE /identity/v3/projects/5b2b5c5c841541cab41cba19a1d129fb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:18.395894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca61458-2b86-4908-acad-41be65696879 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:18.458387 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:18.557414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:18.565725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:18.568403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:18.583568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:18.585024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:18.585264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains/72becc64280a414c91ac4f60a466692f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:18.592421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=72becc64280a414c91ac4f60a466692f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:18.598417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:18.633625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '72becc64280a414c91ac4f60a466692f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.634918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '72becc64280a414c91ac4f60a466692f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.727850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '72becc64280a414c91ac4f60a466692f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.729888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '72becc64280a414c91ac4f60a466692f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:18.735952 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2899/5770] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:34:18 2022] PATCH /identity/v3/domains/72becc64280a414c91ac4f60a466692f => generated 277 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:18.740144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:18.742532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:18.791728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb3425a-9d59-4f42-a67a-2eab641fc2d2 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:18.881043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f4e049-5fe1-46db-a2bc-e23aea289503 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:18.907572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:18.911776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:18.913242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:18.914173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains/72becc64280a414c91ac4f60a466692f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:18.951112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=72becc64280a414c91ac4f60a466692f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:18.957807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:18.985002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:18.986291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:18.986739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:18.987487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] PATH_INFO: `/v3/projects/e06eb800914e46918b722c98245ec477` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:18.989404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e06eb800914e46918b722c98245ec477)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:18.992913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.026300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '72becc64280a414c91ac4f60a466692f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.036402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '72becc64280a414c91ac4f60a466692f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.113679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e06eb800914e46918b722c98245ec477', 'request_id': 'req-1b314561-e119-4356-8193-ef75c6cb6e10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.132280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e06eb800914e46918b722c98245ec477', 'request_id': 'req-1b314561-e119-4356-8193-ef75c6cb6e10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.148929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e06eb800914e46918b722c98245ec477', 'request_id': 'req-1b314561-e119-4356-8193-ef75c6cb6e10'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.151213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72becc64280a414c91ac4f60a466692f', 'request_id': 'req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.165049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72becc64280a414c91ac4f60a466692f', 'request_id': 'req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.181225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72becc64280a414c91ac4f60a466692f', 'request_id': 'req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.186225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] The token cache is being invalidate because project e06eb800914e46918b722c98245ec477 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:19.186447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.187286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b314561-e119-4356-8193-ef75c6cb6e10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.189709 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2872/5771] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:18 2022] DELETE /identity/v3/projects/e06eb800914e46918b722c98245ec477 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:19.192508 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:19.196452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac979-f397-4871-bc5f-4fd7411bab06 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.196749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac979-f397-4871-bc5f-4fd7411bab06 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.197032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ac979-f397-4871-bc5f-4fd7411bab06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.199849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 72becc64280a414c91ac4f60a466692f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:19.200959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.201901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.212806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '72becc64280a414c91ac4f60a466692f', 'request_id': 'req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.214047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '72becc64280a414c91ac4f60a466692f', 'request_id': 'req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.216464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '72becc64280a414c91ac4f60a466692f', 'request_id': 'req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.231514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2900/5772] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:18 2022] DELETE /identity/v3/domains/72becc64280a414c91ac4f60a466692f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:19.236944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.240270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b67ac979-f397-4871-bc5f-4fd7411bab06 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:19.241368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:19.241601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b67ac979-f397-4871-bc5f-4fd7411bab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:19.279154 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:19.367856 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2873/5773] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:19.376541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.376872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.377165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.401978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:19.403943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:19.407474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdd955-74bf-4f5a-a71d-1aa9b51a25ef tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.422872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2874/5774] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:19.423915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.429199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.429911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.430199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.430478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.431202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.433149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.442367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961a7c94-d90a-4631-bdf9-5b229e6ab8a4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.453776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.471854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.472493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.478525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.479344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:19.488845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.492331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.496520 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2901/5775] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:19 2022] POST /identity/v3/projects => generated 376 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:19.497701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.532542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2875/5776] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:19.536869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.559128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc54ed-6703-479d-b422-897899a32db1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.635775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de02343-b921-49e9-a867-56c10c33d69f tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.659352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.663127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.663484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.663763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/f1192d5030a74361b22744a55219bc08` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.670725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=f1192d5030a74361b22744a55219bc08)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.677963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.680592 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2902/5777] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:19 2022] GET /identity/v3/projects/f1192d5030a74361b22744a55219bc08 => generated 376 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:19.685327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.694513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.695201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.695489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.695771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.696503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.697529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b603a-557c-4255-a724-09b9c58f6229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.698533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.705771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.706589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.706944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.707302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.708638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.710794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.738206 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2876/5778] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:19 2022] POST /identity/v3/projects => generated 371 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:19.741026 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2903/5779] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:34:19 2022] GET /identity/v3/projects => generated 6182 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:34:19.748810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.749430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.774082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166b513-7ed4-4ef8-8f1b-cd056ef5f229 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.843435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe3efb4-2311-4c93-a3d4-f1029909558c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.849260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.850145 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:19.850968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.851633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.851849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.852798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.855221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.863827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:19.865417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:19.865714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:19.866062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/f1192d5030a74361b22744a55219bc08` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:19.868308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f1192d5030a74361b22744a55219bc08)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:19.872183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:19.885224 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2877/5780] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:19 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:19.889370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.934534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfaa2501-9ef7-42c5-89d5-1600225eca50 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:19.949735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1192d5030a74361b22744a55219bc08', 'request_id': 'req-b5c09693-10c6-44a6-886e-11c701afd297'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.959373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1192d5030a74361b22744a55219bc08', 'request_id': 'req-b5c09693-10c6-44a6-886e-11c701afd297'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.967243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1192d5030a74361b22744a55219bc08', 'request_id': 'req-b5c09693-10c6-44a6-886e-11c701afd297'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.971885 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:19.981125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project f1192d5030a74361b22744a55219bc08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:19.981504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.982525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:19.984679 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2904/5781] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:19 2022] DELETE /identity/v3/projects/f1192d5030a74361b22744a55219bc08 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:19.990200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:19.992282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:20.093239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699f1a8-7d35-4068-8744-ac6a6ad353f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:20.094117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699f1a8-7d35-4068-8744-ac6a6ad353f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.094886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699f1a8-7d35-4068-8744-ac6a6ad353f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.095250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699f1a8-7d35-4068-8744-ac6a6ad353f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.095957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699f1a8-7d35-4068-8744-ac6a6ad353f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:20.098037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699f1a8-7d35-4068-8744-ac6a6ad353f3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:20.110964 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2878/5782] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:34:20.112386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc454-a047-4f33-a78d-1c78def5c1d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.112735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc454-a047-4f33-a78d-1c78def5c1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.112946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9dc454-a047-4f33-a78d-1c78def5c1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.124127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c09693-10c6-44a6-886e-11c701afd297 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:20.130806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:20.131750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.132134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.132590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.133446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:20.135393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd9dc454-a047-4f33-a78d-1c78def5c1d4 None None] MFA Rules not processed for user `f35d623b786740f08b362ad2e393a042`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:20.135970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:20.136709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd9dc454-a047-4f33-a78d-1c78def5c1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:20.201882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2905/5783] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:34:19 2022] POST /identity/v3/projects => generated 347 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:20.208799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:20.214571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:20.290769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2879/5784] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:20.292609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.293464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.308242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.347211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] MFA Rules not processed for user `6186adfcd67b4091b1d88acbfd35dcba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:20.349180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:20.371676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956c2df-1583-409e-bb0a-7b7cbd41772a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:20.381296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:20.382533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.382533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.382862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.384028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:20.386017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:20.398902 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:20.421568 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2906/5785] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:20 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:20.423395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:20.474644 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2880/5786] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:20.475259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:20.499615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979bead8-f7a2-4fa1-b05b-d30630eb471b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:20.513522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88d95b-695d-45a5-aacf-67dc71d76cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:20.514604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d95b-695d-45a5-aacf-67dc71d76cea admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.514895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d95b-695d-45a5-aacf-67dc71d76cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.515178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88d95b-695d-45a5-aacf-67dc71d76cea admin admin] PATH_INFO: `/v3/projects/4f9ed6af4a07400a861c792e62097438/users/7b105d780d804b41a3b44de9a7464ca4/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.555054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d95b-695d-45a5-aacf-67dc71d76cea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f9ed6af4a07400a861c792e62097438, user_id=7b105d780d804b41a3b44de9a7464ca4, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:20.558453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88d95b-695d-45a5-aacf-67dc71d76cea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:20.584089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9e690-7120-41e7-95fd-80aec98060e9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:20.596281 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2881/5787] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:20 2022] PUT /identity/v3/projects/4f9ed6af4a07400a861c792e62097438/users/7b105d780d804b41a3b44de9a7464ca4/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:20.606551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.606861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.607133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.672064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] MFA Rules not processed for user `7b105d780d804b41a3b44de9a7464ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:20.673617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:20.679986 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:20.703853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:20.704875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.705262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.705637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/89c58366762e4ccca9ac2ba22c8f52ab` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.707445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:update_project(project_id=89c58366762e4ccca9ac2ba22c8f52ab)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:20.710283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:20.789217 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2907/5788] 10.222.0.15 () {60 vars in 1251 bytes} [Tue Jul 19 11:34:20 2022] PATCH /identity/v3/projects/89c58366762e4ccca9ac2ba22c8f52ab => generated 362 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:20.794753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:20.801509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:20.870270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2882/5789] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:20.873041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:20.908073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7ee9c-edf0-454c-84d5-0ed329732201 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:20.925841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:20.926792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:20.927320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:20.927789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/89c58366762e4ccca9ac2ba22c8f52ab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:20.960271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=89c58366762e4ccca9ac2ba22c8f52ab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:20.966390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:20.974595 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2883/5790] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:20 2022] GET /identity/v3/projects/89c58366762e4ccca9ac2ba22c8f52ab => generated 349 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:20.976667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:20.983761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:21.020173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f647da-95f8-4fc9-8936-87dd12c2184d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:21.030964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:21.031671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:21.031950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:21.032237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:21.091127 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:21.148948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8e7cb1-64d2-4d0b-87fe-40d67e321bd6 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:21.166702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:21.167704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:21.168568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:21.169036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:21.181342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:21.183441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:21.198675 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2884/5791] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:21.200453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:21.202849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:21.205019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:21.222773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1ae52c-e811-4e2d-b95e-47d94b7dd1f3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:21.232178 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2908/5792] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:21.238692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:21.239619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:21.239922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:21.240384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/89c58366762e4ccca9ac2ba22c8f52ab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:21.243727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=89c58366762e4ccca9ac2ba22c8f52ab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:21.248927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:21.357549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c58366762e4ccca9ac2ba22c8f52ab', 'request_id': 'req-f3007b05-83cb-4732-be43-376e85fbe03d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:21.375444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c58366762e4ccca9ac2ba22c8f52ab', 'request_id': 'req-f3007b05-83cb-4732-be43-376e85fbe03d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:21.384614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c58366762e4ccca9ac2ba22c8f52ab', 'request_id': 'req-f3007b05-83cb-4732-be43-376e85fbe03d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:21.404239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 89c58366762e4ccca9ac2ba22c8f52ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:21.404837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:21.407260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:21.417659 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2885/5793] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:21 2022] DELETE /identity/v3/projects/89c58366762e4ccca9ac2ba22c8f52ab => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:21.417882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:21.441343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a8492b-6336-47c3-b247-67bb07d3a39e service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:21.592723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:21.593422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:21.593707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:21.593991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:21.595216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:21.597486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:21.652404 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2909/5794] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:21 2022] POST /identity/v3/projects => generated 360 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:21.656402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:21.658802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:21.693996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007b05-83cb-4732-be43-376e85fbe03d tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:21.747608 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:21.872087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:21.873145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:21.873502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:21.873852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/0b5c773aa2bb438e929746a22ec9b706` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:21.875836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:update_project(project_id=0b5c773aa2bb438e929746a22ec9b706)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:21.877278 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:34:21.877278 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:34:21.877278 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:34:21.880262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:21.978864 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2886/5795] 10.222.0.15 () {60 vars in 1251 bytes} [Tue Jul 19 11:34:21 2022] PATCH /identity/v3/projects/0b5c773aa2bb438e929746a22ec9b706 => generated 372 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:21.982923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:22.001968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125c104-709c-4313-a13b-3aded7cc7f0a tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:22.016289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:22.019020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:22.019338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:22.019633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/0b5c773aa2bb438e929746a22ec9b706` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:22.066360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=0b5c773aa2bb438e929746a22ec9b706)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:22.068638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:22.076062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2910/5796] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:21 2022] GET /identity/v3/projects/0b5c773aa2bb438e929746a22ec9b706 => generated 359 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:22.080730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:22.121869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96085f2d-4696-47dd-a043-ae956b74b591 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:22.137266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:22.138184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:22.138612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:22.139048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/0b5c773aa2bb438e929746a22ec9b706` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:22.141008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0b5c773aa2bb438e929746a22ec9b706)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:22.147242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:22.312038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b5c773aa2bb438e929746a22ec9b706', 'request_id': 'req-b56ac73e-53f3-419d-a719-77ac0d4d2291'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:22.329082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b5c773aa2bb438e929746a22ec9b706', 'request_id': 'req-b56ac73e-53f3-419d-a719-77ac0d4d2291'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:22.344625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b5c773aa2bb438e929746a22ec9b706', 'request_id': 'req-b56ac73e-53f3-419d-a719-77ac0d4d2291'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:22.384185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 0b5c773aa2bb438e929746a22ec9b706 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:22.384529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:22.385325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:22.393089 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2887/5797] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:22 2022] DELETE /identity/v3/projects/0b5c773aa2bb438e929746a22ec9b706 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:22.393635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:22.395592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:22.418972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997d25c5-6c90-451d-a861-9450323fbf33 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:22.547863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:22.549414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:22.549858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:22.550293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:22.551233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:22.554185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:22.648088 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2911/5798] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:22 2022] POST /identity/v3/projects => generated 354 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:22.652153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:22.666259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56ac73e-53f3-419d-a719-77ac0d4d2291 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:22.886632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:22.888333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:22.888857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:22.889324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/60f09262731e491dadeb2faae88ce5c2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:22.892613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:update_project(project_id=60f09262731e491dadeb2faae88ce5c2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:22.894819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:22.904909 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:23.006751 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2888/5799] 10.222.0.15 () {60 vars in 1251 bytes} [Tue Jul 19 11:34:22 2022] PATCH /identity/v3/projects/60f09262731e491dadeb2faae88ce5c2 => generated 368 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:23.009803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:23.027176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fca3df-85da-4902-8125-f5ccb524da73 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:23.034819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:23.035731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:23.036088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:23.036289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/60f09262731e491dadeb2faae88ce5c2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:23.055583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:get_project(project_id=60f09262731e491dadeb2faae88ce5c2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:23.058575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:23.061806 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2912/5800] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:34:23 2022] GET /identity/v3/projects/60f09262731e491dadeb2faae88ce5c2 => generated 355 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:23.065505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:23.080831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff3397d-2014-4245-9938-aca2047cdbf5 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:23.087456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:23.088505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:23.088869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:23.089219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/projects/60f09262731e491dadeb2faae88ce5c2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:23.090695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=60f09262731e491dadeb2faae88ce5c2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:23.093328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:23.186308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f09262731e491dadeb2faae88ce5c2', 'request_id': 'req-4d113f6b-107e-4813-9ed2-2ee393faf48c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.201567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f09262731e491dadeb2faae88ce5c2', 'request_id': 'req-4d113f6b-107e-4813-9ed2-2ee393faf48c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.208691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f09262731e491dadeb2faae88ce5c2', 'request_id': 'req-4d113f6b-107e-4813-9ed2-2ee393faf48c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.233123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] The token cache is being invalidate because project 60f09262731e491dadeb2faae88ce5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:23.233431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.236263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.243883 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2889/5801] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:23 2022] DELETE /identity/v3/projects/60f09262731e491dadeb2faae88ce5c2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:23.246065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:23.248835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:23.272528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169b5e59-7b84-48a5-8e20-b406057e5194 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:23.283654 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:23.388406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:23.389310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:23.389615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:23.390074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains/72becc64280a414c91ac4f60a466692f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:23.402746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Could not find domain: 72becc64280a414c91ac4f60a466692f.: keystone.exception.DomainNotFound: Could not find domain: 72becc64280a414c91ac4f60a466692f. Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 72becc64280a414c91ac4f60a466692f. Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:34:23.420828 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:34:23.422309 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 72becc64280a414c91ac4f60a466692f. Jul 19 11:34:23.424267 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:34:23.425652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2913/5802] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:34:23 2022] PATCH /identity/v3/domains/72becc64280a414c91ac4f60a466692f => generated 112 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:34:23.426342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:23.448931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d113f6b-107e-4813-9ed2-2ee393faf48c tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:23.468622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5d3f0-d7fc-4c2a-aa4a-2b43f5878975 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a044a07e9f44e86b42953dad2521a5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '018f609df44344abab313c3e7cbfdade', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:23.470147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d3f0-d7fc-4c2a-aa4a-2b43f5878975 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:23.470666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d3f0-d7fc-4c2a-aa4a-2b43f5878975 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:23.471813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5d3f0-d7fc-4c2a-aa4a-2b43f5878975 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] PATH_INFO: `/v3/domains/367b73cfc1dc4cd9af0d1a82d4dc0145` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:23.484109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a5d3f0-d7fc-4c2a-aa4a-2b43f5878975 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-47a5d3f0-d7fc-4c2a-aa4a-2b43f5878975 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Could not find domain: 367b73cfc1dc4cd9af0d1a82d4dc0145.: keystone.exception.DomainNotFound: Could not find domain: 367b73cfc1dc4cd9af0d1a82d4dc0145. Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 367b73cfc1dc4cd9af0d1a82d4dc0145. Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:34:23.499202 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:34:23.501347 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 367b73cfc1dc4cd9af0d1a82d4dc0145. Jul 19 11:34:23.502365 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:34:23.507217 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2890/5803] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:34:23 2022] PATCH /identity/v3/domains/367b73cfc1dc4cd9af0d1a82d4dc0145 => generated 112 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:34:23.510500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:23.512276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:23.615214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c747bc-0f3c-41dc-b3ba-e6d0a8414a03 tempest-ProjectsTestJSON-509138079 tempest-ProjectsTestJSON-509138079-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:23.627657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:23.631801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:23.632203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:23.633541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] PATH_INFO: `/v3/users/c71037ca5b604aec959d9882d4064bc1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:23.636258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c71037ca5b604aec959d9882d4064bc1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:23.637904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:23.755489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c71037ca5b604aec959d9882d4064bc1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.775022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c71037ca5b604aec959d9882d4064bc1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.804068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c71037ca5b604aec959d9882d4064bc1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.806647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c71037ca5b604aec959d9882d4064bc1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.827082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c71037ca5b604aec959d9882d4064bc1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:23.841871 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2914/5804] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:23 2022] DELETE /identity/v3/users/c71037ca5b604aec959d9882d4064bc1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:23.846495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:23.846835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:23.847991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:23.881591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:23.883718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:23.979141 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2891/5805] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:24.016843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:24.019821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:24.095402 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:24.176730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4b18d-10a0-4100-b579-faf38a5baacf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:24.185247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:24.186555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:24.186931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:24.187625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:24.203501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:24.205184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:24.240378 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2915/5806] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:26.337696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:26.339198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:26.367634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e1321f-7467-4378-87d7-2f1a6eaa8d97 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:26.407362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:26.411854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:26.412561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:26.419806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] PATH_INFO: `/v3/projects/8a5e5a03efc740aea554daf5ae3e31f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:26.431365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5e5a03efc740aea554daf5ae3e31f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:26.442218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:26.542226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5e5a03efc740aea554daf5ae3e31f5', 'request_id': 'req-6ed59d11-a363-4fe6-88f5-97fc15d56268'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.552224 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:26.554562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5e5a03efc740aea554daf5ae3e31f5', 'request_id': 'req-6ed59d11-a363-4fe6-88f5-97fc15d56268'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.565605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5e5a03efc740aea554daf5ae3e31f5', 'request_id': 'req-6ed59d11-a363-4fe6-88f5-97fc15d56268'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.597863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] The token cache is being invalidate because project 8a5e5a03efc740aea554daf5ae3e31f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:26.598149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.599087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.600999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2892/5807] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:26 2022] DELETE /identity/v3/projects/8a5e5a03efc740aea554daf5ae3e31f5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:26.605189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:26.615664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547d3075-df2b-4d69-892d-11619b95b000 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:26.708146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:26.709637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:26.710229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:26.710798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] PATH_INFO: `/v3/users/9a044a07e9f44e86b42953dad2521a5e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:26.712562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a044a07e9f44e86b42953dad2521a5e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:26.715916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:26.826712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a044a07e9f44e86b42953dad2521a5e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.841253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a044a07e9f44e86b42953dad2521a5e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.872240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a044a07e9f44e86b42953dad2521a5e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.873101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a044a07e9f44e86b42953dad2521a5e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.906542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0934a400-2e8d-409d-9ed0-325358f9a2b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a044a07e9f44e86b42953dad2521a5e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:26.921941 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2916/5808] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:26 2022] DELETE /identity/v3/users/9a044a07e9f44e86b42953dad2521a5e => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:28.458757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:28.460320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:28.480746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed59d11-a363-4fe6-88f5-97fc15d56268 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:28.623042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:28.624319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:28.624871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:28.625356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] PATH_INFO: `/v3/projects/018f609df44344abab313c3e7cbfdade` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:28.626867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=018f609df44344abab313c3e7cbfdade)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:28.629128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:28.699367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '018f609df44344abab313c3e7cbfdade', 'request_id': 'req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:28.706890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '018f609df44344abab313c3e7cbfdade', 'request_id': 'req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:28.714154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '018f609df44344abab313c3e7cbfdade', 'request_id': 'req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:28.732690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] The token cache is being invalidate because project 018f609df44344abab313c3e7cbfdade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:28.732984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:28.733898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c8517ee-419e-45e8-aa8d-b805f0c6cf3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:28.735551 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2893/5809] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:28 2022] DELETE /identity/v3/projects/018f609df44344abab313c3e7cbfdade => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:28.740902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:28.741454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:28.741454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:28.766641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:28.767862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:28.816788 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:28.853021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2917/5810] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:28.858006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:28.858296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:28.858586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:28.878946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:28.880185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:28.890728 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2894/5811] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:28.894921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:28.905502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977f792-5406-44e5-b702-c60d76b66bd5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:28.910179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:28.910864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:28.911148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:28.911421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:28.912193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:28.912543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:28.914300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:28.927769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2918/5812] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:34:28.932000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:28.941943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13166fe8-a4ce-4ff0-8523-4ba847be8f0a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:28.947048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:28.947647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:28.947925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:28.948588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:28.948935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:28.950862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.008911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.009899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2895/5813] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:28 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:29.022999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47058d6f-5386-4799-8a81-0e6d3fe6d798 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.144939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.146719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.147075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.147426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.148224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.150397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.186351 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2919/5814] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:29 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:29.190337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.202977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155252b6-1cb7-4dcb-80ff-db80025525c1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.209556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.210794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.211317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.211833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.212880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.215087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.231345 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2896/5815] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:29.232878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.243895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38e1dc-6774-4a36-b55d-8f4f95f7511c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.257822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b75fb-8105-4cdf-a57a-68deef2de49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.258532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b75fb-8105-4cdf-a57a-68deef2de49a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.258813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b75fb-8105-4cdf-a57a-68deef2de49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.259089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b75fb-8105-4cdf-a57a-68deef2de49a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.259845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b75fb-8105-4cdf-a57a-68deef2de49a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.261501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b75fb-8105-4cdf-a57a-68deef2de49a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.274073 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2920/5816] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:29.277063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.290137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7222e5a-5ed9-4017-9144-10f0f32dd109 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.298317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.299362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.299817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.300965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] PATH_INFO: `/v3/projects/27d16cd1acf14f18b06667d14e81d301/users/df3ffd8136cc4bac87276337ef6565cf/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.337141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27d16cd1acf14f18b06667d14e81d301, user_id=df3ffd8136cc4bac87276337ef6565cf, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.341644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.377080 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2897/5817] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:29 2022] PUT /identity/v3/projects/27d16cd1acf14f18b06667d14e81d301/users/df3ffd8136cc4bac87276337ef6565cf/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:29.388503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.388795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.389081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.455315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] MFA Rules not processed for user `df3ffd8136cc4bac87276337ef6565cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:29.456609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:29.548948 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2921/5818] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:29.550411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.559840 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:29.649609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58526051-f294-4a87-8707-be95167ebd79 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.660849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47097488-a375-4822-a060-89728b242f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.662149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097488-a375-4822-a060-89728b242f37 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.662941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097488-a375-4822-a060-89728b242f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.663451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47097488-a375-4822-a060-89728b242f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.665224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47097488-a375-4822-a060-89728b242f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.669313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47097488-a375-4822-a060-89728b242f37 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.714213 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2898/5819] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:29 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:29.715463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.751670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b375b5a-fc92-4eb9-8b18-b88f5ff6de88 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.860091 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:29.882508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.883521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.883984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.884658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.885509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.887839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:29.937556 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2922/5820] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:29 2022] POST /identity/v3/users => generated 298 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:29.939016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47097488-a375-4822-a060-89728b242f37 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:29.955973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47097488-a375-4822-a060-89728b242f37 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:29.966625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:29.967624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:29.970232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:29.970748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:29.975828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:29.981354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.012240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.013464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2899/5821] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:30.027525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a34cc73-d16c-4ff6-bfb0-76657941a3c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.038931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.040430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.058518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.058518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] PATH_INFO: `/v3/projects/34ba89e461264b369649c6487dabd92c/users/96719b02082844d3b5af0a4aa1e05045/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.093369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ba89e461264b369649c6487dabd92c, user_id=96719b02082844d3b5af0a4aa1e05045, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.096908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.118966 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2923/5822] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:30 2022] PUT /identity/v3/projects/34ba89e461264b369649c6487dabd92c/users/96719b02082844d3b5af0a4aa1e05045/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:30.121237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.134182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21aed2-ad81-4f2a-8cfc-87dd44f821c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.220828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e01218-e276-4d99-82ea-e3412e47e1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.221972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01218-e276-4d99-82ea-e3412e47e1d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.222600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01218-e276-4d99-82ea-e3412e47e1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.222805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e01218-e276-4d99-82ea-e3412e47e1d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.223530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01218-e276-4d99-82ea-e3412e47e1d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.225587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e01218-e276-4d99-82ea-e3412e47e1d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.239056 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2900/5823] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:30 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:30.243590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.255337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95bd10-ccac-4956-baf8-658b13f42f22 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.262965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.264496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.265075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.265450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] PATH_INFO: `/v3/projects/34ba89e461264b369649c6487dabd92c/users/96719b02082844d3b5af0a4aa1e05045/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.268288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ba89e461264b369649c6487dabd92c, user_id=96719b02082844d3b5af0a4aa1e05045, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.271169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.283192 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2924/5824] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:30 2022] PUT /identity/v3/projects/34ba89e461264b369649c6487dabd92c/users/96719b02082844d3b5af0a4aa1e05045/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:30.294249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.294536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.294816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.324295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] MFA Rules not processed for user `96719b02082844d3b5af0a4aa1e05045`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:30.325669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:30.425373 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2901/5825] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:30.426009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.438124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f99e3-91d7-4824-bd2a-d9695aa86f76 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.443575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96719b02082844d3b5af0a4aa1e05045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ba89e461264b369649c6487dabd92c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.444501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.445065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.445610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.446422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.448545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.466331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.468604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:30.474671 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:30.497313 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2925/5826] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:30 2022] POST /identity/v3/projects => generated 360 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:30.501365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.566699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654a7c1-1cee-458f-95ce-fac3d72a83ce None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.593801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f37c4-e46e-4bd0-b84d-b35ef9466724 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.599146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'df3ffd8136cc4bac87276337ef6565cf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '27d16cd1acf14f18b06667d14e81d301', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.600291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.600612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.600894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] PATH_INFO: `/v3/projects/5baa154cdcf344aaa8b52f7492b22db5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.602176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] RBAC: Authorizing `identity:delete_project(project_id=5baa154cdcf344aaa8b52f7492b22db5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Jul 19 11:34:30.617635 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application enforcer_obj._enforce( Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Jul 19 11:34:30.618933 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:34:30.619567 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2926/5827] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:30 2022] DELETE /identity/v3/projects/5baa154cdcf344aaa8b52f7492b22db5 => generated 136 bytes in 118 msecs (HTTP/1.1 403) 5 headers in 184 bytes (2 switches on core 0) Jul 19 11:34:30.623215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.680237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.680237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.680237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.680237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] PATH_INFO: `/v3/users/e7ca3ab30fee44b3b5f0786edcc54d47` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.681665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ca3ab30fee44b3b5f0786edcc54d47)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.683808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.760304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80690e-e995-4c50-a69a-0596dfdcc06d tempest-ProjectsNegativeTestJSON-1886062976 tempest-ProjectsNegativeTestJSON-1886062976-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.765456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96719b02082844d3b5af0a4aa1e05045', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '34ba89e461264b369649c6487dabd92c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.766586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ca3ab30fee44b3b5f0786edcc54d47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.766973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.767262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.767705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] PATH_INFO: `/v3/projects/5baa154cdcf344aaa8b52f7492b22db5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.768017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ca3ab30fee44b3b5f0786edcc54d47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.769380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5baa154cdcf344aaa8b52f7492b22db5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.771770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:30.781619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ca3ab30fee44b3b5f0786edcc54d47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.782453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ca3ab30fee44b3b5f0786edcc54d47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.794903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4d23c241-8f99-42df-b058-a86acb938091 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ca3ab30fee44b3b5f0786edcc54d47'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.816845 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:30.827099 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2902/5828] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:30 2022] DELETE /identity/v3/users/e7ca3ab30fee44b3b5f0786edcc54d47 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:30.831759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.832051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.832402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.865748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:30.867421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:30.878772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5baa154cdcf344aaa8b52f7492b22db5', 'request_id': 'req-7e0a9950-8933-424a-966c-e0e486bf16b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.895647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5baa154cdcf344aaa8b52f7492b22db5', 'request_id': 'req-7e0a9950-8933-424a-966c-e0e486bf16b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.903223 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:30.916255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5baa154cdcf344aaa8b52f7492b22db5', 'request_id': 'req-7e0a9950-8933-424a-966c-e0e486bf16b9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.945506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] The token cache is being invalidate because project 5baa154cdcf344aaa8b52f7492b22db5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:30.945905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.946622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:30.949179 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2927/5829] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:30 2022] DELETE /identity/v3/projects/5baa154cdcf344aaa8b52f7492b22db5 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:30.955119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:30.958117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:30.968262 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2903/5830] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:30.977496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0a9950-8933-424a-966c-e0e486bf16b9 tempest-ProjectsNegativeTestJSON-315025320 tempest-ProjectsNegativeTestJSON-315025320-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:30.982937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:30.983899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:30.984184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:30.984493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] PATH_INFO: `/v3/users/df3ffd8136cc4bac87276337ef6565cf` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:30.986379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df3ffd8136cc4bac87276337ef6565cf)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:30.988548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:31.039100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:31.040936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:31.130310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df3ffd8136cc4bac87276337ef6565cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:31.157215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df3ffd8136cc4bac87276337ef6565cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:31.192767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df3ffd8136cc4bac87276337ef6565cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:31.194881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df3ffd8136cc4bac87276337ef6565cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:31.234676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3c3d942f-aeb9-48f4-b5c3-78b1fc576012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df3ffd8136cc4bac87276337ef6565cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:31.260583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2928/5831] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:30 2022] DELETE /identity/v3/users/df3ffd8136cc4bac87276337ef6565cf => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:31.264622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a653c-8061-4529-ab56-fefede2a55df None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:31.267930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:31.268230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:31.268698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:31.299313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:31.300819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:31.379373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:31.380066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:31.381124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:31.381412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:31.384026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:31.408695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2929/5832] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:31.460836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:31.462927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:31.480015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:31.482138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:31.494015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4eaf9-288d-4922-89bf-7a0033578526 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:31.498542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:31.499481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:31.499957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:31.500423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:31.511556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2904/5833] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:31.512675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:31.514329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:31.528039 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2930/5834] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:34:32.322622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:32.325933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:32.364292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a54d5da-f4bf-4415-bea4-7c4163f2757e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:32.372002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:32.373529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:32.373792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:32.374070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] PATH_INFO: `/v3/projects/27d16cd1acf14f18b06667d14e81d301` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:32.376042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27d16cd1acf14f18b06667d14e81d301)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:32.380487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:32.424127 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:32.445429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27d16cd1acf14f18b06667d14e81d301', 'request_id': 'req-7f8be6fd-906e-424a-832c-41cceb261925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.451087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27d16cd1acf14f18b06667d14e81d301', 'request_id': 'req-7f8be6fd-906e-424a-832c-41cceb261925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.459894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27d16cd1acf14f18b06667d14e81d301', 'request_id': 'req-7f8be6fd-906e-424a-832c-41cceb261925'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.479015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] The token cache is being invalidate because project 27d16cd1acf14f18b06667d14e81d301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:32.479292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.481222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.483144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2905/5835] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:32 2022] DELETE /identity/v3/projects/27d16cd1acf14f18b06667d14e81d301 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:32.487650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:32.500135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e6a4c-39bf-4652-891c-98925bde6786 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:32.506222 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:32.582778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:32.583480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:32.583886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:32.584501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] PATH_INFO: `/v3/users/96719b02082844d3b5af0a4aa1e05045` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:32.588226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96719b02082844d3b5af0a4aa1e05045)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:32.591878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:32.700247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96719b02082844d3b5af0a4aa1e05045'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.715515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96719b02082844d3b5af0a4aa1e05045'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.743959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96719b02082844d3b5af0a4aa1e05045'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.745023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96719b02082844d3b5af0a4aa1e05045'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.757742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96719b02082844d3b5af0a4aa1e05045'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:32.781441 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2931/5836] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:32 2022] DELETE /identity/v3/users/96719b02082844d3b5af0a4aa1e05045 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:32.812396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:32.815176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:32.838286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be6fd-906e-424a-832c-41cceb261925 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:32.986228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:32.988527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:32.989029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:32.989524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] PATH_INFO: `/v3/projects/b79d9e21947343ccac5c43af068e8bf9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:32.992595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79d9e21947343ccac5c43af068e8bf9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:33.015743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:33.173651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79d9e21947343ccac5c43af068e8bf9', 'request_id': 'req-fcb663f9-8892-4d72-8ac5-360fd94e8684'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.190152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79d9e21947343ccac5c43af068e8bf9', 'request_id': 'req-fcb663f9-8892-4d72-8ac5-360fd94e8684'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.207841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79d9e21947343ccac5c43af068e8bf9', 'request_id': 'req-fcb663f9-8892-4d72-8ac5-360fd94e8684'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.241180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] The token cache is being invalidate because project b79d9e21947343ccac5c43af068e8bf9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:33.241623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.242710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.251301 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2906/5837] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:32 2022] DELETE /identity/v3/projects/b79d9e21947343ccac5c43af068e8bf9 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:33.251617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:33.262915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:33.316318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156f19-6915-4d12-8201-a8f2de8c3bc2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:33.505971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:33.507687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:33.508144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:33.509229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] PATH_INFO: `/v3/users/2859bf41ac4f478395b520f8021f0b48` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:33.512134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2859bf41ac4f478395b520f8021f0b48)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:33.514647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:33.601730 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:33.640190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2859bf41ac4f478395b520f8021f0b48'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.659107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2859bf41ac4f478395b520f8021f0b48'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.678827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2859bf41ac4f478395b520f8021f0b48'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.680270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2859bf41ac4f478395b520f8021f0b48'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.690808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2859bf41ac4f478395b520f8021f0b48'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:33.700043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2932/5838] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:33 2022] DELETE /identity/v3/users/2859bf41ac4f478395b520f8021f0b48 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:34.312923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:34.315114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:34.342368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb663f9-8892-4d72-8ac5-360fd94e8684 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:34.426551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:34.429553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:34.471997 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:34.500954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:34.503183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:34.503731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:34.504955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] PATH_INFO: `/v3/projects/38f7c768c9a648638e0e600da661f725` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:34.520962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38f7c768c9a648638e0e600da661f725)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:34.523992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:34.600457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a84e0-887a-4d52-9fd1-d01482f48fb6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:34.607506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:34.608532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:34.608839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:34.609538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] PATH_INFO: `/v3/projects/34ba89e461264b369649c6487dabd92c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:34.633178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ba89e461264b369649c6487dabd92c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:34.640952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:34.649219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38f7c768c9a648638e0e600da661f725', 'request_id': 'req-785c6727-0d2e-431f-ac02-fce0067b19a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.666601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38f7c768c9a648638e0e600da661f725', 'request_id': 'req-785c6727-0d2e-431f-ac02-fce0067b19a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.688485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38f7c768c9a648638e0e600da661f725', 'request_id': 'req-785c6727-0d2e-431f-ac02-fce0067b19a5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.714568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] The token cache is being invalidate because project 38f7c768c9a648638e0e600da661f725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:34.715285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.716312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-785c6727-0d2e-431f-ac02-fce0067b19a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.720674 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2907/5839] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:34 2022] DELETE /identity/v3/projects/38f7c768c9a648638e0e600da661f725 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:34.731578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac731a7-cef7-415e-9f4f-5aa46099afbc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:34.732567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac731a7-cef7-415e-9f4f-5aa46099afbc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:34.735147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac731a7-cef7-415e-9f4f-5aa46099afbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:34.783983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ba89e461264b369649c6487dabd92c', 'request_id': 'req-caa77c19-97a7-4359-9b39-86945f63a652'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.791689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3ac731a7-cef7-415e-9f4f-5aa46099afbc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:34.800339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ac731a7-cef7-415e-9f4f-5aa46099afbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:34.806748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ba89e461264b369649c6487dabd92c', 'request_id': 'req-caa77c19-97a7-4359-9b39-86945f63a652'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.820374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ba89e461264b369649c6487dabd92c', 'request_id': 'req-caa77c19-97a7-4359-9b39-86945f63a652'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.861315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] The token cache is being invalidate because project 34ba89e461264b369649c6487dabd92c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:34.862716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.866382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-caa77c19-97a7-4359-9b39-86945f63a652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:34.870204 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2933/5840] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:34 2022] DELETE /identity/v3/projects/34ba89e461264b369649c6487dabd92c => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:34.875068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e4cfe-d0cf-4cc0-ab9e-7cc04955ae4d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:34.875904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e4cfe-d0cf-4cc0-ab9e-7cc04955ae4d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:34.876393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e4cfe-d0cf-4cc0-ab9e-7cc04955ae4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:34.952194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-109e4cfe-d0cf-4cc0-ab9e-7cc04955ae4d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:34.953733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-109e4cfe-d0cf-4cc0-ab9e-7cc04955ae4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:35.014287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2908/5841] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:35.021568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.023343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.023521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.086283 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:35.106505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:35.109343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:35.145473 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2909/5842] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:35.150296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.176008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35757fe-ffe8-486f-bf5d-f793c8c78cd5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.185249 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2934/5843] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:35.188066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.188914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.189306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.192505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.192910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.193834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.195457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.197443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:35.198704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.202836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.278967 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2910/5844] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:35.289186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.289502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:35.293157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:35.319162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344f8a2-280f-4615-ae07-d422e8c25ac9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.326315 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2935/5845] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:35.331156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.341664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.343755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.344358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.344680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.347813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.375519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.380665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9238-92a0-4e28-b3ac-625c859731a9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.399377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.400096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.400809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.400809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.401624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:35.401938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.403624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.434798 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2936/5846] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:35.440950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.446915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:35.447786 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2911/5847] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:35 2022] POST /identity/v3/projects => generated 395 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:35.448648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.470725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4718b6af-5b1a-4f02-8b8b-e5d0b03a09d5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.547197 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:35.590041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee632127-7521-4c51-87c2-a086be650323 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.602296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.602991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.603280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.603559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.604270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.606259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.606414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.607258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.607643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.607929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] PATH_INFO: `/v3/users/6186adfcd67b4091b1d88acbfd35dcba` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.611258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6186adfcd67b4091b1d88acbfd35dcba)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.614863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.662583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2912/5848] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:35 2022] POST /identity/v3/projects => generated 399 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:35.663988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.715252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6186adfcd67b4091b1d88acbfd35dcba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:35.732891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6186adfcd67b4091b1d88acbfd35dcba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:35.756858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6186adfcd67b4091b1d88acbfd35dcba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:35.757713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6186adfcd67b4091b1d88acbfd35dcba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:35.769085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6186adfcd67b4091b1d88acbfd35dcba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:35.782676 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2937/5849] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:35 2022] DELETE /identity/v3/users/6186adfcd67b4091b1d88acbfd35dcba => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:35.784274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.786531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:35.815304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd327a-f713-4096-b778-6233bc43e080 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.850743 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:35.898160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcc3ef-ae5b-481f-bf3b-eba0fa6b314d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.903828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.904788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.905175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.905601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.906313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.906474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.907197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.907563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.907941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.908985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.909161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.912041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.939591 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2938/5850] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:35 2022] POST /identity/v3/users => generated 306 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:35.941409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.945008 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2913/5851] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:35 2022] POST /identity/v3/users => generated 298 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:35.950946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.953546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:35.956028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a665a-e3a0-4d46-a800-2a0154429469 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.961894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.962603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.962888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.963165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.964042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.966147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.981904 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2939/5852] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:35.982793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f575ad-3bb1-43b1-a953-1d46191c1b53 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:35.983164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:35.991506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:35.992226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:35.992567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:35.992946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:35.993762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:35.995767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:35.997560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae89165-a20f-4036-8aa6-924d0a045b13 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.003296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.004431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.004813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.005187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] PATH_INFO: `/v3/projects/42322e0380e54c54a029c9b06137e739/users/ec4d47b1cbaa450d86fe21ec31cff468/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.010994 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2914/5853] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:35 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:36.015472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.024296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42322e0380e54c54a029c9b06137e739, user_id=ec4d47b1cbaa450d86fe21ec31cff468, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.027127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.046266 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2940/5854] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:35 2022] PUT /identity/v3/projects/42322e0380e54c54a029c9b06137e739/users/ec4d47b1cbaa450d86fe21ec31cff468/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:36.049486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a9988-6d96-4f32-ba9e-3ab6edf8d971 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.050842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.116998 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:36.136252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.137119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.137601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.137935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.138787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.140479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.155333 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2915/5855] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:36.157148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015eaad-ced9-41a8-941e-b04594af12f0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.159968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.168741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.169570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.170098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.170477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.171374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.174884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.179945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ecf22-c238-4e7d-91be-d961df93856c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.186603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5705ed-49e0-47a6-8a02-ca0842223710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.187828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5705ed-49e0-47a6-8a02-ca0842223710 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.188092 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2941/5856] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:36 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:36.188514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5705ed-49e0-47a6-8a02-ca0842223710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.188852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5705ed-49e0-47a6-8a02-ca0842223710 admin admin] PATH_INFO: `/v3/projects/5366abca63504634bd32e0fa6e5a1926/users/506286881e7849678135c204dbf04657/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.191732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.210423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5705ed-49e0-47a6-8a02-ca0842223710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5366abca63504634bd32e0fa6e5a1926, user_id=506286881e7849678135c204dbf04657, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.211872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efd1de-4661-4afb-9df5-f7665586cec0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.213406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5705ed-49e0-47a6-8a02-ca0842223710 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.219384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b93f4-3246-4b23-93f7-ab5d4db95094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.220650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b93f4-3246-4b23-93f7-ab5d4db95094 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.221165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b93f4-3246-4b23-93f7-ab5d4db95094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.221655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b93f4-3246-4b23-93f7-ab5d4db95094 admin admin] PATH_INFO: `/v3/projects/42322e0380e54c54a029c9b06137e739/users/ec4d47b1cbaa450d86fe21ec31cff468/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.226127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b93f4-3246-4b23-93f7-ab5d4db95094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42322e0380e54c54a029c9b06137e739, user_id=ec4d47b1cbaa450d86fe21ec31cff468, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.229502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b93f4-3246-4b23-93f7-ab5d4db95094 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.239349 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2916/5857] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:36 2022] PUT /identity/v3/projects/5366abca63504634bd32e0fa6e5a1926/users/506286881e7849678135c204dbf04657/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:36.245509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2942/5858] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:36 2022] PUT /identity/v3/projects/42322e0380e54c54a029c9b06137e739/users/ec4d47b1cbaa450d86fe21ec31cff468/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:36.250275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.250801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.251360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.264845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.265404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.266311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.315487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] MFA Rules not processed for user `506286881e7849678135c204dbf04657`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:36.323244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] MFA Rules not processed for user `ec4d47b1cbaa450d86fe21ec31cff468`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:36.324541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:36.332950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:36.455027 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:36.463608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2943/5859] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:36.466397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.471200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:36.505751 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2917/5860] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:36.506741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.591470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5928509a-5fa4-4b12-b71d-edb0bde62bef None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.597765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.600038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.600422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.600781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] PATH_INFO: `/v3/projects/ec45030fdc6c4842b62458766f8dd076` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.602755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec45030fdc6c4842b62458766f8dd076)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.605740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.669284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7be258-9e9e-4740-9732-2112e4d0e5b5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.684735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec45030fdc6c4842b62458766f8dd076', 'request_id': 'req-874e6a13-3334-46b1-a990-60e2fee134ab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:36.694865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec45030fdc6c4842b62458766f8dd076', 'request_id': 'req-874e6a13-3334-46b1-a990-60e2fee134ab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:36.703902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec45030fdc6c4842b62458766f8dd076', 'request_id': 'req-874e6a13-3334-46b1-a990-60e2fee134ab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:36.719703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] The token cache is being invalidate because project ec45030fdc6c4842b62458766f8dd076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:36.720083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:36.724814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:36.727468 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2944/5861] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:36 2022] DELETE /identity/v3/projects/ec45030fdc6c4842b62458766f8dd076 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:36.728577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.732437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:36.753843 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:36.761984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607cd54-cc64-4e70-b4ac-f1433aec2d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:36.763287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607cd54-cc64-4e70-b4ac-f1433aec2d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.763578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607cd54-cc64-4e70-b4ac-f1433aec2d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.763865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607cd54-cc64-4e70-b4ac-f1433aec2d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.764669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607cd54-cc64-4e70-b4ac-f1433aec2d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:36.767360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607cd54-cc64-4e70-b4ac-f1433aec2d2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:36.815723 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2918/5862] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:36 2022] POST /identity/v3/projects => generated 397 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:36.821216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:36.822525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:36.822915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:36.877621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e6a13-3334-46b1-a990-60e2fee134ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:36.879346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:36.882284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:36.972766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2919/5863] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:36.988699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:36.990549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:37.010834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6201488-2aad-40ab-a4ae-c2b1df568d7a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.013693 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:37.017909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24b9ab-c886-43b8-bd0a-d4518e395079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.018633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24b9ab-c886-43b8-bd0a-d4518e395079 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.018903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24b9ab-c886-43b8-bd0a-d4518e395079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.019180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24b9ab-c886-43b8-bd0a-d4518e395079 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.020274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24b9ab-c886-43b8-bd0a-d4518e395079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.025038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24b9ab-c886-43b8-bd0a-d4518e395079 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.030820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.045576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.046013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.046152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.051247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:37.075515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2920/5864] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:36 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:37.079171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.079468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.088800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.135165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:37.137576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:37.151137 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2921/5865] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:37.152491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.166760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d4f4f-3a14-4e44-86f7-9a167e245f35 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.175296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.176700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.177195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.177701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.180126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.183445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.214258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.217529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.243926 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2922/5866] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:37.245786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.259874 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2945/5867] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:37.261054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.274052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fbba-32a7-4954-8503-8a7e0a59f279 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.276216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2338f3ba-7995-408d-8d16-06e2b435354c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.279715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.280557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.281115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.281482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.282474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.283571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.284511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.284646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.285454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.285742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.286489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:37.287004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.292964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.300776 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2946/5868] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:37.305052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.318369 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2923/5869] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:37.320364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.321437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a4dab4-1657-472e-8f20-2b0db20c7b7f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.335210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084d0f3-c553-40de-8621-ffc19f8109ec admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.336682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe5fbd-f1d8-49b4-8038-ca2c9bca1d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.337593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5fbd-f1d8-49b4-8038-ca2c9bca1d54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.337927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5fbd-f1d8-49b4-8038-ca2c9bca1d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.338296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe5fbd-f1d8-49b4-8038-ca2c9bca1d54 admin admin] PATH_INFO: `/v3/projects/0e0d1f7dbb4240fe9470a91a7c30e00b/users/5ef91c884dc94bc8a97e1c2be406f4bc/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.343557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.344581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.345061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.345546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.346609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.349006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.375921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe5fbd-f1d8-49b4-8038-ca2c9bca1d54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e0d1f7dbb4240fe9470a91a7c30e00b, user_id=5ef91c884dc94bc8a97e1c2be406f4bc, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.378925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe5fbd-f1d8-49b4-8038-ca2c9bca1d54 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.393486 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2924/5870] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:37 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:37.394674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.406200 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2947/5871] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:37 2022] PUT /identity/v3/projects/0e0d1f7dbb4240fe9470a91a7c30e00b/users/5ef91c884dc94bc8a97e1c2be406f4bc/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:37.418235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.418777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.419288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.500728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] MFA Rules not processed for user `5ef91c884dc94bc8a97e1c2be406f4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:37.504752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:37.526250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea12f7-bfe6-411f-b43a-58a992a145c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.558754 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:37.655117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.656065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.656505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.657209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.658017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.660111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.681340 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2948/5872] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:37.695478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.699301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:37.730034 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2925/5873] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:37 2022] POST /identity/v3/users => generated 291 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:37.734442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.754448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcad393-b8ef-42b5-82c4-313ae1c9e0f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.767994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.769084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.769342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.769703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.770552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.776380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.811809 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2926/5874] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:37.813063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.816209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e785837a-4c62-459f-b696-e7c0b983a2c4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.823124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.823978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.824110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.824391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.827237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:37.835863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b1e5-e512-4d76-9129-006aef47be29 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.841311 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:37.858745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.862837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.863246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.863620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.866698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.868721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.898408 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2927/5875] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:37.904286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:37.930135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.930428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9087dfec-962a-4256-815b-6db651d14679 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:37.932088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b5347e-bc5a-419f-bf60-13cfa422bb2e service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:37.941914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:37.945143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:37.946978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:37.947419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] PATH_INFO: `/v3/projects/07a20b8845c6479c867639e74a6941f0/users/52946cb328cf48d0b99fea717b576e6b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:37.961268 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2949/5876] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:37 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:37.977251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a20b8845c6479c867639e74a6941f0, user_id=52946cb328cf48d0b99fea717b576e6b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:37.985128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:38.006953 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2928/5877] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:37 2022] PUT /identity/v3/projects/07a20b8845c6479c867639e74a6941f0/users/52946cb328cf48d0b99fea717b576e6b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:38.013981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:38.014589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:38.014991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:38.080689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:38.084542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:38.220623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2950/5878] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:38.241211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:38.393886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdafc8e-3c5d-4c37-96f0-fe6a740c435e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:38.419687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7fab-1a98-4c09-8f4b-8e518347b867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:38.420773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7fab-1a98-4c09-8f4b-8e518347b867 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:38.421043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7fab-1a98-4c09-8f4b-8e518347b867 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:38.421431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7fab-1a98-4c09-8f4b-8e518347b867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:38.442139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a7fab-1a98-4c09-8f4b-8e518347b867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:38.444323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a7fab-1a98-4c09-8f4b-8e518347b867 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:38.467625 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2929/5879] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:38.523131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:38.537593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8186c87f-5e7b-485e-833b-3484c3bce83c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:38.544568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:38.546188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:38.546708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:38.547206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] PATH_INFO: `/v3/users/ec4d47b1cbaa450d86fe21ec31cff468` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:38.549594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4d47b1cbaa450d86fe21ec31cff468)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:38.554219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:38.660213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4d47b1cbaa450d86fe21ec31cff468'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:38.673217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4d47b1cbaa450d86fe21ec31cff468'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:38.704948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4d47b1cbaa450d86fe21ec31cff468'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:38.706943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4d47b1cbaa450d86fe21ec31cff468'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:38.718748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4d47b1cbaa450d86fe21ec31cff468'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:38.731947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2951/5880] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:38 2022] DELETE /identity/v3/users/ec4d47b1cbaa450d86fe21ec31cff468 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:38.733662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:38.733954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:38.734235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:38.755822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:38.758171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:38.861601 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2930/5881] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:38.878178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:38.882944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:38.930901 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:39.028704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782a9203-3517-4aba-89ee-f7461f7dbb6f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:39.037063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:39.038411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:39.038914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:39.040770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:39.062501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:39.078640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:39.105831 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2952/5882] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:40.573029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:40.575825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:40.594968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d9e28-733e-4871-8289-b8b80bba6232 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:40.601425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:40.602391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:40.602737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:40.603025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] PATH_INFO: `/v3/projects/42322e0380e54c54a029c9b06137e739` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:40.605579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=42322e0380e54c54a029c9b06137e739)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:40.615981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:40.618674 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:40.783157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42322e0380e54c54a029c9b06137e739', 'request_id': 'req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:40.797287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42322e0380e54c54a029c9b06137e739', 'request_id': 'req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:40.812796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42322e0380e54c54a029c9b06137e739', 'request_id': 'req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:40.838045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] The token cache is being invalidate because project 42322e0380e54c54a029c9b06137e739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:40.838652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:40.844107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:40.844107 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2931/5883] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:40 2022] DELETE /identity/v3/projects/42322e0380e54c54a029c9b06137e739 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:40.850788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:40.863303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ce7ff3-8cfe-4bbd-b99f-9cc6eeab279f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:40.940384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:40.942351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:40.942880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:40.943485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] PATH_INFO: `/v3/users/5ef91c884dc94bc8a97e1c2be406f4bc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:40.945379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ef91c884dc94bc8a97e1c2be406f4bc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:40.947724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:41.060833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ef91c884dc94bc8a97e1c2be406f4bc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:41.081208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ef91c884dc94bc8a97e1c2be406f4bc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:41.123553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ef91c884dc94bc8a97e1c2be406f4bc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:41.124611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ef91c884dc94bc8a97e1c2be406f4bc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:41.140953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20f148b9-86f7-4c93-9b99-3a8848c9e2ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ef91c884dc94bc8a97e1c2be406f4bc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:41.161418 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2953/5884] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:40 2022] DELETE /identity/v3/users/5ef91c884dc94bc8a97e1c2be406f4bc => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:43.849307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:43.851470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:43.893990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c9f00-1db9-405d-bbd3-9274fbfa8f3a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:44.097122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:44.098032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:44.098312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:44.098586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] PATH_INFO: `/v3/projects/0e0d1f7dbb4240fe9470a91a7c30e00b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:44.104032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e0d1f7dbb4240fe9470a91a7c30e00b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:44.112085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:44.223531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e0d1f7dbb4240fe9470a91a7c30e00b', 'request_id': 'req-295eb2a0-3ddf-4969-a38f-02f6318610fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:44.243343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e0d1f7dbb4240fe9470a91a7c30e00b', 'request_id': 'req-295eb2a0-3ddf-4969-a38f-02f6318610fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:44.257295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e0d1f7dbb4240fe9470a91a7c30e00b', 'request_id': 'req-295eb2a0-3ddf-4969-a38f-02f6318610fa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:44.282367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] The token cache is being invalidate because project 0e0d1f7dbb4240fe9470a91a7c30e00b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:44.282707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:44.283613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-295eb2a0-3ddf-4969-a38f-02f6318610fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:44.290438 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2932/5885] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:43 2022] DELETE /identity/v3/projects/0e0d1f7dbb4240fe9470a91a7c30e00b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:44.292370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:44.292914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:44.293169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:44.341214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:44.342489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:44.439197 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:44.519588 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2954/5886] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:44.522077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:44.522659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:44.523118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:44.561626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:44.563317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:44.585682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2933/5887] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:44.590808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:44.608383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4e868f-f8c0-4540-a9fc-85100b50100b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:44.624780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:44.626866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:44.627262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:44.627641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:44.629273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:44.631077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:44.637266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:44.672822 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2955/5888] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:44.677391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:44.696929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3331b-add7-4e7f-958c-bd50a4025479 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:44.705244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:44.705940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:44.706225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:44.706502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:44.707250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:44.709329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:44.736864 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:44.765660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2934/5889] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:44 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:44.769761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:44.789686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb43f2d-a5ed-445e-83de-d991e53387cd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:44.920500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:44.921214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:44.921500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:44.921823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:44.922560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:44.927901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:44.973465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:44.974593 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2956/5890] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:44 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:44.989557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b07c86-5e17-4d34-b9bb-49c90af909ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.000770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.001604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.001787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.002086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.005557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.010684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.035742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2935/5891] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:45.040827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.063203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92c1526-9bad-4858-83f7-a368a7be161d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.086764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8032155-5f3e-41d0-a0eb-2e42431159a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.087481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8032155-5f3e-41d0-a0eb-2e42431159a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.087817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8032155-5f3e-41d0-a0eb-2e42431159a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.088686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8032155-5f3e-41d0-a0eb-2e42431159a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.089480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8032155-5f3e-41d0-a0eb-2e42431159a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.095216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8032155-5f3e-41d0-a0eb-2e42431159a6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.123166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.123839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2957/5892] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:45.136127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a96d3-ca9d-465a-8554-61ead801fce2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.144683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.145969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.146294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.146698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] PATH_INFO: `/v3/projects/fdbf763d9aaa433483c07735039215ca/users/52dd449d66ff4623b089761ea75eafce/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.206822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbf763d9aaa433483c07735039215ca, user_id=52dd449d66ff4623b089761ea75eafce, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.210174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.248861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2936/5893] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:45 2022] PUT /identity/v3/projects/fdbf763d9aaa433483c07735039215ca/users/52dd449d66ff4623b089761ea75eafce/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:45.259797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.260096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.260885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.344068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] MFA Rules not processed for user `52dd449d66ff4623b089761ea75eafce`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:45.345374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:45.496883 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2958/5894] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:45.498748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.609764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf345c6-41e8-4e70-91bc-d066ee603c23 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.616449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.617420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.617720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.617995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.618880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.621500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.677030 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2937/5895] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:45 2022] POST /identity/v3/projects => generated 375 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:45.678313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.691632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c4e83-693b-4703-9066-f51a680a65c0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.756083 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:45.794832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.796246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.796834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.797124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.797953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.800187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.830003 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2959/5896] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:45 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:45.833939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.850702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056c747-c22b-438a-9a5e-7daedb727c85 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.857536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.859850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.860288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.860700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.861558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.863453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.877776 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2938/5897] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:45.882323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.900621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc57fe-d97d-4b4d-b46e-c4e31f603545 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.907614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b928a323-9467-423e-8d82-c3558b1c55b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.908482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928a323-9467-423e-8d82-c3558b1c55b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.908869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928a323-9467-423e-8d82-c3558b1c55b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.909313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b928a323-9467-423e-8d82-c3558b1c55b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.910171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928a323-9467-423e-8d82-c3558b1c55b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.912698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b928a323-9467-423e-8d82-c3558b1c55b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:45.929371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2960/5898] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:45.933840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:45.946891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda7432-048b-4556-bb23-62488b0867f0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:45.955770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:45.957436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:45.957826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:45.958384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] PATH_INFO: `/v3/projects/43e1df16402c4f00aef7f5b9cd10e720/users/9a1de907a1304ec3b80d66b1bdb2c1e1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:45.979792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e1df16402c4f00aef7f5b9cd10e720, user_id=9a1de907a1304ec3b80d66b1bdb2c1e1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:45.984882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:46.003071 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2939/5899] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:45 2022] PUT /identity/v3/projects/43e1df16402c4f00aef7f5b9cd10e720/users/9a1de907a1304ec3b80d66b1bdb2c1e1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:46.013863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba69d-3499-4f39-8c76-6a952b1c4691 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:46.014568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba69d-3499-4f39-8c76-6a952b1c4691 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:46.015005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ba69d-3499-4f39-8c76-6a952b1c4691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:46.065739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2c0ba69d-3499-4f39-8c76-6a952b1c4691 None None] MFA Rules not processed for user `9a1de907a1304ec3b80d66b1bdb2c1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:46.067180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c0ba69d-3499-4f39-8c76-6a952b1c4691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:46.208503 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2961/5900] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:46.233570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:46.235684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:46.333875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e6cf7-d6d0-4603-8501-138a7608e448 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:46.346930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:46.348009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:46.348375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:46.348850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:46.394298 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:46.485546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:46.487049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:46.505898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2940/5901] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:46.638275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:46.638925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:46.638925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:46.673759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:46.675685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:46.814895 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2962/5902] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:34:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:46.890300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:46.893560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:47.070580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201d00-07e3-47f5-96ec-900b9c98d757 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:47.084031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:47.085223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:47.085717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:47.086364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:47.097619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:47.101718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:47.152387 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2941/5903] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:34:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:34:47.307218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:47.308798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:47.464385 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:47.522409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50952d2c-4ca0-455f-a834-e3cee89ae26f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:47.530398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:47.532662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:47.538263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:47.538830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:47.539263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:47.539642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] PATH_INFO: `/v3/users/58f678771a2345d4b2d1efab22062b92` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:47.542224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58f678771a2345d4b2d1efab22062b92)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:47.546748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:47.580145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54d5b3f-8b70-40b6-89ab-95bf62f4186a service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:47.586354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fd524-9837-4948-943a-bf122173fc2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:47.587043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fd524-9837-4948-943a-bf122173fc2a service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:47.587443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fd524-9837-4948-943a-bf122173fc2a service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:47.587726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fd524-9837-4948-943a-bf122173fc2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:47.605675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fd524-9837-4948-943a-bf122173fc2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:47.609333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7fd524-9837-4948-943a-bf122173fc2a service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:47.649987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58f678771a2345d4b2d1efab22062b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:47.651440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2942/5904] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:47.668728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58f678771a2345d4b2d1efab22062b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:47.699847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58f678771a2345d4b2d1efab22062b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:47.702735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58f678771a2345d4b2d1efab22062b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:47.720588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2eff7b7f-ae78-4409-be66-9cba4c304c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58f678771a2345d4b2d1efab22062b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:47.735141 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2963/5905] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:47 2022] DELETE /identity/v3/users/58f678771a2345d4b2d1efab22062b92 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:47.739540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:47.739859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:47.740085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:47.775731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:47.777212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:47.823772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:47.824792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:47.825554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:47.871961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:47.875287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:47.930674 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2943/5906] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:47.962902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:47.965389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:48.005336 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2964/5907] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:34:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:48.027006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:48.028594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:48.050498 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:48.127369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710b1f9-cab8-4a49-a12a-eaf0aca4f8d9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:48.137766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:48.138957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:48.140752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:48.143106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:48.170388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:48.171995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:48.189351 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2944/5908] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:34:48.197721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57f0e8-cce6-4884-98c6-c49f82c65e8f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:48.208336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e7e88-9871-44a1-a5c6-2cd8906100b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:48.209534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7e88-9871-44a1-a5c6-2cd8906100b1 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:48.210043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7e88-9871-44a1-a5c6-2cd8906100b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:48.210551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e7e88-9871-44a1-a5c6-2cd8906100b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:48.218568 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:48.227551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e7e88-9871-44a1-a5c6-2cd8906100b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:48.233832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e7e88-9871-44a1-a5c6-2cd8906100b1 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:48.250078 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2965/5909] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:34:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:34:48.450488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:48.452176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:48.475746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6725de-d41a-477b-adb9-ebeba1fa05a2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:48.481779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:48.482881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:48.483199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:48.484231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] PATH_INFO: `/v3/users/52dd449d66ff4623b089761ea75eafce` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:48.485175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52dd449d66ff4623b089761ea75eafce)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:48.487275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:48.580799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52dd449d66ff4623b089761ea75eafce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:48.581519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52dd449d66ff4623b089761ea75eafce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:48.598691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52dd449d66ff4623b089761ea75eafce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:48.599387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52dd449d66ff4623b089761ea75eafce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:48.616062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52dd449d66ff4623b089761ea75eafce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:48.657320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2945/5910] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:48 2022] DELETE /identity/v3/users/52dd449d66ff4623b089761ea75eafce => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:48.659487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:48.660532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:48.660965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:48.688371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:48.689897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:48.777739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2966/5911] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:49.322904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:49.324885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:49.350844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:49.356031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:49.456639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6233527a-e72d-4107-b1c2-6466b8aa1a1a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:49.470543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:49.477285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:49.477791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:49.478277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] PATH_INFO: `/v3/projects/23dcb297a79843598037b362676558a4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:49.492753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23dcb297a79843598037b362676558a4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:49.509297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:49.688163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22bc2c-385c-4c2c-97d7-cc2be6a47bc9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:49.769368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23dcb297a79843598037b362676558a4', 'request_id': 'req-bd46d556-c8af-434b-83ce-48532cc0d8d7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:49.789356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23dcb297a79843598037b362676558a4', 'request_id': 'req-bd46d556-c8af-434b-83ce-48532cc0d8d7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:49.814740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23dcb297a79843598037b362676558a4', 'request_id': 'req-bd46d556-c8af-434b-83ce-48532cc0d8d7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:49.861165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] The token cache is being invalidate because project 23dcb297a79843598037b362676558a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:49.866822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:49.872705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:49.873420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:49.873711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:49.874018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd46d556-c8af-434b-83ce-48532cc0d8d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:49.874474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:49.879195 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2967/5912] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:49 2022] DELETE /identity/v3/projects/23dcb297a79843598037b362676558a4 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:49.881650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:49.882027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:49.882418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:49.886920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:49.932502 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:49.945168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:49.954622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:50.082169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.084492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6be082-bd34-4b2c-846a-de713860e6b2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.120722 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2946/5913] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 802 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:50.148413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2968/5914] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:50.158369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.158894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.159312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.190700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:50.193617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:50.205652 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2947/5915] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:50.210858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.248910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c46e2e-8515-4d4d-8d90-868a19c5feab None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.263768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.265136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.267667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.269003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.270845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:50.271531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.274068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.296005 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2969/5916] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:50.302604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.330095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf2f2d-f0dc-4582-837e-d68943ca7bff None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.356413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.362745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.363277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.365587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.369244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.374679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.456909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2948/5917] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:50 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:50.464291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.482309 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:50.502332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8b10b0-4eb7-4b34-b9f1-1553d33da397 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.570819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.573716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:50.676686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.677402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.677688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.677962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.678674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.680675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.695769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377c345-150e-4366-984c-72aff1d3e762 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.719000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.720027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.721542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.722188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.725072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:50.733997 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2970/5918] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:50 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:50.736902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.761423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.769530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.769712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4e8e7-9f6e-49f6-aaf8-baf51feaef4f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.784377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.788607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.789273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.790522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.793271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.798929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.824420 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2949/5919] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:34:50.845934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.854588 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2971/5920] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:50.870174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8094d-dde1-4af3-a54d-2b1c90c9c763 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.883901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264bc0ff-6e5f-46b6-8e83-4f828d3c3436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.885472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bc0ff-6e5f-46b6-8e83-4f828d3c3436 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.885758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bc0ff-6e5f-46b6-8e83-4f828d3c3436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.888199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264bc0ff-6e5f-46b6-8e83-4f828d3c3436 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.889937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bc0ff-6e5f-46b6-8e83-4f828d3c3436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.894148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264bc0ff-6e5f-46b6-8e83-4f828d3c3436 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:50.921854 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2950/5921] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:50 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:50.924139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:50.947060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735ea31-7a0a-4f21-be57-57f8c8a5299a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:50.957999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:50.959651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:50.960228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:50.960972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] PATH_INFO: `/v3/projects/a50f4d33081549e1a7df19264801ff40/users/03c722b1cdb64ab7b988937f97a00fde/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:50.987364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a50f4d33081549e1a7df19264801ff40, user_id=03c722b1cdb64ab7b988937f97a00fde, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:50.991691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:51.045740 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2972/5922] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:50 2022] PUT /identity/v3/projects/a50f4d33081549e1a7df19264801ff40/users/03c722b1cdb64ab7b988937f97a00fde/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:51.052578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:51.053174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:51.053829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:51.141321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] MFA Rules not processed for user `03c722b1cdb64ab7b988937f97a00fde`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:51.146271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:51.372725 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:51.440521 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2951/5923] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 390 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:51.462973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:51.465782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:51.600088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f345adc-b638-4e20-a1fe-c5d826e973a2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:51.608299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:51.609898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:51.610698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:51.611376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:51.632889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:51.637298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:51.671814 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2973/5924] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:52.910895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:52.913921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:52.999198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:53.244920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400f023-aeeb-422e-8e80-da6dae9bbb5f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:53.261111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:53.262494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:53.263544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:53.264453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] PATH_INFO: `/v3/projects/fdbf763d9aaa433483c07735039215ca` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:53.267037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbf763d9aaa433483c07735039215ca)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:53.269342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e1b8e-61ff-4881-baa9-3b806df6b6a6 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:53.276011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:53.285981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:53.287863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:53.289727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:53.290194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] PATH_INFO: `/v3/users/03c722b1cdb64ab7b988937f97a00fde` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:53.294151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=03c722b1cdb64ab7b988937f97a00fde)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:53.299686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:53.305253 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:53.470081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbf763d9aaa433483c07735039215ca', 'request_id': 'req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.490397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03c722b1cdb64ab7b988937f97a00fde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.494697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbf763d9aaa433483c07735039215ca', 'request_id': 'req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.507343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03c722b1cdb64ab7b988937f97a00fde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.521019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbf763d9aaa433483c07735039215ca', 'request_id': 'req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.527766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03c722b1cdb64ab7b988937f97a00fde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.528908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03c722b1cdb64ab7b988937f97a00fde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.544259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-60ad04f3-b1fc-4066-aafd-6dd14f772d5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03c722b1cdb64ab7b988937f97a00fde'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.556377 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2974/5925] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:52 2022] DELETE /identity/v3/users/03c722b1cdb64ab7b988937f97a00fde => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:53.561617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:53.562224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:53.562594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:53.563756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] The token cache is being invalidate because project fdbf763d9aaa433483c07735039215ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:53.564217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.568100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.572249 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2952/5926] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:52 2022] DELETE /identity/v3/projects/fdbf763d9aaa433483c07735039215ca => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:53.576108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:53.584614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:53.625808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:53.628934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:53.781458 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2975/5927] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:53.786978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58011bd-b7b2-4c39-9f0b-1ac91f0dc66f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:53.806130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:53.807071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:53.807906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:53.807906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] PATH_INFO: `/v3/users/9a1de907a1304ec3b80d66b1bdb2c1e1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:53.824629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1de907a1304ec3b80d66b1bdb2c1e1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:53.826694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:53.865626 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:53.928877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1de907a1304ec3b80d66b1bdb2c1e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.931767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1de907a1304ec3b80d66b1bdb2c1e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.947308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1de907a1304ec3b80d66b1bdb2c1e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.948214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1de907a1304ec3b80d66b1bdb2c1e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.958772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1de907a1304ec3b80d66b1bdb2c1e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:53.982738 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2953/5928] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:53 2022] DELETE /identity/v3/users/9a1de907a1304ec3b80d66b1bdb2c1e1 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:54.068158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:54.069708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:54.167327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183eaf0f-dbd7-452f-8578-ca5d2248b5b0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:54.210364 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:54.232418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:54.233725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:54.234081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:54.234589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:54.237041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:54.349730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:54.354267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bc553-838c-4cfb-90fa-64cbfdb3d631 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:54.378056 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2976/5929] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:56.030524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:56.034549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.078507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4459ad-3b34-451f-b9b8-d4ff9c61bdd2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:56.090589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:56.091672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.091959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.092234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] PATH_INFO: `/v3/projects/43e1df16402c4f00aef7f5b9cd10e720` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.093630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e1df16402c4f00aef7f5b9cd10e720)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:56.096216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:56.179381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e1df16402c4f00aef7f5b9cd10e720', 'request_id': 'req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.192522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e1df16402c4f00aef7f5b9cd10e720', 'request_id': 'req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.204741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e1df16402c4f00aef7f5b9cd10e720', 'request_id': 'req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.226779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] The token cache is being invalidate because project 43e1df16402c4f00aef7f5b9cd10e720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:56.228648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.232965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b70daf1a-c1f1-4992-bd3a-ab0826cfe2ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.236603 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2954/5930] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:56 2022] DELETE /identity/v3/projects/43e1df16402c4f00aef7f5b9cd10e720 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:56.243287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.243813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.243813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.263907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:56.265637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.365614 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2977/5931] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:56.375678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.375968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.376269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.405890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:56.413341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.415298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:56.422613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.438183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc707d8f-e466-498c-a1c3-fbd9cef7facc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:56.451197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:56.452104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.452419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.452770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] PATH_INFO: `/v3/projects/a50f4d33081549e1a7df19264801ff40` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.453987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a50f4d33081549e1a7df19264801ff40)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:56.455911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:56.459735 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2955/5932] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:56.460743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:56.474571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7729f-39a6-45d4-9d5d-40e9a2858b4f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:56.488073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:56.489094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.489585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.490065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.491216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:56.491743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:56.493637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:56.512257 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2956/5933] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:56.517233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:56.549131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51296a43-958c-475f-b174-67599d2392eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:56.562358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a50f4d33081549e1a7df19264801ff40', 'request_id': 'req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.579093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a50f4d33081549e1a7df19264801ff40', 'request_id': 'req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.598076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a50f4d33081549e1a7df19264801ff40', 'request_id': 'req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.623481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] The token cache is being invalidate because project a50f4d33081549e1a7df19264801ff40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:34:56.624301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.627149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-93c47e6f-3cc8-4f28-974f-f2b2924cbeb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:34:56.631608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2978/5934] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:34:56 2022] DELETE /identity/v3/projects/a50f4d33081549e1a7df19264801ff40 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:56.638006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8ef6f-773a-4cf0-a7d5-b32807cfed0e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.638280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8ef6f-773a-4cf0-a7d5-b32807cfed0e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.638558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d8ef6f-773a-4cf0-a7d5-b32807cfed0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.689317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-40d8ef6f-773a-4cf0-a7d5-b32807cfed0e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:56.693677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-40d8ef6f-773a-4cf0-a7d5-b32807cfed0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.705902 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:56.718578 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:56.742563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:56.744016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.744605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.745115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.746846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:56.749166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:56.816451 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2957/5935] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:56 2022] POST /identity/v3/projects => generated 383 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:56.817858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:56.820401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.866323 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2979/5936] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:56.874023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:56.874328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:56.875445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:56.922272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:56.923833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:56.976199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e2f960-a1f4-4b18-acbd-b06a023b748e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:56.998106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:56.998532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.003471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.004548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.007948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.012937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.072834 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2958/5937] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:56 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:57.073877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.088890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a93677-0696-4468-bbfa-b71dbede5edd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.115570 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2980/5938] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:57.116722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.117680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.118224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.118990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.120016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.120133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.122550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.143111 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2959/5939] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:57.146757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a28dc3a-9afc-4ff4-a59e-458cf74aeb13 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.152229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.153388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.154148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.154500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.154838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.155810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:34:57.156196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.157949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.168447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2f00f5-02c4-4ebe-88df-e536bd947a9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.176710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2981/5940] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:34:57.177505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.178261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.178717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.179254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.180376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.181350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.183775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.190028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0332a2d2-53ab-4d5c-b9d7-e2b96c20e696 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.197769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2960/5941] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:57.197962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.198579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.198858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.199131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.199833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.201823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.203124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.217627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca8b3d-c82c-416d-bb3b-68bff1788e39 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.241661 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2982/5942] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:57 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:57.243519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.246332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f4609-76f1-43cb-b25e-db7998388821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.247259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4609-76f1-43cb-b25e-db7998388821 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.247544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4609-76f1-43cb-b25e-db7998388821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.249937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f4609-76f1-43cb-b25e-db7998388821 admin admin] PATH_INFO: `/v3/projects/75aee419b5be43029c531581efe5204c/users/91d4bb997de643a5a51f4c0e5bf4c458/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.286297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4609-76f1-43cb-b25e-db7998388821 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75aee419b5be43029c531581efe5204c, user_id=91d4bb997de643a5a51f4c0e5bf4c458, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.290658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f4609-76f1-43cb-b25e-db7998388821 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.331187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8567e-c887-4496-8a4c-84063f7ee1c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.337939 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2961/5943] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:57 2022] PUT /identity/v3/projects/75aee419b5be43029c531581efe5204c/users/91d4bb997de643a5a51f4c0e5bf4c458/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:57.339637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.339954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.340231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.367915 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:57.375371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] MFA Rules not processed for user `91d4bb997de643a5a51f4c0e5bf4c458`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:57.376799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:57.431408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.432653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.433145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.433674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.434628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.436926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.480767 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2983/5944] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:57 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:57.485573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.519977 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2962/5945] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:57.520379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb915771-243e-423c-88cc-b0f8e2d1c816 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.521945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.535151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.538463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.539599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.539990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.542723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.547388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.552627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5727-6b33-4751-91ac-549b0a0e2eba None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.565224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.566073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.567199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.567579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.569994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.575994 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2984/5946] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:57.577798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.578865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.603664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39489756-1523-4f02-8444-bec2fb069361 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.613499 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:57.618601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.620963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.620963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.621657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.623326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.624705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.641698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2963/5947] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:34:57 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:34:57.646375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.659830 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2985/5948] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:57.663316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.688895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cc0d51-bee0-4dce-8dd8-5e528cc8afb7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.816212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690ae51-3c19-4124-9864-e78c8c373492 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.832136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.833668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.835113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.836971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.838053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.844946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.855563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34fb1d1-199c-49e9-89df-7b63026c52d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.857905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fb1d1-199c-49e9-89df-7b63026c52d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.858331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fb1d1-199c-49e9-89df-7b63026c52d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.858933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34fb1d1-199c-49e9-89df-7b63026c52d3 admin admin] PATH_INFO: `/v3/projects/0a27a46b8d8844238a952b83b7af3ed3/users/68e6a1608c494606a014fff6189f771f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.896086 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2964/5949] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:34:57 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:34:57.897506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.898986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fb1d1-199c-49e9-89df-7b63026c52d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a27a46b8d8844238a952b83b7af3ed3, user_id=68e6a1608c494606a014fff6189f771f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.908730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34fb1d1-199c-49e9-89df-7b63026c52d3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.922511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93989a56-2cd2-406c-be77-0260b41efc95 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:57.938055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:57.939952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.941131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.950197 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2986/5950] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:57 2022] PUT /identity/v3/projects/0a27a46b8d8844238a952b83b7af3ed3/users/68e6a1608c494606a014fff6189f771f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:34:57.950481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.950481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:57.950481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:57.952767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:57.953168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:57.953543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:57.979618 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2965/5951] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:57.981769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:57.994342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14ccba3-7b9a-4e9c-8fd6-ddc520112708 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:58.015012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] MFA Rules not processed for user `68e6a1608c494606a014fff6189f771f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:58.018827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:58.154823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:58.155602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.156799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.157193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.172206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:58.175657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:58.198007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2966/5952] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:34:57 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:34:58.199556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:58.217011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb5813f-4f50-4760-972b-e769966415df admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:58.225799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20ef72-5e05-45e8-b922-f625df9b59db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:58.227156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ef72-5e05-45e8-b922-f625df9b59db admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.228088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ef72-5e05-45e8-b922-f625df9b59db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.228088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ef72-5e05-45e8-b922-f625df9b59db admin admin] PATH_INFO: `/v3/projects/6de810ae185944f582eb39d01277f583/users/82f0da0e67e04b87a7adaed572f39e9b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.228369 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2987/5953] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:58.265734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ef72-5e05-45e8-b922-f625df9b59db admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de810ae185944f582eb39d01277f583, user_id=82f0da0e67e04b87a7adaed572f39e9b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:58.268529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20ef72-5e05-45e8-b922-f625df9b59db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:58.298677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2967/5954] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:34:58 2022] PUT /identity/v3/projects/6de810ae185944f582eb39d01277f583/users/82f0da0e67e04b87a7adaed572f39e9b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:34:58.298932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:58.298932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:58.302275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381d60-aa7e-4db7-87a1-91ade8f0b2d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.302537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381d60-aa7e-4db7-87a1-91ade8f0b2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.302890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b381d60-aa7e-4db7-87a1-91ade8f0b2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.304045 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:58.341592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0b381d60-aa7e-4db7-87a1-91ade8f0b2d6 None None] MFA Rules not processed for user `82f0da0e67e04b87a7adaed572f39e9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:58.342824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b381d60-aa7e-4db7-87a1-91ade8f0b2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:58.403807 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:58.428029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2ffc9-9c95-49af-897f-525a9d64bc74 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:58.534700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:58.535526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.535919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.536298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.554740 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2968/5955] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:58.558341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e494485-df62-4be6-a311-bb62238cd41b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.558758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e494485-df62-4be6-a311-bb62238cd41b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.559143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e494485-df62-4be6-a311-bb62238cd41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.672549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4e494485-df62-4be6-a311-bb62238cd41b None None] MFA Rules not processed for user `52946cb328cf48d0b99fea717b576e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:58.681285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e494485-df62-4be6-a311-bb62238cd41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:58.693144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:58.694682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:58.715232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2988/5956] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:34:58.716379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:58.719480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:58.908402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a131b-9007-463b-a41f-6a758ec2108c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:58.937368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:58.939347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.941998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.941998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.947295 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2969/5957] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:34:58.959886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:58.960185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:58.960531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:58.988410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] MFA Rules not processed for user `52946cb328cf48d0b99fea717b576e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:34:58.998131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:59.016036 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2970/5958] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:34:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:34:59.027012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:59.030464 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:34:59.036534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:34:59.155707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:59.157252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:59.181509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2989/5959] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:59.307004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c51d14-4eed-4fbe-80e9-c28548e2563b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:59.320098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:59.323181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:59.323558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:59.323822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:59.341385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:59.343499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:59.371255 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2971/5960] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:59.392457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:34:59.410755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7418fa6-0837-48d1-92d7-5dfac480c427 service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:34:59.417101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297660c-56f4-4892-a821-d293df2572a9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:34:59.418923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297660c-56f4-4892-a821-d293df2572a9 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:34:59.419695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297660c-56f4-4892-a821-d293df2572a9 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:34:59.420531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297660c-56f4-4892-a821-d293df2572a9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:34:59.443451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297660c-56f4-4892-a821-d293df2572a9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:34:59.444992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297660c-56f4-4892-a821-d293df2572a9 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:34:59.472947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2990/5961] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:34:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:34:59.999086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:00.082627 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:00.111677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f5512-c056-4148-a1b7-86cd0718d6e9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:00.118607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:00.120205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:00.120806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:00.121253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] PATH_INFO: `/v3/users/91d4bb997de643a5a51f4c0e5bf4c458` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:00.124182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d4bb997de643a5a51f4c0e5bf4c458)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:00.127058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:00.217033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d4bb997de643a5a51f4c0e5bf4c458'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:00.218056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d4bb997de643a5a51f4c0e5bf4c458'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:00.255009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d4bb997de643a5a51f4c0e5bf4c458'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:00.257096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d4bb997de643a5a51f4c0e5bf4c458'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:00.273291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d4bb997de643a5a51f4c0e5bf4c458'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:00.317919 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2972/5962] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:34:59 2022] DELETE /identity/v3/users/91d4bb997de643a5a51f4c0e5bf4c458 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:00.323183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:00.323486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:00.324027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:00.372715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:00.378407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:00.602606 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2991/5963] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:00.627652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:00.629224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:00.777472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0f84-86b5-42cf-b016-3630907e5104 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:00.784220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:00.785086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:00.785740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:00.786140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:00.816807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:00.821658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:00.881084 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2973/5964] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:01.672723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:01.674277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:01.857323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a22e40-67fa-46f3-8c56-bd1c0040d5f9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:01.865398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:01.866148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:01.866434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:01.866709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:01.868847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:01.903461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:01.905542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:01.923893 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2992/5965] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:03.717358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:03.718989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:03.746632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a96fd1-bafa-40bf-bf8e-d88898b3d2db service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:03.760865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:03.762201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:03.762691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:03.762960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] PATH_INFO: `/v3/projects/75aee419b5be43029c531581efe5204c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:03.765260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75aee419b5be43029c531581efe5204c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:03.767231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:03.851734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75aee419b5be43029c531581efe5204c', 'request_id': 'req-052a42d3-a1a9-4f64-bfdc-40786e98f032'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:03.876925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75aee419b5be43029c531581efe5204c', 'request_id': 'req-052a42d3-a1a9-4f64-bfdc-40786e98f032'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:03.888173 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:03.892515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75aee419b5be43029c531581efe5204c', 'request_id': 'req-052a42d3-a1a9-4f64-bfdc-40786e98f032'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:03.921412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] The token cache is being invalidate because project 75aee419b5be43029c531581efe5204c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:03.922868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:03.923773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:03.928893 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2974/5966] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:03 2022] DELETE /identity/v3/projects/75aee419b5be43029c531581efe5204c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:03.933053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:03.952489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4891d1d2-dffa-4168-b7b1-b646af8cc038 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:04.024079 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:04.074454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:04.075727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:04.076278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:04.076764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] PATH_INFO: `/v3/users/82f0da0e67e04b87a7adaed572f39e9b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:04.078228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82f0da0e67e04b87a7adaed572f39e9b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:04.080871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:04.162238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82f0da0e67e04b87a7adaed572f39e9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:04.171603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82f0da0e67e04b87a7adaed572f39e9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:04.188335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82f0da0e67e04b87a7adaed572f39e9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:04.189561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82f0da0e67e04b87a7adaed572f39e9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:04.197819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82f0da0e67e04b87a7adaed572f39e9b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:04.206754 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2993/5967] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:03 2022] DELETE /identity/v3/users/82f0da0e67e04b87a7adaed572f39e9b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:05.291385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:05.293477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:05.459976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052a42d3-a1a9-4f64-bfdc-40786e98f032 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:05.545572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:05.546541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:05.547021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:05.547337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:05.551605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:05.572209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:05.574997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d06fd8-b264-4289-902a-6b80dbef91fd service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:05.590024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2975/5968] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:05.850940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:05.853317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:06.089742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432b3bc-7cad-44d0-baef-35d519420236 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:06.101743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:06.103876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:06.109550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:06.110381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] PATH_INFO: `/v3/projects/6de810ae185944f582eb39d01277f583` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:06.117495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de810ae185944f582eb39d01277f583)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:06.119767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:06.225832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de810ae185944f582eb39d01277f583', 'request_id': 'req-c02d7bb3-5a28-4180-a659-d1e506c3aebc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:06.247867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de810ae185944f582eb39d01277f583', 'request_id': 'req-c02d7bb3-5a28-4180-a659-d1e506c3aebc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:06.256448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de810ae185944f582eb39d01277f583', 'request_id': 'req-c02d7bb3-5a28-4180-a659-d1e506c3aebc'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:06.267167 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:06.280822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] The token cache is being invalidate because project 6de810ae185944f582eb39d01277f583 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:06.281584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:06.282619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c02d7bb3-5a28-4180-a659-d1e506c3aebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:06.287551 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2994/5969] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:05 2022] DELETE /identity/v3/projects/6de810ae185944f582eb39d01277f583 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:06.298871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:06.299450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:06.299836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:06.381080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:06.383076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:06.567037 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2976/5970] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:06.575743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:06.576033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:06.576309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:06.609847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:06.611336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:06.641237 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2995/5971] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:06.645569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:06.663051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9bc62-f5ae-42db-aa66-0bccf178c3ac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:06.671023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:06.671733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:06.672019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:06.672296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:06.673104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:06.673417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:06.675060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:06.703299 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2977/5972] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:06.708564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:06.745310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1d222b-5e99-459d-8dfa-35bd534c3956 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:06.757897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:06.758596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:06.758876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:06.759145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:06.759854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:06.768063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:06.847567 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2996/5973] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:06 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:06.851716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:06.864521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397c2d6-fe42-4548-ac38-a74f87c99df6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:06.928639 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:06.974640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:06.975556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:06.975950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:06.976374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:06.977245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:06.979467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:07.017956 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2978/5974] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:06 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:07.022702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:07.035219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcccce-28ab-4ff3-a72d-7d7d0c974d39 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:07.053077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:07.054015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.054455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.054896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.055816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:07.057703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:07.089817 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2997/5975] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:07.095439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:07.109160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccf071-1b01-4597-89b1-1695e1f1f2d2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:07.126265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d80bda4-3962-46ec-9a27-39ce6ba7ff73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:07.127280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80bda4-3962-46ec-9a27-39ce6ba7ff73 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.127603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80bda4-3962-46ec-9a27-39ce6ba7ff73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.127957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d80bda4-3962-46ec-9a27-39ce6ba7ff73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.128848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80bda4-3962-46ec-9a27-39ce6ba7ff73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:07.138438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d80bda4-3962-46ec-9a27-39ce6ba7ff73 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:07.163881 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2979/5976] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:07.168624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:07.184133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce5bdfe-986a-45d8-8aba-4587b0a96a7c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:07.193594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:07.195747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.196270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.196945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] PATH_INFO: `/v3/projects/26e8c9ad0c00487693201b6aba45b550/users/cb30676bceb34d99a127178c7d3f8291/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.234576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=26e8c9ad0c00487693201b6aba45b550, user_id=cb30676bceb34d99a127178c7d3f8291, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:07.238557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:07.275636 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2998/5977] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:07 2022] PUT /identity/v3/projects/26e8c9ad0c00487693201b6aba45b550/users/cb30676bceb34d99a127178c7d3f8291/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:07.286681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.287014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.287504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.367934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] MFA Rules not processed for user `cb30676bceb34d99a127178c7d3f8291`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:07.369312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:07.575853 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2980/5978] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:07.578670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:07.735919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790e1445-18d6-46a9-ab6f-1d55afce4bdc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:07.743610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:07.744316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.744645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.744926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.746348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:07.748992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:07.801591 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 2999/5979] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:07 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:07.805627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:07.822401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff79db-6d69-4af5-b706-8cc6054096f1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:07.921035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:07.921732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.922015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.922290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.923002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:07.926038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:07.961459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:07.964553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2981/5980] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:07 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:07.979720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30186961-2b0c-490a-a25d-7a00930fffec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:07.989455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:07.991864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:07.992301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:07.992646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:07.993654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:07.995748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.018788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.019079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3000/5981] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:08.036196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3e10cf-e78a-49dc-9c17-1fb77b6f8dcf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:08.049568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:08.050779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.051113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.051423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] PATH_INFO: `/v3/projects/ab3a196307524c799fe852f38b58ef02/users/8efa13bc4b304a84802817220adb12ce/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.075174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a196307524c799fe852f38b58ef02, user_id=8efa13bc4b304a84802817220adb12ce, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:08.078899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.131060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.132730 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2982/5982] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:08 2022] PUT /identity/v3/projects/ab3a196307524c799fe852f38b58ef02/users/8efa13bc4b304a84802817220adb12ce/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:08.145147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a3b35-0bab-47a3-9fc1-d588f5a9e242 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:08.315200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ad146-7eab-4aab-b3ce-cca5d5226b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:08.316676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ad146-7eab-4aab-b3ce-cca5d5226b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.317371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ad146-7eab-4aab-b3ce-cca5d5226b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.319311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ad146-7eab-4aab-b3ce-cca5d5226b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.324276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ad146-7eab-4aab-b3ce-cca5d5226b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:08.327040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ad146-7eab-4aab-b3ce-cca5d5226b73 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.356706 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3001/5983] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:08 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:08.357418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.381839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa67d3b9-4e8a-48a4-ac17-43bed4c4f3ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:08.388676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:08.389911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.390300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.391987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] PATH_INFO: `/v3/projects/ab3a196307524c799fe852f38b58ef02/users/8efa13bc4b304a84802817220adb12ce/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.395704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3a196307524c799fe852f38b58ef02, user_id=8efa13bc4b304a84802817220adb12ce, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:08.399641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.404630 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:08.432180 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2983/5984] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:08 2022] PUT /identity/v3/projects/ab3a196307524c799fe852f38b58ef02/users/8efa13bc4b304a84802817220adb12ce/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:08.539462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.539751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.540451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.547549 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:08.579652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] MFA Rules not processed for user `8efa13bc4b304a84802817220adb12ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:08.580922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:08.679025 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3002/5985] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:08 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:08.680291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.699697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae4e72-0d59-4163-b0d1-475de30b092a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:08.712812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8efa13bc4b304a84802817220adb12ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3a196307524c799fe852f38b58ef02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:08.713507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.713794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.714076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.715207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:08.715522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:08.717198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.749494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.754399 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2984/5986] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:08.759842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a821e-4a79-4e5c-bd72-c835aa201897 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:08.764777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8efa13bc4b304a84802817220adb12ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3a196307524c799fe852f38b58ef02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:08.765468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.765763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.766774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.767507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:08.769568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.815904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.832858 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3003/5987] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:08 2022] POST /identity/v3/projects => generated 347 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:08.838729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e7a9c-b947-4280-9694-ed0c9b6a1f63 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:08.930518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8efa13bc4b304a84802817220adb12ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3a196307524c799fe852f38b58ef02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:08.931225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:08.931513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:08.931794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:08.932601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:08.932917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:08.935203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:08.963962 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2985/5988] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:08.996185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:08.998257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:09.148576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22191c9c-49f5-4b61-8aa0-85fbe0bb7693 tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:09.168117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:09.168831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:09.169110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:09.169452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:09.199070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:09.204372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:09.232907 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3004/5989] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:08 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:16.842866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:16.862469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be7181f-a3fb-4e52-b4b3-8e312bae058c tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:16.867651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8efa13bc4b304a84802817220adb12ce', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab3a196307524c799fe852f38b58ef02', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:16.868875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:16.869323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:16.869789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] PATH_INFO: `/v3/projects/b775aa550c7046dfa1046dd99ed96cef` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:16.871275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b775aa550c7046dfa1046dd99ed96cef)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:16.873489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:16.980504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b775aa550c7046dfa1046dd99ed96cef', 'request_id': 'req-8edc8b56-2da6-40d6-9e94-835ece377c4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:16.998496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b775aa550c7046dfa1046dd99ed96cef', 'request_id': 'req-8edc8b56-2da6-40d6-9e94-835ece377c4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.010524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b775aa550c7046dfa1046dd99ed96cef', 'request_id': 'req-8edc8b56-2da6-40d6-9e94-835ece377c4f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.032751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] The token cache is being invalidate because project b775aa550c7046dfa1046dd99ed96cef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:17.033430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.034572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8edc8b56-2da6-40d6-9e94-835ece377c4f tempest-QuotasNegativeTest-1660363830 tempest-QuotasNegativeTest-1660363830-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.036736 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2986/5990] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:16 2022] DELETE /identity/v3/projects/b775aa550c7046dfa1046dd99ed96cef => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:17.042554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:17.193863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f235e-8e5b-4672-a878-f44c86447a9a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:17.227434 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:17.353089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:17.355277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:17.355845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:17.356423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] PATH_INFO: `/v3/users/cb30676bceb34d99a127178c7d3f8291` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:17.358606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb30676bceb34d99a127178c7d3f8291)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:17.361267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:17.444640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb30676bceb34d99a127178c7d3f8291'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.454000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb30676bceb34d99a127178c7d3f8291'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.470118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb30676bceb34d99a127178c7d3f8291'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.470943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb30676bceb34d99a127178c7d3f8291'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.478883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb30676bceb34d99a127178c7d3f8291'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:17.487884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3005/5991] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:17 2022] DELETE /identity/v3/users/cb30676bceb34d99a127178c7d3f8291 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:17.492961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:17.493479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:17.493914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:17.519941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:17.521397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:17.585708 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:17.601721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2987/5992] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:17.663912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:17.665823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:17.779632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f0a722-10db-40b8-b36b-d2de16b2bda7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:17.785340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d5448-0d3f-4aa9-bbec-6793d46b8aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:17.786365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d5448-0d3f-4aa9-bbec-6793d46b8aac service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:17.786608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d5448-0d3f-4aa9-bbec-6793d46b8aac service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:17.787141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d5448-0d3f-4aa9-bbec-6793d46b8aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:17.806776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d5448-0d3f-4aa9-bbec-6793d46b8aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:17.808874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d5448-0d3f-4aa9-bbec-6793d46b8aac service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:17.822232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3006/5993] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:18.853489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:18.855042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:18.870225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617d78-e67f-4744-a249-501c58f4e0b3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:18.910865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:18.912112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:18.912606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:18.913142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] PATH_INFO: `/v3/users/506286881e7849678135c204dbf04657` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:18.917111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=506286881e7849678135c204dbf04657)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:18.921446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:19.029634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '506286881e7849678135c204dbf04657'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:19.030571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '506286881e7849678135c204dbf04657'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:19.051301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '506286881e7849678135c204dbf04657'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:19.052658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '506286881e7849678135c204dbf04657'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:19.094456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '506286881e7849678135c204dbf04657'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:19.135183 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2988/5994] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:18 2022] DELETE /identity/v3/users/506286881e7849678135c204dbf04657 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:19.139795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:19.140335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:19.140752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:19.166595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:19.170343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:19.229492 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:19.264019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3007/5995] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:19.312091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:19.313897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:19.410489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84858869-5ab5-4d54-9c2d-d389b0b2a67b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:19.415873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:19.416755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:19.417094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:19.417622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:19.445104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:19.447063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:19.460619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2989/5996] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:20.246127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:20.248077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:20.295675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9175386e-a0fd-4ae2-ab4f-808c57f925d3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:20.309695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:20.319533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:20.321128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:20.321628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] PATH_INFO: `/v3/projects/26e8c9ad0c00487693201b6aba45b550` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:20.325642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26e8c9ad0c00487693201b6aba45b550)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:20.332337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:20.398939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:20.402088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:20.480966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26e8c9ad0c00487693201b6aba45b550', 'request_id': 'req-088aa462-7fc1-43da-88e4-506077f56ca7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.501529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26e8c9ad0c00487693201b6aba45b550', 'request_id': 'req-088aa462-7fc1-43da-88e4-506077f56ca7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.509465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26e8c9ad0c00487693201b6aba45b550', 'request_id': 'req-088aa462-7fc1-43da-88e4-506077f56ca7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.546542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] The token cache is being invalidate because project 26e8c9ad0c00487693201b6aba45b550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:20.546843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.551208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.556440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3008/5997] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:20 2022] DELETE /identity/v3/projects/26e8c9ad0c00487693201b6aba45b550 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:20.557461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:20.564045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:20.619026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0a4bd4-49a3-4b88-a5ae-433536486314 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:20.636700 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:20.711910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088aa462-7fc1-43da-88e4-506077f56ca7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:20.722391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:20.723611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:20.724822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:20.725718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] PATH_INFO: `/v3/projects/5366abca63504634bd32e0fa6e5a1926` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:20.727776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5366abca63504634bd32e0fa6e5a1926)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:20.732910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:20.767006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:20.768413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:20.768707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:20.768989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:20.774748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:20.795415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:20.797293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:20.813195 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2990/5998] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:35:20.827912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:20.833312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:20.863068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5366abca63504634bd32e0fa6e5a1926', 'request_id': 'req-7c257bc8-134a-4490-9916-164f90a36e70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.876650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5366abca63504634bd32e0fa6e5a1926', 'request_id': 'req-7c257bc8-134a-4490-9916-164f90a36e70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.886288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6771b092-2234-4592-8b58-6347163a1111 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:20.889433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5366abca63504634bd32e0fa6e5a1926', 'request_id': 'req-7c257bc8-134a-4490-9916-164f90a36e70'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.893001 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:20.919986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] The token cache is being invalidate because project 5366abca63504634bd32e0fa6e5a1926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:20.920751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.921468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7c257bc8-134a-4490-9916-164f90a36e70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:20.923323 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3009/5999] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:20 2022] DELETE /identity/v3/projects/5366abca63504634bd32e0fa6e5a1926 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:20.937501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae701a-5fbc-4556-9c25-db5ef28dcd75 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:20.937501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae701a-5fbc-4556-9c25-db5ef28dcd75 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:20.937501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae701a-5fbc-4556-9c25-db5ef28dcd75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:20.996134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8fae701a-5fbc-4556-9c25-db5ef28dcd75 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:20.997692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8fae701a-5fbc-4556-9c25-db5ef28dcd75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:21.033424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.034463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.034741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.035013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] PATH_INFO: `/v3/users/8efa13bc4b304a84802817220adb12ce` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.036261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8efa13bc4b304a84802817220adb12ce)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:21.038243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:21.121172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8efa13bc4b304a84802817220adb12ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:21.122194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8efa13bc4b304a84802817220adb12ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:21.141605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8efa13bc4b304a84802817220adb12ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:21.142814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8efa13bc4b304a84802817220adb12ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:21.154986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8efa13bc4b304a84802817220adb12ce'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:21.170119 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3010/6000] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:21.178780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.179149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.179374 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2991/6001] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:20 2022] DELETE /identity/v3/users/8efa13bc4b304a84802817220adb12ce => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:21.182614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.213643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:21.223030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:21.390703 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3011/6002] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:21.395206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:21.408897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcade1d7-aef4-4e71-97ba-cbaadbcc7661 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:21.418871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.419884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.420435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.420916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.435023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:21.435870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:21.437952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:21.472435 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2992/6003] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:21.472685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:21.482821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459870be-f839-4dd3-baf9-5630344b25d7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:21.498380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.499260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.499702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.500090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.501039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:21.503225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:21.555343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:21.564313 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:21.567591 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3012/6004] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:21 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:35:21.573932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a40e8d-8ed9-4f06-ae21-fb37512f9bab admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:21.755135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.756755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.756755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.757139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.758998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:21.761464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:21.788697 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2993/6005] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:21 2022] POST /identity/v3/users => generated 293 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:21.794245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:21.821665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3aa610-ebbc-4046-ab0d-219d254646f9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:21.829387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.830973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.831516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.832299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.833477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:21.835714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:21.857417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:21.872811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3013/6006] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:21.876211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0b81b6-e83b-488d-9d3c-a2c851849cba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:21.881738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26a212-755d-4d6f-9021-1d60d3b1a7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.883413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a212-755d-4d6f-9021-1d60d3b1a7be admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.883908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a212-755d-4d6f-9021-1d60d3b1a7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.885123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26a212-755d-4d6f-9021-1d60d3b1a7be admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.886117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26a212-755d-4d6f-9021-1d60d3b1a7be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:21.888223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26a212-755d-4d6f-9021-1d60d3b1a7be admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:21.917756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2994/6007] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:21.919307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:21.936618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39015b7-6152-4617-91fb-cc4b66e44563 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:21.957285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:21.959622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:21.960376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:21.960680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] PATH_INFO: `/v3/projects/9dc1958bf8a54f6496331f9b66e4035e/users/c8e4753921f94cb683c05a3f2c98b11e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:21.998904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc1958bf8a54f6496331f9b66e4035e, user_id=c8e4753921f94cb683c05a3f2c98b11e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:22.002995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:22.044528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3014/6008] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:21 2022] PUT /identity/v3/projects/9dc1958bf8a54f6496331f9b66e4035e/users/c8e4753921f94cb683c05a3f2c98b11e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:22.055137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:22.056668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:22.057175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:22.131271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] MFA Rules not processed for user `c8e4753921f94cb683c05a3f2c98b11e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:22.132714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:22.338962 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2995/6009] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:22.386275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:22.388158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:22.400462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:22.401952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:22.516142 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:22.562026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffbc80-79f9-4e3d-8c14-42a95dcfd364 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:22.566833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca63c-7b03-4777-874a-8ae2d9aa2adf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:22.567412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca63c-7b03-4777-874a-8ae2d9aa2adf service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:22.567694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca63c-7b03-4777-874a-8ae2d9aa2adf service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:22.567971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca63c-7b03-4777-874a-8ae2d9aa2adf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:22.588318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ca63c-7b03-4777-874a-8ae2d9aa2adf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:22.589878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ca63c-7b03-4777-874a-8ae2d9aa2adf service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:22.601373 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3015/6010] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:22 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:22.603989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de750f37-fbc1-4ca0-8cfa-e2f6377936ea None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:22.630609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:22.631496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:22.631940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:22.632231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] PATH_INFO: `/v3/projects/ab3a196307524c799fe852f38b58ef02` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:22.635995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3a196307524c799fe852f38b58ef02)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:22.638281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:22.668157 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:22.770810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3a196307524c799fe852f38b58ef02', 'request_id': 'req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:22.785745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3a196307524c799fe852f38b58ef02', 'request_id': 'req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:22.801537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3a196307524c799fe852f38b58ef02', 'request_id': 'req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:22.830377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] The token cache is being invalidate because project ab3a196307524c799fe852f38b58ef02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:22.830636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:22.831435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7b4c1c07-4bf2-40dd-a94f-f7b692602a37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:22.842470 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2996/6011] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:22 2022] DELETE /identity/v3/projects/ab3a196307524c799fe852f38b58ef02 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:22.847510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:22.847802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:22.848191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:22.878922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:22.881948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:22.988482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3016/6012] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:22.995403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:22.995703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:22.996027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.018986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:23.020430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:23.030070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2997/6013] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:23.034513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.072862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c43aa-7bde-45ef-bd06-010c5c97e9eb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.087392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.088744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.089040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.089317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.090080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:23.090384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.092477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.115593 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3017/6014] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:23.117529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.129051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5b9f6-2be2-41be-83f8-bb7f7b5ce31f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.134153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.134837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.135540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.135834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.136632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.138688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.178448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2998/6015] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:23 2022] POST /identity/v3/projects => generated 407 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:23.184993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.207897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbbf73b-a227-4930-85d8-c0344bf9a77b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.318481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.319333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.319744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.320251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.321103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.323515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.360371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3018/6016] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:23 2022] POST /identity/v3/users => generated 304 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:23.364473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.382366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210eb56-1cf7-4aa8-8f9e-be00c48bc5ad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.389153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.390207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.390698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.391195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.392131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.394157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.414096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 2999/6017] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:23.420896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.441748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b73ff38-4789-426f-87ab-e49654d8e2bc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.451135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ff88c2-dcd8-4d25-8f37-a9c7971fb170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.452216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff88c2-dcd8-4d25-8f37-a9c7971fb170 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.453557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff88c2-dcd8-4d25-8f37-a9c7971fb170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.454066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ff88c2-dcd8-4d25-8f37-a9c7971fb170 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.455191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff88c2-dcd8-4d25-8f37-a9c7971fb170 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.457298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ff88c2-dcd8-4d25-8f37-a9c7971fb170 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.472187 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3019/6018] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:23 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:23.477169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.498012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe814f-515c-4c09-a5e2-5c2e41440054 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.507890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.509268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.509806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.510324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] PATH_INFO: `/v3/projects/2f93cde34cfc4060aaa8de9d23304de4/users/2d25abd7a3554efaa234c2f0da158e4e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.537812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f93cde34cfc4060aaa8de9d23304de4, user_id=2d25abd7a3554efaa234c2f0da158e4e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.541171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.560008 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3000/6019] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:23 2022] PUT /identity/v3/projects/2f93cde34cfc4060aaa8de9d23304de4/users/2d25abd7a3554efaa234c2f0da158e4e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:23.570536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.571567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.572059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.608628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] MFA Rules not processed for user `2d25abd7a3554efaa234c2f0da158e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:23.610211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:23.667657 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:23.732126 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3020/6020] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:23 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:23.734120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.841283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c4cb0-8fe7-4225-b39f-1107ac61d097 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:23.847862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:23.848932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:23.849421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:23.849872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:23.850672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:23.853415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:23.899707 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3001/6021] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:23 2022] POST /identity/v3/projects => generated 407 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:35:23.903834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:23.917071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6677724-0c6c-4a30-94ed-010766905257 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:24.022517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:24.023318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.023666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.024040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.024885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:24.027028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:24.067860 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3021/6022] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:23 2022] POST /identity/v3/users => generated 310 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:24.069722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:24.083859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00821c-1f48-409a-b503-bbc431b4a869 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:24.100857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:24.101636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.102020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.102397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.106041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:24.107313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:24.138196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3002/6023] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:24.140741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:24.163139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863777df-173c-47e5-9560-c17820633a37 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:24.168728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:24.169755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.170016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.170295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] PATH_INFO: `/v3/projects/32094b9402e64e0eb923eaa445b698be/users/1fa3b3dcecdd4ff6892de3c61584162d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.206432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32094b9402e64e0eb923eaa445b698be, user_id=1fa3b3dcecdd4ff6892de3c61584162d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:24.210299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:24.238560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3022/6024] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:24 2022] PUT /identity/v3/projects/32094b9402e64e0eb923eaa445b698be/users/1fa3b3dcecdd4ff6892de3c61584162d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:24.239030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:24.251599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688511d6-42a8-4527-88e6-736d940f0d5f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:24.262742 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:24.334388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1431ffcb-c06d-4614-aeeb-141c4e15446b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:24.335621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431ffcb-c06d-4614-aeeb-141c4e15446b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.336099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431ffcb-c06d-4614-aeeb-141c4e15446b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.336566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1431ffcb-c06d-4614-aeeb-141c4e15446b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.338052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431ffcb-c06d-4614-aeeb-141c4e15446b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:24.340323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1431ffcb-c06d-4614-aeeb-141c4e15446b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:24.354263 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3003/6025] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:24.359713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:24.380442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98badfc1-18ac-4517-bb58-f0dc00cb7e69 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:24.406281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:24.407520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.407896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.408417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] PATH_INFO: `/v3/projects/32094b9402e64e0eb923eaa445b698be/users/1fa3b3dcecdd4ff6892de3c61584162d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.411016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32094b9402e64e0eb923eaa445b698be, user_id=1fa3b3dcecdd4ff6892de3c61584162d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:24.415734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:24.444080 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3023/6026] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:24 2022] PUT /identity/v3/projects/32094b9402e64e0eb923eaa445b698be/users/1fa3b3dcecdd4ff6892de3c61584162d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:24.456437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.456734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.457755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.512332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] MFA Rules not processed for user `1fa3b3dcecdd4ff6892de3c61584162d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:24.513988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:24.682934 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3004/6027] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:24 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:24.708164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:24.710953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:24.850152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0875d41f-aeee-4a03-8522-fd9e00242192 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:24.875363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:24.876100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:24.877132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:24.878347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:24.950950 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:24.984887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:24.987497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:25.002707 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3024/6028] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:24 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:26.441031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:26.453166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:26.689591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250e77f-0046-4dab-a6bf-fa9c2a6bbe94 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:26.712273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:26.713018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:26.713304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:26.713579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:26.757352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:26.759191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:26.797749 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3005/6029] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:26 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:27.193757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:27.196284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:27.221799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e465ff5-2a0c-4f20-a431-6bd3142c11ba service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:27.230345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:27.231566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:27.232087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:27.232741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:27.236083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:27.284468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:27.286664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:27.345951 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3025/6030] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:35:36.782353 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:36.872584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:36.874084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:37.080103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8b7f87-546e-4238-b8a8-856f0d32fbf9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:37.097222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:37.099826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:37.100516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:37.101329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:37.104396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:37.193758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:37.195596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88abee7-e153-4495-8551-779025e1161b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:37.209533 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3006/6031] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:37.330199 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=15 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:41.522744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:41.525141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:41.654586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a547c8f-ca84-4810-8e42-9cff23a6f100 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:41.660093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:41.661157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:41.661538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:41.661913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] PATH_INFO: `/v3/users/68e6a1608c494606a014fff6189f771f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:41.663371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] RBAC: Authorizing `identity:delete_user(user_id=68e6a1608c494606a014fff6189f771f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:41.665833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:41.770729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68e6a1608c494606a014fff6189f771f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:41.792694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68e6a1608c494606a014fff6189f771f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:41.813012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68e6a1608c494606a014fff6189f771f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:41.814866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68e6a1608c494606a014fff6189f771f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:41.828141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68e6a1608c494606a014fff6189f771f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:41.874342 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3026/6032] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:41 2022] DELETE /identity/v3/users/68e6a1608c494606a014fff6189f771f => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:41.882295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:41.882824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:41.882824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:41.909610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:41.910947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:42.083420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:42.085572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3007/6033] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:42.085855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:42.109715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0839847-389c-4391-bc1d-d82085de062f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:42.120902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:42.121885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:42.122740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:42.123030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] PATH_INFO: `/v3/users/c52883c1ab6a4dc2aa920785c1772c6d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:42.125000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c52883c1ab6a4dc2aa920785c1772c6d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:42.127469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:42.173046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:42.174853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:42.242520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c52883c1ab6a4dc2aa920785c1772c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:42.256426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c52883c1ab6a4dc2aa920785c1772c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:42.280565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c52883c1ab6a4dc2aa920785c1772c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:42.283070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c52883c1ab6a4dc2aa920785c1772c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:42.287313 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:42.291976 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:42.302170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c52883c1ab6a4dc2aa920785c1772c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:42.310220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85290bc5-5834-4892-85aa-342ae1a80a6a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:42.320086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3027/6034] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:42 2022] DELETE /identity/v3/users/c52883c1ab6a4dc2aa920785c1772c6d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:42.324269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:42.325682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:42.326151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:42.327191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:42.330124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:42.349747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:42.351851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:42.367984 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3008/6035] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:43.167744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:43.169855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:43.374004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f63c3-27b9-4e63-b19c-2c1af0fa59a5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:43.386951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:43.389510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:43.389797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:43.391998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] PATH_INFO: `/v3/users/c8e4753921f94cb683c05a3f2c98b11e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:43.395297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8e4753921f94cb683c05a3f2c98b11e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:43.396957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:43.516601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8e4753921f94cb683c05a3f2c98b11e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.528679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:43.531371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:43.542579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8e4753921f94cb683c05a3f2c98b11e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.547537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f42fa6-4849-4fd7-bada-c353f2d2992c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:43.553546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:43.555494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:43.555494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:43.556403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] PATH_INFO: `/v3/projects/7c1c6406e3274ac98aa34d7744afdacc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:43.558054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1c6406e3274ac98aa34d7744afdacc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:43.560397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:43.566679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8e4753921f94cb683c05a3f2c98b11e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.567782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8e4753921f94cb683c05a3f2c98b11e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.579761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5a384fb7-f779-4227-8a72-36938f0ba940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8e4753921f94cb683c05a3f2c98b11e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.595200 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3028/6036] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:43 2022] DELETE /identity/v3/users/c8e4753921f94cb683c05a3f2c98b11e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:43.598816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c49d7-112f-43bd-bcb6-5c522b49a8d9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:43.599409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c49d7-112f-43bd-bcb6-5c522b49a8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:43.600470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c49d7-112f-43bd-bcb6-5c522b49a8d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:43.640832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-699c49d7-112f-43bd-bcb6-5c522b49a8d9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:43.648604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-699c49d7-112f-43bd-bcb6-5c522b49a8d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:43.653832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1c6406e3274ac98aa34d7744afdacc', 'request_id': 'req-63ef0553-5fae-4612-8de6-f790c09f05cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.675167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1c6406e3274ac98aa34d7744afdacc', 'request_id': 'req-63ef0553-5fae-4612-8de6-f790c09f05cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.683501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1c6406e3274ac98aa34d7744afdacc', 'request_id': 'req-63ef0553-5fae-4612-8de6-f790c09f05cb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.707345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] The token cache is being invalidate because project 7c1c6406e3274ac98aa34d7744afdacc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:43.707825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.708619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63ef0553-5fae-4612-8de6-f790c09f05cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:43.714576 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3009/6037] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:43 2022] DELETE /identity/v3/projects/7c1c6406e3274ac98aa34d7744afdacc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:43.717470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:43.717888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:43.718443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:43.768641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:43.770603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:43.784192 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3029/6038] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:43.865352 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3010/6039] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:43.869089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:43.869620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:43.870114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:43.893745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:43.895340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:43.903034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:43.904619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:43.913827 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3030/6040] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:43.915716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:43.925463 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:43.935464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6f1e6-be92-4c7f-81c3-12a1c8457369 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:43.947159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:43.948214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:43.949049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:43.950870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:43.951888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:43.952510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:43.954938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:43.976572 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3031/6041] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:43.985049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.004166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287d60-9ff8-4192-9660-360df2426e4d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.018079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.018780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.019766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.019766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.020156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.022092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.031981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9e90d-836a-422c-b823-ec08e8b2756f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.041989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.042675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.042959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.043249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.069846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.072633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.097053 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3011/6042] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:35:44.124906 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3032/6043] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:43 2022] POST /identity/v3/projects => generated 371 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:44.129136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.144259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57513373-475e-4bcc-a936-85791bb1e01a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.180493 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:44.337951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.338654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.338928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.339202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.341616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.342475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.343370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:44.352383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.381234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb611a-e6b4-4c9a-b758-7d994d9a839b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.399458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.400284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.400612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.400862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] PATH_INFO: `/v3/projects/0a27a46b8d8844238a952b83b7af3ed3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.410249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a27a46b8d8844238a952b83b7af3ed3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.412293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.422545 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3012/6044] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:44 2022] POST /identity/v3/users => generated 286 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:44.427647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.452648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c3e11-e174-4bf3-b211-92cbb14321aa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.464072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.467855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.467855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.468161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.468964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.475447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.500670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3013/6045] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:44.511340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.523013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a27a46b8d8844238a952b83b7af3ed3', 'request_id': 'req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:44.537900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a27a46b8d8844238a952b83b7af3ed3', 'request_id': 'req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:44.540572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131af21b-eb67-4254-8d74-f93cacdf714b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.556865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a27a46b8d8844238a952b83b7af3ed3', 'request_id': 'req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:44.587697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] The token cache is being invalidate because project 0a27a46b8d8844238a952b83b7af3ed3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:44.588177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:44.590618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fb5cc27f-f6cf-4f68-89bf-870ec65c55dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:44.595096 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3033/6046] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:44 2022] DELETE /identity/v3/projects/0a27a46b8d8844238a952b83b7af3ed3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:44.602251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067b0da-6c1b-4817-a80d-fe3e1b6285c7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.602251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067b0da-6c1b-4817-a80d-fe3e1b6285c7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.602251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0067b0da-6c1b-4817-a80d-fe3e1b6285c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.627385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.628077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.628375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.633752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.634563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.636245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.650245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0067b0da-6c1b-4817-a80d-fe3e1b6285c7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:44.651483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0067b0da-6c1b-4817-a80d-fe3e1b6285c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:44.660746 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3014/6047] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:44.661985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.667077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:44.674369 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3034/6048] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:44.690694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12388694-9763-48a9-9566-f043ea385d13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:44.726046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8412-3c1c-49a9-8e6f-616642169cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:44.727332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8412-3c1c-49a9-8e6f-616642169cd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.727841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8412-3c1c-49a9-8e6f-616642169cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.728296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8412-3c1c-49a9-8e6f-616642169cd1 admin admin] PATH_INFO: `/v3/projects/9e4bac0846374c789e3eb1711191f496/users/10541155857b49f98bca2dfdea19c645/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.767035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8412-3c1c-49a9-8e6f-616642169cd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4bac0846374c789e3eb1711191f496, user_id=10541155857b49f98bca2dfdea19c645, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:44.769851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8412-3c1c-49a9-8e6f-616642169cd1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:44.794332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.794889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.795371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.796673 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3015/6049] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:44 2022] PUT /identity/v3/projects/9e4bac0846374c789e3eb1711191f496/users/10541155857b49f98bca2dfdea19c645/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:44.807315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e533f6-c7c2-4a7f-bdbc-ff077cbe4cf1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.807569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e533f6-c7c2-4a7f-bdbc-ff077cbe4cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.807856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e533f6-c7c2-4a7f-bdbc-ff077cbe4cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.835546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:44.836798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c5e533f6-c7c2-4a7f-bdbc-ff077cbe4cf1 None None] MFA Rules not processed for user `10541155857b49f98bca2dfdea19c645`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:44.836997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:44.838328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5e533f6-c7c2-4a7f-bdbc-ff077cbe4cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:44.920220 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:44.950090 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3016/6050] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:44.953108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:44.953410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:44.953858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:44.973818 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3035/6051] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:44.978757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:44.978917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] MFA Rules not processed for user `10541155857b49f98bca2dfdea19c645`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:44.980629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:44.992394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3017/6052] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:44.996596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8cb59b-b0ef-4256-95f0-aa28edf558cc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.006198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.008131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:45.009758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.010463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.010783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.011002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.011756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:45.012228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.013915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.056871 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3036/6053] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:35:45.058552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.088027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345bc1a1-ba38-48a2-94cd-76245c258aa3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.095041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.095860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.096210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.096626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.097470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.100015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.136911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3037/6054] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:45 2022] POST /identity/v3/projects => generated 359 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:45.141792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.160670 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:45.203717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c23d85-bf02-4306-912a-5f2beb346637 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.279711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d42d3-a0ad-4753-95f2-f97940009853 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.290020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.291969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.292448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.292832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.293682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.295765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.339671 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3038/6055] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:45 2022] POST /identity/v3/users => generated 280 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:45.346361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.361025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.364384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.364384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.364384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.380959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab684df-b6e4-4fc5-836f-3615e231a186 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.395452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.399122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.401082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.401828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.404695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.408571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.444545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3039/6056] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:45.444545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.448149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:45.475340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e753d43-9eb6-4072-b71b-29de134b4d81 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.487093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.489665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.490142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.490527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] PATH_INFO: `/v3/projects/9dc1958bf8a54f6496331f9b66e4035e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.493585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc1958bf8a54f6496331f9b66e4035e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.498393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.532922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.536219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.567966 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3018/6057] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:35:45.571173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.595386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768ea90-fbbc-4495-92d8-44758f285d69 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.613115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc1958bf8a54f6496331f9b66e4035e', 'request_id': 'req-e7ce09de-d3a3-43ca-a627-869126cf17b1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:45.630520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc1958bf8a54f6496331f9b66e4035e', 'request_id': 'req-e7ce09de-d3a3-43ca-a627-869126cf17b1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:45.642710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc1958bf8a54f6496331f9b66e4035e', 'request_id': 'req-e7ce09de-d3a3-43ca-a627-869126cf17b1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:45.647780 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:45.690532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] The token cache is being invalidate because project 9dc1958bf8a54f6496331f9b66e4035e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:45.691105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:45.692406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e7ce09de-d3a3-43ca-a627-869126cf17b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:45.699283 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3040/6058] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:45 2022] DELETE /identity/v3/projects/9dc1958bf8a54f6496331f9b66e4035e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:45.700243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9dea4-8ddd-49d1-936b-c9499cf5bb20 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.700560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9dea4-8ddd-49d1-936b-c9499cf5bb20 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.700839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9dea4-8ddd-49d1-936b-c9499cf5bb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.721798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1da9dea4-8ddd-49d1-936b-c9499cf5bb20 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:45.723790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1da9dea4-8ddd-49d1-936b-c9499cf5bb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:45.777463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.778359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.778754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.779159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.783780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.783780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.804528 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3019/6059] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:45.805713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:45.808827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:45.830525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bace1a5-f01a-4625-86f0-324a69fbe7ea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:45.843308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d61aa-1644-4bcf-ab57-39c57bf25800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:45.845907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d61aa-1644-4bcf-ab57-39c57bf25800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.846675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d61aa-1644-4bcf-ab57-39c57bf25800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.846965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d61aa-1644-4bcf-ab57-39c57bf25800 admin admin] PATH_INFO: `/v3/projects/06e73b9148b44b6c8daaf1dc05e94e93/users/f8dcd6ce01494406b0f47bde9f55e1a2/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.872736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d61aa-1644-4bcf-ab57-39c57bf25800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06e73b9148b44b6c8daaf1dc05e94e93, user_id=f8dcd6ce01494406b0f47bde9f55e1a2, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:45.875675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d61aa-1644-4bcf-ab57-39c57bf25800 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:45.879654 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3041/6060] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:45.891905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.892292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.892612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.911216 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3020/6061] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:45 2022] PUT /identity/v3/projects/06e73b9148b44b6c8daaf1dc05e94e93/users/f8dcd6ce01494406b0f47bde9f55e1a2/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:45.914725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:45.915191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:45.915414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:45.941633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:45.943596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:45.959946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] MFA Rules not processed for user `f8dcd6ce01494406b0f47bde9f55e1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:45.962474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:45.970504 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:46.108258 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3021/6062] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:45 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:46.108930 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3042/6063] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:46.113708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.127322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c438567-b8fe-499d-b54c-ddc2b3969ee4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.134210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.134899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.135260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.136121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.137526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:46.137526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.138847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.140580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:46.140770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.174284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3022/6064] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:46.178874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.200082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc9107c-da8b-4758-ab54-c139a995a0b1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.211314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.212088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.217616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.218224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.219070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.222106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.252183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a090a2f-0d75-49cd-b511-1049515426a5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.259115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.260129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.260638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.261092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.265511 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3023/6065] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:46 2022] POST /identity/v3/projects => generated 375 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:35:46.268016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.279233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.281368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.298004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3043/6066] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:46 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:46.353773 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:46.369881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d26e8-bb84-45e7-b351-2d3b9aacb282 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.377011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.377719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.378000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.378276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.378979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.381605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.409200 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3024/6067] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:46 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:46.413198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.430237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7130a-858e-4962-ae91-1ea477e6f881 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.442009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.443239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.443838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.444459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.445563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.447810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.469238 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3044/6068] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:46.470993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.506110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd07c1-3e74-419f-82d4-b4945e6e2242 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.520600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d367ee-e292-45df-8fc1-66d38b1b0479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.521485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d367ee-e292-45df-8fc1-66d38b1b0479 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.522766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d367ee-e292-45df-8fc1-66d38b1b0479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.524060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d367ee-e292-45df-8fc1-66d38b1b0479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.525168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d367ee-e292-45df-8fc1-66d38b1b0479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.537256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d367ee-e292-45df-8fc1-66d38b1b0479 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.570827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:46.587489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc151f4-49a0-42ac-9f38-68c359e0e976 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:46.588660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3025/6069] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:46.603318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:46.609050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.609373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.609654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] PATH_INFO: `/v3/projects/228921167e6746558ba63a10b8441135/users/0bfccb4289a241d587f6204c06669a34/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.657957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] RBAC: Authorizing `identity:create_grant(project_id=228921167e6746558ba63a10b8441135, user_id=0bfccb4289a241d587f6204c06669a34, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:46.669217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:46.714364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:46.714790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:46.715541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:46.717091 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3045/6070] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:46 2022] PUT /identity/v3/projects/228921167e6746558ba63a10b8441135/users/0bfccb4289a241d587f6204c06669a34/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:46.776660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] MFA Rules not processed for user `0bfccb4289a241d587f6204c06669a34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:46.777341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:47.033802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3026/6071] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:47.066468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:47.254935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefcdbf-3261-40aa-8219-0d4f0c7d776f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:47.260891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791c947-3e08-462b-b7e3-1789aefdbfce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:47.263795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c947-3e08-462b-b7e3-1789aefdbfce service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:47.264441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c947-3e08-462b-b7e3-1789aefdbfce service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:47.265036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791c947-3e08-462b-b7e3-1789aefdbfce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:47.298035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c947-3e08-462b-b7e3-1789aefdbfce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:47.300323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791c947-3e08-462b-b7e3-1789aefdbfce service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:47.326918 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3046/6072] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:49.370838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:49.506367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafb530a-1c3e-435a-b495-43a3686a8a39 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:49.527809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:49.530939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:49.531404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:49.531837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] PATH_INFO: `/v3/users/0bfccb4289a241d587f6204c06669a34` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:49.533713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bfccb4289a241d587f6204c06669a34)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:49.537015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:49.655670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bfccb4289a241d587f6204c06669a34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.656377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bfccb4289a241d587f6204c06669a34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.669643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bfccb4289a241d587f6204c06669a34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.671211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bfccb4289a241d587f6204c06669a34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.692867 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:49.692867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bfccb4289a241d587f6204c06669a34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:49.741907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:49.742578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3027/6073] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:49 2022] DELETE /identity/v3/users/0bfccb4289a241d587f6204c06669a34 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:49.743169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:49.743508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:49.771894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:49.773496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:49.812593 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:49.921548 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3047/6074] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:49.964010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:49.965800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:50.067876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82dc983-e389-487c-a6de-fef6a1e30f1a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:50.074632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9610e4a-7f1a-4a25-abf6-50f54ee9c9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:50.075581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610e4a-7f1a-4a25-abf6-50f54ee9c9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:50.075998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610e4a-7f1a-4a25-abf6-50f54ee9c9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:50.076507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9610e4a-7f1a-4a25-abf6-50f54ee9c9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:50.091100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610e4a-7f1a-4a25-abf6-50f54ee9c9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:50.093034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9610e4a-7f1a-4a25-abf6-50f54ee9c9e7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:50.111267 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3028/6075] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:52.846202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:52.847794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:52.875735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0754d1-86f7-4dae-a83c-9650362e3572 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:52.890552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:52.891633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:52.891921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:52.893752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] PATH_INFO: `/v3/projects/228921167e6746558ba63a10b8441135` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:52.899696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] RBAC: Authorizing `identity:delete_project(project_id=228921167e6746558ba63a10b8441135)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:52.902079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:53.075125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '228921167e6746558ba63a10b8441135', 'request_id': 'req-64a8b5f7-35c0-44ce-891e-c46a9472518e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:53.086283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '228921167e6746558ba63a10b8441135', 'request_id': 'req-64a8b5f7-35c0-44ce-891e-c46a9472518e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:53.096293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '228921167e6746558ba63a10b8441135', 'request_id': 'req-64a8b5f7-35c0-44ce-891e-c46a9472518e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:53.121519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] The token cache is being invalidate because project 228921167e6746558ba63a10b8441135 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:53.121896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:53.122587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-64a8b5f7-35c0-44ce-891e-c46a9472518e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:53.124967 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3048/6076] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:52 2022] DELETE /identity/v3/projects/228921167e6746558ba63a10b8441135 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:53.130227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:53.130968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:53.130968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:53.198810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:53.217476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:53.393022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3029/6077] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:53.401296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:53.401665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:53.401862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:53.445106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:53.446423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:53.456708 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3049/6078] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:53.461360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:53.494695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0522a-9be6-479f-afbf-b72896a0e352 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:53.507470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:53.508573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:53.509072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:53.512000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:53.513133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:53.514332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:53.517184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:53.544112 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3030/6079] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:53.550407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:53.562639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e153c-6f99-4815-a6d9-d06eb3bebd1f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:53.568986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:53.569817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:53.570201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:53.570572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:53.571831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:53.574525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:53.610731 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3050/6080] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:53 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:53.616234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:53.641358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9052e1-021f-4ba8-9df7-30622e727794 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:53.821457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:53.822809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:53.823178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:53.823525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:53.828993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:53.845225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:53.894182 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:53.915563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:53.929791 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3031/6081] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:53 2022] POST /identity/v3/users => generated 287 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:53.939324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:53.943199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:53.945041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a67e1b-c310-4c7d-8ff4-4e7b9ccfe5de admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:53.966138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:53.980171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:53.980848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:53.981988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:53.984813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:53.991614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:54.073802 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3051/6082] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:53 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:54.078242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:54.117349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31d9ea7-6197-4733-a830-606439746af4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:54.145310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:54.146027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:54.146317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:54.152690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:54.157105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:54.166387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:54.208668 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3052/6083] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:54.209667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:54.234302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b658c958-feff-407e-a767-821ba42ea3cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:54.238062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62412c-7c31-4a4b-a0e0-e52df6ece2c6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:54.244169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:54.246383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:54.246690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:54.246976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:54.253652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7199294c-9ac9-4eca-a88e-349bf9b16049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:54.254873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199294c-9ac9-4eca-a88e-349bf9b16049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:54.255183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199294c-9ac9-4eca-a88e-349bf9b16049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:54.255420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7199294c-9ac9-4eca-a88e-349bf9b16049 admin admin] PATH_INFO: `/v3/projects/d62611cfa6dd409192d32a31599e3f4c/users/4538a3d4ccf44e168b498c1319321fc9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:54.256970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:54.300325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:54.303130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:54.321588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199294c-9ac9-4eca-a88e-349bf9b16049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d62611cfa6dd409192d32a31599e3f4c, user_id=4538a3d4ccf44e168b498c1319321fc9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:54.328116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7199294c-9ac9-4eca-a88e-349bf9b16049 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:54.373532 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3053/6084] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:54 2022] PUT /identity/v3/projects/d62611cfa6dd409192d32a31599e3f4c/users/4538a3d4ccf44e168b498c1319321fc9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:54.384767 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3032/6085] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:54.385256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:54.385667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:54.386049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:54.493387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] MFA Rules not processed for user `4538a3d4ccf44e168b498c1319321fc9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:54.501454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:54.609129 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:54.783704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:54.802328 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3054/6086] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:54.827490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abcc9f8-231e-4d80-946d-63590f10ecf3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:54.970453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:54.977757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:54.978605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:54.978995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:54.980022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:54.982646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:55.048490 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3033/6087] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:54 2022] POST /identity/v3/projects => generated 373 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:55.057097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:55.090022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edbaf69-4029-47bd-a5f0-1e4cbbaaaf67 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:55.254387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:55.254795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:55.255232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:55.255573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:55.256425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:55.258596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:55.303478 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3055/6088] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:55 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:55.304519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:55.319435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f769a0-619b-48ad-9dab-e7b915a87f14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:55.338861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:55.339588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:55.339873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:55.340147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:55.340972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:55.342898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:55.375836 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3034/6089] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:35:55.377362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:55.404957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802a621-943d-4c7b-80fe-fee39f8b3768 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:55.420609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:55.421562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:55.421886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:55.422170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] PATH_INFO: `/v3/projects/45e7fca8a6a54433a5e37ff4c591db80/users/46f2a0175fe74c308452739fa335f87c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:55.448691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e7fca8a6a54433a5e37ff4c591db80, user_id=46f2a0175fe74c308452739fa335f87c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:55.453080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:55.482329 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3056/6090] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:55 2022] PUT /identity/v3/projects/45e7fca8a6a54433a5e37ff4c591db80/users/46f2a0175fe74c308452739fa335f87c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:55.489853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:55.533758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9ce0b-93d2-4621-b203-61cb0da81284 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:55.759940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd695d7-5f95-4652-8152-236ee482835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:55.782561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd695d7-5f95-4652-8152-236ee482835b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:55.783064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd695d7-5f95-4652-8152-236ee482835b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:55.784119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd695d7-5f95-4652-8152-236ee482835b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:55.786890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd695d7-5f95-4652-8152-236ee482835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:55.789557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd695d7-5f95-4652-8152-236ee482835b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:55.850143 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3035/6091] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:35:55 2022] GET /identity/v3/roles => generated 1420 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:35:55.850847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:55.866023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922ab2c8-6306-4e15-a121-b7c686160d21 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:55.879859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:55.882417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:55.882969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:55.883485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] PATH_INFO: `/v3/projects/45e7fca8a6a54433a5e37ff4c591db80/users/46f2a0175fe74c308452739fa335f87c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:55.887276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e7fca8a6a54433a5e37ff4c591db80, user_id=46f2a0175fe74c308452739fa335f87c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:55.893947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:55.955119 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3057/6092] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:35:55 2022] PUT /identity/v3/projects/45e7fca8a6a54433a5e37ff4c591db80/users/46f2a0175fe74c308452739fa335f87c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:35:55.981311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:55.981897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:55.983704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:56.018444 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:56.093255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] MFA Rules not processed for user `46f2a0175fe74c308452739fa335f87c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:56.096331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:56.302032 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3036/6093] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:55 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:56.314579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:56.316813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:56.458148 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:56.473778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e6816a-97a2-45ce-9acf-8301108e4373 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:56.527238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:56.529159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:56.529490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:56.532883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:56.549785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:56.555640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:56.570021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3058/6094] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:56 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:56.771734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:56.798402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d5b657-d5cd-4695-b6d0-b4cc8b8c8a2e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:56.802751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:56.803448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:56.803735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:56.804013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:56.903742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:56.905375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:56.917691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3037/6095] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:56 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:57.574184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:57.575960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:57.730726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176892b5-c029-4b28-b44f-a8bdc881b8c2 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:57.740174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:57.741217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:57.741504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:57.741782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] PATH_INFO: `/v3/users/52946cb328cf48d0b99fea717b576e6b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:57.744317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] RBAC: Authorizing `identity:delete_user(user_id=52946cb328cf48d0b99fea717b576e6b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:57.750672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:57.870105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52946cb328cf48d0b99fea717b576e6b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:57.888817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52946cb328cf48d0b99fea717b576e6b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:57.923707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52946cb328cf48d0b99fea717b576e6b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:57.925361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52946cb328cf48d0b99fea717b576e6b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:57.938271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:57.940943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:57.957837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c50b6a05-7fb2-4332-8795-263ac280246f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52946cb328cf48d0b99fea717b576e6b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:57.975183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43388f-dcca-4962-aafe-6e631d299770 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:57.980563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3059/6096] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:57 2022] DELETE /identity/v3/users/52946cb328cf48d0b99fea717b576e6b => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:58.087673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:58.088829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:58.089112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:58.089383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] PATH_INFO: `/v3/users/2d25abd7a3554efaa234c2f0da158e4e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:58.091566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d25abd7a3554efaa234c2f0da158e4e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:58.094536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:58.145818 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:58.171178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d25abd7a3554efaa234c2f0da158e4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:58.172271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d25abd7a3554efaa234c2f0da158e4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:58.191114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d25abd7a3554efaa234c2f0da158e4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:58.192180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d25abd7a3554efaa234c2f0da158e4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:58.223563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d25abd7a3554efaa234c2f0da158e4e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:58.278069 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3038/6097] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:35:57 2022] DELETE /identity/v3/users/2d25abd7a3554efaa234c2f0da158e4e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:58.282396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:58.282715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:58.282976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:58.311355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:58.313422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:58.465457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3060/6098] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:58.494026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:58.496181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:58.653881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d7212-3540-4748-aaa4-6e78e7542140 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:58.669071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70e6a6-a99b-40da-a20c-0980229a9c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:58.669858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70e6a6-a99b-40da-a20c-0980229a9c33 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:58.670151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70e6a6-a99b-40da-a20c-0980229a9c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:58.670949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70e6a6-a99b-40da-a20c-0980229a9c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:58.702451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70e6a6-a99b-40da-a20c-0980229a9c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:58.705372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70e6a6-a99b-40da-a20c-0980229a9c33 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:58.733821 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3039/6099] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:35:58.826800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:58.829105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:58.870479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ff00cc-038a-4157-988c-08330e3c6c25 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:58.877654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:58.878779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:58.879107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:58.879376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] PATH_INFO: `/v3/projects/07a20b8845c6479c867639e74a6941f0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:58.881025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a20b8845c6479c867639e74a6941f0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:58.883638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:58.887280 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:35:59.060861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a20b8845c6479c867639e74a6941f0', 'request_id': 'req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:59.087543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a20b8845c6479c867639e74a6941f0', 'request_id': 'req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:59.111370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a20b8845c6479c867639e74a6941f0', 'request_id': 'req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:59.141833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] The token cache is being invalidate because project 07a20b8845c6479c867639e74a6941f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:35:59.142228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:59.144126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8b8b8b2-9dad-41b9-ba68-782a5a9eac59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:35:59.157645 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3061/6100] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:35:58 2022] DELETE /identity/v3/projects/07a20b8845c6479c867639e74a6941f0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:35:59.162126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:59.162126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:59.162126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:59.225866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:59.227175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:59.400534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3040/6101] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:35:59.408697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:59.409575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:59.410326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:59.563379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:35:59.565329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:35:59.652299 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3062/6102] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:35:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:35:59.659548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:59.680219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37564c-d59b-477e-b09f-678437dbef87 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:59.691025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:59.692426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:59.693045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:59.694310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:59.695429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:35:59.695983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:59.700070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:59.745873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:59.746381 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3041/6103] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:35:59.771411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3932c-a2cb-40f2-8518-cc89bd71680a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:59.789184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:35:59.791060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:35:59.791953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:35:59.793025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:35:59.796332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:35:59.801324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:35:59.872020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3063/6104] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:35:59 2022] POST /identity/v3/projects => generated 385 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:35:59.877549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:35:59.898538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2de17-23cb-4232-962f-ef87510dd191 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:35:59.995220 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:00.055447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:00.056359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.056647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.056921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.057794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:00.060605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:00.107581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3042/6105] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:35:59 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:00.108815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:00.163782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502b4ca-f31e-4881-be09-989c24667c87 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:00.183020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:00.184084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.184693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.185231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.186275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:00.188646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:00.222014 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3064/6106] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:00.223349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:00.294488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062fcf3-27ba-45e0-a68c-06266a524a47 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:00.301063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0178c6-82c7-4250-b21f-44e9bb00c719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:00.302063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0178c6-82c7-4250-b21f-44e9bb00c719 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.302537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0178c6-82c7-4250-b21f-44e9bb00c719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.303312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0178c6-82c7-4250-b21f-44e9bb00c719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.304253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0178c6-82c7-4250-b21f-44e9bb00c719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:00.306301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0178c6-82c7-4250-b21f-44e9bb00c719 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:00.328715 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3043/6107] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:00 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:00.333068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:00.348741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904cdb20-fed5-40c0-bd73-4e3eb6077c21 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:00.356898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:00.358092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.358460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.358766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] PATH_INFO: `/v3/projects/ca1a48e9e0a94ec7a50712df1f8ede83/users/b7e089707fae4bf3955cdf2ee20a5f31/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.379611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca1a48e9e0a94ec7a50712df1f8ede83, user_id=b7e089707fae4bf3955cdf2ee20a5f31, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:00.383997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:00.440571 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3065/6108] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:00 2022] PUT /identity/v3/projects/ca1a48e9e0a94ec7a50712df1f8ede83/users/b7e089707fae4bf3955cdf2ee20a5f31/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:00.446138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.446683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.447314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.487178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:00.505839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:00.575081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:00.578475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:00.690518 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3044/6109] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:00.693642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f12915-5c29-439a-8e9e-c92aef459111 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:00.701805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:00.703268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:00.703676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:00.704121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] PATH_INFO: `/v3/projects/2f93cde34cfc4060aaa8de9d23304de4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:00.720740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f93cde34cfc4060aaa8de9d23304de4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:00.724215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:00.741791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:00.743307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:00.758265 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:00.867407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f93cde34cfc4060aaa8de9d23304de4', 'request_id': 'req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:00.890968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f93cde34cfc4060aaa8de9d23304de4', 'request_id': 'req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:00.907822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f93cde34cfc4060aaa8de9d23304de4', 'request_id': 'req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:00.917729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c8351d-d2e9-47de-9119-cbf5523cdbcb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:00.939012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] The token cache is being invalidate because project 2f93cde34cfc4060aaa8de9d23304de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:00.939594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:00.941048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:00.950698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3066/6110] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:00 2022] DELETE /identity/v3/projects/2f93cde34cfc4060aaa8de9d23304de4 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:00.952925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:00.955437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:01.007841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:01.008488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:01.008886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:01.009358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:01.011708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:01.020763 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:01.161688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc3ced-fee0-4c0d-8da7-d0f28e2a15f7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:01.173889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:01.175185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:01.175548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:01.175895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] PATH_INFO: `/v3/users/1fa3b3dcecdd4ff6892de3c61584162d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:01.178307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa3b3dcecdd4ff6892de3c61584162d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:01.180736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:01.213019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:01.214779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:01.235021 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3045/6111] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:01.304830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa3b3dcecdd4ff6892de3c61584162d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:01.321925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa3b3dcecdd4ff6892de3c61584162d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:01.339590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa3b3dcecdd4ff6892de3c61584162d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:01.340427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa3b3dcecdd4ff6892de3c61584162d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:01.354130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bff74407-740c-41d2-9e3e-97f34fb37e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa3b3dcecdd4ff6892de3c61584162d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:01.362128 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3067/6112] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:00 2022] DELETE /identity/v3/users/1fa3b3dcecdd4ff6892de3c61584162d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:02.624454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:02.661093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eb9de0-4fb3-4581-9759-9b99878cd41e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:02.902555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:02.903813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:02.904297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:02.904792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] PATH_INFO: `/v3/projects/32094b9402e64e0eb923eaa445b698be` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:02.906801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32094b9402e64e0eb923eaa445b698be)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:02.909347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:03.030551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32094b9402e64e0eb923eaa445b698be', 'request_id': 'req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:03.048708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32094b9402e64e0eb923eaa445b698be', 'request_id': 'req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:03.064818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32094b9402e64e0eb923eaa445b698be', 'request_id': 'req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:03.084092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] The token cache is being invalidate because project 32094b9402e64e0eb923eaa445b698be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:03.084406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:03.085093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d8e7eb33-40dc-4ca3-a16f-92a85a2b99c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:03.091242 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3046/6113] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:02 2022] DELETE /identity/v3/projects/32094b9402e64e0eb923eaa445b698be => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:03.094482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:03.095064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:03.095173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:03.136286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:03.139887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:03.234054 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:03.409678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3068/6114] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:03.418045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:03.418248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:03.418440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:03.455995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:03.457374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:03.491082 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3047/6115] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:03.496480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:03.519498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d74184-238a-474d-a5b2-29efcd0d523f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:03.532495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:03.533521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:03.533521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:03.537346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:03.540023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:03.540751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:03.544098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:03.573248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3069/6116] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:03.578086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:03.605300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec93f6-e909-452d-addb-9bdfab4df3ca None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:03.614717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628a695c-9b78-4179-b41d-0dff62020105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:03.616313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a695c-9b78-4179-b41d-0dff62020105 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:03.617165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a695c-9b78-4179-b41d-0dff62020105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:03.618219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a695c-9b78-4179-b41d-0dff62020105 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:03.619741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a695c-9b78-4179-b41d-0dff62020105 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:03.625367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628a695c-9b78-4179-b41d-0dff62020105 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:03.699637 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3048/6117] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:03 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:03.735425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:03.755964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8134-f646-4058-b288-3d9bab4194fb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:03.756263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8134-f646-4058-b288-3d9bab4194fb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:03.758435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac8134-f646-4058-b288-3d9bab4194fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:03.781770 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:03.799688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb0fc14-5635-4ec9-86d5-f6a1de8118d0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:03.847577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37ac8134-f646-4058-b288-3d9bab4194fb None None] MFA Rules not processed for user `b7e089707fae4bf3955cdf2ee20a5f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:03.849297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37ac8134-f646-4058-b288-3d9bab4194fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:04.095862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:04.098926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.102604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.103548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.106580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:04.121376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:04.144377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3049/6118] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:04.153082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.153404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.153664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.200996 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3070/6119] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:03 2022] POST /identity/v3/users => generated 293 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:04.206347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:04.215237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] MFA Rules not processed for user `b7e089707fae4bf3955cdf2ee20a5f31`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:04.227173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:04.242264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911cc129-a0a7-474c-8231-04140c05fb53 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:04.256510 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3050/6120] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:04.265915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:04.267334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.267804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.268179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.271482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:04.273476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:04.276181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:04.278810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:04.301688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3071/6121] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:04.302883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:04.326725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971f71b-ae1c-4c4f-95b4-cd2bd6c2932c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:04.339889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:04.341539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.342655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.343028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.346879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:04.349048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:04.379109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3072/6122] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:04.380225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:04.420304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6ba7-a35e-4eda-af4a-a1690a96bc0b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:04.429911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29dffb0-b9ee-4234-aa1b-9903203adacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:04.432284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dffb0-b9ee-4234-aa1b-9903203adacb admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.432692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dffb0-b9ee-4234-aa1b-9903203adacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.433078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29dffb0-b9ee-4234-aa1b-9903203adacb admin admin] PATH_INFO: `/v3/projects/5ea5bf2f9aa444c7bf60f81e5352c293/users/191169ffd9bc40b893f3767103d79382/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.463938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9996e2-c57f-4897-8c86-0b93a5384a04 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:04.470914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dffb0-b9ee-4234-aa1b-9903203adacb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ea5bf2f9aa444c7bf60f81e5352c293, user_id=191169ffd9bc40b893f3767103d79382, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:04.473581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29dffb0-b9ee-4234-aa1b-9903203adacb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:04.481816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:04.483002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.484595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.487136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.509960 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3073/6123] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:04 2022] PUT /identity/v3/projects/5ea5bf2f9aa444c7bf60f81e5352c293/users/191169ffd9bc40b893f3767103d79382/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:04.512414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.513057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.513430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.518168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:04.527438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:04.548637 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3051/6124] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:04.561713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] MFA Rules not processed for user `191169ffd9bc40b893f3767103d79382`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:04.563440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:04.626790 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:04.692250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:04.696426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3074/6125] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:04.710314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f53a5f-8136-4a85-996a-615787dba0e9 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:04.855853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:04.860585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:04.860957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:04.861250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:04.862000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:04.867157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:04.894786 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:04.946942 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3052/6126] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:04 2022] POST /identity/v3/projects => generated 383 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:04.953763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:04.969434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baae1bd3-d6f4-4710-9db5-b38d80324079 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:05.220102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:05.226421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:05.226421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:05.226421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:05.226421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:05.226421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:05.270412 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3075/6127] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:04 2022] POST /identity/v3/users => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:05.271627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:05.283289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719c431-8f13-4a73-9205-d520a84c30e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:05.306027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:05.307078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:05.307560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:05.308011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:05.311023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:05.315410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:05.348773 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3053/6128] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:05.349729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:05.365777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abec34a1-1f9c-4187-93ec-f3466f4dc765 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:05.383001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:05.384447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:05.384741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:05.385025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] PATH_INFO: `/v3/projects/9aa9881d97ac4fe58bee988b25c88f7b/users/52facb1fae434ed3bbf634305e949d51/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:05.426169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa9881d97ac4fe58bee988b25c88f7b, user_id=52facb1fae434ed3bbf634305e949d51, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:05.442092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:05.478859 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3076/6129] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:05 2022] PUT /identity/v3/projects/9aa9881d97ac4fe58bee988b25c88f7b/users/52facb1fae434ed3bbf634305e949d51/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:05.480155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:05.501045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b029d90-754a-421a-8ffc-8c05f7ddbe30 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:05.668114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4aee25-4a05-4185-a8ff-8c0602653195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:05.669100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aee25-4a05-4185-a8ff-8c0602653195 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:05.669386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aee25-4a05-4185-a8ff-8c0602653195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:05.669659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4aee25-4a05-4185-a8ff-8c0602653195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:05.670625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aee25-4a05-4185-a8ff-8c0602653195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:05.672675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4aee25-4a05-4185-a8ff-8c0602653195 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:05.702258 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3054/6130] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:05.705530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:05.721908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5e950-091c-499f-b147-9a5add46cd2c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:05.746113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:05.748705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:05.749398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:05.750622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] PATH_INFO: `/v3/projects/9aa9881d97ac4fe58bee988b25c88f7b/users/52facb1fae434ed3bbf634305e949d51/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:05.759156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa9881d97ac4fe58bee988b25c88f7b, user_id=52facb1fae434ed3bbf634305e949d51, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:05.773085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:05.797411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3077/6131] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:05 2022] PUT /identity/v3/projects/9aa9881d97ac4fe58bee988b25c88f7b/users/52facb1fae434ed3bbf634305e949d51/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:05.809071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:05.809510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:05.810451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:05.876848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] MFA Rules not processed for user `52facb1fae434ed3bbf634305e949d51`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:05.878333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:06.071217 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3055/6132] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:06.348209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:06.352895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:06.469640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48ca9e0-c91d-4d81-8b1f-d20b0c183f59 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:06.478079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:06.479015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:06.479356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:06.479728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:06.492921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:06.494725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:06.523445 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3078/6133] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:07.151968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:07.153816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:07.239945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656611d-6a77-4cde-a3ca-82135c66b9e0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:07.247833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:07.248804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:07.249090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:07.249412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] PATH_INFO: `/v3/users/b7e089707fae4bf3955cdf2ee20a5f31` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:07.257067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e089707fae4bf3955cdf2ee20a5f31)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:07.257067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:07.258012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:07.259508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:07.261504 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:07.288644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a8c48-6c8c-4894-a13f-db4c8370b76f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:07.303146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:07.304337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:07.304772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:07.305152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] PATH_INFO: `/v3/users/f35d623b786740f08b362ad2e393a042` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:07.308744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f35d623b786740f08b362ad2e393a042)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:07.310899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:07.355115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e089707fae4bf3955cdf2ee20a5f31'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.356036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e089707fae4bf3955cdf2ee20a5f31'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.363806 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:07.387855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e089707fae4bf3955cdf2ee20a5f31'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.394316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e089707fae4bf3955cdf2ee20a5f31'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.440565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f35d623b786740f08b362ad2e393a042'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.446991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e089707fae4bf3955cdf2ee20a5f31'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.459469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f35d623b786740f08b362ad2e393a042'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.485726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f35d623b786740f08b362ad2e393a042'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.487837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f35d623b786740f08b362ad2e393a042'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.505922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f35d623b786740f08b362ad2e393a042'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:07.522331 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3079/6134] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:07 2022] DELETE /identity/v3/users/f35d623b786740f08b362ad2e393a042 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:07.535244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3056/6135] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:07 2022] DELETE /identity/v3/users/b7e089707fae4bf3955cdf2ee20a5f31 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:08.317294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:08.319091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:08.325560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:08.327247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:08.535639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e678b8c-878f-4004-8524-21ab3858e7d5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:08.552044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:08.553844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba68de8-a509-440f-8440-a937995ae88d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:08.555385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:08.555678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:08.555962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] PATH_INFO: `/v3/projects/ca1a48e9e0a94ec7a50712df1f8ede83` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:08.559632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca1a48e9e0a94ec7a50712df1f8ede83)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:08.565496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:08.567147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:08.570037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:08.570326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:08.571146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] PATH_INFO: `/v3/projects/de2a7f7d10614ee7bae10d3b54f5f0e6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:08.578615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2a7f7d10614ee7bae10d3b54f5f0e6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:08.580694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:08.689065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca1a48e9e0a94ec7a50712df1f8ede83', 'request_id': 'req-c8d8082b-11fc-42df-9f66-63a8abc9470a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.713253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2a7f7d10614ee7bae10d3b54f5f0e6', 'request_id': 'req-c2e7fca3-7dc7-4e90-94be-114a917ad140'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.719523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca1a48e9e0a94ec7a50712df1f8ede83', 'request_id': 'req-c8d8082b-11fc-42df-9f66-63a8abc9470a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.731137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca1a48e9e0a94ec7a50712df1f8ede83', 'request_id': 'req-c8d8082b-11fc-42df-9f66-63a8abc9470a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.740282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2a7f7d10614ee7bae10d3b54f5f0e6', 'request_id': 'req-c2e7fca3-7dc7-4e90-94be-114a917ad140'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.762562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2a7f7d10614ee7bae10d3b54f5f0e6', 'request_id': 'req-c2e7fca3-7dc7-4e90-94be-114a917ad140'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.764973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] The token cache is being invalidate because project ca1a48e9e0a94ec7a50712df1f8ede83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:08.765268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.769990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c8d8082b-11fc-42df-9f66-63a8abc9470a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.775816 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3080/6136] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:08 2022] DELETE /identity/v3/projects/ca1a48e9e0a94ec7a50712df1f8ede83 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:08.780848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a77b6-b612-4bf3-9e1d-41766a824722 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:08.783275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a77b6-b612-4bf3-9e1d-41766a824722 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:08.784794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a77b6-b612-4bf3-9e1d-41766a824722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:08.793232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] The token cache is being invalidate because project de2a7f7d10614ee7bae10d3b54f5f0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:08.793533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.796891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c2e7fca3-7dc7-4e90-94be-114a917ad140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:08.804886 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3057/6137] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:08 2022] DELETE /identity/v3/projects/de2a7f7d10614ee7bae10d3b54f5f0e6 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:08.806803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944516-5565-48f4-83d0-2f13f936a3e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:08.807106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944516-5565-48f4-83d0-2f13f936a3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:08.807387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d944516-5565-48f4-83d0-2f13f936a3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:08.834466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7d944516-5565-48f4-83d0-2f13f936a3e4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:08.835847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7d944516-5565-48f4-83d0-2f13f936a3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:08.838145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1b5a77b6-b612-4bf3-9e1d-41766a824722 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:08.843308 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:08.851220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1b5a77b6-b612-4bf3-9e1d-41766a824722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:08.929389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3058/6138] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:08.938724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:08.939004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:08.939281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:08.980145 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:08.992965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:08.992965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:09.015494 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3059/6139] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:09.021978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.041788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80469fc9-476a-400c-b93e-cc5ba305639d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.069969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.071035 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3081/6140] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:09.078601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.078963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.079308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.079452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.080309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:09.080487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.080771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.080892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.084519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.105687 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3060/6141] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:09.106803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.119870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52efbe98-48aa-4ded-b719-53adf0ffd2a5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.126315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.127396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.127961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.128574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.130336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.134973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.140957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:09.142203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:09.166769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3082/6142] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:09.171192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.183971 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3061/6143] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:09 2022] POST /identity/v3/projects => generated 375 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:09.186031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.191278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2b401-fdd7-4d57-90c9-5f780e6cc3ae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.289062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.289886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.290312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.290689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.291543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:09.291954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.293762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.308579 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3083/6144] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:36:09.312929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.325918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c05575-8c7a-427c-8b50-40f2e25b59e5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.332186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.333128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.334758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.335148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.336016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.338365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.350806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b43a15-f652-44bd-b307-f7bd7bfa9f24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.362633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.363347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.363627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.363903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.364691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.369608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.374948 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3084/6145] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:09 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:09.379040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.404633 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3062/6146] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:09 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:09.410438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.424545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b978e5f-7a49-4732-b09e-df45b9038e1a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.534430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb316df0-45bd-4ea7-9c05-c6785882ac1a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.541058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.541782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.542181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.542574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.543387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.545687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.559834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.560867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.561150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.561669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.563124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.565540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.567715 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:09.588648 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3063/6147] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:36:09.589850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3085/6148] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:09 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:09.593868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.605952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.615567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c755b0a-fcf6-4444-91da-ab33ad806b02 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.630209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.631023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.631312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.631860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.633567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.639045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d447c-4bfe-4c3f-a43e-d18f76231896 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.640386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.654868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.656062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.656888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.657382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.658348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.660210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.668265 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3064/6149] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:09.675622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.689226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21163c-e422-47e6-9584-cc5c873134d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.692817 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3086/6150] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:09.694581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a870b2f-22cf-4cd3-b686-4a5ec4bcafac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.695713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b2f-22cf-4cd3-b686-4a5ec4bcafac admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.696510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b2f-22cf-4cd3-b686-4a5ec4bcafac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.696773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a870b2f-22cf-4cd3-b686-4a5ec4bcafac admin admin] PATH_INFO: `/v3/projects/78c8da23f7894ec693a7758562b6667a/users/3ed06990d507460183ab07a6c184f92c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.697568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.718885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a870b2f-22cf-4cd3-b686-4a5ec4bcafac admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c8da23f7894ec693a7758562b6667a, user_id=3ed06990d507460183ab07a6c184f92c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.721858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a870b2f-22cf-4cd3-b686-4a5ec4bcafac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.722511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d36a1-ab60-4eda-854d-602e7d9dd1d9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.737644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.742131 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3065/6151] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:09 2022] PUT /identity/v3/projects/78c8da23f7894ec693a7758562b6667a/users/3ed06990d507460183ab07a6c184f92c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:09.742859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.743501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.743979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.744962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:09.746879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:09.754781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.755084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.755366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:09.768875 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3087/6152] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:09.772574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:09.804144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0a9aa-4f2a-4047-871e-f77d3a9288ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:09.814082 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:09.842329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] MFA Rules not processed for user `3ed06990d507460183ab07a6c184f92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:09.843598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:09.985644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47258383-963b-46e6-a7a3-cda43e860cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:09.992310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258383-963b-46e6-a7a3-cda43e860cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:09.993908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258383-963b-46e6-a7a3-cda43e860cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:09.994212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47258383-963b-46e6-a7a3-cda43e860cf1 admin admin] PATH_INFO: `/v3/projects/dbf4e24e0b5d40c59e92d3837d000e44/users/48cb5c48433247349aa440e12720cf28/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.064730 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3066/6153] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:10.071320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258383-963b-46e6-a7a3-cda43e860cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbf4e24e0b5d40c59e92d3837d000e44, user_id=48cb5c48433247349aa440e12720cf28, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.078435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:10.082053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47258383-963b-46e6-a7a3-cda43e860cf1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.082269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:10.115364 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3088/6154] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:09 2022] PUT /identity/v3/projects/dbf4e24e0b5d40c59e92d3837d000e44/users/48cb5c48433247349aa440e12720cf28/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:10.126009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.126621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.127290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.203473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] MFA Rules not processed for user `48cb5c48433247349aa440e12720cf28`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:10.204771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:10.298519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34fb151-633c-4296-b2bf-11fa7e8d99a1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:10.389203 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3089/6155] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:10.397532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:10.442694 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:10.497267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:10.499159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.499454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.499856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.551998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad7101b-12e6-4b7a-bb30-cb60e1d95292 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:10.559067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:10.559852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.560295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.560683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.562230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.565748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.629472 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3090/6156] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:10 2022] POST /identity/v3/projects => generated 371 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:10.631153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:10.636801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.641920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.658795 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:10.669826 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3067/6157] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:10 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:10.780686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0053896-9d4b-4cb2-8f33-d1aeb963fe8e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:10.786534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:10.787270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.787805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.787805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.789221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.791447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.823748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:10.841430 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3091/6158] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:10 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:10.849958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69c26c7-12d1-4494-a469-7ba4d39aa194 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:10.856843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:10.857966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.858559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.861464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.862738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.864912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.878995 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3068/6159] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:10.883414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:10.895183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97888e74-c963-48ef-9120-b1fb9a3d1c7b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:10.920257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:10.921806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:10.922309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:10.922681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] PATH_INFO: `/v3/projects/d324c6ced15d4f348d8f8cdff37ad073/users/cca5b19c7ae3447b99d9e295e5614107/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:10.957375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d324c6ced15d4f348d8f8cdff37ad073, user_id=cca5b19c7ae3447b99d9e295e5614107, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:10.961983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:10.990477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.009218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3092/6160] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:10 2022] PUT /identity/v3/projects/d324c6ced15d4f348d8f8cdff37ad073/users/cca5b19c7ae3447b99d9e295e5614107/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:11.013441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.020472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b457fe43-44e2-4316-9e7c-3b5fc8c161cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.128831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c856bdf-23be-4f35-9dcf-b13b244c3351 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.130524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.131222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.131502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.131777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.132597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.135801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.144335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.146865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.147139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.147467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] PATH_INFO: `/v3/users/3ed06990d507460183ab07a6c184f92c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.151173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ed06990d507460183ab07a6c184f92c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.167669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.177999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3069/6161] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:10 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:11.183309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.212381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35bf49-d76e-4a57-8678-6f2c44e4a7d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.236704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c38006b-8da2-4354-b259-c2950c1c94dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.237323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38006b-8da2-4354-b259-c2950c1c94dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.237603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38006b-8da2-4354-b259-c2950c1c94dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.237881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c38006b-8da2-4354-b259-c2950c1c94dd admin admin] PATH_INFO: `/v3/projects/d324c6ced15d4f348d8f8cdff37ad073/users/cca5b19c7ae3447b99d9e295e5614107/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.245433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38006b-8da2-4354-b259-c2950c1c94dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d324c6ced15d4f348d8f8cdff37ad073, user_id=cca5b19c7ae3447b99d9e295e5614107, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.251697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c38006b-8da2-4354-b259-c2950c1c94dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.293641 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3070/6162] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:11 2022] PUT /identity/v3/projects/d324c6ced15d4f348d8f8cdff37ad073/users/cca5b19c7ae3447b99d9e295e5614107/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:11.304151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.304510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.304814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.305716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ed06990d507460183ab07a6c184f92c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:11.321262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ed06990d507460183ab07a6c184f92c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:11.341074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] MFA Rules not processed for user `cca5b19c7ae3447b99d9e295e5614107`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:11.342661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:11.354563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ed06990d507460183ab07a6c184f92c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:11.355320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ed06990d507460183ab07a6c184f92c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:11.359167 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:11.372383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-19ac050c-693a-4fe6-90d4-ae3e32fc82f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ed06990d507460183ab07a6c184f92c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:11.392949 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3093/6163] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:11 2022] DELETE /identity/v3/users/3ed06990d507460183ab07a6c184f92c => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:11.397452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.398062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.398552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.404231 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:11.437412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:11.438756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:11.460100 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3071/6164] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:11.464579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.479139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bea9137-4657-4dc3-bc75-afecea45c693 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.577784 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3094/6165] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:11.604671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.605393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.605674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.605954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/services` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.607322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.609435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.638653 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3072/6166] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:11 2022] POST /identity/v3/services => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:11.643121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.662337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3e8c5-cb2a-4924-827e-12bb4e7c96ed None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.680465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.683478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:11.700080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.700798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.701082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.701358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.702629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.703974 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:11.703974 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:11.703974 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:11.705023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.730992 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-502500185. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:11.730992 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:11.730992 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:11.800799 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3095/6167] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:36:11 2022] POST /identity/v3/endpoints => generated 358 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:11.805529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.833892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a60347-99e9-45a3-8162-231c777169e0 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.855464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.856576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.857186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.857645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.865832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a34264-1406-4156-8b80-642f99cd66dd tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.876655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.878422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.878710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.878989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-502500185` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.879778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-502500185)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.881245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.882050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.884893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.889805 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3096/6168] 10.222.0.15 () {58 vars in 1202 bytes} [Tue Jul 19 11:36:11 2022] GET /identity/v3/regions/tempest-region-502500185 => generated 178 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:11.891521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.915105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3fe221-946a-499a-be46-c86ea4dd1f3d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:11.930926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:11.932543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:11.932879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:11.933099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:11.933856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:11.939282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:11.943847 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3073/6169] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:11 2022] GET /identity/v3/auth/tokens => generated 3540 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:11.975113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3097/6170] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:11 2022] POST /identity/v3/services => generated 289 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:11.976228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:11.989425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fcc5b0-48d6-4b23-a66c-f8f0842c06ad service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.009964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.010690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.010978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.011257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.012241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.013728 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:12.013728 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:12.013728 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:12.015573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.039757 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1129168518. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:12.039757 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:12.039757 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:12.119447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3074/6171] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:36:11 2022] POST /identity/v3/endpoints => generated 363 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:12.121154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.139077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913af418-f2a8-4234-8207-a0b2edffe531 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.179852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.181201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.181599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.184632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-1129168518` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.185520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1129168518)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.186869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.193088 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3098/6172] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:36:12 2022] GET /identity/v3/regions/tempest-region-1129168518 => generated 180 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:12.198156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.205329 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:12.216018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345a56b5-d34d-4acf-854e-690a734d493b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.226054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.228170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.228811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.229096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.231476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.237163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.292189 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1046127288. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:12.292189 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:12.292189 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:12.341379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3075/6173] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:36:12 2022] POST /identity/v3/endpoints => generated 361 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:12.348123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.365294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835cbb9e-6cc1-4ce3-8e7c-f8bb6651345d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.409648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.410717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.411106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.411466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-1046127288` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.412549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1046127288)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.414062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.424326 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3099/6174] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:36:12 2022] GET /identity/v3/regions/tempest-region-1046127288 => generated 180 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:12.428699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.446957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870a59-c603-4f2b-972e-20b5fe447ffc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.482480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.484534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.485011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.485491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.486440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.487702 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:12.487702 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:12.487702 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:12.489211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.501492 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3076/6175] 10.222.0.15 () {58 vars in 1133 bytes} [Tue Jul 19 11:36:12 2022] GET /identity/v3/endpoints => generated 4386 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:36:12.507071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.548783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba53ed18-4dd4-43bb-8316-597fe567a2af tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.556290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.561582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.562226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.562752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/37300aac3ba04cb7abd5a0cdd0800e83` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.591029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=37300aac3ba04cb7abd5a0cdd0800e83)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.609242 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:12.609242 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:12.609242 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:12.617622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.632654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.639465 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3100/6176] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:12 2022] GET /identity/v3/endpoints/37300aac3ba04cb7abd5a0cdd0800e83 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:36:12.656551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a8148b-0c52-4046-9f85-13607748f00a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.680379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.682580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.683178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.683627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/37300aac3ba04cb7abd5a0cdd0800e83` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.689616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=37300aac3ba04cb7abd5a0cdd0800e83)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.697124 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:12.697124 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:12.697124 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:12.702740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.741183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '37300aac3ba04cb7abd5a0cdd0800e83', 'request_id': 'req-797e2874-031c-4f7d-9459-0391062369e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:12.781292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3077/6177] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:36:12 2022] DELETE /identity/v3/endpoints/37300aac3ba04cb7abd5a0cdd0800e83 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:12.783197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.817397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9438ee-7b45-40a7-a941-d6136ad8c10d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.877123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.882228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.883132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.883132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:12.884033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:12.885411 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:12.885411 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:12.885411 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:12.887880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:12.913884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3101/6178] 10.222.0.15 () {58 vars in 1133 bytes} [Tue Jul 19 11:36:12 2022] GET /identity/v3/endpoints => generated 4038 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:12.917795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:12.943420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e2874-031c-4f7d-9459-0391062369e3 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:12.966404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:12.968396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:12.972269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:12.975862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/37300aac3ba04cb7abd5a0cdd0800e83` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.001047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Could not find endpoint: 37300aac3ba04cb7abd5a0cdd0800e83.: keystone.exception.EndpointNotFound: Could not find endpoint: 37300aac3ba04cb7abd5a0cdd0800e83. Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2865, in one Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._iter().one() Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1417, in one Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._only_one_row( Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exc.NoResultFound( Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:13.027200 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 37300aac3ba04cb7abd5a0cdd0800e83. Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:13.032980 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:36:13.037545 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 37300aac3ba04cb7abd5a0cdd0800e83. Jul 19 11:36:13.043032 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:13.053717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3078/6179] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:36:12 2022] DELETE /identity/v3/endpoints/37300aac3ba04cb7abd5a0cdd0800e83 => generated 114 bytes in 136 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:36:13.057988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.093333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a58ab-b661-48f8-9673-adaae391cc4b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.110947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.112378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.112671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.112949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-1046127288` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.117314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1046127288)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.123716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.171455 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1046127288. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:13.171455 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:13.171455 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:13.208380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3102/6180] 10.222.0.15 () {58 vars in 1208 bytes} [Tue Jul 19 11:36:13 2022] DELETE /identity/v3/regions/tempest-region-1046127288 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:13.209416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.226008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b538a-7d6f-4d98-bd91-24e330562336 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.261501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.262288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.262574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.262857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.263688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.265603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.275704 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3079/6181] 10.222.0.15 () {58 vars in 1133 bytes} [Tue Jul 19 11:36:13 2022] GET /identity/v3/endpoints => generated 4038 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:13.279786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.285378 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:13.300721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d718ec-7f86-4b00-a12f-31e47dc455be tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.315741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.316633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.316926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.317205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.318047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Adding query filter params (service_id=ee8daeed1ba44a4a8d47fda249555a0b) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:13.318372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.320536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.336596 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3103/6182] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:36:13 2022] GET /identity/v3/endpoints?service_id=ee8daeed1ba44a4a8d47fda249555a0b => generated 500 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:13.341024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.375688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151dbf5-a90a-44be-ae0c-f1719c961b3a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.400451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.406360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.407144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.407536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.416919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Adding query filter params (service_id=76607827413a4c7daa4434286a878f12) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:13.417984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.429728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.441787 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3080/6183] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:36:13 2022] GET /identity/v3/endpoints?service_id=76607827413a4c7daa4434286a878f12 => generated 505 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:13.446192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.494155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa23ab72-46c0-470f-a3b0-9809d2400a6c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.522037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.528505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.529009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.529633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.531029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:13.536040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.539459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.582496 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3104/6184] 10.222.0.15 () {58 vars in 1166 bytes} [Tue Jul 19 11:36:13 2022] GET /identity/v3/endpoints?interface=public => generated 3393 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:13.586726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.614506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1c9b67-c32e-4883-b2c9-198bce1edc58 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.634466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.635139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.640220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.640688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.645187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:13.645554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.653729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.676066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3081/6185] 10.222.0.15 () {58 vars in 1170 bytes} [Tue Jul 19 11:36:13 2022] GET /identity/v3/endpoints?interface=internal => generated 480 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:13.687865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.705544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fcd55-f795-4fa8-8379-8f81381551ff tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.746983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.749713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.750058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.754750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.766769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.777325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:13.823817 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3105/6186] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:13 2022] POST /identity/v3/services => generated 289 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:13.828985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:13.851263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db2f02-9942-4fa9-97bb-cbed6e53cbcc tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:13.937582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:13.940975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:13.940975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:13.940975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:13.940975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:13.946495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:14.026577 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-728398885. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:14.026577 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:14.026577 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:14.085100 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3082/6187] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:36:13 2022] POST /identity/v3/endpoints => generated 358 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:14.089210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:14.108257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4c0c80-e5d5-4d18-b14c-c78ac0f1658c tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:14.151405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:14.152504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:14.152900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:14.153325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-728398885` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:14.154112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-728398885)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:14.155589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:14.161594 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3106/6188] 10.222.0.15 () {58 vars in 1202 bytes} [Tue Jul 19 11:36:14 2022] GET /identity/v3/regions/tempest-region-728398885 => generated 178 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:14.163460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:14.182004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2d0636-5705-4539-b8c2-1a3db1e10198 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:14.198889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:14.199953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:14.200328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:14.200994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/ac3b436879a942d1a7f7d28ae8145ee1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:14.222455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=ac3b436879a942d1a7f7d28ae8145ee1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:14.224090 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:14.224090 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:14.224090 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:14.226219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:14.264338 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1989215249. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:14.264338 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:14.264338 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:14.407612 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3083/6189] 10.222.0.15 () {60 vars in 1255 bytes} [Tue Jul 19 11:36:14 2022] PATCH /identity/v3/endpoints/ac3b436879a942d1a7f7d28ae8145ee1 => generated 363 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:36:14.408958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:14.426317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a9e09-74d3-4a13-8881-3f0359043da8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:14.481274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:14.481808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:14.481980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:14.482810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-1989215249` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:14.483200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1989215249)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:14.484245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:14.490992 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3107/6190] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:36:14 2022] GET /identity/v3/regions/tempest-region-1989215249 => generated 180 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:14.496613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:14.539039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4d361-2485-4883-a6d6-7e5c5da8e1e8 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:14.565929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:14.583838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:14.584200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:14.584436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/ac3b436879a942d1a7f7d28ae8145ee1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:14.620737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ac3b436879a942d1a7f7d28ae8145ee1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:14.623480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:14.650891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ac3b436879a942d1a7f7d28ae8145ee1', 'request_id': 'req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:14.685113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3084/6191] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:36:14 2022] DELETE /identity/v3/endpoints/ac3b436879a942d1a7f7d28ae8145ee1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:14.686430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:14.710752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e15593-e368-400b-b750-897448cc028f tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:14.790645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:14.796308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:14.796661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:14.797348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-1989215249` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:14.797647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1989215249)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:14.805169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:14.863831 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1989215249. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:14.863831 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:14.863831 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:14.900137 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3108/6192] 10.222.0.15 () {58 vars in 1208 bytes} [Tue Jul 19 11:36:14 2022] DELETE /identity/v3/regions/tempest-region-1989215249 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:14.904710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:14.913900 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:14.931731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0c5af1-0f1b-4b21-84fb-6770c6b8fd0b tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:14.975697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:14.976878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:14.976878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:14.977238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-728398885` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:14.977848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-728398885)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:14.979593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:15.066867 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3085/6193] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:36:14 2022] DELETE /identity/v3/regions/tempest-region-728398885 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:15.072632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:15.084754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:15.091956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:15.101810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfaefc-717e-44c3-9723-9e6ed376cf6a tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:15.162104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:15.165971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.167662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.171669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/services/851758c192c74284b8e8baf1b9d3ee96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:15.174851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_service(service_id=851758c192c74284b8e8baf1b9d3ee96)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:15.182986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:15.186801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85948452-b6e3-4993-bc45-a6879e2f7003 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:15.210049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:15.216742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.220810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.221666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] PATH_INFO: `/v3/users/191169ffd9bc40b893f3767103d79382` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:15.226430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=191169ffd9bc40b893f3767103d79382)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:15.240481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:15.282910 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3109/6194] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:15 2022] DELETE /identity/v3/services/851758c192c74284b8e8baf1b9d3ee96 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:15.290956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:15.299113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:15.415768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191169ffd9bc40b893f3767103d79382'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.416516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191169ffd9bc40b893f3767103d79382'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.425121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a06d2-db67-4693-86b5-3b46ea46ead5 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:15.433437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:15.434424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.434794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.435079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] PATH_INFO: `/v3/projects/78c8da23f7894ec693a7758562b6667a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:15.436558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c8da23f7894ec693a7758562b6667a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:15.439917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:15.450864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191169ffd9bc40b893f3767103d79382'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.451628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191169ffd9bc40b893f3767103d79382'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.483693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191169ffd9bc40b893f3767103d79382'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.541743 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3086/6195] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:15 2022] DELETE /identity/v3/users/191169ffd9bc40b893f3767103d79382 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:15.542979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:15.545570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:15.561910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c8da23f7894ec693a7758562b6667a', 'request_id': 'req-51f4600f-e728-456f-8859-2d4337d87f6c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.590320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c8da23f7894ec693a7758562b6667a', 'request_id': 'req-51f4600f-e728-456f-8859-2d4337d87f6c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.602377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c8da23f7894ec693a7758562b6667a', 'request_id': 'req-51f4600f-e728-456f-8859-2d4337d87f6c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.639748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] The token cache is being invalidate because project 78c8da23f7894ec693a7758562b6667a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:15.640083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.641158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51f4600f-e728-456f-8859-2d4337d87f6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.662198 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3110/6196] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:15 2022] DELETE /identity/v3/projects/78c8da23f7894ec693a7758562b6667a => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:15.667542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.667913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.668101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:15.723439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e418c5-5040-4126-ad7c-ce451f7b2299 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:15.749622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:15.750946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:15.769485 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:15.797003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:15.797898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.798186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.808912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/82334dc89db443399580f974f54b100c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:15.831567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=82334dc89db443399580f974f54b100c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:15.834367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:15.861078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4ad4c71c-5597-430c-9ea3-231e495c3428 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '82334dc89db443399580f974f54b100c', 'request_id': 'req-4ad4c71c-5597-430c-9ea3-231e495c3428'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:15.887175 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3087/6197] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:36:15 2022] DELETE /identity/v3/endpoints/82334dc89db443399580f974f54b100c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:15.889084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b296e-8842-4304-a298-fbbcb462968e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.892828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b296e-8842-4304-a298-fbbcb462968e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.893375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b296e-8842-4304-a298-fbbcb462968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:15.963899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-289b296e-8842-4304-a298-fbbcb462968e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:15.965754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-289b296e-8842-4304-a298-fbbcb462968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:15.969395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3111/6198] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3673 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:15.977418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:15.978412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3088/6199] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3673 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:15.986921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:15.988455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:15.989690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:15.990004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.002794 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:16.030972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:16.035443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:16.061949 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3089/6200] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:15 2022] POST /identity/v3/auth/tokens => generated 3673 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:16.069356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2d268-231e-488d-9e57-aee6e9fa7a97 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.072264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.083606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.085036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.085499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.085937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-1129168518` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.086767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1129168518)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.089359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.092996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617de19-c911-40b1-b176-fbea8ea71955 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.098427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.099231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.099662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.100045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.101256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:16.101698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.104753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.119379 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1129168518. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:16.119379 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:16.119379 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:16.127704 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3090/6201] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:16.128853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.131068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:16.134061 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3112/6202] 10.222.0.15 () {58 vars in 1208 bytes} [Tue Jul 19 11:36:15 2022] DELETE /identity/v3/regions/tempest-region-1129168518 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:16.135146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.199475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9d69f-16c4-45b4-82ef-5d0adea5906d tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.211691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.214311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.214700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.215129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.215966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.218440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.303452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757788d-efb7-489e-a21c-cec5c4d74202 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.306910 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3113/6203] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:16 2022] POST /identity/v3/projects => generated 401 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:16.309049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.519414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.521811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.522386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.522740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.653094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c4ec3-a218-41b4-810c-45cbfdb2baed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.670657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.672377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.672856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.673304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/services/76607827413a4c7daa4434286a878f12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.674216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_service(service_id=76607827413a4c7daa4434286a878f12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.678003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.743406 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3114/6204] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:16 2022] DELETE /identity/v3/services/76607827413a4c7daa4434286a878f12 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:16.746590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.751124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.754528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.807335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3091/6205] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:16 2022] GET /identity/v3/auth/tokens => generated 3673 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:16.831781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9102d271-4a00-4081-bc8a-69787daca774 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.833251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.837179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:16.852000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.853028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.853471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.853948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.854804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.857152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.880137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cf2f35-de44-4f69-a3d4-f6187d8b4ae5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:16.898498 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:16.901331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:16.906239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:16.906545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:16.906853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] PATH_INFO: `/v3/users/f8dcd6ce01494406b0f47bde9f55e1a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:16.913609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8dcd6ce01494406b0f47bde9f55e1a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:16.915703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:16.937489 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3115/6206] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:16 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:16.937489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:16.993098 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:16.993978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1037-d40b-4169-8b8e-245f92b070fc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.003067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.003967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.004252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.004578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/endpoints/4342b3915acd4c4eb924d9d3a888a126` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.020150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=4342b3915acd4c4eb924d9d3a888a126)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:17.021241 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:17.021241 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:17.021241 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:17.022401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:17.036397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8dcd6ce01494406b0f47bde9f55e1a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:17.037448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8dcd6ce01494406b0f47bde9f55e1a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:17.047125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '4342b3915acd4c4eb924d9d3a888a126', 'request_id': 'req-7ee9276e-2ed9-4246-8666-08eb922dd87e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:17.069038 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3116/6207] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:36:16 2022] DELETE /identity/v3/endpoints/4342b3915acd4c4eb924d9d3a888a126 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:17.070136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:17.075490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:17.076028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8dcd6ce01494406b0f47bde9f55e1a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:17.077405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8dcd6ce01494406b0f47bde9f55e1a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:17.091083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8dcd6ce01494406b0f47bde9f55e1a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:17.138341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee9276e-2ed9-4246-8666-08eb922dd87e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.143533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec85c9-4ab1-421c-943b-c342c5103b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.144233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec85c9-4ab1-421c-943b-c342c5103b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.144542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec85c9-4ab1-421c-943b-c342c5103b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.144882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec85c9-4ab1-421c-943b-c342c5103b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.145595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec85c9-4ab1-421c-943b-c342c5103b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:17.147303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eec85c9-4ab1-421c-943b-c342c5103b58 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:17.158361 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3092/6208] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:16 2022] DELETE /identity/v3/users/f8dcd6ce01494406b0f47bde9f55e1a2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:17.162457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:17.166778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:17.173843 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3117/6209] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:17.174554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.174841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.175115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.218404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:17.219803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:17.380385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad026ffb-1d1c-49f4-a451-1561535cbffa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.381158 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3118/6210] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:17 2022] POST /identity/v3/auth/tokens => generated 3360 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:17.382657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:17.410017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.410898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.411284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.412187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/regions/tempest-region-502500185` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.413155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-502500185)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:17.416030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:17.427027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b69931-5aa7-4231-96a2-497f3994987e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.441430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.442849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.442849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.442849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.446626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:17.446626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:17.472967 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3119/6211] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:17 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:17.474083 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-502500185. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:36:17.474083 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:36:17.474083 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:17.484047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3093/6212] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:36:17 2022] DELETE /identity/v3/regions/tempest-region-502500185 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:17.486217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:17.487284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:17.494505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:17.557440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac23385-8299-4109-b497-01e89af3608e tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.571637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.573774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.573774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.573774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] PATH_INFO: `/v3/projects/0a32d0bfd7f142ddb8cedda792f043b0/users/99bf21e520934c18aa9c72ff899f25e8/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.616879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a32d0bfd7f142ddb8cedda792f043b0, user_id=99bf21e520934c18aa9c72ff899f25e8, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:17.621056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:17.663265 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3094/6213] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:17 2022] PUT /identity/v3/projects/0a32d0bfd7f142ddb8cedda792f043b0/users/99bf21e520934c18aa9c72ff899f25e8/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:17.665730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:17.701279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012b7e4c-8498-4488-a97f-c95301124b6e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.773318 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:17.807895 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:17.833477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db3ced9-0572-4e40-a017-be7b7f51e2ff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:17.849100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4cb9f3-de87-4bbd-97dc-e66446fe7c57 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cca5b19c7ae3447b99d9e295e5614107', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd324c6ced15d4f348d8f8cdff37ad073', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.850462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cb9f3-de87-4bbd-97dc-e66446fe7c57 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.850743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cb9f3-de87-4bbd-97dc-e66446fe7c57 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.853342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4cb9f3-de87-4bbd-97dc-e66446fe7c57 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] PATH_INFO: `/v3/services/ee8daeed1ba44a4a8d47fda249555a0b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.855365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cb9f3-de87-4bbd-97dc-e66446fe7c57 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ee8daeed1ba44a4a8d47fda249555a0b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:17.861026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4cb9f3-de87-4bbd-97dc-e66446fe7c57 tempest-EndPointsTestJSON-2038310268 tempest-EndPointsTestJSON-2038310268-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:17.885992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:17.889579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.889858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.891514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:17.960471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3095/6214] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:17 2022] DELETE /identity/v3/services/ee8daeed1ba44a4a8d47fda249555a0b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:17.965345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:17.965644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:17.965929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:18.065841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] MFA Rules not processed for user `99bf21e520934c18aa9c72ff899f25e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:18.068812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:18.092953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:18.094967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:18.132144 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3120/6215] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:17 2022] GET /identity/v3/auth/tokens => generated 3360 bytes in 656 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:18.135473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:18.137360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:18.213931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713bbde-9188-4693-b04c-1929ebacf50f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:18.274529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:18.279280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:18.279508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:18.280046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] PATH_INFO: `/v3/users/48cb5c48433247349aa440e12720cf28` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:18.284623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cb5c48433247349aa440e12720cf28)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:18.291716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:18.445307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3096/6216] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:18.452740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:18.457031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:18.476106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cb5c48433247349aa440e12720cf28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.505974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cb5c48433247349aa440e12720cf28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.515659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4fd446-5633-4b7b-af14-e40b33adbc1c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:18.535926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:18.539234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:18.539574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:18.544244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] PATH_INFO: `/v3/projects/5ea5bf2f9aa444c7bf60f81e5352c293` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:18.555168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ea5bf2f9aa444c7bf60f81e5352c293)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:18.564111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:18.567282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cb5c48433247349aa440e12720cf28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.569045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cb5c48433247349aa440e12720cf28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.586437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cb5c48433247349aa440e12720cf28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.601494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3121/6217] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:18 2022] DELETE /identity/v3/users/48cb5c48433247349aa440e12720cf28 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:18.609585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:18.612952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:18.771403 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:18.842762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac2b912-b53d-49a3-846a-0bf1553316e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:18.843771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ea5bf2f9aa444c7bf60f81e5352c293', 'request_id': 'req-31c9b4e5-43ec-4664-b607-7ae65efb0b78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.878722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ea5bf2f9aa444c7bf60f81e5352c293', 'request_id': 'req-31c9b4e5-43ec-4664-b607-7ae65efb0b78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.921235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ea5bf2f9aa444c7bf60f81e5352c293', 'request_id': 'req-31c9b4e5-43ec-4664-b607-7ae65efb0b78'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.974374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] The token cache is being invalidate because project 5ea5bf2f9aa444c7bf60f81e5352c293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:18.974647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.977778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-31c9b4e5-43ec-4664-b607-7ae65efb0b78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:18.990938 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3097/6218] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:18 2022] DELETE /identity/v3/projects/5ea5bf2f9aa444c7bf60f81e5352c293 => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:18.996730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:18.997295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:19.000390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:19.043105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:19.045007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:19.083645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:19.084777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:19.091325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:19.094990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:19.095936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:19.105182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:19.132902 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:19.181873 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3122/6219] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:18 2022] POST /identity/v3/projects => generated 401 bytes in 580 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:19.182750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:19.187523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:19.220058 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3098/6220] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:19.221001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:19.229155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:19.259210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba73632-f40e-44a8-a17b-ca2088c8baa4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:19.469344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232501ae-9288-4d4a-8d6d-bd440ca1bce4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:19.495639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:19.500620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:19.502036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:19.502571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] PATH_INFO: `/v3/users/52facb1fae434ed3bbf634305e949d51` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:19.505381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:19.506681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52facb1fae434ed3bbf634305e949d51)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:19.507876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:19.510847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:19.510847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:19.510847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:19.513102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:19.525012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:19.573407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3099/6221] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:19 2022] POST /identity/v3/users => generated 307 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:19.574327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:19.596842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:19.716824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52facb1fae434ed3bbf634305e949d51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:19.745173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52facb1fae434ed3bbf634305e949d51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:19.804188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5748d0f-f853-4b40-8c95-70f99da29fde admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:19.812148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:19.813091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:19.813624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:19.814160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:19.827150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52facb1fae434ed3bbf634305e949d51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:19.829786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52facb1fae434ed3bbf634305e949d51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:19.839717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:19.840115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:19.856504 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:19.865170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3100/6222] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:19.866232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:19.867687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:19.889069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52facb1fae434ed3bbf634305e949d51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:19.897366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ea7e0-12a0-448b-b47c-6d3c2ba68e15 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:19.915705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:19.916817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:19.917463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:19.917839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] PATH_INFO: `/v3/projects/06e73b9148b44b6c8daaf1dc05e94e93` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:19.920719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06e73b9148b44b6c8daaf1dc05e94e93)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:19.922823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:19.953558 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3123/6223] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:19 2022] DELETE /identity/v3/users/52facb1fae434ed3bbf634305e949d51 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:19.959826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:19.968387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:20.053258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06e73b9148b44b6c8daaf1dc05e94e93', 'request_id': 'req-cd398083-b467-45d8-bb2d-d36837089e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:20.063636 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:20.076605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06e73b9148b44b6c8daaf1dc05e94e93', 'request_id': 'req-cd398083-b467-45d8-bb2d-d36837089e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:20.106007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06e73b9148b44b6c8daaf1dc05e94e93', 'request_id': 'req-cd398083-b467-45d8-bb2d-d36837089e06'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:20.139305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] The token cache is being invalidate because project 06e73b9148b44b6c8daaf1dc05e94e93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:20.139873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:20.140984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd398083-b467-45d8-bb2d-d36837089e06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:20.146786 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3101/6224] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:19 2022] DELETE /identity/v3/projects/06e73b9148b44b6c8daaf1dc05e94e93 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:20.151998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554981d2-3412-4690-98be-60cff609e4eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.152456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554981d2-3412-4690-98be-60cff609e4eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.152835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554981d2-3412-4690-98be-60cff609e4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.186601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12253b-5a73-43f2-a6b2-6a6a06c262e7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.195457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-554981d2-3412-4690-98be-60cff609e4eb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:20.196962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-554981d2-3412-4690-98be-60cff609e4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:20.279901 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3102/6225] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:20.303724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.304953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.305689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.306905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.308064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.308732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.310771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.311922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.315090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.339090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3124/6226] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:20.344998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.345963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:20.347472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:20.348025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:20.367047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3103/6227] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:20.368503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.407889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7958f-df4b-4be4-a0f6-e0853eb7ae66 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.422214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.422520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74566b-d1b7-442b-a603-28c7f21f148a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.423218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.424747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.426175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.427414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:20.428448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.434393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.442154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.443093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.443377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.443654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] PATH_INFO: `/v3/projects/a350dcf9613a4671b54e6c7dea0013b5/users/85d204cf5262424eb608799696a164e3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.466466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3104/6228] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:20.471254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.479263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a350dcf9613a4671b54e6c7dea0013b5, user_id=85d204cf5262424eb608799696a164e3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.482857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.493382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ade83-e5d5-492d-a8ad-ef03362eaf33 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.508794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.510601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.521384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.521757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.522805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.524512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.539659 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3125/6229] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:20 2022] PUT /identity/v3/projects/a350dcf9613a4671b54e6c7dea0013b5/users/85d204cf5262424eb608799696a164e3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:20.543670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.595657 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3105/6230] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:20 2022] POST /identity/v3/projects => generated 381 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:20.596723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.690558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6e1a35-37de-4899-b8af-a188c65bfa57 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.724787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18833c-fbd1-4184-aa5f-2cf26c23d252 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.732779 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:20.737704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.738415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.738703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.738996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.745376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.748971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.796208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3106/6231] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:20 2022] POST /identity/v3/users => generated 291 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:20.797422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.820139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69014fb-5e04-4d21-8565-f1ca41f066ac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.827685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.829538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.829825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.830102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.832324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.832618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.833444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.833799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.834081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.834827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.836480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.836849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.871727 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3126/6232] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:20.874614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3107/6233] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:20.875148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.877710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.898110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75b79e-ef6f-44b2-b91d-48c29a4f37c3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.907067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546f96b-c641-48c0-8935-e9192936ce43 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:20.914487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.915064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bdf34-fb7d-4610-b1a8-2c1a7c8f3a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:20.915426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.915757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bdf34-fb7d-4610-b1a8-2c1a7c8f3a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.916040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bdf34-fb7d-4610-b1a8-2c1a7c8f3a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.916316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bdf34-fb7d-4610-b1a8-2c1a7c8f3a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.916799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.917087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] PATH_INFO: `/v3/projects/a350dcf9613a4671b54e6c7dea0013b5/users/85d204cf5262424eb608799696a164e3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.917262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bdf34-fb7d-4610-b1a8-2c1a7c8f3a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.918922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bdf34-fb7d-4610-b1a8-2c1a7c8f3a96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.922444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a350dcf9613a4671b54e6c7dea0013b5, user_id=85d204cf5262424eb608799696a164e3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:20.928007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:20.953534 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3127/6234] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:20 2022] PUT /identity/v3/projects/a350dcf9613a4671b54e6c7dea0013b5/users/85d204cf5262424eb608799696a164e3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:20.959832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:20.962842 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3108/6235] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:20.964436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:20.970940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:20.971326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:20.992481 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:21.014202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] MFA Rules not processed for user `85d204cf5262424eb608799696a164e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:21.015787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:21.141293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d2d40b-82cb-4901-b52f-bb4938f84d23 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:21.149460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:21.150314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:21.150610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:21.150877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] PATH_INFO: `/v3/projects/3878fcd68cd847528dff3508c261c723/users/27c1aba616c041d89a74864a697920aa/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:21.157451 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3109/6236] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:21.159310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:21.188902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c0902-ea2a-4af4-8f45-408a8fdac0dd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:21.188902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d92740f-8883-4a69-8e00-12d40613b5f1 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d204cf5262424eb608799696a164e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a350dcf9613a4671b54e6c7dea0013b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:21.188902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92740f-8883-4a69-8e00-12d40613b5f1 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:21.189480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92740f-8883-4a69-8e00-12d40613b5f1 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:21.189480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d92740f-8883-4a69-8e00-12d40613b5f1 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:21.190257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92740f-8883-4a69-8e00-12d40613b5f1 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:21.191950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d92740f-8883-4a69-8e00-12d40613b5f1 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:21.192441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3878fcd68cd847528dff3508c261c723, user_id=27c1aba616c041d89a74864a697920aa, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:21.198826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:21.243508 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3128/6237] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:20 2022] PUT /identity/v3/projects/3878fcd68cd847528dff3508c261c723/users/27c1aba616c041d89a74864a697920aa/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:21.243745 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3110/6238] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:36:21 2022] POST /identity/v3/roles => generated 239 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:21.245990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:21.246489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:21.247279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:21.247565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:21.315453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] MFA Rules not processed for user `27c1aba616c041d89a74864a697920aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:21.317582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:21.427046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d686d807-9702-4f72-b07e-32e0da1e63c1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:21.447307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d204cf5262424eb608799696a164e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a350dcf9613a4671b54e6c7dea0013b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:21.448443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:21.448682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:21.448967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] PATH_INFO: `/v3/projects/0a32d0bfd7f142ddb8cedda792f043b0/users/99bf21e520934c18aa9c72ff899f25e8/roles/53a32017a7564ba6a87cf351e4337a52` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:21.451762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0a32d0bfd7f142ddb8cedda792f043b0, user_id=99bf21e520934c18aa9c72ff899f25e8, role_id=53a32017a7564ba6a87cf351e4337a52)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:21.454903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:21.501617 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3111/6239] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:21.501617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:21.505283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:21.508270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3129/6240] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:21 2022] PUT /identity/v3/projects/0a32d0bfd7f142ddb8cedda792f043b0/users/99bf21e520934c18aa9c72ff899f25e8/roles/53a32017a7564ba6a87cf351e4337a52 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:21.509302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:21.562442 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:21.641738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a96639-8249-4dfd-b8dc-955331d61704 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:21.648514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:21.649210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:21.649496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:21.649777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:21.650541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:21.653248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:21.692660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3130/6241] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:21 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:21.693722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:21.697557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951812e6-cf92-4d6a-8de2-19f907eb0981 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:21.699677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:21.724380 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:21.880657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:21.882946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:21.883232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:21.883508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] PATH_INFO: `/v3/projects/9aa9881d97ac4fe58bee988b25c88f7b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:21.887865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa9881d97ac4fe58bee988b25c88f7b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:21.893748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:22.014263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fac796c-563c-4bbf-a9ea-7f9f3ce1e711 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:22.014504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa9881d97ac4fe58bee988b25c88f7b', 'request_id': 'req-026a7770-d947-44be-bcc8-20d9b6d8931b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.029970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa9881d97ac4fe58bee988b25c88f7b', 'request_id': 'req-026a7770-d947-44be-bcc8-20d9b6d8931b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.065613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa9881d97ac4fe58bee988b25c88f7b', 'request_id': 'req-026a7770-d947-44be-bcc8-20d9b6d8931b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.087416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] The token cache is being invalidate because project 9aa9881d97ac4fe58bee988b25c88f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:22.090305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.092530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.095797 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3112/6242] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:21 2022] DELETE /identity/v3/projects/9aa9881d97ac4fe58bee988b25c88f7b => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:22.096867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:22.099980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.174814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8525e72-7124-4926-828c-d31e18a30b91 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99bf21e520934c18aa9c72ff899f25e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a32d0bfd7f142ddb8cedda792f043b0', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-484261740', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:22.175590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525e72-7124-4926-828c-d31e18a30b91 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.175996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525e72-7124-4926-828c-d31e18a30b91 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.176402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8525e72-7124-4926-828c-d31e18a30b91 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] PATH_INFO: `/v3/users/99bf21e520934c18aa9c72ff899f25e8/application_credentials` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.177255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525e72-7124-4926-828c-d31e18a30b91 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] RBAC: Authorizing `identity:create_application_credential(user_id=99bf21e520934c18aa9c72ff899f25e8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:22.178536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8525e72-7124-4926-828c-d31e18a30b91 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:22.270213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026a7770-d947-44be-bcc8-20d9b6d8931b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:22.283595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:22.284393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.284603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.285237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.285752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:22.289764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:22.310912 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:22.336101 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3113/6243] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:22 2022] POST /identity/v3/users => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:22.337162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:22.339766 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3131/6244] 10.222.0.15 () {60 vars in 1314 bytes} [Tue Jul 19 11:36:21 2022] POST /identity/v3/users/99bf21e520934c18aa9c72ff899f25e8/application_credentials => generated 659 bytes in 646 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:22.341422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.341818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.342282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.345430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.368577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f656-fef4-4da2-8b43-ae5a02b11b40 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:22.385090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:22.386369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:22.388178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.388500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.388822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] PATH_INFO: `/v3/projects/dbf4e24e0b5d40c59e92d3837d000e44` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.390808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.392470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbf4e24e0b5d40c59e92d3837d000e44)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:22.394421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:22.423033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3132/6245] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:22.424090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:22.445603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd932067-54dd-4480-b545-e7b68468a366 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:22.465264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea120f4f-0141-41c3-bf82-243a3beee0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:22.465972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea120f4f-0141-41c3-bf82-243a3beee0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.466254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea120f4f-0141-41c3-bf82-243a3beee0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.466530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea120f4f-0141-41c3-bf82-243a3beee0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.467369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea120f4f-0141-41c3-bf82-243a3beee0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:22.469068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea120f4f-0141-41c3-bf82-243a3beee0d8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:22.486143 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:22.506079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3133/6246] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:22 2022] GET /identity/v3/roles => generated 1650 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:22.511004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.511329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.511613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.523757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbf4e24e0b5d40c59e92d3837d000e44', 'request_id': 'req-42d8f37a-9e5a-4529-83b3-c76b3109a553'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.540034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbf4e24e0b5d40c59e92d3837d000e44', 'request_id': 'req-42d8f37a-9e5a-4529-83b3-c76b3109a553'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.554717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbf4e24e0b5d40c59e92d3837d000e44', 'request_id': 'req-42d8f37a-9e5a-4529-83b3-c76b3109a553'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.569022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] MFA Rules not processed for user `99bf21e520934c18aa9c72ff899f25e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:22.570396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.580487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] The token cache is being invalidate because project dbf4e24e0b5d40c59e92d3837d000e44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:22.580781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.583451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-42d8f37a-9e5a-4529-83b3-c76b3109a553 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:22.588534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3114/6247] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:22 2022] DELETE /identity/v3/projects/dbf4e24e0b5d40c59e92d3837d000e44 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:22.588534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.588534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.588534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.632974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:22.634232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.805499 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3115/6248] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:22.805499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:22.805499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.862463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aa276b-b48a-4a46-b328-df5e777bff70 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:22.878049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:22.878972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:22.879253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:22.879524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] PATH_INFO: `/v3/projects/0bd0d361fb524286b5e85373ad9c1540/users/731b1d8316654551a9d9833dd4af0ef7/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:22.923211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd0d361fb524286b5e85373ad9c1540, user_id=731b1d8316654551a9d9833dd4af0ef7, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:22.927138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:22.937451 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3134/6249] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:22 2022] POST /identity/v3/auth/tokens => generated 3384 bytes in 431 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 19 11:36:22.938550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:22.940311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:22.953075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3116/6250] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:22 2022] PUT /identity/v3/projects/0bd0d361fb524286b5e85373ad9c1540/users/731b1d8316654551a9d9833dd4af0ef7/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:22.953651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.131161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c555a-8096-432d-8735-55e82d4825cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.137089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.137785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.138066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.138343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.139135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:23.139442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.142994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.158525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3117/6251] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:23.159370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.161482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:23.202481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c86819-5d1f-4448-8a86-7e58d18343d6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.214718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.215785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.216176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.219307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] PATH_INFO: `/v3/users/cca5b19c7ae3447b99d9e295e5614107` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.237759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca5b19c7ae3447b99d9e295e5614107)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.244635 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:23.247974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.309690 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=2,keystone:SELECT=97,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:23.375797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde45c6-d20f-4f48-a5d3-c400c458cb33 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.389928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99bf21e520934c18aa9c72ff899f25e8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a32d0bfd7f142ddb8cedda792f043b0', 'project_domain_id': 'default', 'roles': ['member', 'tempest-test_role-484261740', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.391283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.391679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.392661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] PATH_INFO: `/v3/users/99bf21e520934c18aa9c72ff899f25e8/application_credentials/cf6bdc4700f64afe8cc9d35aeeaf5e80` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.393994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] RBAC: Authorizing `identity:delete_application_credential(user_id=99bf21e520934c18aa9c72ff899f25e8, application_credential_id=cf6bdc4700f64afe8cc9d35aeeaf5e80)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.395746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.439120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3118/6252] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:36:23 2022] DELETE /identity/v3/users/99bf21e520934c18aa9c72ff899f25e8/application_credentials/cf6bdc4700f64afe8cc9d35aeeaf5e80 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:23.439780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.467393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc449609-2e2c-4f09-ac48-2fbc78e4cef8 tempest-ApplicationCredentialsV3AdminTest-812282811 tempest-ApplicationCredentialsV3AdminTest-812282811-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.480534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca5b19c7ae3447b99d9e295e5614107'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:23.485089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.485787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.486067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.487087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.488721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.493761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.505036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca5b19c7ae3447b99d9e295e5614107'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:23.530827 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3119/6253] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:23 2022] GET /identity/v3/roles => generated 1650 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:23.538334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.543892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca5b19c7ae3447b99d9e295e5614107'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:23.547500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca5b19c7ae3447b99d9e295e5614107'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:23.575019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0819e885-81b4-4407-86b8-7e90209d5c21 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.591939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca5b19c7ae3447b99d9e295e5614107'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:23.592204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.593445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.593849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.596790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.597839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.600119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.612093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3135/6254] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:22 2022] DELETE /identity/v3/users/cca5b19c7ae3447b99d9e295e5614107 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:23.613293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.615427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:23.675085 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3120/6255] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:23 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:23.676336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.678538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:23.719312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46869f41-ed24-4843-b7af-29d68d20841f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.845989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68544e-0d32-4fdc-a1ca-7d2af6481382 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:23.853340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.854745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.855274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.855818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] PATH_INFO: `/v3/projects/0bd0d361fb524286b5e85373ad9c1540/users/731b1d8316654551a9d9833dd4af0ef7/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.859993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd0d361fb524286b5e85373ad9c1540, user_id=731b1d8316654551a9d9833dd4af0ef7, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.864780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.894203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85d204cf5262424eb608799696a164e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a350dcf9613a4671b54e6c7dea0013b5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:23.895290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:23.895678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:23.896061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] PATH_INFO: `/v3/roles/53a32017a7564ba6a87cf351e4337a52` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:23.900182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: Authorizing `identity:delete_role(role_id=53a32017a7564ba6a87cf351e4337a52)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:23.903341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:23.917260 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3121/6256] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:23 2022] PUT /identity/v3/projects/0bd0d361fb524286b5e85373ad9c1540/users/731b1d8316654551a9d9833dd4af0ef7/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:23.918543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:23.921116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:23.994827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] Invalidating the token cache because role 53a32017a7564ba6a87cf351e4337a52 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:23.995243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.001407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-30cce31d-94df-45c6-9d8e-fb185d27e3b7 tempest-ApplicationCredentialsV3AdminTest-502293461 tempest-ApplicationCredentialsV3AdminTest-502293461-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.010205 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3136/6257] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:23 2022] DELETE /identity/v3/roles/53a32017a7564ba6a87cf351e4337a52 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:24.014822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.015155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.016015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.048221 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:24.121990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd274f19-ec4c-4319-86c5-60bfe71e2ba9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:24.136339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] MFA Rules not processed for user `731b1d8316654551a9d9833dd4af0ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:24.137690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.181989 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:24.265272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:24.266253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.266253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.266607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.267354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:24.269527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:24.324661 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3122/6258] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:23 2022] POST /identity/v3/users => generated 295 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:24.325964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:24.328755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.338897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3137/6259] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:24.338897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:24.338897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.352549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99478744-83ec-4367-92cd-20e7e7f3d730 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:24.367979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:24.368676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf83f4-5aa8-4016-8cd6-4cb7888aa56d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:24.369520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.370045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.370538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] PATH_INFO: `/v3/users/99bf21e520934c18aa9c72ff899f25e8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.374785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99bf21e520934c18aa9c72ff899f25e8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:24.377143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:24.382324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:24.383211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.383486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.383752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] PATH_INFO: `/v3/projects/d324c6ced15d4f348d8f8cdff37ad073` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.385063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d324c6ced15d4f348d8f8cdff37ad073)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:24.386987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:24.458969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99bf21e520934c18aa9c72ff899f25e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.459718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99bf21e520934c18aa9c72ff899f25e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.472834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99bf21e520934c18aa9c72ff899f25e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.473572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99bf21e520934c18aa9c72ff899f25e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.502616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd324c6ced15d4f348d8f8cdff37ad073', 'request_id': 'req-b5a723b2-7237-4f6f-986c-572439aa2fa5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.510817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99bf21e520934c18aa9c72ff899f25e8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.522051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd324c6ced15d4f348d8f8cdff37ad073', 'request_id': 'req-b5a723b2-7237-4f6f-986c-572439aa2fa5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.535126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd324c6ced15d4f348d8f8cdff37ad073', 'request_id': 'req-b5a723b2-7237-4f6f-986c-572439aa2fa5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.552674 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3123/6260] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:24 2022] DELETE /identity/v3/users/99bf21e520934c18aa9c72ff899f25e8 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:24.554245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:24.559574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.561263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] The token cache is being invalidate because project d324c6ced15d4f348d8f8cdff37ad073 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:24.561931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.563328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:24.569893 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3138/6261] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:24 2022] DELETE /identity/v3/projects/d324c6ced15d4f348d8f8cdff37ad073 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:24.569893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:24.572566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.704502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852137a-1e6c-44fe-8f36-8515e84e0318 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:24.724894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a723b2-7237-4f6f-986c-572439aa2fa5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:24.725118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3347b5d8-02a6-4f5a-9966-c54afa195548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:24.725118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347b5d8-02a6-4f5a-9966-c54afa195548 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.725118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347b5d8-02a6-4f5a-9966-c54afa195548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.725118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3347b5d8-02a6-4f5a-9966-c54afa195548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.725524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347b5d8-02a6-4f5a-9966-c54afa195548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:24.725524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3347b5d8-02a6-4f5a-9966-c54afa195548 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:24.749512 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3124/6262] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:24.749512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870d522-f3b1-4d72-815b-685d42ad46d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.750013 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:24.750233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870d522-f3b1-4d72-815b-685d42ad46d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.750350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870d522-f3b1-4d72-815b-685d42ad46d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.793156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4870d522-f3b1-4d72-815b-685d42ad46d6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:24.794406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4870d522-f3b1-4d72-815b-685d42ad46d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.815268 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3125/6263] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:24.816637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.816928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.817206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.828811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:24.829490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.829800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.830055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.832009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.848094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:24.851022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.860810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3126/6264] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:24.862306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:24.869428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.891057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a1f93-a0ee-4cb2-855c-2100224aaa6f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:24.902921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:24.903819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:24.904330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:24.904701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:24.905539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:24.907756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:24.910504 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:24.934779 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3127/6265] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:24.936225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:24.938640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:24.947861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:24.966306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742f888-69e0-44d3-aacb-b986aa013cd6 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.000189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3139/6266] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:25.003526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.003817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.004096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.060023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add7414-2e61-4fa5-ae72-d2fac653aa2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.070094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.070894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.071258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.071606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.100762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:25.102689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.102840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:25.107521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.129759 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3140/6267] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:25.132011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.136671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3128/6268] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:25.139022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.158956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293cffc7-1072-42c6-b01d-0959a2607dec service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.183125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.185252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.186566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.187529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.189558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:25.190384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.194094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.203425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3883e-c123-454b-851b-3ea13cc1de89 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.219217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d6d133-01fb-4bc1-bfe5-286bfa27dc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.224017 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3129/6269] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:25.224243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6d133-01fb-4bc1-bfe5-286bfa27dc1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.224243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6d133-01fb-4bc1-bfe5-286bfa27dc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.224243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d6d133-01fb-4bc1-bfe5-286bfa27dc1a admin admin] PATH_INFO: `/v3/projects/9631c48ce91049f284999f4d48f1f05d/users/7403fcb0a88c49529c19cf01c96d7fd5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.225560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.251493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11679eb8-2051-42b3-8519-b04be0d485a0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.264061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.268839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.269300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.269716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.270573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.280698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6d133-01fb-4bc1-bfe5-286bfa27dc1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9631c48ce91049f284999f4d48f1f05d, user_id=7403fcb0a88c49529c19cf01c96d7fd5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.286898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d6d133-01fb-4bc1-bfe5-286bfa27dc1a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.289732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.331212 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3141/6270] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:25 2022] PUT /identity/v3/projects/9631c48ce91049f284999f4d48f1f05d/users/7403fcb0a88c49529c19cf01c96d7fd5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:25.334220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.334514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.337092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.389993 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3130/6271] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:25 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:25.393011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.394763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] MFA Rules not processed for user `7403fcb0a88c49529c19cf01c96d7fd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:25.396785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:25.518936 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3142/6272] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:25.555106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.619867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61000c-538d-4d56-83c7-4ba4f0ce81e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.638024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.638782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.639073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.644325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.645402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.651945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.682421 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:25.715850 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3131/6273] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:25 2022] POST /identity/v3/users => generated 289 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:25.720584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.738845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90548e8-69b0-4353-ad13-cdfe1f158484 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.751524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.752240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.752559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.753067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.753599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.755259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.777021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c367ab-72f5-47f0-baf6-58cdbba59e21 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.779507 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3132/6274] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:36:25.784289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.788216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.789120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.789547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.790749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.806669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c50de4-ef43-4a81-b9c1-c59160010c55 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.821692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.825921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.826449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719afcae-d541-48bc-8cb8-6f2eaa0c4443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.827370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719afcae-d541-48bc-8cb8-6f2eaa0c4443 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.827990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719afcae-d541-48bc-8cb8-6f2eaa0c4443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.830196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719afcae-d541-48bc-8cb8-6f2eaa0c4443 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.831187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719afcae-d541-48bc-8cb8-6f2eaa0c4443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.834353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719afcae-d541-48bc-8cb8-6f2eaa0c4443 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.856408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3143/6275] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:25.873501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:25.879727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3133/6276] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:36:25.891344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9d9cf0-756a-4b2f-b2ca-f019a53820f7 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:25.900549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:25.901479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.901762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.902242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] PATH_INFO: `/v3/projects/820292202b8c41a783ff0c573b85baa8/users/1eba94838ff445d7af0023e2444aad64/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:25.928637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=820292202b8c41a783ff0c573b85baa8, user_id=1eba94838ff445d7af0023e2444aad64, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:25.931722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:25.960469 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3144/6277] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:25 2022] PUT /identity/v3/projects/820292202b8c41a783ff0c573b85baa8/users/1eba94838ff445d7af0023e2444aad64/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:25.977410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:25.978840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:25.979254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:26.065579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:26.068155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:26.103430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] MFA Rules not processed for user `1eba94838ff445d7af0023e2444aad64`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:26.106879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:26.151725 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:26.256288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74767a2c-850d-4e98-8ee1-038f9056e641 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:26.281188 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3134/6278] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:26.282782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:26.284028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:26.284028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:26.284757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] PATH_INFO: `/v3/projects/0a32d0bfd7f142ddb8cedda792f043b0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:26.285071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:26.313652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc86fc4-3b34-4d32-bc85-2bcd92538314 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:26.315282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a32d0bfd7f142ddb8cedda792f043b0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:26.321933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:26.325733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:26.325992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:26.326497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:26.326873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:26.327887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:26.330334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:26.417609 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3135/6279] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:26 2022] POST /identity/v3/projects => generated 377 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:26.424138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:26.475071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a32d0bfd7f142ddb8cedda792f043b0', 'request_id': 'req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.499138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a32d0bfd7f142ddb8cedda792f043b0', 'request_id': 'req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.510544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a32d0bfd7f142ddb8cedda792f043b0', 'request_id': 'req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.533758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] The token cache is being invalidate because project 0a32d0bfd7f142ddb8cedda792f043b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:26.534480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.535566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.547918 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3145/6280] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:26 2022] DELETE /identity/v3/projects/0a32d0bfd7f142ddb8cedda792f043b0 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:26.550036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:26.551901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:26.601736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58d30a8-6785-405f-a793-21290738eaf0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:26.631079 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:26.675433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf6e3cb-4a8a-4f8c-939a-7ee097041efe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:26.686164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:26.689922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:26.690223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:26.690662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] PATH_INFO: `/v3/users/85d204cf5262424eb608799696a164e3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:26.693890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d204cf5262424eb608799696a164e3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:26.701673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:26.750448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:26.751452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:26.751936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:26.752511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:26.753481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:26.759513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:26.805256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3136/6281] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:26 2022] POST /identity/v3/users => generated 295 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:26.809884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:26.815069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:26.825290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d204cf5262424eb608799696a164e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.843048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96de7c-2524-4d51-bf38-dc58a00529f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:26.844916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d204cf5262424eb608799696a164e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.859045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:26.860426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:26.861096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:26.861786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:26.862818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:26.864976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:26.881887 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3137/6282] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:26.886980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:26.890016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d204cf5262424eb608799696a164e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.892140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d204cf5262424eb608799696a164e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.928797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04aba53-44d6-4b62-949a-b08ecb1ef9bc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:26.931407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d204cf5262424eb608799696a164e3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:26.954841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:26.956852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:26.962688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:26.962919 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3146/6283] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:26 2022] DELETE /identity/v3/users/85d204cf5262424eb608799696a164e3 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:26.964801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] PATH_INFO: `/v3/projects/e1e8ac2eae9c4384af43b1075f7e390a/users/8fffd3dc75af4cc19b8f1d27f3db87f4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:27.023276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e8ac2eae9c4384af43b1075f7e390a, user_id=8fffd3dc75af4cc19b8f1d27f3db87f4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:27.031557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:27.063626 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:27.081224 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3138/6284] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:26 2022] PUT /identity/v3/projects/e1e8ac2eae9c4384af43b1075f7e390a/users/8fffd3dc75af4cc19b8f1d27f3db87f4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:27.085517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:27.087022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:27.132324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:27.134207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:27.269695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623e6560-cbef-4ddb-80d3-4619e396af36 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:27.284272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:27.285018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:27.285350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:27.285793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:27.286553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:27.289659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:27.293352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45c0a97-ddbf-4258-8dfb-197bbb0c8b90 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:27.303306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:27.306914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:27.307273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:27.307553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] PATH_INFO: `/v3/users/10541155857b49f98bca2dfdea19c645` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:27.311460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10541155857b49f98bca2dfdea19c645)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:27.316107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:27.320749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3147/6285] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:27.325868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:27.345514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c1b7c-005d-41db-9484-8f5ca312d49b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:27.355263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915abc0-c7d8-492e-99c2-4eeeaf2d0db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:27.356539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915abc0-c7d8-492e-99c2-4eeeaf2d0db4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:27.356947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915abc0-c7d8-492e-99c2-4eeeaf2d0db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:27.358536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915abc0-c7d8-492e-99c2-4eeeaf2d0db4 admin admin] PATH_INFO: `/v3/projects/e1e8ac2eae9c4384af43b1075f7e390a/users/8fffd3dc75af4cc19b8f1d27f3db87f4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:27.363978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915abc0-c7d8-492e-99c2-4eeeaf2d0db4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1e8ac2eae9c4384af43b1075f7e390a, user_id=8fffd3dc75af4cc19b8f1d27f3db87f4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:27.367908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e915abc0-c7d8-492e-99c2-4eeeaf2d0db4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:27.395726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3148/6286] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:27 2022] PUT /identity/v3/projects/e1e8ac2eae9c4384af43b1075f7e390a/users/8fffd3dc75af4cc19b8f1d27f3db87f4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:27.408446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:27.408736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:27.409071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:27.449363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10541155857b49f98bca2dfdea19c645'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:27.450698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10541155857b49f98bca2dfdea19c645'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:27.487917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10541155857b49f98bca2dfdea19c645'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:27.495190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10541155857b49f98bca2dfdea19c645'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:27.525371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d349a98a-4e56-4b21-b258-ea0dd8ef2b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10541155857b49f98bca2dfdea19c645'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:27.535507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] MFA Rules not processed for user `8fffd3dc75af4cc19b8f1d27f3db87f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:27.536807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:27.588481 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3139/6287] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:27 2022] DELETE /identity/v3/users/10541155857b49f98bca2dfdea19c645 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:27.590399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:27.590794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:27.591197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:27.612822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:27.613771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:27.691699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3140/6288] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:27.708631 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:27.722675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:27.726859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:27.817916 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:27.821904 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3149/6289] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:27 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:27.826418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:27.898268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d0171-be71-4e07-92b4-1af77caf063b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:27.956299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66f4d4-e647-41c2-98db-7578318ee3d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:27.970609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:27.970786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:27.970997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:27.971228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:28.020289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:28.028596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:28.082479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3141/6290] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:28.150249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:28.151453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:28.151957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:28.153953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:28.155070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:28.163175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:28.222108 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3150/6291] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:27 2022] POST /identity/v3/projects => generated 334 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:28.226641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:28.257930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce5a11-8a42-4623-a0c9-44157856f8b2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:28.464387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:28.465091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:28.465415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:28.465697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:28.466401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:28.468590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:28.542694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:28.544400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3142/6292] 10.222.0.15 () {60 vars in 1151 bytes} [Tue Jul 19 11:36:28 2022] POST /identity/v3/projects => generated 333 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:28.577464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79acea6-e967-4bc7-aad7-c046beb67137 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:28.749977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:28.750684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:28.752222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:28.752558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:28.753453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:28.755475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:28.852590 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3151/6293] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:28 2022] POST /identity/v3/projects => generated 358 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:28.858716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:28.874517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877f3ecf-478c-4981-a1eb-622f8513687d tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:29.067989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:29.069151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:29.070584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:29.070584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:29.073403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:29.083675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:29.156984 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3143/6294] 10.222.0.15 () {58 vars in 1130 bytes} [Tue Jul 19 11:36:28 2022] GET /identity/v3/projects => generated 7579 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:29.165335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:29.191742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d082c4-a6d6-4486-9a03-6237d46306a1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:29.222007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:29.222705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:29.223214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:29.223506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:29.224297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:29.225162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:29.231885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:29.281607 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3152/6295] 10.222.0.15 () {58 vars in 1157 bytes} [Tue Jul 19 11:36:29 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:29.282699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:29.300203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a8a24-e87b-4099-90c8-f448a52b5189 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:29.311507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:29.312279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:29.312694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:29.312981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:29.314161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Adding query filter params (parent_id=9817c807f90e4813a6555d6a1cd8339f) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:29.314572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:29.317399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:29.367327 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3144/6296] 10.222.0.15 () {58 vars in 1215 bytes} [Tue Jul 19 11:36:29 2022] GET /identity/v3/projects?parent_id=9817c807f90e4813a6555d6a1cd8339f => generated 498 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:29.375187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:29.398829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f6c8c-4dc4-4dc8-ba4e-fb8491b8acb7 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:29.408195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:29.409241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:29.409720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:29.410073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects/29c36c2063a24d8da21a535ee5981d00` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:29.416164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:delete_project(project_id=29c36c2063a24d8da21a535ee5981d00)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:29.419932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:29.466590 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:29.554248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c36c2063a24d8da21a535ee5981d00', 'request_id': 'req-2b93b486-e067-4097-be9f-a25daa169073'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:29.567940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c36c2063a24d8da21a535ee5981d00', 'request_id': 'req-2b93b486-e067-4097-be9f-a25daa169073'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:29.576702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c36c2063a24d8da21a535ee5981d00', 'request_id': 'req-2b93b486-e067-4097-be9f-a25daa169073'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:29.590426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] The token cache is being invalidate because project 29c36c2063a24d8da21a535ee5981d00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:29.590793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:29.592255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:29.594411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3153/6297] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:29 2022] DELETE /identity/v3/projects/29c36c2063a24d8da21a535ee5981d00 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:29.598993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:29.600562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:29.650687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2659-b866-496f-aeaa-e08768ba144a tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:29.714031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:29.716285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:29.735703 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:29.821943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:29.822853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:29.823142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:29.823425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects/9817c807f90e4813a6555d6a1cd8339f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:29.826833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9817c807f90e4813a6555d6a1cd8339f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:29.828841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:29.891237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b93b486-e067-4097-be9f-a25daa169073 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:29.906935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:29.908021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:29.908253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:29.908564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] PATH_INFO: `/v3/projects/a350dcf9613a4671b54e6c7dea0013b5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:29.911691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a350dcf9613a4671b54e6c7dea0013b5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:29.915416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:29.963309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9817c807f90e4813a6555d6a1cd8339f', 'request_id': 'req-8cd1a706-a4db-4b33-9d4c-011b885bc61e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:29.985708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9817c807f90e4813a6555d6a1cd8339f', 'request_id': 'req-8cd1a706-a4db-4b33-9d4c-011b885bc61e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.003524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9817c807f90e4813a6555d6a1cd8339f', 'request_id': 'req-8cd1a706-a4db-4b33-9d4c-011b885bc61e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.043577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] The token cache is being invalidate because project 9817c807f90e4813a6555d6a1cd8339f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:30.045059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.047024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.049352 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3145/6298] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:29 2022] DELETE /identity/v3/projects/9817c807f90e4813a6555d6a1cd8339f => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:30.055557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:30.059509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.062693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a350dcf9613a4671b54e6c7dea0013b5', 'request_id': 'req-88b36d82-3481-4eca-9ea1-19b0e0f330f6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.078905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a350dcf9613a4671b54e6c7dea0013b5', 'request_id': 'req-88b36d82-3481-4eca-9ea1-19b0e0f330f6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.090867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a350dcf9613a4671b54e6c7dea0013b5', 'request_id': 'req-88b36d82-3481-4eca-9ea1-19b0e0f330f6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.117660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] The token cache is being invalidate because project a350dcf9613a4671b54e6c7dea0013b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:30.119443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.122077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.126797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3154/6299] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:29 2022] DELETE /identity/v3/projects/a350dcf9613a4671b54e6c7dea0013b5 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:30.127649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:30.129058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.214868 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:30.219288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1a706-a4db-4b33-9d4c-011b885bc61e tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:30.302311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b36d82-3481-4eca-9ea1-19b0e0f330f6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:30.315022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fffd3dc75af4cc19b8f1d27f3db87f4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e1e8ac2eae9c4384af43b1075f7e390a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:30.317012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.317546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.317836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] PATH_INFO: `/v3/projects/a03b1b2a0d9e486fb07e9ab932b0ffc3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.320264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a03b1b2a0d9e486fb07e9ab932b0ffc3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:30.323448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:30.371118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:30.371941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.372230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.372626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] PATH_INFO: `/v3/projects/9e4bac0846374c789e3eb1711191f496` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.376038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4bac0846374c789e3eb1711191f496)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:30.378091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:30.392116 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:30.430501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a03b1b2a0d9e486fb07e9ab932b0ffc3', 'request_id': 'req-94795715-d20e-4d34-87b4-b6ffb19a30c1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.450770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a03b1b2a0d9e486fb07e9ab932b0ffc3', 'request_id': 'req-94795715-d20e-4d34-87b4-b6ffb19a30c1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.474557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a03b1b2a0d9e486fb07e9ab932b0ffc3', 'request_id': 'req-94795715-d20e-4d34-87b4-b6ffb19a30c1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.510750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] The token cache is being invalidate because project a03b1b2a0d9e486fb07e9ab932b0ffc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:30.510750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.511591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4bac0846374c789e3eb1711191f496', 'request_id': 'req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.512822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-94795715-d20e-4d34-87b4-b6ffb19a30c1 tempest-ListProjectsTestJSON-1993531600 tempest-ListProjectsTestJSON-1993531600-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.515470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3155/6300] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:30 2022] DELETE /identity/v3/projects/a03b1b2a0d9e486fb07e9ab932b0ffc3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:30.520899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f2fb-a3c5-42c1-b8f7-48461c94dfa0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.521192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f2fb-a3c5-42c1-b8f7-48461c94dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.521481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282f2fb-a3c5-42c1-b8f7-48461c94dfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.525833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4bac0846374c789e3eb1711191f496', 'request_id': 'req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.533695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4bac0846374c789e3eb1711191f496', 'request_id': 'req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.543329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e282f2fb-a3c5-42c1-b8f7-48461c94dfa0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:30.545396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e282f2fb-a3c5-42c1-b8f7-48461c94dfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.570172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] The token cache is being invalidate because project 9e4bac0846374c789e3eb1711191f496 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:30.570656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.575649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.579275 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3146/6301] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:30 2022] DELETE /identity/v3/projects/9e4bac0846374c789e3eb1711191f496 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:30.584336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:30.586162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.667194 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3156/6302] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:30.669402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8824f-749a-47b9-8d76-2129458a6dac None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.669697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8824f-749a-47b9-8d76-2129458a6dac None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.669976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8824f-749a-47b9-8d76-2129458a6dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.712443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-58b8824f-749a-47b9-8d76-2129458a6dac None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:30.714006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-58b8824f-749a-47b9-8d76-2129458a6dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.755184 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3157/6303] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:30.755184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7102799-a591-4273-9246-79e0e239622a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.755184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7102799-a591-4273-9246-79e0e239622a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.755184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7102799-a591-4273-9246-79e0e239622a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.793771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101bb47-1cb4-4c63-9fa6-0ef8df08f2db admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:30.805671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:30.806977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.807430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.808043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] PATH_INFO: `/v3/users/1eba94838ff445d7af0023e2444aad64` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.812868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eba94838ff445d7af0023e2444aad64)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:30.816708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d7102799-a591-4273-9246-79e0e239622a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:30.817606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:30.818360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7102799-a591-4273-9246-79e0e239622a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.851278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3158/6304] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:30.852930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:30.853254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:30.853541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:30.904338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eba94838ff445d7af0023e2444aad64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.908509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eba94838ff445d7af0023e2444aad64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.916027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:30.923837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:30.939197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eba94838ff445d7af0023e2444aad64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.940087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eba94838ff445d7af0023e2444aad64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.981547 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3159/6305] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:30.985445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:30.986558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eba94838ff445d7af0023e2444aad64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:30.988866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:31.019351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5cee7-79c7-4389-995c-8dfd96d45d6a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.053882 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3147/6306] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:30 2022] DELETE /identity/v3/users/1eba94838ff445d7af0023e2444aad64 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:31.056254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.056797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.058088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.058375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.058650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.065441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:31.065766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.074689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ca2dfd-0859-4ed2-9ab8-4c2ec475bf09 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.122844 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3160/6307] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:31.126398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.126702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.126979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.130019 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:31.188968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:31.196669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:31.250531 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:31.253778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305fd9f-c682-4349-abdc-abb91f481170 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.267841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.270190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.270479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.270763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.271530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:31.273966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.275636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.307287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3148/6308] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:31.315575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.346995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca109b-ab62-4a37-be93-b77d46478e4e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.361138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.361824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.362125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.362400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3161/6309] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:31.363373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.365112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.365742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.367749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.393059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa5ee1-b5ef-405e-bc9c-9b6de49b93dc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.403988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.405684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.407061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.409472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.410256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.416694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.442530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3149/6310] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:31 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:31.443827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.448160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:31.493998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3162/6311] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:31 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:31.496648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.613173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a20cb2-9ae2-41f3-9fd2-c907d0c52000 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.661928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a4dd1-a5e3-4912-8908-87b98be56b69 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.669332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.670925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.671464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.671972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.672937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.675451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.708543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.709326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.710040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.710496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.725965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.727671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.743822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3150/6312] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:31.744402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3163/6313] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:31 2022] POST /identity/v3/users => generated 294 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:31.744963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.752779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.756853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9557e85-01ed-48ce-8cfa-f81d4ad2b924 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.765352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.766118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.766402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.766681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.767476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.770005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.775401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed46a1-928b-45bb-aec3-983d6fae2813 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.796745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.798075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.798601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.799105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.800088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.802159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.814126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3151/6314] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:31 2022] POST /identity/v3/users => generated 293 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:31.815719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.828857 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3164/6315] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:31.830840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30bcf01-700d-413c-859f-76c5a0cebabd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.833724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.837629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.838337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.838622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.838903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.839648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.841497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.860123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3152/6316] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:31.861249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.862041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02437bfe-5f18-4808-83f8-242e09ab051c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.876450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.877624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.878143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.878886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.879871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.881842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.885998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf750e61-e6d4-4c7f-bd14-6ff5fd269374 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.893996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.894714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.895559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.896391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.897893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.900799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.917248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3165/6317] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:31.922762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.923514 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3153/6318] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:31 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:31.924952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:31.938771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db14b414-0453-4585-af86-8f28b1e73777 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.943009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c455875-3d90-4b71-9268-2f8b091c47b9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:31.947531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755b6f5-114f-416a-b85f-a31e4aa985d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.948508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b6f5-114f-416a-b85f-a31e4aa985d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.948795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b6f5-114f-416a-b85f-a31e4aa985d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.949074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755b6f5-114f-416a-b85f-a31e4aa985d9 admin admin] PATH_INFO: `/v3/projects/6bd126f24ef248edac495b3fb0c5eb37/users/287ef8d1f1c64e1fb247e5b6f0639153/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.952031 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:31.954827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050d2874-e2da-486c-8452-a97c5b32abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:31.956023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2874-e2da-486c-8452-a97c5b32abd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:31.956435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2874-e2da-486c-8452-a97c5b32abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:31.956810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050d2874-e2da-486c-8452-a97c5b32abd2 admin admin] PATH_INFO: `/v3/projects/b562b0aea2024ca68c57bddb2e058509/users/fba2199dd79d4191aee1a6e4e039ca01/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:31.982769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755b6f5-114f-416a-b85f-a31e4aa985d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd126f24ef248edac495b3fb0c5eb37, user_id=287ef8d1f1c64e1fb247e5b6f0639153, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.987521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755b6f5-114f-416a-b85f-a31e4aa985d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:31.989917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d2874-e2da-486c-8452-a97c5b32abd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b562b0aea2024ca68c57bddb2e058509, user_id=fba2199dd79d4191aee1a6e4e039ca01, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:31.993012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050d2874-e2da-486c-8452-a97c5b32abd2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:32.021718 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3166/6319] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:31 2022] PUT /identity/v3/projects/b562b0aea2024ca68c57bddb2e058509/users/fba2199dd79d4191aee1a6e4e039ca01/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:32.033002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3154/6320] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:31 2022] PUT /identity/v3/projects/6bd126f24ef248edac495b3fb0c5eb37/users/287ef8d1f1c64e1fb247e5b6f0639153/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:32.033261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.033565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.034334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.038896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.040305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.041377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.088948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:32.096933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:32.097549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] MFA Rules not processed for user `fba2199dd79d4191aee1a6e4e039ca01`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:32.099033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:32.212968 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:32.255016 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3155/6321] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:32.285192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:32.286660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:32.297022 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3167/6322] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:32.297664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:32.330834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf91f9b8-d578-48d5-927e-c3349cd311ca None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:32.339201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:32.339596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.339873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.340227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.341030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:32.343259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:32.422202 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3168/6323] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:32 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:32.427268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:32.451721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc092b65-0d82-48bb-99f2-d92173e061e3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:32.554965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4909449-7046-477f-a995-b3686e7820c1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:32.591486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:32.621437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.621729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.644838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.645541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:32.649110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:32.752954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:32.753555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.753842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.754195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.778765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:32.783620 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3169/6324] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:32 2022] POST /identity/v3/users => generated 302 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:32.787751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:32.803317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:32.811901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0e3f7-dd62-45d3-a074-cadcb4a6ec2a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:32.821700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:32.822712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.823207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.823490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.824684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:32.826876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:32.850181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3170/6325] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:32.853984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:32.861288 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3156/6326] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:36:32.883367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842e5e-a962-4945-987f-c1223825af68 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:32.910602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:32.912508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:32.912945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:32.913351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] PATH_INFO: `/v3/projects/f9ca8a1f4b5743afa9b1927e17564126/users/62b1996e08bd491fb9b00a1ebb2867e3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:32.954013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ca8a1f4b5743afa9b1927e17564126, user_id=62b1996e08bd491fb9b00a1ebb2867e3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:32.956946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:32.982395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3171/6327] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:32 2022] PUT /identity/v3/projects/f9ca8a1f4b5743afa9b1927e17564126/users/62b1996e08bd491fb9b00a1ebb2867e3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:32.984361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:32.998536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e008bc-06ce-4db5-8c03-182a001fe5f2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.111105 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:33.145744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c9480-a4aa-4d10-a3e6-1fdf97ce5fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.147039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c9480-a4aa-4d10-a3e6-1fdf97ce5fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.147431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c9480-a4aa-4d10-a3e6-1fdf97ce5fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.147857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c9480-a4aa-4d10-a3e6-1fdf97ce5fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.148796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c9480-a4aa-4d10-a3e6-1fdf97ce5fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.151143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c9480-a4aa-4d10-a3e6-1fdf97ce5fb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.172409 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3157/6328] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:32 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:33.173504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.185291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04714081-91fd-45a4-bcad-d7d71c2a9a00 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.190751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.191674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.191954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.192229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] PATH_INFO: `/v3/projects/f9ca8a1f4b5743afa9b1927e17564126/users/62b1996e08bd491fb9b00a1ebb2867e3/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.194432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ca8a1f4b5743afa9b1927e17564126, user_id=62b1996e08bd491fb9b00a1ebb2867e3, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.197172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.228715 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3172/6329] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:33 2022] PUT /identity/v3/projects/f9ca8a1f4b5743afa9b1927e17564126/users/62b1996e08bd491fb9b00a1ebb2867e3/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:33.240146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.240479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.240766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.308454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] MFA Rules not processed for user `62b1996e08bd491fb9b00a1ebb2867e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:33.309710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:33.404100 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3158/6330] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:33.409413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.424895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2486bb2a-91c7-4b50-905f-e477261e99dc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.436400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.439138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.439536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.441441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.442394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.450031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.479199 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3173/6331] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:33 2022] POST /identity/v3/domains => generated 276 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:33.483978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.498002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c269ddb1-4a99-47ad-a7c6-9267eef34140 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.601508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.602686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.603547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.603547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.604180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.609971 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:33.609971 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:33.609971 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:33.610916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.668949 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3159/6332] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:36:33 2022] PUT /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config => generated 138 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:33.673686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.692110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27f7a-731f-4581-968b-6520b6730300 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.702981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.704090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.704492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.704776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.716059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203, group=identity)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.717511 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:33.717511 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:33.717511 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:33.718581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.729269 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3174/6333] 10.222.0.15 () {58 vars in 1274 bytes} [Tue Jul 19 11:36:33 2022] GET /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config/identity => generated 45 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:33.733796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.766405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888a858-3fe1-4420-96bc-32c684df7dd0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.776081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.777530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.779400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.780031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.782395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.783782 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:33.783782 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:33.783782 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:33.786755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.805082 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3160/6334] 10.222.0.15 () {58 vars in 1295 bytes} [Tue Jul 19 11:36:33 2022] GET /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config/identity/driver => generated 31 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:33.807496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.822331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f93c4-c968-4085-866a-213a6ca677f4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.838403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.839293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.839585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.839870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config/ldap` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.841260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203, group=ldap)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.842902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.869355 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3175/6335] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:36:33 2022] GET /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config/ldap => generated 106 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:33.870944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.871697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.873790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:33.889597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19053775-7c1f-47d1-9616-e9efbc0c65cf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.904493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.905409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.905703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.905990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config/ldap/url` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.908215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203, group=ldap, option=url)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.913940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.931098 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3176/6336] 10.222.0.15 () {58 vars in 1274 bytes} [Tue Jul 19 11:36:33 2022] GET /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config/ldap/url => generated 46 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:33.935404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:33.960540 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:33.962293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1588144f-6ef6-49b6-b50f-cf552a5d1095 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:33.970631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:33.971649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:33.972055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:33.972229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config/ldap/user_tree_dn` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:33.981224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203, group=ldap, option=user_tree_dn)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:33.983049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:33.992098 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3177/6337] 10.222.0.15 () {58 vars in 1301 bytes} [Tue Jul 19 11:36:33 2022] GET /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config/ldap/user_tree_dn => generated 63 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:33.995981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:34.013476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a29d2-16dc-4dca-94c8-71f0cf3b4811 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:34.032002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:34.032861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:34.033155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:34.033439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203/config` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:34.034126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=477c9306883c4a7abcdc85caaf239203)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:34.035178 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:34.035178 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:34.035178 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:34.036768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:34.048907 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=7,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:34.057105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bd4274-074a-4682-9d5a-8bd9d72c4e6d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:34.063932 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3178/6338] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:33 2022] DELETE /identity/v3/domains/477c9306883c4a7abcdc85caaf239203/config => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:34.069702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:34.074169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:34.076105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:34.076429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:34.077976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:34.086441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:34.089773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94491f-0fe9-49b7-93fa-1062d7e8a834 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:34.098042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:34.099060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:34.099340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:34.099621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:34.104799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=477c9306883c4a7abcdc85caaf239203)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:34.106489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:34.158532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '477c9306883c4a7abcdc85caaf239203'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.159484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '477c9306883c4a7abcdc85caaf239203'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.221524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '477c9306883c4a7abcdc85caaf239203'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.227457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '477c9306883c4a7abcdc85caaf239203'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.233677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3179/6339] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:34 2022] PATCH /identity/v3/domains/477c9306883c4a7abcdc85caaf239203 => generated 277 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:34.235256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:34.236794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:34.267814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:34.270822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:34.300423 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3161/6340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:34.409041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9f267-6568-4639-a60c-6818df6cc01b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:34.440976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:34.442006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:34.442297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:34.442577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:34.471332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=477c9306883c4a7abcdc85caaf239203)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:34.473837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:34.565663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '477c9306883c4a7abcdc85caaf239203'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.582946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '477c9306883c4a7abcdc85caaf239203'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.717741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477c9306883c4a7abcdc85caaf239203', 'request_id': 'req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.740579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477c9306883c4a7abcdc85caaf239203', 'request_id': 'req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.757289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477c9306883c4a7abcdc85caaf239203', 'request_id': 'req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.791212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] The token cache is being invalidate because project 477c9306883c4a7abcdc85caaf239203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:34.791513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.792258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.815084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '477c9306883c4a7abcdc85caaf239203', 'request_id': 'req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.821190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '477c9306883c4a7abcdc85caaf239203', 'request_id': 'req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.821997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '477c9306883c4a7abcdc85caaf239203', 'request_id': 'req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:34.825914 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:UPDATE=1,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:34.843113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3180/6341] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:34 2022] DELETE /identity/v3/domains/477c9306883c4a7abcdc85caaf239203 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:34.848087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:34.884644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead5cf93-a422-4e27-a850-b5bf2f0e4389 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.017254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.022520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:35.026990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.027860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.028256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.028846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.029733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.035578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.061163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3162/6342] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:34 2022] POST /identity/v3/domains => generated 276 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:35.067340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.071071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:35.226073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ba27b-20f9-4c0a-808c-e6b5ef7fa818 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.292796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fcb2f-9093-4ea9-aafa-cdda4c8a1824 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.321169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.322182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.322550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.322917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.323753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.325605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.356815 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:35.366908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.367834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.368264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.368537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] PATH_INFO: `/v3/projects/820292202b8c41a783ff0c573b85baa8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.373403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] RBAC: Authorizing `identity:delete_project(project_id=820292202b8c41a783ff0c573b85baa8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.375484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.410114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3163/6343] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:36:35 2022] PUT /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config => generated 138 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:35.414513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.433072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed641c-0ca7-496d-be80-741a8c151dd5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.447735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.448930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.449305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.449657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.452815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.453941 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:35.453941 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:35.453941 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:35.459085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.472673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '820292202b8c41a783ff0c573b85baa8', 'request_id': 'req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.494190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '820292202b8c41a783ff0c573b85baa8', 'request_id': 'req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.518007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '820292202b8c41a783ff0c573b85baa8', 'request_id': 'req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.541704 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3164/6344] 10.222.0.15 () {60 vars in 1270 bytes} [Tue Jul 19 11:36:35 2022] PATCH /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config => generated 142 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:36:35.542931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.543683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] The token cache is being invalidate because project 820292202b8c41a783ff0c573b85baa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:35.544037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.545070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.548564 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3181/6345] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:35 2022] DELETE /identity/v3/projects/820292202b8c41a783ff0c573b85baa8 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:35.558099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.560850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:35.567258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a471b6-da1b-4bc0-99b1-79a91b5f9bb3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.702394 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:35.736252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.737844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.738705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.739404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.741524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.748566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.771087 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3165/6346] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:35 2022] GET /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config => generated 142 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:35.772308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.775558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:35.787478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9171f22-dbb7-40ee-9bfd-ee3dfb3c2545 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.801700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c4c81a-20b6-42fa-8fd2-b984c4005394 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.807348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.808275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.808696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.808979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] PATH_INFO: `/v3/users/8fffd3dc75af4cc19b8f1d27f3db87f4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.811305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fffd3dc75af4cc19b8f1d27f3db87f4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.813360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.816528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.817451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.817835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.818292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.819532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.821831 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:35.821831 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:35.821831 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:35.824920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.850402 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3166/6347] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:35 2022] DELETE /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:35.851655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.876926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd2b60-95cf-4ff5-983e-34b3f5c22891 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:35.893284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:35.894186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:35.896468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:35.896468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:35.897733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:35.904849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Could not find any options in domain configuration for domain b55fafd984b042c682ed3eeed2c2f0ee.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain b55fafd984b042c682ed3eeed2c2f0ee. Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:35.939073 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain b55fafd984b042c682ed3eeed2c2f0ee. Jul 19 11:36:35.940227 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:35.950734 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3167/6348] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:35 2022] GET /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config => generated 151 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:36:35.952280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:35.956311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fffd3dc75af4cc19b8f1d27f3db87f4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.976914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fffd3dc75af4cc19b8f1d27f3db87f4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:35.982250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9646aa3a-72e6-4d4b-8f16-5f9fe1e3a1dd tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:36.003306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fffd3dc75af4cc19b8f1d27f3db87f4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.004055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fffd3dc75af4cc19b8f1d27f3db87f4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.019068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:36.021433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fffd3dc75af4cc19b8f1d27f3db87f4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.024138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:36.024465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:36.025548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:36.029601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:36.035351 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3182/6349] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:35 2022] DELETE /identity/v3/users/8fffd3dc75af4cc19b8f1d27f3db87f4 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:36.035617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:36.074884 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3168/6350] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:35 2022] DELETE /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee/config => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:36.079187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:36.080702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:36.266832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba935b-4ff8-400d-a064-7f90bc97eaf1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:36.276136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:36.277542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:36.278157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:36.278673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:36.282253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:36.284130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:36.351005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.352103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.402828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.403512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.406340 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3183/6351] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:36 2022] PATCH /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee => generated 277 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:36:36.410394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:36.412570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:36.450843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61327452-79b9-4479-9d5c-9ea691156411 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:36.591954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:36.593406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:36.593982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:36.594428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:36.612434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b55fafd984b042c682ed3eeed2c2f0ee)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:36.615373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:36.631393 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:36.656558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.666966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.768433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee', 'request_id': 'req-da1634b5-db02-43ed-99d5-5ec0f2289375'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.785154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee', 'request_id': 'req-da1634b5-db02-43ed-99d5-5ec0f2289375'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.792929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee', 'request_id': 'req-da1634b5-db02-43ed-99d5-5ec0f2289375'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.817634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] The token cache is being invalidate because project b55fafd984b042c682ed3eeed2c2f0ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:36.817917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.818733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.834978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee', 'request_id': 'req-da1634b5-db02-43ed-99d5-5ec0f2289375'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.839342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee', 'request_id': 'req-da1634b5-db02-43ed-99d5-5ec0f2289375'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.850392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b55fafd984b042c682ed3eeed2c2f0ee', 'request_id': 'req-da1634b5-db02-43ed-99d5-5ec0f2289375'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:36.859327 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3169/6352] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:36 2022] DELETE /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:36.864231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:36.880812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802a60c-09b9-4a14-ac2f-22ef7625d88a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:36.912505 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:37.024270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.024999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.025295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.025578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.026357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.028091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.064930 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3184/6353] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:36 2022] POST /identity/v3/domains => generated 276 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:37.069198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.070746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:37.093255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1634b5-db02-43ed-99d5-5ec0f2289375 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.238219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.239107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.239589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.240037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.241043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.242887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.312041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3170/6354] 10.222.0.15 () {60 vars in 1268 bytes} [Tue Jul 19 11:36:37 2022] PUT /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config => generated 138 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:37.316211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.332160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b42c82-82b8-41ff-86dd-ef0113c45576 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.350031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.351072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.351365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.351698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.352646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e, group=identity)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.353695 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:37.353695 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:37.353695 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:37.355003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.418907 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3185/6355] 10.222.0.15 () {60 vars in 1296 bytes} [Tue Jul 19 11:36:37 2022] PATCH /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity => generated 176 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:37.422923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.440643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48317846-8e93-44a3-a94e-5a41dc4179ef tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.449571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.451493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:37.461274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.462222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.462512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.462795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.463568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.465306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.554518 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3171/6356] 10.222.0.15 () {60 vars in 1317 bytes} [Tue Jul 19 11:36:37 2022] PATCH /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity/driver => generated 176 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:37.558317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.570837 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:37.589683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ea308-c1e2-4788-8ae5-fa1c9d008e4f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.607165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.607815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.608281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.608692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.611508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.615088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.639135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b682c77-ab2b-4651-b82b-18ba4748c5c4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.649686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.651235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.651516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.651870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] PATH_INFO: `/v3/projects/e1e8ac2eae9c4384af43b1075f7e390a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.654206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1e8ac2eae9c4384af43b1075f7e390a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.656388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.677671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3172/6357] 10.222.0.15 () {58 vars in 1298 bytes} [Tue Jul 19 11:36:37 2022] DELETE /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity/driver => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:37.693215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.757725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281b2f-26db-4b5d-a32d-24dce1497b08 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.768514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:37.783681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.783681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.783681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity/driver` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:37.788275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e, group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:37.791988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Could not find option driver in group identity in domain configuration for domain 77eb348e09a54499989bf79d1c5a465e.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:37.860801 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:37.861960 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:37.870921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3173/6358] 10.222.0.15 () {58 vars in 1295 bytes} [Tue Jul 19 11:36:37 2022] GET /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity/driver => generated 171 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 11:36:37.871117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1e8ac2eae9c4384af43b1075f7e390a', 'request_id': 'req-cb337073-8747-4680-9911-e23f0555bb9e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:37.873470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:37.895454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1e8ac2eae9c4384af43b1075f7e390a', 'request_id': 'req-cb337073-8747-4680-9911-e23f0555bb9e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:37.924313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc950a-4948-4c57-bf0d-a51a79620cf5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:37.927570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1e8ac2eae9c4384af43b1075f7e390a', 'request_id': 'req-cb337073-8747-4680-9911-e23f0555bb9e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:37.972015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] The token cache is being invalidate because project e1e8ac2eae9c4384af43b1075f7e390a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:37.972321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:37.975381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cb337073-8747-4680-9911-e23f0555bb9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:37.979884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3186/6359] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:37 2022] DELETE /identity/v3/projects/e1e8ac2eae9c4384af43b1075f7e390a => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:37.985960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730727d0-674c-4703-b9e5-68599db7b872 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:37.986245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730727d0-674c-4703-b9e5-68599db7b872 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:37.986519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730727d0-674c-4703-b9e5-68599db7b872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.014632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-730727d0-674c-4703-b9e5-68599db7b872 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:38.017250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-730727d0-674c-4703-b9e5-68599db7b872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:38.025721 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:38.119033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.120137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.120504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.121729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.122498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e, group=identity)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.135044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.184154 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3187/6360] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:38.185844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.186468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.186754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.216435 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3174/6361] 10.222.0.15 () {58 vars in 1277 bytes} [Tue Jul 19 11:36:37 2022] DELETE /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:38.220293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.232471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:38.237551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:38.239035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:38.264050 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3188/6362] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:38.265153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.286657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bafb3b-7918-4066-8a7a-c205589843ba tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.288915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849454-7312-4662-a748-56e7a9b472e4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.303434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.304335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.304838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.305283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.306212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:38.306518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.308316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.317311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.318967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.319630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.320853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.326811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e, group=identity)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.329181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.344140 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3189/6363] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:38.345144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.366027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637ab13-8c39-4786-891f-99db0ba18455 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Could not find group identity in domain configuration for domain 77eb348e09a54499989bf79d1c5a465e.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:38.376121 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:38.377293 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:36:38.383473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.384188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.384501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.384779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.385175 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3175/6364] 10.222.0.15 () {58 vars in 1274 bytes} [Tue Jul 19 11:36:38 2022] GET /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config/identity => generated 154 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:36:38.385547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.386633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.387549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.406829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8d1527-ca83-4bc2-a7f4-fde26f75253f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.412311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.413200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.413542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.413826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e/config` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.416480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=77eb348e09a54499989bf79d1c5a465e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.420877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.440689 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3176/6365] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:38 2022] DELETE /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e/config => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:38.450238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.450835 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3190/6366] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:38 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:38.451994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.510362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b9c848-d651-48c7-9aa0-137348decb87 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.679331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.680137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.680452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.680736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.682140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=77eb348e09a54499989bf79d1c5a465e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.683914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.708642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9447bbf7-5fd8-4346-a328-445d02ffb305 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.727981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:38.728915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:38.729199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:38.729474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:38.735318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:38.739387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:38.747661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '77eb348e09a54499989bf79d1c5a465e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:38.748631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '77eb348e09a54499989bf79d1c5a465e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:38.794459 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3191/6367] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:38 2022] POST /identity/v3/users => generated 284 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:38.803730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.807969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:38.828818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '77eb348e09a54499989bf79d1c5a465e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:38.831098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '77eb348e09a54499989bf79d1c5a465e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:38.835074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3177/6368] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:38 2022] PATCH /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e => generated 277 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:38.839326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:38.854509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:38.857624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5432ac-669b-49a9-a33e-d3b42786f509 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:38.895624 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:38.989908 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:39.008806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.009915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.010364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.010802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.011733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.013704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.038333 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3192/6369] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:39.040801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.052916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:39.060119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355df4d3-78c2-457e-91f0-35188083828a tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.081085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.082076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.082558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.083006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.093904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30b02d-6a7e-4389-ba7b-3bb0fd177bc6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.103441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.108014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.108743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.109386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.113266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.114917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=77eb348e09a54499989bf79d1c5a465e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.116623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.119445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.143533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3193/6370] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:39.147689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.160397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0835a2-2504-4ee4-9907-8af59cd84297 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.167292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f5fcee-cda8-4562-9772-604a3840dc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.169126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fcee-cda8-4562-9772-604a3840dc8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.169838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fcee-cda8-4562-9772-604a3840dc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.170060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f5fcee-cda8-4562-9772-604a3840dc8f admin admin] PATH_INFO: `/v3/projects/6ec2016d6814471c9df027caf8b6b1f1/users/0e27b458e91e4368a24ce1a618e1f27c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.198792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '77eb348e09a54499989bf79d1c5a465e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.203962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fcee-cda8-4562-9772-604a3840dc8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ec2016d6814471c9df027caf8b6b1f1, user_id=0e27b458e91e4368a24ce1a618e1f27c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.210360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '77eb348e09a54499989bf79d1c5a465e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.210639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f5fcee-cda8-4562-9772-604a3840dc8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.248457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3194/6371] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:39 2022] PUT /identity/v3/projects/6ec2016d6814471c9df027caf8b6b1f1/users/0e27b458e91e4368a24ce1a618e1f27c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:39.250006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.251799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.252199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.327554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] MFA Rules not processed for user `0e27b458e91e4368a24ce1a618e1f27c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:39.328609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77eb348e09a54499989bf79d1c5a465e', 'request_id': 'req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.329177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:39.380707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77eb348e09a54499989bf79d1c5a465e', 'request_id': 'req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.405118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77eb348e09a54499989bf79d1c5a465e', 'request_id': 'req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.431984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] The token cache is being invalidate because project 77eb348e09a54499989bf79d1c5a465e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:39.432639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.434305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.451566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '77eb348e09a54499989bf79d1c5a465e', 'request_id': 'req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.453695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '77eb348e09a54499989bf79d1c5a465e', 'request_id': 'req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.461686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '77eb348e09a54499989bf79d1c5a465e', 'request_id': 'req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:39.476270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3178/6372] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:38 2022] DELETE /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:39.478026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.479700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:39.511897 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3195/6373] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:39.517033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.518490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:39.541461 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:39.573596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82d6b3-9fc8-4cf4-a8ed-448e2ea9b740 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.579179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.579842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.581246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.581544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.582226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.583295 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:39.583295 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:39.583295 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:39.584226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.592773 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3179/6374] 10.222.0.15 () {58 vars in 1172 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:39.593679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.605364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b3ae8-957a-417d-b5a0-89c13ba8e95d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.611579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.612404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.612839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.613132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.613801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.616488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.618591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3180/6375] 10.222.0.15 () {58 vars in 1199 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:39.623020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.635262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152dae7-ad37-4101-8c54-fb031fcbb5ae tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.640902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.641702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.641993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.642280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.642952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.644627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.649570 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3181/6376] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 11:36:39.650486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.662733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250da0c6-a5c1-4db2-99af-9c7869c342fb tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.667691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.668548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.669276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.669276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.670303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.671949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.677854 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3182/6377] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:39.679164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.690332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b910620-e8ca-449c-8b65-a74169f4f136 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.692123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e66309-aabc-4470-ad93-dac0eff82d40 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.697467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.697997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.698290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.698570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.699205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.699339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.700753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.701206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.701662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.701801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.703110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.706685 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3183/6378] 10.222.0.15 () {58 vars in 1187 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:39.707627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.709649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.724035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c2104a-e526-4522-8c7c-7483d3ad3814 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.729145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.729950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.730456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.730925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.731839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.734180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.735588 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3184/6379] 10.222.0.15 () {58 vars in 1199 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:39.741139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.753517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72452ca4-59ed-46bc-97bc-f7cb5501cd85 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.762651 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3196/6380] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:39 2022] POST /identity/v3/projects => generated 369 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:39.766580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.767585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.768801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.769090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.769374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:39.770049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:39.775152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:39.781022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3185/6381] 10.222.0.15 () {58 vars in 1202 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:39.787092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:39.823068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144cd573-d13c-4d3c-8daf-b6b0e261a2b7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.904436 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:39.985459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d81ee-cddb-4695-b076-ebf1ad4afb10 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:39.998410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:39.999223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:39.999385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:39.999665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.000795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.004431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.019083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.019901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.020193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.020657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.021346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.023028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.030831 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3186/6382] 10.222.0.15 () {58 vars in 1208 bytes} [Tue Jul 19 11:36:39 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.031834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.063624 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3197/6383] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:39 2022] POST /identity/v3/users => generated 291 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:40.067139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebdc310-5983-445c-af84-de2393fafee0 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.068635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.083125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.083938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.084229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.084550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.085230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.086903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.090373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f6665-7977-4ab0-8269-4a905851a274 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.091888 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3187/6384] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.096484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.107214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.107836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.108495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.108778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.109549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.111242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.121058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea43631-2288-4f60-af2f-b1116a62d304 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.135201 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3198/6385] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:40.136073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.136919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.137203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.137778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.138218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.140452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.145909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.147078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3188/6386] 10.222.0.15 () {58 vars in 1217 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.148021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.166808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddbb5b-9fdf-40f5-8bf7-6c71784ce281 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.171705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37250601-bf45-4974-b457-0bad6a33c89c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.188438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.189382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.189667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.189957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] PATH_INFO: `/v3/projects/6e78ce732e0b4d0eade66332145555e7/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.195611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.196637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.196925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.197206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.197889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.199577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.201036 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3189/6387] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.211922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.232786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899b9c21-1128-41be-8844-0cad3ce17e50 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.234379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e78ce732e0b4d0eade66332145555e7, user_id=9c482e9bafe946e0a873b5ec23efad44, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.238266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.261434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.262637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.263098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.263388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.264069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.265988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.275096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3190/6388] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.287197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.287761 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3199/6389] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:40 2022] PUT /identity/v3/projects/6e78ce732e0b4d0eade66332145555e7/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:40.291487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.316779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb5b6b-3807-49c1-9702-c6bcc9cd3a74 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.478033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8b38-803c-462b-ad16-b88c37cfc2ce admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.486601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.489521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.490582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.491041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.491393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.493082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.493774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.494029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.496055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.497173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.499314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.499743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.506207 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3191/6390] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.507411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.531274 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3200/6391] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:40.532838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c867c2-d7f1-40f6-b846-32b112322b9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.535184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.547761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.549063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.549552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.551487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.553782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.558360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.562007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3192/6392] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.565901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213afe0c-8477-41f0-a911-08a299a5c0c0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.567346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.586042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e47de06-0e1b-41ed-9568-988b44029fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.588220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47de06-0e1b-41ed-9568-988b44029fd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.589405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47de06-0e1b-41ed-9568-988b44029fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.590147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e47de06-0e1b-41ed-9568-988b44029fd2 admin admin] PATH_INFO: `/v3/projects/6e78ce732e0b4d0eade66332145555e7/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.594189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47de06-0e1b-41ed-9568-988b44029fd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e78ce732e0b4d0eade66332145555e7, user_id=9c482e9bafe946e0a873b5ec23efad44, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.597835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32b6d45-1505-4145-a599-44457dbf17fe tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.603637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e47de06-0e1b-41ed-9568-988b44029fd2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.611654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.612907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.615315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.616603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.618310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.621824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.624982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3193/6393] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.633404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.637103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3201/6394] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:40 2022] PUT /identity/v3/projects/6e78ce732e0b4d0eade66332145555e7/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:40.649461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.650008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.650774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.657962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f2925a-dcf1-498e-9d8a-3beb6e7a2ec4 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.714533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] MFA Rules not processed for user `9c482e9bafe946e0a873b5ec23efad44`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:40.716534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:40.761645 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:40.812626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.814015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.814923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.816039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.817130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.819099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.823337 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3194/6395] 10.222.0.15 () {58 vars in 1238 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.833514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.861348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237b941-da60-4137-9d80-dfe7e4278545 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.876705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.877964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.879942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.880977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.882545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.886042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.892956 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:40.897622 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3195/6396] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.898840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.923302 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3202/6397] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:36:40.926479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.929134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40235670-12c2-4b29-a52f-502671f936d3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.942444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.946117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.946548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.946941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:40.949539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:40.951686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:40.959534 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3196/6398] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:40.964145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:40.990940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87aa46-c0dd-44e0-80f0-a7f5bb5d00db tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:40.997335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:40.998560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:40.999097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:40.999487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.000292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.002671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.008830 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3197/6399] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:40 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 11:36:41.010513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.030525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acf36a-5fae-4513-a773-2ebc6b9ba7d7 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.040059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.041668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.042143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.042540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.043473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.045738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.051606 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3198/6400] 10.222.0.15 () {58 vars in 1268 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.053125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.069482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced333a-b0d3-45ec-8a23-098643a35f9e tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.082924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.083934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.085099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.086549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.087369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.093602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.101743 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3199/6401] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.117973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.134740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a13006-6f22-4d9b-bf42-3fb28d55485f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.149104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.151887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225b862-c03b-4164-aab7-653dadada6cc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.152541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.152754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.153033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.155328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.161519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.170233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.171883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.172291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.172761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.175353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.177200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.186672 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3200/6402] 10.222.0.15 () {58 vars in 1256 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.191327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.215837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bd3db8-a99d-408d-8a51-5ff9c9c0734c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.226395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.227462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.228954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.229359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.230165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.236744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.236895 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3203/6403] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:40 2022] POST /identity/v3/projects => generated 369 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:41.239262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.243415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3201/6404] 10.222.0.15 () {58 vars in 1247 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.244519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.274630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061f625-f0ab-4ec4-b808-b37ea3135b26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.382708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e75be6-a96d-4695-adaa-c15b7458168d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.388998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.389712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.389997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.390277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.397679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.399326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.434889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.438080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.438631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.439035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.442230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.444182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.451438 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3202/6405] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.452065 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3204/6406] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:41 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:41.453653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.454202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.477102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def15c3-36e4-48ab-9ac4-8609f440bf56 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.484596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.486827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.487233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.487628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.489297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.491546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.497808 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3203/6407] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.498945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.500038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bbe2f-1340-4831-a17d-6cd42491c7a8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.530615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a597138-dca9-42e6-82f4-ca86ff2c8eaa tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.537701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.538655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.539214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.539391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.539593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.540109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.541395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.543606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.544516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.544899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.547202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.550001 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3204/6408] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.552382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.553669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.573808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5e642-f0fb-4500-9076-df30c22ec550 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.585034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3205/6409] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:41.586202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.586683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.587988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.588372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.588862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.589618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.592925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.599872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3205/6410] 10.222.0.15 () {58 vars in 1289 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.601030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.612837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c9992-9aa4-4cdf-8303-e5eb882a96bf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.630653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c9159-ad6c-4b7d-b995-7e1ff6e83580 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.634788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.635372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.638166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.639395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.639712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.645607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.646974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.647291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.647579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.648452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.649428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.650596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.658182 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3206/6411] 10.222.0.15 () {58 vars in 1256 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.659886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.691751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3206/6412] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:41.700945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.713574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad65b73-3d15-4fd2-af32-68fe61c6fa9c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.740984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.746170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.748301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.756538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.759179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.783844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea42ef-fa99-437b-8475-f53146c3b747 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.785268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.799651 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3207/6413] 10.222.0.15 () {58 vars in 1265 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.806679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.812013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c74974-9261-4c99-875a-ce0427094b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.815485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74974-9261-4c99-875a-ce0427094b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.815485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74974-9261-4c99-875a-ce0427094b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.815485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c74974-9261-4c99-875a-ce0427094b76 admin admin] PATH_INFO: `/v3/projects/7fb917d611324544b6ca63059443b422/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.846866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88888d59-a8a0-4f5f-b4f7-ef571542e537 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.878083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:41.878971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.879262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.879543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:41.880220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.881898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.887811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c74974-9261-4c99-875a-ce0427094b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb917d611324544b6ca63059443b422, user_id=056cdd7f8fea43608dcf52b5a5e468c8, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:41.897343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c74974-9261-4c99-875a-ce0427094b76 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:41.899174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3208/6414] 10.222.0.15 () {58 vars in 1307 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:41.900382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:41.949961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379363ce-6043-4ad7-9401-733e9270ddf3 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:41.968496 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3207/6415] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:41 2022] PUT /identity/v3/projects/7fb917d611324544b6ca63059443b422/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:41.973363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:41.974893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:41.976077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.064528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] MFA Rules not processed for user `056cdd7f8fea43608dcf52b5a5e468c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:42.066484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:42.109537 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:42.170072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.175167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.176177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.179193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.181487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.184103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.194121 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3209/6416] 10.222.0.15 () {58 vars in 1289 bytes} [Tue Jul 19 11:36:41 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.195354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.245124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0f3ee1-1fc2-410b-9cf4-1e03edb55e80 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.267171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.269341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.270992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.276829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.277894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.281264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.287985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3210/6417] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.294162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.343845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4d0de7-4917-44ab-a30e-41e5184c358f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.351531 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3208/6418] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:42.357835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.377281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.383278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.389320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.389796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.390636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.392622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.402012 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3211/6419] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.403173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.431477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dc95d-dbb3-4e42-9db3-dbb0cb9a9d49 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.447791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.449658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.451352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.451758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.452599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.455810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.460933 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3212/6420] 10.222.0.15 () {58 vars in 1241 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.462044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.493499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacd3125-a875-4d6f-92d3-25850f7e3527 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.536981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.536981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.536981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.537388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.539387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.548977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.565396 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3213/6421] 10.222.0.15 () {58 vars in 1244 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.579077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.627276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0908f648-6916-47d9-ab18-3797b1d91e0b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.631964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b720a4d9-1264-494b-aaa8-9b7e96ae9a5f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.666101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.667420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.668377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.668847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.669248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.669634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.670021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.670826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.671221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.672112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.673925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.676561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.686682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3214/6422] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.696047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.744734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3209/6423] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:42 2022] POST /identity/v3/domains => generated 277 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:42.749174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.752217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032dc8f4-695a-47a8-870b-47d905907b16 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.766813 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:42.952375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee697e4-4495-41fd-abc5-d104bcbf2b8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.959247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.959974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.960310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.961380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.964047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.964899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:42.966153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:42.966595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:42.967045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:42.967178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.967997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:42.970832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:42.972658 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3215/6424] 10.222.0.15 () {58 vars in 1253 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:42.976571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:42.996637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b80d3b-4188-45c2-8c39-df1e6671773c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:42.999726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3210/6425] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:36:42 2022] POST /identity/v3/roles => generated 240 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:43.000800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.022408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a58785f-911f-46f6-add2-1e4609b0d1e3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.023978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.025147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.025589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.026030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.026851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.028743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.032863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3216/6426] 10.222.0.15 () {58 vars in 1256 bytes} [Tue Jul 19 11:36:42 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.034032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.035096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.035521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.035924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/dc54db927c564c3c9fe764a7d6923c3d/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/c08eb5d9f59443ac87d38ae7eda0b3b6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.042731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.063880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20491396-8874-44a0-a4f6-6e064dacb552 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.077091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.078230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.082255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=dc54db927c564c3c9fe764a7d6923c3d, user_id=056cdd7f8fea43608dcf52b5a5e468c8, role_id=c08eb5d9f59443ac87d38ae7eda0b3b6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.083167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.083665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.084564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.085536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.089641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.106699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3211/6427] 10.222.0.15 () {60 vars in 1479 bytes} [Tue Jul 19 11:36:42 2022] PUT /identity/v3/domains/dc54db927c564c3c9fe764a7d6923c3d/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/c08eb5d9f59443ac87d38ae7eda0b3b6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:43.107639 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3217/6428] 10.222.0.15 () {58 vars in 1250 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.111530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.118379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.148945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cd3812-24a6-4207-937d-172b135ef683 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.202484 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:43.320447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e574fd-dbe3-4a60-95b7-6d59c7d68201 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.332538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.333444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.334397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.334809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.335197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.335992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.336849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.338655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.339111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.339495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.340452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.342263 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3218/6429] 10.222.0.15 () {58 vars in 1256 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.343711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.347501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.367252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2581233c-793c-4117-baaa-40f994eec38c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.383195 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3212/6430] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:43 2022] POST /identity/v3/domains => generated 275 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:43.384322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.527869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a565d-cda9-4956-90c3-a1a5d51187a0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.571350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.573200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.573598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.573989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.576875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.576875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.593995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.594864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.595152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.595449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.600140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.606374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.622629 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3219/6431] 10.222.0.15 () {58 vars in 1292 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.625045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.651071 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3213/6432] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:36:43 2022] POST /identity/v3/roles => generated 239 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:43.655002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.679758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d252b-9f28-4b22-bfcc-e45ffa1b4ffc tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.686826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c1be-3bb4-4ebd-a5f1-2357c803fb7c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.697224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.698499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.698986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.701705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.702797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.702935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.703639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.703923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.704206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.704943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.706861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.707417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.709322 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3220/6433] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.715155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.746004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0540dd9-c043-447d-ae15-bd8acf76484c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.812214 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3214/6434] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:36:43 2022] POST /identity/v3/groups => generated 326 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:43.816925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.823976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.825571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.826647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.830289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.830587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.835578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.847447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3221/6435] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.851390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.882453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c7189-a74a-4ff5-bbd8-31997edd4548 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.895078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.897408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.897715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.898007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups/1cf8a6069e8149e09c4f6fae6acadf55/users/056cdd7f8fea43608dcf52b5a5e468c8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.909864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01bbe50-02c1-4771-b3e9-a7c6ffcf5bdf tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:43.919633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=1cf8a6069e8149e09c4f6fae6acadf55, user_id=056cdd7f8fea43608dcf52b5a5e468c8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.924449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.948400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:43.951010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:43.951010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:43.954747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:43.956545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:43.967646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:43.969209 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3222/6436] 10.222.0.15 () {58 vars in 1211 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:43.974348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:43.991224 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3215/6437] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:36:43 2022] PUT /identity/v3/groups/1cf8a6069e8149e09c4f6fae6acadf55/users/056cdd7f8fea43608dcf52b5a5e468c8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:43.996663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.018844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274b7d1f-5e47-4a5d-91ea-8cdfa0fc53a5 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.152029 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:44.199287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c04950-09a2-49bc-9d6d-bd2b3414e261 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.211581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.212479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.212768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.213048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/525083d808d042968ca7dae33a17b3a5/groups/1cf8a6069e8149e09c4f6fae6acadf55/roles/c9f73b15cb274d2bbc757791c043ca29` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.220465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=525083d808d042968ca7dae33a17b3a5, group_id=1cf8a6069e8149e09c4f6fae6acadf55, role_id=c9f73b15cb274d2bbc757791c043ca29)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.224577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.227075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.228771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.228771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.231661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.232697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.234134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.236259 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:44.243328 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3223/6438] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:36:43 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:44.248393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.271417 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3216/6439] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:43 2022] PUT /identity/v3/domains/525083d808d042968ca7dae33a17b3a5/groups/1cf8a6069e8149e09c4f6fae6acadf55/roles/c9f73b15cb274d2bbc757791c043ca29 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:44.275947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.286866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bb5e2-cd44-4cdd-b66f-87eb9876802c tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.473223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.474044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.474328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.474606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.475277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.477227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.484780 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3224/6440] 10.222.0.15 () {58 vars in 1214 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:44.496186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.496560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b09cb1a-0c40-4a53-81b6-c99780e4d914 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.511283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.512150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.512689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.513293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.514125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.515870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.522724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b5cb5-1ef4-4d7b-ad94-e473f785c332 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.537626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.538454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.538736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.539030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.539699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.541397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.560560 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3217/6441] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:44 2022] POST /identity/v3/domains => generated 277 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:44.562458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.564805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3225/6442] 10.222.0.15 () {58 vars in 1217 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:44.565799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.611509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62be98d8-f9e3-4f7f-8f5d-cf4df85bdcb2 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.791685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a931f0bd-f706-4a6b-b9a9-4b992728b089 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.817101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.818279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.818752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.819130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.819915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.821911 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:44.821911 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:36:44.821911 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:36:44.829137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.833994 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3218/6443] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:44.835520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.849759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.853730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.855095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.856259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.856857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a4513-3f5f-4196-b7a8-dd48721acb5d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.858063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.861730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.872051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.873214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.874295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.874740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.875562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.877404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.884990 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3219/6444] 10.222.0.15 () {58 vars in 1238 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:44.886153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.895407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3226/6445] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:36:44 2022] POST /identity/v3/roles => generated 239 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:44.899613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.904162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8438318-b51d-4848-a44c-72ad9d14827f tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.916997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.917840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.918132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.918411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.919146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.920845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.925030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3220/6446] 10.222.0.15 () {58 vars in 1259 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Jul 19 11:36:44.927184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dd1df3-e3f7-44ff-af93-ac9a8809c97e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.932554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.940983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.941951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.942237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.942519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/889c8807bb6e4f33a7edfe930f5b2738/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/58c62c5c42564133973ae3a6cbf366bd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.956143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f605c8b-5d55-46cd-9046-37a34ca5b569 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:44.966024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:44.966861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:44.967142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:44.967416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:44.968092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.969776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:44.973917 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3221/6447] 10.222.0.15 () {58 vars in 1262 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:44.974575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=889c8807bb6e4f33a7edfe930f5b2738, user_id=056cdd7f8fea43608dcf52b5a5e468c8, role_id=58c62c5c42564133973ae3a6cbf366bd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:44.975547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:44.977487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.007618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3560398-c524-4294-82a1-460e8ac3af92 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.018936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.019759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.020038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.020467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.021571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.023217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.026219 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3227/6448] 10.222.0.15 () {60 vars in 1479 bytes} [Tue Jul 19 11:36:44 2022] PUT /identity/v3/domains/889c8807bb6e4f33a7edfe930f5b2738/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/58c62c5c42564133973ae3a6cbf366bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:45.028292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.037226 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3222/6449] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:44 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:45.038252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.077433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548592cc-33f7-4e59-b735-574d57b08d26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.168363 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:45.204413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.205247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.205532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.205813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.206492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.212521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc766ff-7cd6-40d8-aaf9-f059ddbc6afa tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.216542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.218068 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3223/6450] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:45 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:45.222281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.225301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.226233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.226685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.227137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.228140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.233592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.247145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92df145-26fd-4c47-9e39-6bba43b4aa26 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.263827 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3228/6451] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:45 2022] POST /identity/v3/domains => generated 275 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:36:45.264047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.264047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.264266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.264496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.265121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.265826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.266746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.275062 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3224/6452] 10.222.0.15 () {58 vars in 1277 bytes} [Tue Jul 19 11:36:45 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Jul 19 11:36:45.276034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.312131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8a27ac-4c75-46d6-afa0-9018638b1757 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.327798 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:45.408411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab1272-9748-4fb0-a94a-c7075611c0c3 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.424078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.424911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.425272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.425624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.426453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.428326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.452071 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3229/6453] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:36:45 2022] POST /identity/v3/roles => generated 239 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:45.462954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.489544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9924c8-0d4d-4d06-b557-0249f45f283c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.496985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.497909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.498191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.498469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/77eb348e09a54499989bf79d1c5a465e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.508486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.509351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.509766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.510272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.511640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.512356 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:45.512356 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:45.512356 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:45.513958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.514770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Could not find domain: 77eb348e09a54499989bf79d1c5a465e.: keystone.exception.DomainNotFound: Could not find domain: 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:45.542799 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:45.544580 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:36:45.545957 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 77eb348e09a54499989bf79d1c5a465e. Jul 19 11:36:45.547544 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.548540 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3225/6454] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:45 2022] PATCH /identity/v3/domains/77eb348e09a54499989bf79d1c5a465e => generated 112 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:36:45.553414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.576956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89898026-c233-451e-971a-c95918726c2d tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.589391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.590404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.590655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.590936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.597490 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3230/6455] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:36:45 2022] POST /identity/v3/groups => generated 327 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:45.600607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.608755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Could not find domain: b55fafd984b042c682ed3eeed2c2f0ee.: keystone.exception.DomainNotFound: Could not find domain: b55fafd984b042c682ed3eeed2c2f0ee. Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b55fafd984b042c682ed3eeed2c2f0ee. Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:45.627548 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:45.629027 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:36:45.630492 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b55fafd984b042c682ed3eeed2c2f0ee. Jul 19 11:36:45.631993 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.631993 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3226/6456] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:45 2022] PATCH /identity/v3/domains/b55fafd984b042c682ed3eeed2c2f0ee => generated 112 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:36:45.637556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.639843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bcfeac-2cc5-4799-8184-4137aa573e28 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.658348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.660207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff9fd4-a81b-4c66-ac8b-2e5b14e14636 tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.663036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.665134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.665542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups/227f580a5033408ca450edcb6171db8a/users/056cdd7f8fea43608dcf52b5a5e468c8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.674980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62b1996e08bd491fb9b00a1ebb2867e3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f9ca8a1f4b5743afa9b1927e17564126', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.675886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.676229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.676556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] PATH_INFO: `/v3/domains/477c9306883c4a7abcdc85caaf239203` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.686430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=227f580a5033408ca450edcb6171db8a, user_id=056cdd7f8fea43608dcf52b5a5e468c8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.690700 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:36:45.690700 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(msg) Jul 19 11:36:45.690700 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:36:45.693544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:36:45.697426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Could not find domain: 477c9306883c4a7abcdc85caaf239203.: keystone.exception.DomainNotFound: Could not find domain: 477c9306883c4a7abcdc85caaf239203. Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 477c9306883c4a7abcdc85caaf239203. Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:36:45.712375 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:36:45.713849 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:36:45.717676 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 477c9306883c4a7abcdc85caaf239203. Jul 19 11:36:45.719235 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:36:45.719235 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3227/6457] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:45 2022] PATCH /identity/v3/domains/477c9306883c4a7abcdc85caaf239203 => generated 112 bytes in 77 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:36:45.736440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.741594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:45.796066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3231/6458] 10.222.0.15 () {60 vars in 1359 bytes} [Tue Jul 19 11:36:45 2022] PUT /identity/v3/groups/227f580a5033408ca450edcb6171db8a/users/056cdd7f8fea43608dcf52b5a5e468c8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:45.800033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:45.930826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3aac7-47ce-45d0-8f1f-9f0af9269c2b tempest-DomainConfigurationTestJSON-2133489443 tempest-DomainConfigurationTestJSON-2133489443-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.947200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c4d6c1-46c8-4a90-8a23-c82d3c68735a tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:45.971005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:45.971464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:45.971757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:45.972036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/c24157d5106b40e898d4fa19397c9c86/groups/227f580a5033408ca450edcb6171db8a/roles/0b5ce2ae722240efbfc8e61196e63b9d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:45.984456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=c24157d5106b40e898d4fa19397c9c86, group_id=227f580a5033408ca450edcb6171db8a, role_id=0b5ce2ae722240efbfc8e61196e63b9d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:45.987339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:46.034513 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3232/6459] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:45 2022] PUT /identity/v3/domains/c24157d5106b40e898d4fa19397c9c86/groups/227f580a5033408ca450edcb6171db8a/roles/0b5ce2ae722240efbfc8e61196e63b9d => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:46.063711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:46.184947 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:46.203244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:46.205813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:46.207183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:46.207957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] PATH_INFO: `/v3/users/fba2199dd79d4191aee1a6e4e039ca01` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:46.217084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fba2199dd79d4191aee1a6e4e039ca01)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:46.231601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:46.340713 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:46.356872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fba2199dd79d4191aee1a6e4e039ca01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:46.370555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fba2199dd79d4191aee1a6e4e039ca01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:46.399183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fba2199dd79d4191aee1a6e4e039ca01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:46.399865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fba2199dd79d4191aee1a6e4e039ca01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:46.425711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9ba46da4-23ad-4a24-9646-790e7283ee32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fba2199dd79d4191aee1a6e4e039ca01'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:46.436185 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3228/6460] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:45 2022] DELETE /identity/v3/users/fba2199dd79d4191aee1a6e4e039ca01 => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:46.438836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:46.439128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:46.439405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:46.474562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:46.475854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:46.632607 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3229/6461] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:46.646739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9a47f9-cf1b-4bbd-9d5a-4782a3d727ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:46.660469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:46.662468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:46.809273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '056cdd7f8fea43608dcf52b5a5e468c8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7fb917d611324544b6ca63059443b422', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:46.813756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:46.814809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:46.815167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] PATH_INFO: `/v3/auth/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:46.815887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:46.817384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:46.831738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6778743a-a81a-4771-81f7-0b3ef820059d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:46.858156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:46.858156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:46.858156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:46.858473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:46.877799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:46.879581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:46.910154 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3233/6462] 10.222.0.15 () {58 vars in 1142 bytes} [Tue Jul 19 11:36:46 2022] GET /identity/v3/auth/domains => generated 1172 bytes in 869 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:46.915171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:46.916713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3230/6463] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:36:46.920312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:46.973619 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:47.114947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca5406b-b2f3-4dd5-ab43-0e3981a27132 tempest-TokensV3TestJSON-2140343421 tempest-TokensV3TestJSON-2140343421-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:47.137696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:47.143593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:47.144141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:47.144629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/c24157d5106b40e898d4fa19397c9c86/groups/227f580a5033408ca450edcb6171db8a/roles/0b5ce2ae722240efbfc8e61196e63b9d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:47.153681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=c24157d5106b40e898d4fa19397c9c86, group_id=227f580a5033408ca450edcb6171db8a, role_id=0b5ce2ae722240efbfc8e61196e63b9d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:47.157908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:47.175893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role 0b5ce2ae722240efbfc8e61196e63b9d was removed from group 227f580a5033408ca450edcb6171db8a on domain c24157d5106b40e898d4fa19397c9c86. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:47.176671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:47.177701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:47.211442 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3234/6464] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:36:46 2022] DELETE /identity/v3/domains/c24157d5106b40e898d4fa19397c9c86/groups/227f580a5033408ca450edcb6171db8a/roles/0b5ce2ae722240efbfc8e61196e63b9d => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:47.216909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:47.232563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb587a65-254f-4baf-a37e-03346db28e7c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:47.425032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:47.426522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:47.427186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:47.427788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups/227f580a5033408ca450edcb6171db8a/users/056cdd7f8fea43608dcf52b5a5e468c8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:47.430208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=227f580a5033408ca450edcb6171db8a, user_id=056cdd7f8fea43608dcf52b5a5e468c8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:47.432941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:47.436520 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:47.451709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:47.488912 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3231/6465] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:36:47 2022] DELETE /identity/v3/groups/227f580a5033408ca450edcb6171db8a/users/056cdd7f8fea43608dcf52b5a5e468c8 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:47.492922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:47.495218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:47.523234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8f1498-dd71-4eed-8df1-26a8f59c1c72 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:47.657699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:47.658613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:47.658887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:47.660645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups/227f580a5033408ca450edcb6171db8a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:47.665119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_group(group_id=227f580a5033408ca450edcb6171db8a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:47.667776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:47.773180 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3235/6466] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:36:47 2022] DELETE /identity/v3/groups/227f580a5033408ca450edcb6171db8a => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:47.773666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:47.795881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee04eeef-1a30-4167-828a-21bfd38368e2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:47.946286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:47.948062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:47.948472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:47.948827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles/0b5ce2ae722240efbfc8e61196e63b9d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:47.951675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0b5ce2ae722240efbfc8e61196e63b9d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:47.955686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:48.024402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role 0b5ce2ae722240efbfc8e61196e63b9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:48.024868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.025693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.032317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3232/6467] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:47 2022] DELETE /identity/v3/roles/0b5ce2ae722240efbfc8e61196e63b9d => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:48.034975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:48.038725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:48.071594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc70640f-ef33-402a-a427-b55740b9ad99 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:48.217530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:48.218441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:48.218724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:48.219009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/c24157d5106b40e898d4fa19397c9c86` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:48.220959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c24157d5106b40e898d4fa19397c9c86)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:48.222628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:48.258876 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:48.275618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.277190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.331359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.332487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.348075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3236/6468] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:48 2022] PATCH /identity/v3/domains/c24157d5106b40e898d4fa19397c9c86 => generated 276 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:48.349405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:48.396611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48510963-e1e4-498d-a7c6-b60b5e83f9d2 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:48.536167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:48.537440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:48.537719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:48.537988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/c24157d5106b40e898d4fa19397c9c86` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:48.553947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c24157d5106b40e898d4fa19397c9c86)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:48.555956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:48.586741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.597496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.662624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:48.665881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:48.666340 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:48.750340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86', 'request_id': 'req-5bd0d004-67a9-4584-a429-cf8db338f5ae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.783692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86', 'request_id': 'req-5bd0d004-67a9-4584-a429-cf8db338f5ae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.821936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86', 'request_id': 'req-5bd0d004-67a9-4584-a429-cf8db338f5ae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.868484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] The token cache is being invalidate because project c24157d5106b40e898d4fa19397c9c86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:48.868785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.877713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.915227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86', 'request_id': 'req-5bd0d004-67a9-4584-a429-cf8db338f5ae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.915774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86', 'request_id': 'req-5bd0d004-67a9-4584-a429-cf8db338f5ae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.920821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c24157d5106b40e898d4fa19397c9c86', 'request_id': 'req-5bd0d004-67a9-4584-a429-cf8db338f5ae'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:48.945852 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3233/6469] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:48 2022] DELETE /identity/v3/domains/c24157d5106b40e898d4fa19397c9c86 => generated 0 bytes in 597 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:48.950406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:48.953732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:48.957716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21be2fa8-8cb1-4c62-83e2-0011bac7769e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:49.144686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:49.146481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:49.146771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:49.147485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] PATH_INFO: `/v3/projects/b562b0aea2024ca68c57bddb2e058509` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:49.151922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b562b0aea2024ca68c57bddb2e058509)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:49.157758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0d004-67a9-4584-a429-cf8db338f5ae tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:49.159036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:49.174120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:49.177354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:49.177949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:49.178559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/889c8807bb6e4f33a7edfe930f5b2738/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/58c62c5c42564133973ae3a6cbf366bd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:49.186558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=889c8807bb6e4f33a7edfe930f5b2738, user_id=056cdd7f8fea43608dcf52b5a5e468c8, role_id=58c62c5c42564133973ae3a6cbf366bd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:49.194203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:49.215315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role 58c62c5c42564133973ae3a6cbf366bd was removed from user 056cdd7f8fea43608dcf52b5a5e468c8 on domain 889c8807bb6e4f33a7edfe930f5b2738. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:49.215643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.217734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.274535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3234/6470] 10.222.0.15 () {58 vars in 1463 bytes} [Tue Jul 19 11:36:48 2022] DELETE /identity/v3/domains/889c8807bb6e4f33a7edfe930f5b2738/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/58c62c5c42564133973ae3a6cbf366bd => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:49.276093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:49.291194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:49.306764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b562b0aea2024ca68c57bddb2e058509', 'request_id': 'req-649556e7-c3bb-4e00-ba13-ab930a41f58f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.316125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b562b0aea2024ca68c57bddb2e058509', 'request_id': 'req-649556e7-c3bb-4e00-ba13-ab930a41f58f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.347478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b562b0aea2024ca68c57bddb2e058509', 'request_id': 'req-649556e7-c3bb-4e00-ba13-ab930a41f58f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.382681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] The token cache is being invalidate because project b562b0aea2024ca68c57bddb2e058509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:49.383045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.388473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.392495 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3237/6471] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:48 2022] DELETE /identity/v3/projects/b562b0aea2024ca68c57bddb2e058509 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:49.396980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:49.399787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:49.436734 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:49.514045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447416e1-6cc3-4fcf-8925-32a6adccb331 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:49.603032 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:49.610338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649556e7-c3bb-4e00-ba13-ab930a41f58f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:49.623127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:49.625086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:49.627197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:49.628134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] PATH_INFO: `/v3/users/62b1996e08bd491fb9b00a1ebb2867e3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:49.631131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62b1996e08bd491fb9b00a1ebb2867e3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:49.635317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:49.690862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:49.692905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:49.693194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:49.693483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles/58c62c5c42564133973ae3a6cbf366bd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:49.696575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_role(role_id=58c62c5c42564133973ae3a6cbf366bd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:49.708379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:49.756395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62b1996e08bd491fb9b00a1ebb2867e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.757698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62b1996e08bd491fb9b00a1ebb2867e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.773963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62b1996e08bd491fb9b00a1ebb2867e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.777707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62b1996e08bd491fb9b00a1ebb2867e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.802388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62b1996e08bd491fb9b00a1ebb2867e3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.808794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role 58c62c5c42564133973ae3a6cbf366bd has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:49.809796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.813100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:49.815565 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3235/6472] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:49 2022] DELETE /identity/v3/roles/58c62c5c42564133973ae3a6cbf366bd => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:49.824910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:49.827445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:49.835697 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3238/6473] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:49 2022] DELETE /identity/v3/users/62b1996e08bd491fb9b00a1ebb2867e3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:50.003232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18f5a-4e4c-4df3-b8fc-18ae3a842dba tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:50.122718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:50.124214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:50.124636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:50.125123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/889c8807bb6e4f33a7edfe930f5b2738` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:50.126942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=889c8807bb6e4f33a7edfe930f5b2738)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:50.129412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:50.210329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.211665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.338530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.340774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.352017 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3236/6474] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:49 2022] PATCH /identity/v3/domains/889c8807bb6e4f33a7edfe930f5b2738 => generated 278 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:50.352411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:50.355368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:50.414789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea3ebe-0c61-4c39-bdb2-1b9e9ed329b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:50.542923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:50.544617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:50.545181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:50.545928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/889c8807bb6e4f33a7edfe930f5b2738` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:50.589648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=889c8807bb6e4f33a7edfe930f5b2738)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:50.592448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:50.652783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.656841 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:50.672676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.813689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738', 'request_id': 'req-78ac478e-b202-4bc6-ad8d-00ee3779363c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.839266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738', 'request_id': 'req-78ac478e-b202-4bc6-ad8d-00ee3779363c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.848992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738', 'request_id': 'req-78ac478e-b202-4bc6-ad8d-00ee3779363c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.890784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] The token cache is being invalidate because project 889c8807bb6e4f33a7edfe930f5b2738 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:50.891142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.894376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.905112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738', 'request_id': 'req-78ac478e-b202-4bc6-ad8d-00ee3779363c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.906779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738', 'request_id': 'req-78ac478e-b202-4bc6-ad8d-00ee3779363c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.912106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '889c8807bb6e4f33a7edfe930f5b2738', 'request_id': 'req-78ac478e-b202-4bc6-ad8d-00ee3779363c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:50.921812 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3239/6475] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:50 2022] DELETE /identity/v3/domains/889c8807bb6e4f33a7edfe930f5b2738 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:50.927783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:50.929262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:50.947367 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:50.960532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e080d-b784-4113-99eb-067774f14895 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:50.981087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:50.982873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:51.134323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:51.135498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:51.135975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:51.136455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/525083d808d042968ca7dae33a17b3a5/groups/1cf8a6069e8149e09c4f6fae6acadf55/roles/c9f73b15cb274d2bbc757791c043ca29` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:51.154716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=525083d808d042968ca7dae33a17b3a5, group_id=1cf8a6069e8149e09c4f6fae6acadf55, role_id=c9f73b15cb274d2bbc757791c043ca29)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:51.163179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:51.187371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role c9f73b15cb274d2bbc757791c043ca29 was removed from group 1cf8a6069e8149e09c4f6fae6acadf55 on domain 525083d808d042968ca7dae33a17b3a5. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:51.187719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.189150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.228960 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3237/6476] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:36:50 2022] DELETE /identity/v3/domains/525083d808d042968ca7dae33a17b3a5/groups/1cf8a6069e8149e09c4f6fae6acadf55/roles/c9f73b15cb274d2bbc757791c043ca29 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:51.230166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:51.235777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:51.331253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ac478e-b202-4bc6-ad8d-00ee3779363c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:51.471006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3647e74-8ff6-4bd8-ac69-c41e1cf86217 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:51.540431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:51.541649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:51.542049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:51.542436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups/1cf8a6069e8149e09c4f6fae6acadf55/users/056cdd7f8fea43608dcf52b5a5e468c8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:51.562178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=1cf8a6069e8149e09c4f6fae6acadf55, user_id=056cdd7f8fea43608dcf52b5a5e468c8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:51.563242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:51.589386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.616692 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3238/6477] 10.222.0.15 () {58 vars in 1343 bytes} [Tue Jul 19 11:36:51 2022] DELETE /identity/v3/groups/1cf8a6069e8149e09c4f6fae6acadf55/users/056cdd7f8fea43608dcf52b5a5e468c8 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:51.620674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:51.621660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:51.624093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:51.624875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] PATH_INFO: `/v3/users/7e1f471a538c49a2ac44d9a7a0b59109` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:51.627310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f471a538c49a2ac44d9a7a0b59109)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:51.628520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:51.629894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:51.678718 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:51.754213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f471a538c49a2ac44d9a7a0b59109'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.757048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f471a538c49a2ac44d9a7a0b59109'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.780855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f471a538c49a2ac44d9a7a0b59109'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.782076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f471a538c49a2ac44d9a7a0b59109'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.813915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f471a538c49a2ac44d9a7a0b59109'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:51.932856 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3240/6478] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:50 2022] DELETE /identity/v3/users/7e1f471a538c49a2ac44d9a7a0b59109 => generated 0 bytes in 952 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:51.942601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d53aa-51bd-430a-8217-d6c5d7f89f89 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:51.945110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:51.948760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.051706 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:52.158746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12552b-3a22-4906-8f37-b4c8d4756671 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:52.170732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4de369-5fb5-4ccf-9e47-68cd0d5b3f8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:52.174103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de369-5fb5-4ccf-9e47-68cd0d5b3f8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.175428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:52.175725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de369-5fb5-4ccf-9e47-68cd0d5b3f8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.177864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4de369-5fb5-4ccf-9e47-68cd0d5b3f8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/groups/1cf8a6069e8149e09c4f6fae6acadf55` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.181416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.181703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.183448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] PATH_INFO: `/v3/projects/f9ca8a1f4b5743afa9b1927e17564126` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.184098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4de369-5fb5-4ccf-9e47-68cd0d5b3f8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_group(group_id=1cf8a6069e8149e09c4f6fae6acadf55)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:52.186298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ca8a1f4b5743afa9b1927e17564126)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:52.188558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4de369-5fb5-4ccf-9e47-68cd0d5b3f8b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:52.193995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:52.303137 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3239/6479] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:36:51 2022] DELETE /identity/v3/groups/1cf8a6069e8149e09c4f6fae6acadf55 => generated 0 bytes in 673 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:52.304746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.305149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.305541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.330303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ca8a1f4b5743afa9b1927e17564126', 'request_id': 'req-11a53028-33b5-410c-9d7a-1eb41fecdf40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.343955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ca8a1f4b5743afa9b1927e17564126', 'request_id': 'req-11a53028-33b5-410c-9d7a-1eb41fecdf40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.345264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:52.346623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.358678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ca8a1f4b5743afa9b1927e17564126', 'request_id': 'req-11a53028-33b5-410c-9d7a-1eb41fecdf40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.385380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] The token cache is being invalidate because project f9ca8a1f4b5743afa9b1927e17564126 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:52.386169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.387898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-11a53028-33b5-410c-9d7a-1eb41fecdf40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.390909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3241/6480] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:51 2022] DELETE /identity/v3/projects/f9ca8a1f4b5743afa9b1927e17564126 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:52.393783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fedf4-81a2-4d8c-b6d1-463641a3efa3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.394264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fedf4-81a2-4d8c-b6d1-463641a3efa3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.394847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fedf4-81a2-4d8c-b6d1-463641a3efa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.449463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d46fedf4-81a2-4d8c-b6d1-463641a3efa3 None None] MFA Rules not processed for user `287ef8d1f1c64e1fb247e5b6f0639153`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:52.451054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d46fedf4-81a2-4d8c-b6d1-463641a3efa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.470297 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:52.500662 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3240/6481] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:52.502165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:52.505564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.561465 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3242/6482] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:52.562492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.562784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.563512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.588041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:52.589465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.607860 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3243/6483] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:52.607860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:52.607860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.689553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359e42-2348-4384-9ff9-7e814fb0954c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:52.705413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:52.706444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.706750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863fc3ef-564a-4d12-8cd8-ab65be41c9af None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:52.706911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.707291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles/c9f73b15cb274d2bbc757791c043ca29` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.709703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c9f73b15cb274d2bbc757791c043ca29)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:52.711634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:52.714726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bab401-9309-47de-8c70-2aeed1709d89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:52.715468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab401-9309-47de-8c70-2aeed1709d89 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.715757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab401-9309-47de-8c70-2aeed1709d89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.716038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bab401-9309-47de-8c70-2aeed1709d89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.746524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bab401-9309-47de-8c70-2aeed1709d89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:52.748723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bab401-9309-47de-8c70-2aeed1709d89 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:52.773861 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:52.789590 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3244/6484] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:52.794512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:52.795912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:52.796214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:52.815599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role c9f73b15cb274d2bbc757791c043ca29 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:52.815999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.817116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:52.821048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3241/6485] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:52 2022] DELETE /identity/v3/roles/c9f73b15cb274d2bbc757791c043ca29 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:52.825038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:52.831988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:52.870002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:52.879182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:53.007991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f09ce5-ef33-43a1-96d0-e3e9f41c89c4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:53.025493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:53.025769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:53.025882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:53.026122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/525083d808d042968ca7dae33a17b3a5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:53.029384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=525083d808d042968ca7dae33a17b3a5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:53.034002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:53.105975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '525083d808d042968ca7dae33a17b3a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.106658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '525083d808d042968ca7dae33a17b3a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.119332 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3245/6486] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:53.122781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:53.126613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:53.149205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '525083d808d042968ca7dae33a17b3a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.149873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '525083d808d042968ca7dae33a17b3a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.153990 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3242/6487] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:52 2022] PATCH /identity/v3/domains/525083d808d042968ca7dae33a17b3a5 => generated 276 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:53.155233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:53.158090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:53.162137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360a2d3d-4bf8-4010-bff1-c115033ae8b0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:53.345375 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:53.349330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3a60f-c480-435a-864b-fed7a4b3cdbf tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:53.366821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:53.368773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:53.368773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:53.368773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:53.369837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:53.372002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:53.376007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:53.385651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:53.386607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:53.387261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:53.387462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] PATH_INFO: `/v3/users/27c1aba616c041d89a74864a697920aa` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:53.392558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=27c1aba616c041d89a74864a697920aa)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:53.402506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:53.410863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3243/6488] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:53.410863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:53.418069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:53.534999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27c1aba616c041d89a74864a697920aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.539131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27c1aba616c041d89a74864a697920aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.561195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27c1aba616c041d89a74864a697920aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.561915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27c1aba616c041d89a74864a697920aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.582126 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:53.584219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27c1aba616c041d89a74864a697920aa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.627012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449b552-8375-4f81-b6f7-78d85bb0d56c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:53.637464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3246/6489] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:53 2022] DELETE /identity/v3/users/27c1aba616c041d89a74864a697920aa => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:53.647969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:53.648634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:53.649219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:53.649650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:53.650035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/525083d808d042968ca7dae33a17b3a5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:53.656952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:53.686118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=525083d808d042968ca7dae33a17b3a5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:53.691657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:53.784272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '525083d808d042968ca7dae33a17b3a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:53.804963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '525083d808d042968ca7dae33a17b3a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.006886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7127b12b-39c3-4270-85c7-ae4690162fcc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:54.035208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f48f244-64a8-40df-b048-5f84a05af160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:54.036327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f244-64a8-40df-b048-5f84a05af160 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.036703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f244-64a8-40df-b048-5f84a05af160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.036999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f48f244-64a8-40df-b048-5f84a05af160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.038035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48f244-64a8-40df-b048-5f84a05af160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:54.040242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f48f244-64a8-40df-b048-5f84a05af160 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:54.072633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '525083d808d042968ca7dae33a17b3a5', 'request_id': 'req-ca1b74a7-09bb-45ce-99d9-f3bf77657091'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.089611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '525083d808d042968ca7dae33a17b3a5', 'request_id': 'req-ca1b74a7-09bb-45ce-99d9-f3bf77657091'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.101537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '525083d808d042968ca7dae33a17b3a5', 'request_id': 'req-ca1b74a7-09bb-45ce-99d9-f3bf77657091'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.116800 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3247/6490] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:53 2022] POST /identity/v3/projects => generated 365 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:54.118179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.118470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.118760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.135874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] The token cache is being invalidate because project 525083d808d042968ca7dae33a17b3a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:54.136171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.138379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.159963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:54.161766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.167972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '525083d808d042968ca7dae33a17b3a5', 'request_id': 'req-ca1b74a7-09bb-45ce-99d9-f3bf77657091'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.168208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '525083d808d042968ca7dae33a17b3a5', 'request_id': 'req-ca1b74a7-09bb-45ce-99d9-f3bf77657091'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.169871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '525083d808d042968ca7dae33a17b3a5', 'request_id': 'req-ca1b74a7-09bb-45ce-99d9-f3bf77657091'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.206391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3244/6491] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:53 2022] DELETE /identity/v3/domains/525083d808d042968ca7dae33a17b3a5 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:54.206391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:54.209341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.293349 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:54.317264 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3248/6492] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:54.318199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:54.320085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.353268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9d334-8492-4f53-a86c-a3f4856a8f1d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:54.360604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:54.361158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.361445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.361729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.362033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1b74a7-09bb-45ce-99d9-f3bf77657091 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:54.362805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:54.364963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:54.381012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:54.382292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.382581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.382860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] PATH_INFO: `/v3/projects/7d0dc7636df94bea8042325415db8ca0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.384536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d0dc7636df94bea8042325415db8ca0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:54.387443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:54.399159 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3249/6493] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:54 2022] POST /identity/v3/users => generated 283 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:54.400050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:54.414202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.457554 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:54.482425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d0dc7636df94bea8042325415db8ca0', 'request_id': 'req-1482cf25-8a29-4ba0-8d8b-02ddef539d22'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.498555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d0dc7636df94bea8042325415db8ca0', 'request_id': 'req-1482cf25-8a29-4ba0-8d8b-02ddef539d22'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.510808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d0dc7636df94bea8042325415db8ca0', 'request_id': 'req-1482cf25-8a29-4ba0-8d8b-02ddef539d22'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.529195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] The token cache is being invalidate because project 7d0dc7636df94bea8042325415db8ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:54.530626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.531818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.534520 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3245/6494] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:54 2022] DELETE /identity/v3/projects/7d0dc7636df94bea8042325415db8ca0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:54.536300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:54.539348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.563399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f189bf8-9546-408d-add4-fdbe01f71de4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:54.630572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482cf25-8a29-4ba0-8d8b-02ddef539d22 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:54.638100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:54.639685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.640169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.640642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.644811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.682775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:54.683794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.684083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.684388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/dc54db927c564c3c9fe764a7d6923c3d/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/c08eb5d9f59443ac87d38ae7eda0b3b6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.690869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=dc54db927c564c3c9fe764a7d6923c3d, user_id=056cdd7f8fea43608dcf52b5a5e468c8, role_id=c08eb5d9f59443ac87d38ae7eda0b3b6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:54.693985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:54.714446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role c08eb5d9f59443ac87d38ae7eda0b3b6 was removed from user 056cdd7f8fea43608dcf52b5a5e468c8 on domain dc54db927c564c3c9fe764a7d6923c3d. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:54.714824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.715619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:54.740217 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3250/6495] 10.222.0.15 () {58 vars in 1463 bytes} [Tue Jul 19 11:36:54 2022] DELETE /identity/v3/domains/dc54db927c564c3c9fe764a7d6923c3d/users/056cdd7f8fea43608dcf52b5a5e468c8/roles/c08eb5d9f59443ac87d38ae7eda0b3b6 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:54.740217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:54.743339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.798468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:54.802524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982e2b00-143e-49cc-8a1d-50babecf0622 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:54.828264 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3246/6496] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:54.831278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.831462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.831723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.876184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:54.878679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.900781 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3247/6497] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:54.912262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:54.914119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:54.921647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a0f5c-deb5-4cd5-9486-83fca9e3be05 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:54.934486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab55543-3ed2-4c91-9683-6eb1c7a15ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:54.936156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab55543-3ed2-4c91-9683-6eb1c7a15ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.936156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab55543-3ed2-4c91-9683-6eb1c7a15ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.936409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab55543-3ed2-4c91-9683-6eb1c7a15ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:54.938381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab55543-3ed2-4c91-9683-6eb1c7a15ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:54.944304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab55543-3ed2-4c91-9683-6eb1c7a15ddd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:54.981254 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3251/6498] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:54 2022] GET /identity/v3/roles => generated 1651 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:54.982823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:54.983123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:54.983373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.032797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:55.075639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:55.115390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3252/6499] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:55.120244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.129359 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:55.139923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b1926-4270-42d1-a458-c8060c0de1e1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.147195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.149029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.149492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.149949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.151416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.154011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.166160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06defbcd-5bd0-4b27-9d35-06a99cd7957c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.189233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.189233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.189233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.189752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles/c08eb5d9f59443ac87d38ae7eda0b3b6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.191417 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3253/6500] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:55 2022] GET /identity/v3/roles => generated 1651 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:55.192757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.192923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c08eb5d9f59443ac87d38ae7eda0b3b6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.199986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.207877 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:55.212157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d02a90-33c8-410e-9ee1-83405f7085a0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.228219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.229167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.229539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.230372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.233121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:36:55.233652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.235461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.262312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3254/6501] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:55.263831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.281171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb2152-0e00-4184-9b40-fa83b50b9db0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.288953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.291372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.292263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.292263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] PATH_INFO: `/v3/projects/a5ea7ac5827e49ca9d04ce863a67c4b3/users/42f4c669804c40f4874599c1209fe638/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.301040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role c08eb5d9f59443ac87d38ae7eda0b3b6 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:55.301608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:55.302573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:55.311563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3248/6502] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:54 2022] DELETE /identity/v3/roles/c08eb5d9f59443ac87d38ae7eda0b3b6 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:55.313041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.314971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:55.323267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5ea7ac5827e49ca9d04ce863a67c4b3, user_id=42f4c669804c40f4874599c1209fe638, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.327996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.363950 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3255/6503] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:55 2022] PUT /identity/v3/projects/a5ea7ac5827e49ca9d04ce863a67c4b3/users/42f4c669804c40f4874599c1209fe638/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:55.366339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.368566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:55.479014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238c97fd-7cab-44a3-9119-8c85a4561d4e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.510203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e5669-9d59-46cf-8177-fcf2edb26de1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.518623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.520508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.520802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.521084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/dc54db927c564c3c9fe764a7d6923c3d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.522624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=dc54db927c564c3c9fe764a7d6923c3d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.527410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.558284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:55.560087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:55.610316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:55.610950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a72ad612-8a99-45ae-9a14-883a63554b52 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:55.620651 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3256/6504] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:36:55 2022] PATCH /identity/v3/domains/dc54db927c564c3c9fe764a7d6923c3d => generated 278 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:55.625200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831010-9431-4349-991b-223069630021 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.625488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831010-9431-4349-991b-223069630021 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.625767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71831010-9431-4349-991b-223069630021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.648202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.648988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.649700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.649926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.652306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.654345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.721848 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3249/6505] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:55 2022] POST /identity/v3/projects => generated 381 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:55.723780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.729171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:55.735228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-71831010-9431-4349-991b-223069630021 None None] MFA Rules not processed for user `42f4c669804c40f4874599c1209fe638`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:55.739544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71831010-9431-4349-991b-223069630021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:55.843896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3257/6506] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:55.849855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831010-9431-4349-991b-223069630021 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.852184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-71831010-9431-4349-991b-223069630021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:55.869831 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:55.945004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71831010-9431-4349-991b-223069630021 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.946473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9a2c2-289d-4a87-8a8d-8cd415e7005b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:55.950022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.951340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.951631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.951912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.953110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:55.956266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:55.963539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:55.965036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:55.966934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:55.969840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/dc54db927c564c3c9fe764a7d6923c3d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:55.977849 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:55.990713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3258/6507] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:55 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:55.996700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:55.998721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:56.003321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=dc54db927c564c3c9fe764a7d6923c3d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.005019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.017944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ced6889-b8ef-47ac-83ce-5377ffbc74a0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.024824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.025521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.026812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.027502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.028419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.031404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.081444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.086578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.088066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3259/6508] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:55 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:56.089625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.189383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d', 'request_id': 'req-f24b5159-0ad1-47f6-9b15-2338562d4b86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.207565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d', 'request_id': 'req-f24b5159-0ad1-47f6-9b15-2338562d4b86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.230666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d', 'request_id': 'req-f24b5159-0ad1-47f6-9b15-2338562d4b86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.253510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] The token cache is being invalidate because project dc54db927c564c3c9fe764a7d6923c3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:56.253896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.254893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.257595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91264507-0855-4dfc-b641-7a52dc81ad93 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.275764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d', 'request_id': 'req-f24b5159-0ad1-47f6-9b15-2338562d4b86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.276562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d', 'request_id': 'req-f24b5159-0ad1-47f6-9b15-2338562d4b86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.278793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'dc54db927c564c3c9fe764a7d6923c3d', 'request_id': 'req-f24b5159-0ad1-47f6-9b15-2338562d4b86'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:56.297942 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3250/6509] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:55 2022] DELETE /identity/v3/domains/dc54db927c564c3c9fe764a7d6923c3d => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:56.298933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.304978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:56.360037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.360769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.361051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.361338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.362730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.364969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.377878 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3260/6510] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:56.379917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.386639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:56.428428 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:56.484629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24b5159-0ad1-47f6-9b15-2338562d4b86 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.495708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.496618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.496918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.497184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.499011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.500930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.520930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402a13cd-4af1-4d0b-97dc-89e772ac2cc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.528307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.529681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.530554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.531158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.532089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.541071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.548548 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3251/6511] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:56 2022] POST /identity/v3/users => generated 289 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:56.548548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.550344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:56.572898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3261/6512] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:56.573715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.587608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e9faa3-7a49-4cc5-9bd8-602de35ad85a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.593026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.593927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.594309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.594686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.595610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.597092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec85e79-acd5-4670-b319-b94fe0975948 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.597710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.611444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.614968 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3252/6513] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:56.615116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.615237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.615352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.615352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.616175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.619591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.637260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc09457-ecf0-4a8f-aebd-dcf629b7d9e5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.647202 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3262/6514] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:56.649680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.652506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.655562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.656036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.657366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/6ec2016d6814471c9df027caf8b6b1f1/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.663168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5362d637-ecfe-412a-8a69-fe289d70b590 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:56.665118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6ec2016d6814471c9df027caf8b6b1f1, user_id=9c482e9bafe946e0a873b5ec23efad44, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.675637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.698063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:56.700800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:56.702882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:56.704549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] PATH_INFO: `/v3/projects/2f6df448522a4d2d815db0a1e26bf65c/users/e5997ac4e85e46a980c29eaeb78f9dd6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:56.708301 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3253/6515] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:56 2022] PUT /identity/v3/projects/6ec2016d6814471c9df027caf8b6b1f1/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:56.709293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.724153 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:56.748536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f6df448522a4d2d815db0a1e26bf65c, user_id=e5997ac4e85e46a980c29eaeb78f9dd6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:56.751770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:56.824680 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3263/6516] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:56 2022] PUT /identity/v3/projects/2f6df448522a4d2d815db0a1e26bf65c/users/e5997ac4e85e46a980c29eaeb78f9dd6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:56.838172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:56.919833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de675aeb-fcab-4730-9c8e-39a3b9a2a0cb tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.030804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700fb8f-4380-4925-b12f-afb5cd1eb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.033783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fb8f-4380-4925-b12f-afb5cd1eb106 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.048676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fb8f-4380-4925-b12f-afb5cd1eb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.049897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700fb8f-4380-4925-b12f-afb5cd1eb106 admin admin] PATH_INFO: `/v3/projects/689021c7158a4aec8c7640e9be7f3000/users/f68cb4fd83a34f98a79acd6b5940b289/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.093823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700fb8f-4380-4925-b12f-afb5cd1eb106 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689021c7158a4aec8c7640e9be7f3000, user_id=f68cb4fd83a34f98a79acd6b5940b289, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.096673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700fb8f-4380-4925-b12f-afb5cd1eb106 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.099607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fbd6ea-1647-4f5e-83cf-8b205d4554b4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.126962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.127654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.127945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.128323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.128910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.130028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.136039 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3254/6517] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:56 2022] PUT /identity/v3/projects/689021c7158a4aec8c7640e9be7f3000/users/f68cb4fd83a34f98a79acd6b5940b289/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:57.137684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.138022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.138482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.215928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] MFA Rules not processed for user `e5997ac4e85e46a980c29eaeb78f9dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:57.219406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.230558 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3264/6518] 10.222.0.15 () {58 vars in 1145 bytes} [Tue Jul 19 11:36:56 2022] GET /identity/v3/auth/projects => generated 826 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:36:57.231535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.238440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.259514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936c557-a7cb-4b9c-b13b-69406d8fd148 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.319487 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:57.354278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.355301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.355627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.355950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] PATH_INFO: `/v3/projects/3878fcd68cd847528dff3508c261c723` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.357522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3878fcd68cd847528dff3508c261c723)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.359837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.386080 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3255/6519] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:57.387700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.418250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8f4cf-db3f-46fd-98ff-d6ea69591c7b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.440895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3878fcd68cd847528dff3508c261c723', 'request_id': 'req-b0b1da90-e366-4292-895d-f28531665ac3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.450157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3878fcd68cd847528dff3508c261c723', 'request_id': 'req-b0b1da90-e366-4292-895d-f28531665ac3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.460936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3878fcd68cd847528dff3508c261c723', 'request_id': 'req-b0b1da90-e366-4292-895d-f28531665ac3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.468090 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:57.486712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] The token cache is being invalidate because project 3878fcd68cd847528dff3508c261c723 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:57.487318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.488802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.491385 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3265/6520] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:57 2022] DELETE /identity/v3/projects/3878fcd68cd847528dff3508c261c723 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:57.492919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.495108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.554590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.555385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.555669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.556148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.557443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.561476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.574296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b1da90-e366-4292-895d-f28531665ac3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.579848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.580959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.581500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.581784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/6ec2016d6814471c9df027caf8b6b1f1/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.584802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6ec2016d6814471c9df027caf8b6b1f1, user_id=9c482e9bafe946e0a873b5ec23efad44, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.587755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3256/6521] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:36:57.588229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.589815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.596502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.599721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role c71870b3a21e455080504ab36dac896f was removed from user 9c482e9bafe946e0a873b5ec23efad44 on project 6ec2016d6814471c9df027caf8b6b1f1. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:57.600958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.603710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.638937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3266/6522] 10.222.0.15 () {58 vars in 1466 bytes} [Tue Jul 19 11:36:57 2022] DELETE /identity/v3/projects/6ec2016d6814471c9df027caf8b6b1f1/users/9c482e9bafe946e0a873b5ec23efad44/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:57.639872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.642303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.701596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4434-9c27-4048-99ef-f8986245348e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.743445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81b46f-b4c5-47c8-a359-b3a854b4a6fc tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:57.752235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.753642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.754194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.754883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] PATH_INFO: `/v3/users/731b1d8316654551a9d9833dd4af0ef7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.756806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=731b1d8316654551a9d9833dd4af0ef7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.760404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.772482 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:57.778466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:57.782734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:57.783311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:57.783830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:57.786807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.859929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '731b1d8316654551a9d9833dd4af0ef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.861946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '731b1d8316654551a9d9833dd4af0ef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.884489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '731b1d8316654551a9d9833dd4af0ef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.885509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '731b1d8316654551a9d9833dd4af0ef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.892287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:57.895325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:57.904957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '731b1d8316654551a9d9833dd4af0ef7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:57.920095 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3257/6523] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:36:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:36:57.926038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.929451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.948364 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3267/6524] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:36:57 2022] DELETE /identity/v3/users/731b1d8316654551a9d9833dd4af0ef7 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:57.949482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:57.951803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:57.959172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed31240-3680-4359-b1e4-6dc6ff3ecaaa service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.012803 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:58.060376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d005206-09a0-4104-9460-411c832c970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:58.061343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005206-09a0-4104-9460-411c832c970d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.061613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005206-09a0-4104-9460-411c832c970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.064322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d005206-09a0-4104-9460-411c832c970d admin admin] PATH_INFO: `/v3/projects/689021c7158a4aec8c7640e9be7f3000/users/f68cb4fd83a34f98a79acd6b5940b289/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.073571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d005206-09a0-4104-9460-411c832c970d admin admin] RBAC: Authorizing `identity:create_grant(project_id=689021c7158a4aec8c7640e9be7f3000, user_id=f68cb4fd83a34f98a79acd6b5940b289, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:58.085199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d005206-09a0-4104-9460-411c832c970d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:58.116058 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3258/6525] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:57 2022] PUT /identity/v3/projects/689021c7158a4aec8c7640e9be7f3000/users/f68cb4fd83a34f98a79acd6b5940b289/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:58.118449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.118751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.119033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.125712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1ea57-c807-4f32-b0d9-2095754b9641 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.158303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] MFA Rules not processed for user `f68cb4fd83a34f98a79acd6b5940b289`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:36:58.159807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:58.291983 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3259/6526] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:36:58.294209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:58.306517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83baa0-d1af-47ad-bc2b-61131188038c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.330008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:58.330953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.332610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.333358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.334543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:58.336636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:58.337400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:58.337704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.338089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.338468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.339771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:58.342978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:58.366742 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3260/6527] 10.222.0.15 () {60 vars in 1149 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/domains => generated 275 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:58.368089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:58.388434 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3268/6528] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:36:57 2022] POST /identity/v3/users => generated 323 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:58.393489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:58.431425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2edcb01-4da1-4e0a-9c31-e8ee337f8a48 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.483211 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:58.511277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cc352d-d052-4e2c-bd0d-288b80648f0f tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.525405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:58.526129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.526477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.526773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.528383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:58.534180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:58.574996 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3261/6529] 10.222.0.15 () {60 vars in 1149 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/domains => generated 276 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:58.579901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:58.623360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:58.623690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.623819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.623998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.630486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:58.637531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:58.664443 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:58.729574 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3269/6530] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/projects => generated 364 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:58.735114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:58.753584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27c606-74a8-472f-b64d-13864ff447b4 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.907447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:58.911444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:58.911881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:58.912269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:58.913182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:58.915757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:58.953660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3262/6531] 10.222.0.15 () {60 vars in 1149 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/domains => generated 277 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:58.962171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b14c68-1db1-4620-9a89-b1967d3e7808 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:58.967744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:59.106620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:59.111175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:59.112498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:59.112808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:59.114208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:59.125563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:59.139960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96b2478-781c-49d8-a0a9-fd643843d5af tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:59.157054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:59.157565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:59.157858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:59.158139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:59.158971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:59.164208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:59.189090 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3270/6532] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/projects => generated 361 bytes in 459 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:59.193927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:59.198196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3263/6533] 10.222.0.15 () {60 vars in 1149 bytes} [Tue Jul 19 11:36:58 2022] POST /identity/v3/domains => generated 280 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:59.202356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:59.294962 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:59.347116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d993bd-58a9-4e83-8820-66e123bb1795 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:59.349061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0fb84-7a1c-41b4-b9f2-67cafabe18f1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:59.358360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:59.359285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:59.359574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:59.359851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/c845b20c3ae14ccd8812a0633d1a4fce` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:59.377355 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:36:59.391614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c845b20c3ae14ccd8812a0633d1a4fce)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:59.393319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:59.450399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.455451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.486922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:59.487632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:59.487918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:59.488197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:59.489266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:59.493399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:59.525575 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3271/6534] 10.222.0.15 () {60 vars in 1142 bytes} [Tue Jul 19 11:36:59 2022] POST /identity/v3/roles => generated 238 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:36:59.531500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:59.566091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e5f7a1-f237-4d0e-94a7-903ad3dda61b tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:59.575693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce', 'request_id': 'req-3dd5dace-270c-4189-a69d-b6d3d4d787b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.597254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce', 'request_id': 'req-3dd5dace-270c-4189-a69d-b6d3d4d787b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.611001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce', 'request_id': 'req-3dd5dace-270c-4189-a69d-b6d3d4d787b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.636083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project c845b20c3ae14ccd8812a0633d1a4fce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:36:59.636875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.638177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.650403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce', 'request_id': 'req-3dd5dace-270c-4189-a69d-b6d3d4d787b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.651701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce', 'request_id': 'req-3dd5dace-270c-4189-a69d-b6d3d4d787b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.652753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c845b20c3ae14ccd8812a0633d1a4fce', 'request_id': 'req-3dd5dace-270c-4189-a69d-b6d3d4d787b6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:36:59.679722 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3264/6535] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:36:59 2022] DELETE /identity/v3/domains/c845b20c3ae14ccd8812a0633d1a4fce => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:36:59.686805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:59.689045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:59.738559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:36:59.740618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:36:59.745055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:36:59.745624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/09b9fda5f02c472aa8cf9179983a4b1a/users/0f414953041e42e69633063ff0e065a8/roles/7abdad6ec0e94dc684d771ec6b103ee7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:36:59.782518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(project_id=09b9fda5f02c472aa8cf9179983a4b1a, user_id=0f414953041e42e69633063ff0e065a8, role_id=7abdad6ec0e94dc684d771ec6b103ee7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:36:59.787805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:36:59.823095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3272/6536] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:36:59 2022] PUT /identity/v3/projects/09b9fda5f02c472aa8cf9179983a4b1a/users/0f414953041e42e69633063ff0e065a8/roles/7abdad6ec0e94dc684d771ec6b103ee7 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:36:59.826242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:36:59.830669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:36:59.876775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd5dace-270c-4189-a69d-b6d3d4d787b6 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:36:59.991515 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:00.003840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c85bcf-8234-4099-b4f6-df3c6a60282d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:00.016623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:00.017707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:00.019008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.020015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.020569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.021090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.021592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.022068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] PATH_INFO: `/v3/projects/0bd0d361fb524286b5e85373ad9c1540` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.023077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:00.025735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:00.026884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd0d361fb524286b5e85373ad9c1540)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:00.032281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:00.038282 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:00.062250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3265/6537] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:36:59 2022] POST /identity/v3/domains => generated 249 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:00.063918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:00.072486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.149524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66034308-b6a8-436d-85c9-e12bd50ee734 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:00.158729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd0d361fb524286b5e85373ad9c1540', 'request_id': 'req-a77f157d-c5b7-49b2-9914-7f56e2cfc188'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.179361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd0d361fb524286b5e85373ad9c1540', 'request_id': 'req-a77f157d-c5b7-49b2-9914-7f56e2cfc188'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.195346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd0d361fb524286b5e85373ad9c1540', 'request_id': 'req-a77f157d-c5b7-49b2-9914-7f56e2cfc188'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.251862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] The token cache is being invalidate because project 0bd0d361fb524286b5e85373ad9c1540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:00.255349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.257065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.261004 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3273/6538] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:36:59 2022] DELETE /identity/v3/projects/0bd0d361fb524286b5e85373ad9c1540 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:00.262191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:00.263737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.277281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5ba34b-1ede-492e-b4ed-55c0717c936e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:00.278279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba34b-1ede-492e-b4ed-55c0717c936e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.278567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba34b-1ede-492e-b4ed-55c0717c936e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.278898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5ba34b-1ede-492e-b4ed-55c0717c936e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/1a4b4a67dfb8456ebcc3bfe7633a3b6f/users/0f414953041e42e69633063ff0e065a8/roles/7abdad6ec0e94dc684d771ec6b103ee7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.297350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba34b-1ede-492e-b4ed-55c0717c936e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1a4b4a67dfb8456ebcc3bfe7633a3b6f, user_id=0f414953041e42e69633063ff0e065a8, role_id=7abdad6ec0e94dc684d771ec6b103ee7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:00.300182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5ba34b-1ede-492e-b4ed-55c0717c936e tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:00.360675 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3266/6539] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:00 2022] PUT /identity/v3/projects/1a4b4a67dfb8456ebcc3bfe7633a3b6f/users/0f414953041e42e69633063ff0e065a8/roles/7abdad6ec0e94dc684d771ec6b103ee7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:00.362599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05aef-5dfe-4d30-9fe1-07218b3f8ab8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.362895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05aef-5dfe-4d30-9fe1-07218b3f8ab8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.363170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c05aef-5dfe-4d30-9fe1-07218b3f8ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.422226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b6c05aef-5dfe-4d30-9fe1-07218b3f8ab8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:00.424248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b6c05aef-5dfe-4d30-9fe1-07218b3f8ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.475882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77f157d-c5b7-49b2-9914-7f56e2cfc188 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:00.612826 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3267/6540] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:00.612826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be87ff-ffa7-490a-89f8-32602d7c15df None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.612826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be87ff-ffa7-490a-89f8-32602d7c15df None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.612826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be87ff-ffa7-490a-89f8-32602d7c15df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.629367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:00.630598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.631374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.631879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/e2d25c58b09a4cc697be5f7ff31291f9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.651006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e2d25c58b09a4cc697be5f7ff31291f9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:00.654761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:00.689890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.691176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.716593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-84be87ff-ffa7-490a-89f8-32602d7c15df None None] MFA Rules not processed for user `0f414953041e42e69633063ff0e065a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:00.717727 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:00.717888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-84be87ff-ffa7-490a-89f8-32602d7c15df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.721757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3268/6541] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:00 2022] POST /identity/v3/auth/tokens => generated 335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:37:00.728957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.729543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.729809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.742575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.743925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0cfe95a-f9ca-423d-a6b6-1be540097858 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:00.749286 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3274/6542] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:00 2022] PATCH /identity/v3/domains/e2d25c58b09a4cc697be5f7ff31291f9 => generated 250 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:00.750974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:00.752031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:00.752459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:00.759002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.776292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] MFA Rules not processed for user `0f414953041e42e69633063ff0e065a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:00.778184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.790720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:00.791964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.820787 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:00.942660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3269/6543] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:00.945570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:00.947243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:00.956875 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3275/6544] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:00 2022] POST /identity/v3/auth/tokens => generated 3214 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 19 11:37:00.958192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:00.984870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0dee3f-79bd-4b3b-9a02-07a3d2ff4a3d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:00.997555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:00.998380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.000318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.000729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.004455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:01.004914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:01.007446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:01.035187 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3276/6545] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:01.037722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:01.043920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:01.136015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9894f-033d-45f1-86ef-36c59975f3fc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:01.153876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:01.155280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.155804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.156329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/e2d25c58b09a4cc697be5f7ff31291f9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.173282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e2d25c58b09a4cc697be5f7ff31291f9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:01.175560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:01.204098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.208242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.217252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b29ce40-60c8-4df5-9732-26dd41aa0a08 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:01.229192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:01.231276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.231744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.232704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.246146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:01.249681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:01.276233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9', 'request_id': 'req-a8fe6392-d4e4-42df-af85-2f9ea512e016'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.288336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3277/6546] 10.222.0.15 () {56 vars in 1307 bytes} [Tue Jul 19 11:37:01 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:01.288336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:01.309634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11fc20-967a-4b73-a27c-3e7d691fd497 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:01.320574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9', 'request_id': 'req-a8fe6392-d4e4-42df-af85-2f9ea512e016'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.343382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9', 'request_id': 'req-a8fe6392-d4e4-42df-af85-2f9ea512e016'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.378107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project e2d25c58b09a4cc697be5f7ff31291f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:01.378767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.379437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.420573 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:01.434039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9', 'request_id': 'req-a8fe6392-d4e4-42df-af85-2f9ea512e016'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.435643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9', 'request_id': 'req-a8fe6392-d4e4-42df-af85-2f9ea512e016'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.436264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8fe6392-d4e4-42df-af85-2f9ea512e016 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e2d25c58b09a4cc697be5f7ff31291f9', 'request_id': 'req-a8fe6392-d4e4-42df-af85-2f9ea512e016'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:01.455257 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3270/6547] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:00 2022] DELETE /identity/v3/domains/e2d25c58b09a4cc697be5f7ff31291f9 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:01.456828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.457306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.457664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.465675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:01.486272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] MFA Rules not processed for user `0f414953041e42e69633063ff0e065a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:01.488120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:01.494531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:01.495641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.496121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.497263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.497906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:01.499893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:01.564155 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:01.582275 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3278/6548] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:01 2022] POST /identity/v3/projects => generated 375 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:01.584872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:01.588832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:01.681461 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3271/6549] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:01 2022] POST /identity/v3/auth/tokens => generated 3213 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 19 11:37:01.682373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:01.687825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:01.738052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9921086-9cc4-4c0f-a25b-11a887abae8b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:01.823302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856dc3d3-0427-44e7-ba53-af25ac223530 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:01.836603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:01.837118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.837405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.837685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.838440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:01.842835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:01.892499 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3279/6550] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:01 2022] POST /identity/v3/domains => generated 279 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:01.900182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:01.910032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:01.962611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:01.963297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:01.963584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:01.963859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:01.964663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:01.967019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:02.085489 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3272/6551] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:01 2022] POST /identity/v3/users => generated 288 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:02.086260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:02.147849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579fd96f-a6a9-4604-b7f8-73014c8d3d29 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:02.152742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a70c6-dbbe-4309-a19e-5639d43a5be9 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:02.171355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:02.177713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:02.178410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:02.178869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/roles/7abdad6ec0e94dc684d771ec6b103ee7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:02.181054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_role(role_id=7abdad6ec0e94dc684d771ec6b103ee7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:02.185369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:02.280572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invalidating the token cache because role 7abdad6ec0e94dc684d771ec6b103ee7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:02.281314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.287872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.290484 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3280/6552] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:01 2022] DELETE /identity/v3/roles/7abdad6ec0e94dc684d771ec6b103ee7 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:02.291398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:02.295460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:02.339321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:02.342996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:02.343418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:02.343803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/3ced74ff3356495a8b28d20055c2f401` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:02.372968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3ced74ff3356495a8b28d20055c2f401)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:02.374939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:02.428420 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:02.444322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3ced74ff3356495a8b28d20055c2f401'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.445641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3ced74ff3356495a8b28d20055c2f401'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.448599 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:02.459779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1348901-be98-434b-986a-d2f037d3ad2d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:02.500798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3ced74ff3356495a8b28d20055c2f401'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.502436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3ced74ff3356495a8b28d20055c2f401'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.507375 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3273/6553] 10.222.0.15 () {60 vars in 1249 bytes} [Tue Jul 19 11:37:02 2022] PATCH /identity/v3/domains/3ced74ff3356495a8b28d20055c2f401 => generated 278 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:02.508957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:02.511116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:02.614048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:02.614623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:02.614900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:02.615177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:02.615915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:02.617582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:02.659996 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3281/6554] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:02.662521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:02.674050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:02.678779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a165b4-0cbd-427a-a4c9-5a2ab1112708 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:02.687451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:02.688591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:02.688883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:02.689164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/1a4b4a67dfb8456ebcc3bfe7633a3b6f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:02.694261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a4b4a67dfb8456ebcc3bfe7633a3b6f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:02.696768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:02.835991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a4b4a67dfb8456ebcc3bfe7633a3b6f', 'request_id': 'req-e790834a-b71d-4441-adfd-b0c8719686d0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.857526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a4b4a67dfb8456ebcc3bfe7633a3b6f', 'request_id': 'req-e790834a-b71d-4441-adfd-b0c8719686d0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.866445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9674c90-0214-4330-8ea1-cea81ab17ebf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:02.874175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a4b4a67dfb8456ebcc3bfe7633a3b6f', 'request_id': 'req-e790834a-b71d-4441-adfd-b0c8719686d0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.905265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] The token cache is being invalidate because project 1a4b4a67dfb8456ebcc3bfe7633a3b6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:02.905572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.906832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:02.913502 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3274/6555] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:02 2022] DELETE /identity/v3/projects/1a4b4a67dfb8456ebcc3bfe7633a3b6f => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:02.915192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:02.920750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.021852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.023210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.023687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.024134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/3ced74ff3356495a8b28d20055c2f401` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.064801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=3ced74ff3356495a8b28d20055c2f401)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.066823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.078196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3282/6556] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:37:02 2022] GET /identity/v3/domains/3ced74ff3356495a8b28d20055c2f401 => generated 278 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:03.079200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.081912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.106233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790834a-b71d-4441-adfd-b0c8719686d0 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.119228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.121360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.122072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.123216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.123689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.125413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.142025 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:03.144241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3275/6557] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:03.145384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.147937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.159812 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:UPDATE=1,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:03.167140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b73b17-72d3-4f55-9cbf-94dd5df81eed tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.170007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd0a997-5ff3-4391-af84-439bc07e2d0a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.173503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.174753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.175164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.175448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/1a4b4a67dfb8456ebcc3bfe7633a3b6f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.182225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.184076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.185197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.185506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/3ced74ff3356495a8b28d20055c2f401` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.185635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1a4b4a67dfb8456ebcc3bfe7633a3b6f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.187029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3ced74ff3356495a8b28d20055c2f401)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.187645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.189325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.235365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3ced74ff3356495a8b28d20055c2f401'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Could not find project: 1a4b4a67dfb8456ebcc3bfe7633a3b6f.: keystone.exception.ProjectNotFound: Could not find project: 1a4b4a67dfb8456ebcc3bfe7633a3b6f. Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 19 11:37:03.235810 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 1a4b4a67dfb8456ebcc3bfe7633a3b6f. Jul 19 11:37:03.236947 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:03.246284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3ced74ff3356495a8b28d20055c2f401'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.262415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3283/6558] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:03 2022] DELETE /identity/v3/projects/1a4b4a67dfb8456ebcc3bfe7633a3b6f => generated 113 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:03.262949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.299583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467faec7-fdfd-4225-90b8-2d6ddc0a347d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.306532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.307762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.308227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.308545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] PATH_INFO: `/v3/projects/3a8abf9e242641ef8d8b60237d3b4c50/users/2dcad547720e4fee9e052c97aa918a02/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.337791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ced74ff3356495a8b28d20055c2f401', 'request_id': 'req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.344625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8abf9e242641ef8d8b60237d3b4c50, user_id=2dcad547720e4fee9e052c97aa918a02, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.349441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ced74ff3356495a8b28d20055c2f401', 'request_id': 'req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.354488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.365122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ced74ff3356495a8b28d20055c2f401', 'request_id': 'req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.390950 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3284/6559] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:03 2022] PUT /identity/v3/projects/3a8abf9e242641ef8d8b60237d3b4c50/users/2dcad547720e4fee9e052c97aa918a02/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:03.390950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.394035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project 3ced74ff3356495a8b28d20055c2f401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:03.394628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.395668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.410377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3ced74ff3356495a8b28d20055c2f401', 'request_id': 'req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.411946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3ced74ff3356495a8b28d20055c2f401', 'request_id': 'req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.414113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3ced74ff3356495a8b28d20055c2f401', 'request_id': 'req-8d9fa8d6-0201-4e7f-8d26-8d942d787fba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.427103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3276/6560] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:03 2022] DELETE /identity/v3/domains/3ced74ff3356495a8b28d20055c2f401 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:03.428790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.429394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.429513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.463759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] MFA Rules not processed for user `2dcad547720e4fee9e052c97aa918a02`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:03.466771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.554085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526c099-c1c1-48f2-a4e8-a07d205eb52a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.577638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.577905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.578202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.578483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/projects/09b9fda5f02c472aa8cf9179983a4b1a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.582103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_project(project_id=09b9fda5f02c472aa8cf9179983a4b1a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.584803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.595020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3277/6561] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:03.600339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.601337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.642612 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:03.713138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09b9fda5f02c472aa8cf9179983a4b1a', 'request_id': 'req-04816d81-04f1-492b-9302-45caf18a0893'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.732515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09b9fda5f02c472aa8cf9179983a4b1a', 'request_id': 'req-04816d81-04f1-492b-9302-45caf18a0893'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.742157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fcc959-2fe7-488e-8a7a-ea2d89b51ff2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.743209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09b9fda5f02c472aa8cf9179983a4b1a', 'request_id': 'req-04816d81-04f1-492b-9302-45caf18a0893'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.778213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] The token cache is being invalidate because project 09b9fda5f02c472aa8cf9179983a4b1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:03.778514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.780802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:03.788959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3285/6562] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:03 2022] DELETE /identity/v3/projects/09b9fda5f02c472aa8cf9179983a4b1a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:03.789895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.791434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.847577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.848985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.849502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.850049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.852063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.854298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:03.875521 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3278/6563] 10.222.0.15 () {58 vars in 1127 bytes} [Tue Jul 19 11:37:03 2022] GET /identity/v3/domains => generated 1346 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:03.877187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:03.879710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:03.895265 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:03.935636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04816d81-04f1-492b-9302-45caf18a0893 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:03.945606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:03.946100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:03.946391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:03.946678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:03.947374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:03.949597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:04.000331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157e992d-c7de-4c66-ba0c-5e79636e78d0 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.007189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3286/6564] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:04.008052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.010587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.011685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.012228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.012566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/users/0f414953041e42e69633063ff0e065a8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.014211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.016242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorizing `identity:delete_user(user_id=0f414953041e42e69633063ff0e065a8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:04.019804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:04.125117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f414953041e42e69633063ff0e065a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.144223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f414953041e42e69633063ff0e065a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.156067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe09094-7658-4a09-a7ef-9acff072c506 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.171129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.172687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.172983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.173272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/3ced74ff3356495a8b28d20055c2f401` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.178148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f414953041e42e69633063ff0e065a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.179487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f414953041e42e69633063ff0e065a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.189639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:04.191173 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:04.200496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f414953041e42e69633063ff0e065a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find domain: 3ced74ff3356495a8b28d20055c2f401.: keystone.exception.DomainNotFound: Could not find domain: 3ced74ff3356495a8b28d20055c2f401. Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3ced74ff3356495a8b28d20055c2f401. Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:04.205876 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:04.207225 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3ced74ff3356495a8b28d20055c2f401. Jul 19 11:37:04.208417 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:04.220607 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3279/6565] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:03 2022] DELETE /identity/v3/users/0f414953041e42e69633063ff0e065a8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:04.221111 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3287/6566] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:04 2022] PATCH /identity/v3/domains/3ced74ff3356495a8b28d20055c2f401 => generated 112 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:04.224428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.227774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.230519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.234383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.286806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339d7e5-13ac-470a-8750-5b96bba0afa5 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.405896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.406590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.406868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.407151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.407996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:04.409605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:04.420746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1494940d-2ba4-4e1c-9d9d-4562bc5119b4 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.436743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.437455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.437816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.438137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.438734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:04.440790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:04.442718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3288/6567] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:04 2022] POST /identity/v3/domains => generated 275 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:04.447184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.449137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.493127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3280/6568] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:04 2022] POST /identity/v3/users => generated 294 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:04.495512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.499164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.532629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a00231-342c-4403-8c85-7cf78cad8c4a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.536171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388317ce-f74c-4d90-8939-56aed1af7686 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.551361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.552567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.553044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.553495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/c24157d5106b40e898d4fa19397c9c86` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.557072 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:04.564287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Could not find domain: c24157d5106b40e898d4fa19397c9c86.: keystone.exception.DomainNotFound: Could not find domain: c24157d5106b40e898d4fa19397c9c86. Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: c24157d5106b40e898d4fa19397c9c86. Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:04.581850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:04.583185 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: c24157d5106b40e898d4fa19397c9c86. Jul 19 11:37:04.584313 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:04.589428 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3289/6569] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:04 2022] PATCH /identity/v3/domains/c24157d5106b40e898d4fa19397c9c86 => generated 112 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:04.593420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.625495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.626402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.626683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.626961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] PATH_INFO: `/v3/users/287ef8d1f1c64e1fb247e5b6f0639153` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.629102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=287ef8d1f1c64e1fb247e5b6f0639153)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:04.631645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:04.704570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '287ef8d1f1c64e1fb247e5b6f0639153'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.724979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '287ef8d1f1c64e1fb247e5b6f0639153'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.773767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23dfc5-9f9a-435e-80ef-b50748198c5c tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:04.779078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '287ef8d1f1c64e1fb247e5b6f0639153'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.779979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '287ef8d1f1c64e1fb247e5b6f0639153'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.783000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:04.784167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:04.786124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:04.786425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:04.788406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:04.791419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:04.793761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '287ef8d1f1c64e1fb247e5b6f0639153'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:04.812181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3281/6570] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:04 2022] DELETE /identity/v3/users/287ef8d1f1c64e1fb247e5b6f0639153 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:04.813549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.817968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.833163 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:04.865785 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3290/6571] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:04 2022] POST /identity/v3/users => generated 348 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:04.866925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:04.871235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:04.911919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62209755-b069-4a57-a663-75d58793bb9c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.024967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c4533f-f475-4054-84b5-c3802a0bea9c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.037871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.040492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.041566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.043356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.044187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.046159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.047223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.047390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.047621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/889c8807bb6e4f33a7edfe930f5b2738` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.049201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.063502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:05.070211 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3282/6572] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:05.071489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Could not find domain: 889c8807bb6e4f33a7edfe930f5b2738.: keystone.exception.DomainNotFound: Could not find domain: 889c8807bb6e4f33a7edfe930f5b2738. Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 889c8807bb6e4f33a7edfe930f5b2738. Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:05.075311 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:05.076710 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 889c8807bb6e4f33a7edfe930f5b2738. Jul 19 11:37:05.077896 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:05.080400 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3291/6573] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:04 2022] PATCH /identity/v3/domains/889c8807bb6e4f33a7edfe930f5b2738 => generated 112 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:05.081035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.081934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:05.094517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669ad74-5c05-482a-bcaa-8c28324fb502 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.101948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.103039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.103321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.103597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] PATH_INFO: `/v3/projects/086e939158bd42b09e343feeade03e17/users/af1598b2551748cbb7cedbe1db897857/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.143661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=086e939158bd42b09e343feeade03e17, user_id=af1598b2551748cbb7cedbe1db897857, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.150299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.181807 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3292/6574] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:05 2022] PUT /identity/v3/projects/086e939158bd42b09e343feeade03e17/users/af1598b2551748cbb7cedbe1db897857/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:05.182546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.241268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ddfea-a3d4-45bd-9ade-4af53fc8037b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.300114 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:05.332012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a2bffc-0e9e-4aa6-bfcc-d4c4e1b61957 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.345288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.346478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.346478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.346743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/525083d808d042968ca7dae33a17b3a5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.360062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:05.365384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.366238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.366602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.368893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/groups` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.371289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Could not find domain: 525083d808d042968ca7dae33a17b3a5.: keystone.exception.DomainNotFound: Could not find domain: 525083d808d042968ca7dae33a17b3a5. Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 525083d808d042968ca7dae33a17b3a5. Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:05.376850 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:05.378331 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 525083d808d042968ca7dae33a17b3a5. Jul 19 11:37:05.379615 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:05.381057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.382706 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3293/6575] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:05 2022] PATCH /identity/v3/domains/525083d808d042968ca7dae33a17b3a5 => generated 112 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:05.383703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.430677 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3283/6576] 10.222.0.15 () {60 vars in 1146 bytes} [Tue Jul 19 11:37:05 2022] POST /identity/v3/groups => generated 324 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:05.431857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.466972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12123687-1b22-421a-b798-2a0b27cb2f10 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.479255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c482e9bafe946e0a873b5ec23efad44', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e78ce732e0b4d0eade66332145555e7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.479968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.483136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.483908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] PATH_INFO: `/v3/domains/dc54db927c564c3c9fe764a7d6923c3d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.505556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8268cfbc-87ef-473a-a1bb-590b36a6b09d tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.506453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Could not find domain: dc54db927c564c3c9fe764a7d6923c3d.: keystone.exception.DomainNotFound: Could not find domain: dc54db927c564c3c9fe764a7d6923c3d. Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: dc54db927c564c3c9fe764a7d6923c3d. Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:05.528082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:05.529682 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: dc54db927c564c3c9fe764a7d6923c3d. Jul 19 11:37:05.531044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:05.532779 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3284/6577] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:05 2022] PATCH /identity/v3/domains/dc54db927c564c3c9fe764a7d6923c3d => generated 112 bytes in 104 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:05.534038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.536332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.540294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.542034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.543525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.544679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.548525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e065131-52aa-47ed-8795-aa69a4ee1ba1 tempest-TokensV3TestJSON-1061439153 tempest-TokensV3TestJSON-1061439153-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.550313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.563805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.564869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.565024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3294/6578] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:05.565623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.565991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.566121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/125f0a26ccd341479362ab2398c741a2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.567429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=125f0a26ccd341479362ab2398c741a2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.569336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:05.569646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.587742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88b904-ed13-4883-9e12-7e377c22dba4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.609652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.610669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.611021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.611426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] PATH_INFO: `/v3/users/0e27b458e91e4368a24ce1a618e1f27c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.615869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e27b458e91e4368a24ce1a618e1f27c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.622503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '125f0a26ccd341479362ab2398c741a2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.624103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '125f0a26ccd341479362ab2398c741a2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.639408 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:05.644208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.679632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '125f0a26ccd341479362ab2398c741a2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.680514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '125f0a26ccd341479362ab2398c741a2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.687909 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3285/6579] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:05 2022] PATCH /identity/v3/domains/125f0a26ccd341479362ab2398c741a2 => generated 276 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:05.687909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.691705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:05.784725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e27b458e91e4368a24ce1a618e1f27c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.784725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e27b458e91e4368a24ce1a618e1f27c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.806991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e27b458e91e4368a24ce1a618e1f27c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.808427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e27b458e91e4368a24ce1a618e1f27c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.829898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e27b458e91e4368a24ce1a618e1f27c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:05.857864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8243fe1-e9d4-45e6-9da8-dfd0836d6c8d tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.863703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.864806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.865180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.865541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] PATH_INFO: `/v3/projects/086e939158bd42b09e343feeade03e17/users/af1598b2551748cbb7cedbe1db897857/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.867705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] RBAC: Authorizing `identity:create_grant(project_id=086e939158bd42b09e343feeade03e17, user_id=af1598b2551748cbb7cedbe1db897857, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.870608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:05.877838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3295/6580] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:05 2022] DELETE /identity/v3/users/0e27b458e91e4368a24ce1a618e1f27c => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:05.880900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.884222 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3286/6581] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:05 2022] PUT /identity/v3/projects/086e939158bd42b09e343feeade03e17/users/af1598b2551748cbb7cedbe1db897857/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:05.885181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:05.885337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:05.895859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:05.968086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce86a8c-3b1c-4297-bc05-71b35359c00d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:05.973935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:05.974746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:05.975027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:05.975298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] PATH_INFO: `/v3/projects/6bd126f24ef248edac495b3fb0c5eb37` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:05.976672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd126f24ef248edac495b3fb0c5eb37)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:05.978743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:06.034285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96079706-252d-4a95-9686-49b3340777b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:06.049787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd126f24ef248edac495b3fb0c5eb37', 'request_id': 'req-e1c0e661-4920-4c69-b9b6-aa3549982d3a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.052231 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:06.074642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd126f24ef248edac495b3fb0c5eb37', 'request_id': 'req-e1c0e661-4920-4c69-b9b6-aa3549982d3a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.085928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd126f24ef248edac495b3fb0c5eb37', 'request_id': 'req-e1c0e661-4920-4c69-b9b6-aa3549982d3a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.104078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] The token cache is being invalidate because project 6bd126f24ef248edac495b3fb0c5eb37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:06.105265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.106027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1c0e661-4920-4c69-b9b6-aa3549982d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.109101 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3287/6582] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:05 2022] DELETE /identity/v3/projects/6bd126f24ef248edac495b3fb0c5eb37 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:06.110459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927177fa-a72b-451f-bb91-05b3c029d6e8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:06.110736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927177fa-a72b-451f-bb91-05b3c029d6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:06.111021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927177fa-a72b-451f-bb91-05b3c029d6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:06.132611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-927177fa-a72b-451f-bb91-05b3c029d6e8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:06.134452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-927177fa-a72b-451f-bb91-05b3c029d6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:06.147773 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:UPDATE=1,keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:06.152521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:06.153446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:06.154069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:06.154466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/125f0a26ccd341479362ab2398c741a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:06.179413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=125f0a26ccd341479362ab2398c741a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:06.183171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:06.226785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '125f0a26ccd341479362ab2398c741a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.228515 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3288/6583] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:06.231180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afbc8-e373-4895-8842-8c7d61f5e5c3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:06.232045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '125f0a26ccd341479362ab2398c741a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.232385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afbc8-e373-4895-8842-8c7d61f5e5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:06.232948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4afbc8-e373-4895-8842-8c7d61f5e5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:06.270725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0f4afbc8-e373-4895-8842-8c7d61f5e5c3 None None] MFA Rules not processed for user `af1598b2551748cbb7cedbe1db897857`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:06.272677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0f4afbc8-e373-4895-8842-8c7d61f5e5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:06.398706 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3289/6584] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:06.399941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:06.400232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:06.400535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:06.469446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:06.470136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86aae3fade564f759359df990643b7e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.470678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:06.472075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86aae3fade564f759359df990643b7e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.488748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86aae3fade564f759359df990643b7e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.489738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86aae3fade564f759359df990643b7e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.508392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86aae3fade564f759359df990643b7e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.519658 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:06.617625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '125f0a26ccd341479362ab2398c741a2', 'request_id': 'req-05735314-c62c-465f-947d-8958c2592169'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.626664 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3290/6585] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:06.626664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:06.626664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:06.634922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '125f0a26ccd341479362ab2398c741a2', 'request_id': 'req-05735314-c62c-465f-947d-8958c2592169'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.652898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '125f0a26ccd341479362ab2398c741a2', 'request_id': 'req-05735314-c62c-465f-947d-8958c2592169'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.681865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project 125f0a26ccd341479362ab2398c741a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:06.683314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.685560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.704268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '125f0a26ccd341479362ab2398c741a2', 'request_id': 'req-05735314-c62c-465f-947d-8958c2592169'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.706438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '125f0a26ccd341479362ab2398c741a2', 'request_id': 'req-05735314-c62c-465f-947d-8958c2592169'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.714398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '125f0a26ccd341479362ab2398c741a2', 'request_id': 'req-05735314-c62c-465f-947d-8958c2592169'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:06.730259 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3296/6586] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:05 2022] DELETE /identity/v3/domains/125f0a26ccd341479362ab2398c741a2 => generated 0 bytes in 851 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:06.731482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:06.734976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:06.735534 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:06.767570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d134f-e773-42db-bd9b-91c906c7c353 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:06.884088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:06.885099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:06.885386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05735314-c62c-465f-947d-8958c2592169 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:06.885913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:06.886422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:06.897895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:06.899407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:06.900102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:06.900398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:06.900675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:06.915141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:07.015112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.017385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ad590-1978-4b1a-b7b9-fbd2ce4f31ac service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.056330 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3291/6587] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:07.057976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.058384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.058765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.083750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.084579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:07.085328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.086172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:07.101974 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3292/6588] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:07.101974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.103539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:07.106698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3297/6589] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:06 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:07.107669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.141116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc57f20-d84c-4e45-b26c-f8697260c42f service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.151840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.152563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.152852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.153131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.153875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:07.155771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.160317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.198839 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3298/6590] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:07.200581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.220606 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:07.232274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be44755-b842-469a-a29a-a8e30c28abb6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.270410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.274571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.275777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.276750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.277634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0755804-90b5-4989-9d5a-8d5ae9a488b2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.278564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.282272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.282936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.283837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.284117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.284489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/125f0a26ccd341479362ab2398c741a2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.293693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=125f0a26ccd341479362ab2398c741a2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.295649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find domain: 125f0a26ccd341479362ab2398c741a2.: keystone.exception.DomainNotFound: Could not find domain: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:07.322411 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:07.323868 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.325158 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3293/6591] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:37:07 2022] GET /identity/v3/domains/125f0a26ccd341479362ab2398c741a2 => generated 112 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:07.332828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.354217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479f134-2afe-49c5-b99b-e131e6102d6c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.359872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.360826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.361241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.361480 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3299/6592] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:07 2022] POST /identity/v3/projects => generated 401 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:07.361603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/users/86aae3fade564f759359df990643b7e7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.364711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.377306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:get_user(user_id=86aae3fade564f759359df990643b7e7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.379584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find user: 86aae3fade564f759359df990643b7e7.: keystone.exception.UserNotFound: Could not find user: 86aae3fade564f759359df990643b7e7. Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 19 11:37:07.417484 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:07.418838 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 86aae3fade564f759359df990643b7e7. Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.420183 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3294/6593] 10.222.0.15 () {58 vars in 1220 bytes} [Tue Jul 19 11:37:07 2022] GET /identity/v3/users/86aae3fade564f759359df990643b7e7 => generated 110 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:07.423093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.445444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a14bb3b-8790-4f4a-b122-7d769c401f76 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.496473 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:07.520052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27ffba-749a-4a1b-95bb-881fa4f51e5c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.533186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.534017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.534473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.534850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.536064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.538397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.574125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.575329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.575690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.575973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/groups/d00699740bee417fb289d299dabd1a24` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.582998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:get_group(group_id=d00699740bee417fb289d299dabd1a24)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.585529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.613594 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3300/6594] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:07 2022] POST /identity/v3/users => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:07.617949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find group: d00699740bee417fb289d299dabd1a24.: keystone.exception.GroupNotFound: Could not find group: d00699740bee417fb289d299dabd1a24. Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Jul 19 11:37:07.624618 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_group(group_id) Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:07.625901 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: d00699740bee417fb289d299dabd1a24. Jul 19 11:37:07.627362 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.630605 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3295/6595] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:07 2022] GET /identity/v3/groups/d00699740bee417fb289d299dabd1a24 => generated 111 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 11:37:07.635145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.655321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab184d-bc0d-439b-984a-9f6d44b4f1c7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.662570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f2e88c-f235-4600-b053-e07ddbd440bc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.669318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.674421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.674913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.675400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.676133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.676959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.677251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.677533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/groups/d00699740bee417fb289d299dabd1a24` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.685013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.688000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.689860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:07.743302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3301/6596] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find group: d00699740bee417fb289d299dabd1a24.: keystone.exception.GroupNotFound: Could not find group: d00699740bee417fb289d299dabd1a24. Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Jul 19 11:37:07.748649 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:07.749964 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: d00699740bee417fb289d299dabd1a24. Jul 19 11:37:07.754457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.755728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.755853 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3296/6597] 10.222.0.15 () {58 vars in 1226 bytes} [Tue Jul 19 11:37:07 2022] DELETE /identity/v3/groups/d00699740bee417fb289d299dabd1a24 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:07.760760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.790002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd241427-75d7-4969-bbd1-285408ed9847 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.796883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093fb79d-ddd4-4552-bbc6-05820f629219 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.819255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.820899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.821374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.822072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.824668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.825833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.827861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.847109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.847109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.847109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/users/86aae3fade564f759359df990643b7e7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.862134 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3302/6598] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:07.866185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.867510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_user(user_id=86aae3fade564f759359df990643b7e7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:07.869601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:07.914449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e0af4b-7e36-4c67-ae9d-2f0d7e52c001 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.935013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da127-bbc1-421f-93be-1a2b94af5b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:07.939822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da127-bbc1-421f-93be-1a2b94af5b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:07.940110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da127-bbc1-421f-93be-1a2b94af5b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:07.940412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da127-bbc1-421f-93be-1a2b94af5b20 admin admin] PATH_INFO: `/v3/projects/13fbd07f08024e3e9154a179a688dff3/users/fcefd6e9ab754d278944a94f1c1c41e9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find user: 86aae3fade564f759359df990643b7e7.: keystone.exception.UserNotFound: Could not find user: 86aae3fade564f759359df990643b7e7. Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Jul 19 11:37:07.942043 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:07.943314 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 86aae3fade564f759359df990643b7e7. Jul 19 11:37:07.944912 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:07.946539 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3297/6599] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:07 2022] DELETE /identity/v3/users/86aae3fade564f759359df990643b7e7 => generated 110 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:07.947765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:07.984380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4622ec48-c2c0-4d38-82aa-75df8c81a81b tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:07.987639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261da127-bbc1-421f-93be-1a2b94af5b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13fbd07f08024e3e9154a179a688dff3, user_id=fcefd6e9ab754d278944a94f1c1c41e9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:08.004568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261da127-bbc1-421f-93be-1a2b94af5b20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:08.011311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:08.013742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.014085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.014354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/125f0a26ccd341479362ab2398c741a2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.038917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:08.050102 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3303/6600] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:07 2022] PUT /identity/v3/projects/13fbd07f08024e3e9154a179a688dff3/users/fcefd6e9ab754d278944a94f1c1c41e9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:08.060292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.060603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.060881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find domain: 125f0a26ccd341479362ab2398c741a2.: keystone.exception.DomainNotFound: Could not find domain: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:08.087294 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:08.089289 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:08.090757 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:08.092196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3298/6601] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:07 2022] PATCH /identity/v3/domains/125f0a26ccd341479362ab2398c741a2 => generated 112 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Jul 19 11:37:08.097409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:08.124025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de6c3b-144e-482a-bc6d-46342a48d503 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:08.139325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] MFA Rules not processed for user `fcefd6e9ab754d278944a94f1c1c41e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:08.147983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:08.303444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:08.304596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.304898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.305173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.305942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:08.318930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:08.353928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3299/6602] 10.222.0.15 () {58 vars in 1127 bytes} [Tue Jul 19 11:37:08 2022] GET /identity/v3/domains => generated 1346 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:08.355777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3304/6603] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:08 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:08.359314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:08.368989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:08.397770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6d897-ef12-4178-ad0d-a70212ed79dc tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:08.418170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:08.419276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.419935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.420244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.422346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:08.422690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:08.429708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:08.433238 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:08.492544 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3300/6604] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:08 2022] GET /identity/v3/domains?enabled=True => generated 1093 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:08.493764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:08.509597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:08.557866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f5455-84f1-429f-9c04-11ad4cc73558 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:08.565672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:08.567109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.567557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.568010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] PATH_INFO: `/v3/users/fcefd6e9ab754d278944a94f1c1c41e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.569930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcefd6e9ab754d278944a94f1c1c41e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:08.572757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:08.664562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4066-3812-4608-9dcd-c958044bc51a tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:08.665099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcefd6e9ab754d278944a94f1c1c41e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.665950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcefd6e9ab754d278944a94f1c1c41e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.677423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:08.679164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.679758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.680582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] PATH_INFO: `/v3/projects/6ec2016d6814471c9df027caf8b6b1f1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.680744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcefd6e9ab754d278944a94f1c1c41e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.681996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcefd6e9ab754d278944a94f1c1c41e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.683543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ec2016d6814471c9df027caf8b6b1f1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:08.686319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:08.694611 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:08.707374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcefd6e9ab754d278944a94f1c1c41e9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.753015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3305/6605] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:08 2022] DELETE /identity/v3/users/fcefd6e9ab754d278944a94f1c1c41e9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:08.754101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:08.757495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:08.792975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ec2016d6814471c9df027caf8b6b1f1', 'request_id': 'req-0cc583f9-a40d-4962-ac34-391455e2f4bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.809906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ec2016d6814471c9df027caf8b6b1f1', 'request_id': 'req-0cc583f9-a40d-4962-ac34-391455e2f4bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.821342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ec2016d6814471c9df027caf8b6b1f1', 'request_id': 'req-0cc583f9-a40d-4962-ac34-391455e2f4bd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.853921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] The token cache is being invalidate because project 6ec2016d6814471c9df027caf8b6b1f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:08.855127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.856469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0cc583f9-a40d-4962-ac34-391455e2f4bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:08.862497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3301/6606] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:08 2022] DELETE /identity/v3/projects/6ec2016d6814471c9df027caf8b6b1f1 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:08.864039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140d31-3955-4389-9449-479221d42a15 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.864039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140d31-3955-4389-9449-479221d42a15 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.866697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53140d31-3955-4389-9449-479221d42a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.895342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c714503-6745-4af8-ac36-10ba3105e4d9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:08.901721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:08.903453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:08.905772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:08.909249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:08.910750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-866291182) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:08.912026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:08.913928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:08.937250 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3306/6607] 10.222.0.15 () {58 vars in 1196 bytes} [Tue Jul 19 11:37:08 2022] GET /identity/v3/domains?name=tempest-test_domain-866291182 => generated 406 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:08.938671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:08.945200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:08.945558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-53140d31-3955-4389-9449-479221d42a15 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:08.949749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53140d31-3955-4389-9449-479221d42a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:09.009686 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:09.069820 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3302/6608] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:09.071075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140d31-3955-4389-9449-479221d42a15 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:09.072714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-53140d31-3955-4389-9449-479221d42a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:09.089101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53140d31-3955-4389-9449-479221d42a15 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:09.094794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:09.096132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:09.096677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:09.097363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/125f0a26ccd341479362ab2398c741a2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:09.099765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ab179-1873-429e-b672-8c10315a2cc1 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:09.113612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:09.118504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:09.119508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:09.121037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:09.121396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] PATH_INFO: `/v3/users/9c482e9bafe946e0a873b5ec23efad44` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Could not find domain: 125f0a26ccd341479362ab2398c741a2.: keystone.exception.DomainNotFound: Could not find domain: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:09.128533 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:09.130044 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 125f0a26ccd341479362ab2398c741a2. Jul 19 11:37:09.131360 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:09.133501 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3303/6609] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:09 2022] PATCH /identity/v3/domains/125f0a26ccd341479362ab2398c741a2 => generated 112 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:09.134433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:09.135404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c482e9bafe946e0a873b5ec23efad44)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:09.137718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:09.140336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:09.235738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5922b-ac90-4943-a271-ca7a4326eb8e tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:09.239886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:09.240715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:09.241190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:09.241639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:09.256212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c482e9bafe946e0a873b5ec23efad44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.257482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c482e9bafe946e0a873b5ec23efad44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.259331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:09.267182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:09.281747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c482e9bafe946e0a873b5ec23efad44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.283136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c482e9bafe946e0a873b5ec23efad44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.298174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3304/6610] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:09.301835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:09.305302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c482e9bafe946e0a873b5ec23efad44'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.332460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10ab9cf-8d23-436d-be82-75c2f21433fe service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:09.346247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:09.348411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:09.348702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:09.348981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/5fc0e4f2cfc8423f94de675b869f4f5a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:09.355547 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3307/6611] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:08 2022] DELETE /identity/v3/users/9c482e9bafe946e0a873b5ec23efad44 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:09.370570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=5fc0e4f2cfc8423f94de675b869f4f5a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:09.372396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:09.392809 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:09.452310 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3305/6612] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:09 2022] PATCH /identity/v3/domains/5fc0e4f2cfc8423f94de675b869f4f5a => generated 277 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:09.457435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:09.459473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:09.638452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e2823-6538-4ec6-9b74-4c60ab2dbc45 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:09.668995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:09.672935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:09.673902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:09.674359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/5fc0e4f2cfc8423f94de675b869f4f5a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:09.728886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=5fc0e4f2cfc8423f94de675b869f4f5a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:09.731644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:09.785950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.792088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.835626 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:09.902985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a', 'request_id': 'req-f9a23b25-df57-4812-91f0-08a533fbc52c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.917714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a', 'request_id': 'req-f9a23b25-df57-4812-91f0-08a533fbc52c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.940875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a', 'request_id': 'req-f9a23b25-df57-4812-91f0-08a533fbc52c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.973125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project 5fc0e4f2cfc8423f94de675b869f4f5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:09.973492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:09.974246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.003768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a', 'request_id': 'req-f9a23b25-df57-4812-91f0-08a533fbc52c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.004668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a', 'request_id': 'req-f9a23b25-df57-4812-91f0-08a533fbc52c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.015463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '5fc0e4f2cfc8423f94de675b869f4f5a', 'request_id': 'req-f9a23b25-df57-4812-91f0-08a533fbc52c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.029474 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3308/6613] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:09 2022] DELETE /identity/v3/domains/5fc0e4f2cfc8423f94de675b869f4f5a => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:10.033902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:10.037426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:10.070912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67e54-44b6-4906-9abb-d6e2c5af3865 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:10.225608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:10.226532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:10.226966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:10.227128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/c13236a5a0af4fff9c985c1b6eed0f6f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:10.257238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=c13236a5a0af4fff9c985c1b6eed0f6f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:10.258974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:10.304873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.305695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.362370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.363327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.368021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3306/6614] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:10 2022] PATCH /identity/v3/domains/c13236a5a0af4fff9c985c1b6eed0f6f => generated 277 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:10.372555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:10.391258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a23b25-df57-4812-91f0-08a533fbc52c tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:10.410700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:10.412479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:10.536524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:10.537436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:10.537726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:10.538025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/c13236a5a0af4fff9c985c1b6eed0f6f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:10.546598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbae4424-ba9e-454b-a991-0fb7db139331 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:10.555871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=c13236a5a0af4fff9c985c1b6eed0f6f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:10.556841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:10.559669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:10.560787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:10.560947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:10.561460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] PATH_INFO: `/v3/projects/13fbd07f08024e3e9154a179a688dff3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:10.576958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=13fbd07f08024e3e9154a179a688dff3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:10.584091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:10.611740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.617512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.696882 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:10.718207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13fbd07f08024e3e9154a179a688dff3', 'request_id': 'req-377c048a-f1ae-426f-aa0d-57c719be4aaf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.723620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f', 'request_id': 'req-59be1ea2-1571-4a99-a918-aaacc91b9e07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.733352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f', 'request_id': 'req-59be1ea2-1571-4a99-a918-aaacc91b9e07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.735243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13fbd07f08024e3e9154a179a688dff3', 'request_id': 'req-377c048a-f1ae-426f-aa0d-57c719be4aaf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.738160 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:10.747428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13fbd07f08024e3e9154a179a688dff3', 'request_id': 'req-377c048a-f1ae-426f-aa0d-57c719be4aaf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.755760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f', 'request_id': 'req-59be1ea2-1571-4a99-a918-aaacc91b9e07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.774893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] The token cache is being invalidate because project 13fbd07f08024e3e9154a179a688dff3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:10.775822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.778931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-377c048a-f1ae-426f-aa0d-57c719be4aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.781579 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3307/6615] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:10 2022] DELETE /identity/v3/projects/13fbd07f08024e3e9154a179a688dff3 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:10.787310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project c13236a5a0af4fff9c985c1b6eed0f6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:10.787735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.788852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.790413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d51bd-cb8f-428e-818b-06618eedc3fb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:10.790935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d51bd-cb8f-428e-818b-06618eedc3fb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:10.791432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d51bd-cb8f-428e-818b-06618eedc3fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:10.813599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f', 'request_id': 'req-59be1ea2-1571-4a99-a918-aaacc91b9e07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.814732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f', 'request_id': 'req-59be1ea2-1571-4a99-a918-aaacc91b9e07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.820209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'c13236a5a0af4fff9c985c1b6eed0f6f', 'request_id': 'req-59be1ea2-1571-4a99-a918-aaacc91b9e07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:10.831021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bc5d51bd-cb8f-428e-818b-06618eedc3fb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:10.831341 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3309/6616] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:10 2022] DELETE /identity/v3/domains/c13236a5a0af4fff9c985c1b6eed0f6f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:10.832927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc5d51bd-cb8f-428e-818b-06618eedc3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:10.837440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:10.843393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:10.971296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59be1ea2-1571-4a99-a918-aaacc91b9e07 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:10.974562 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3308/6617] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:10.986336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:10.986982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:10.987489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:10.989915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.004427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.004815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.005003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/0aca3153826940f0be422453113cc498` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.014996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:11.017055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:11.024214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0aca3153826940f0be422453113cc498)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.025943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.034978 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3309/6618] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:11.037301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.048189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a0616-945e-47a9-b54a-4c9f09cb0a74 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:11.053778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.055565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.056123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.056930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.057980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:11.058513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.060747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.079180 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3310/6619] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:11.079397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0aca3153826940f0be422453113cc498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.079888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0aca3153826940f0be422453113cc498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.080978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.083708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:11.101052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dad3a8f-1d17-4210-90f4-dba26850fc57 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:11.137348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0aca3153826940f0be422453113cc498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.137993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0aca3153826940f0be422453113cc498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.141120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3310/6620] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:10 2022] PATCH /identity/v3/domains/0aca3153826940f0be422453113cc498 => generated 276 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:37:11.144716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.146892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:11.234965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.235595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.235881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.236159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.236928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.239280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.329430 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3311/6621] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:11 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:11.330453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.332228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:11.347310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b74817d-d8db-46ab-9b8c-5610bf9f59a7 tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:11.396320 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:11.433684 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:11.475361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f68cb4fd83a34f98a79acd6b5940b289', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689021c7158a4aec8c7640e9be7f3000', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.477130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.477590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.478136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] PATH_INFO: `/v3/domains/0aca3153826940f0be422453113cc498` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.495459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94db3c-c44b-41fd-b234-c37350c38058 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:11.498741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0aca3153826940f0be422453113cc498)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.501415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.516662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.517553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.517837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.518118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] PATH_INFO: `/v3/projects/6e78ce732e0b4d0eade66332145555e7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.519381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e78ce732e0b4d0eade66332145555e7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.521921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.534963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0aca3153826940f0be422453113cc498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.540491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0aca3153826940f0be422453113cc498'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.632648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e78ce732e0b4d0eade66332145555e7', 'request_id': 'req-cc337ccf-7ab5-4284-bb28-a99ae10a262b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.647776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e78ce732e0b4d0eade66332145555e7', 'request_id': 'req-cc337ccf-7ab5-4284-bb28-a99ae10a262b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.655188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aca3153826940f0be422453113cc498', 'request_id': 'req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.663784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aca3153826940f0be422453113cc498', 'request_id': 'req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.668200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e78ce732e0b4d0eade66332145555e7', 'request_id': 'req-cc337ccf-7ab5-4284-bb28-a99ae10a262b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.671522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aca3153826940f0be422453113cc498', 'request_id': 'req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.694905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] The token cache is being invalidate because project 0aca3153826940f0be422453113cc498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:11.696799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] The token cache is being invalidate because project 6e78ce732e0b4d0eade66332145555e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:11.697247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.698009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.698812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.704672 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3312/6622] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:11 2022] DELETE /identity/v3/projects/6e78ce732e0b4d0eade66332145555e7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:11.704672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.704986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.708398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:11.716991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0aca3153826940f0be422453113cc498', 'request_id': 'req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.718147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0aca3153826940f0be422453113cc498', 'request_id': 'req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.735297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0aca3153826940f0be422453113cc498', 'request_id': 'req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:11.753238 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3311/6623] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:11 2022] DELETE /identity/v3/domains/0aca3153826940f0be422453113cc498 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:11.754324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.758052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:11.885902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc337ccf-7ab5-4284-bb28-a99ae10a262b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:11.893383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.895029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.897636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.898795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69eda9-5df3-4b44-bb31-7f14e5267dcd tempest-DomainsTestJSON-312480475 tempest-DomainsTestJSON-312480475-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:11.899204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.900052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.905327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.912674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:11.914919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:11.915301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:11.916162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] PATH_INFO: `/v3/users/056cdd7f8fea43608dcf52b5a5e468c8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:11.924183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=056cdd7f8fea43608dcf52b5a5e468c8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:11.927986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:11.940756 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:11.975858 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3313/6624] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:11 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:11.980798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:11.985602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:12.014921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25810a72-7aa4-4d95-8863-61956462597e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:12.040299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:12.048337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:12.048337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:12.048337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] PATH_INFO: `/v3/users/42f4c669804c40f4874599c1209fe638` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:12.053023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42f4c669804c40f4874599c1209fe638)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:12.062624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:12.077567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.078588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.106145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.106775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.122545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '056cdd7f8fea43608dcf52b5a5e468c8'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.153369 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3312/6625] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:11 2022] DELETE /identity/v3/users/056cdd7f8fea43608dcf52b5a5e468c8 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:12.154281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:12.169492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:12.207464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42f4c669804c40f4874599c1209fe638'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.211402 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:12.229533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42f4c669804c40f4874599c1209fe638'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.252274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42f4c669804c40f4874599c1209fe638'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.256859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42f4c669804c40f4874599c1209fe638'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.274638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7de02851-c8ca-423e-a898-7b7074da8bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42f4c669804c40f4874599c1209fe638'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:12.296476 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3314/6626] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:11 2022] DELETE /identity/v3/users/42f4c669804c40f4874599c1209fe638 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:12.299522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:12.299812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:12.300090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:12.302993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b4681-f5aa-4ddf-ae90-592be019ccf0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:12.350679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:12.353199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:12.425100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:12.425807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:12.426095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:12.426372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:12.427111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:12.428904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:12.453913 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3313/6627] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:12.457841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:12.461021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:12.473278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3315/6628] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:12.484243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0ec0a7-89e8-4030-9265-60e01ef5c27a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:12.495726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:12.498911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:12.527828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:12.529405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:12.539001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:12.540399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:12.543007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:12.550700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:12.605365 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3314/6629] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:12.612661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:12.657542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1b4e1-f031-4229-a24a-14138ea04493 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:12.671309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c875298-8fa0-4a9f-b608-e4d9f7c90746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:12.672231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c875298-8fa0-4a9f-b608-e4d9f7c90746 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:12.675625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c875298-8fa0-4a9f-b608-e4d9f7c90746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:12.675919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c875298-8fa0-4a9f-b608-e4d9f7c90746 admin admin] PATH_INFO: `/v3/projects/44b748e137e44837a2b4314092a2c57b/users/f047ddb9fbfd4b6f8fd66d02e0dbca20/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:12.719238 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:12.726900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c875298-8fa0-4a9f-b608-e4d9f7c90746 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44b748e137e44837a2b4314092a2c57b, user_id=f047ddb9fbfd4b6f8fd66d02e0dbca20, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:12.733033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c875298-8fa0-4a9f-b608-e4d9f7c90746 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:12.761281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6d44fb-eccf-40f8-a1c4-6cde3752c263 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:12.767553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3315/6630] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:12 2022] PUT /identity/v3/projects/44b748e137e44837a2b4314092a2c57b/users/f047ddb9fbfd4b6f8fd66d02e0dbca20/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:12.789772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:12.793873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:12.797202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:12.857049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:12.859416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:13.065921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:13.067296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:13.068497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:13.069086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:13.146336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3316/6631] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:13.171031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:13.172740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:13.175442 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:13.200481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cde5f52-c149-4f87-82c5-b9d6209c0121 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:13.210127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:13.213027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:13.213341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:13.213660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:13.236799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:13.240591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:13.265576 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3317/6632] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:37:13.301441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:13.304376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:13.333851 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3316/6633] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 839 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:13.602973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:13.604920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:13.765205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a78f9f4-fdcf-4c67-8bae-7706cba5a65c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:13.773280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:13.774484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:13.774484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:13.774857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:13.777620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:13.796703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:13.799132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:13.829166 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3318/6634] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:13.915183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:13.917227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:14.071864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346701d0-1b53-44ac-b263-bb6a3baefcbd service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:14.084405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:14.085333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:14.085924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:14.086394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:14.086848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:14.087290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:14.092642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:14.140058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5294a20a-3587-4864-8aa4-766ff4f6e8bc service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:14.173304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:14.174243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:14.174532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:14.174812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] PATH_INFO: `/v3/projects/7fb917d611324544b6ca63059443b422` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:14.177996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb917d611324544b6ca63059443b422)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:14.185123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:14.235973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:14.238386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8907e-6c5f-4cb3-9e1e-20e7e4162f74 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:14.252173 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3317/6635] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:13 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:14.287595 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:14.297078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb917d611324544b6ca63059443b422', 'request_id': 'req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:14.309218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb917d611324544b6ca63059443b422', 'request_id': 'req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:14.332505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb917d611324544b6ca63059443b422', 'request_id': 'req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:14.354692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] The token cache is being invalidate because project 7fb917d611324544b6ca63059443b422 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:14.354989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:14.356705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d0c14b3e-48f1-4769-ab40-5f18ec50c3fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:14.365495 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3319/6636] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:14 2022] DELETE /identity/v3/projects/7fb917d611324544b6ca63059443b422 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:14.367271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:14.367271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:14.367481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:14.427847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:14.429122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:14.624456 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3318/6637] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:14.632761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:14.633696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:14.633980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:14.672642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:14.673772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:14.694111 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3320/6638] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:14.699060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:14.715253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbc1e57-5f4e-4ae8-98a7-75320707b0fe None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:14.726533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:14.727153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:14.729568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:14.729871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:14.730682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:14.730997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:14.736759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:14.765016 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3319/6639] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:37:14.768766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:14.782230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9e2270-58c0-4aa8-afa0-9b3cb910ca76 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:14.790519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:14.791779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:14.792629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:14.798177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:14.799143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:14.805096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:14.856666 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3321/6640] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:14 2022] POST /identity/v3/projects => generated 369 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:14.860794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:14.883733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35646798-daea-44fa-bb9d-57c158567c98 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:14.907957 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:15.074617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:15.077324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.077918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.078375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.079334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:15.081677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:15.119186 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3320/6641] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:14 2022] POST /identity/v3/users => generated 285 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:15.124838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:15.141795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3bcde1-64d9-4fa3-8943-94688582a2e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:15.155276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:15.155977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.156257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.156558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.157298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:15.159020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:15.208017 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3322/6642] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:15.213638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:15.224418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:15.228203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51876ccc-7a42-495b-9fbe-a3560fe8ba70 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:15.235254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:15.243500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:15.244140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.244453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.244955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.245774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:15.254669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:15.276699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc17a7-e658-4b4f-b219-52b08f9b8dbd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:15.294740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:15.295715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.296007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.296294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] PATH_INFO: `/v3/projects/a5ea7ac5827e49ca9d04ce863a67c4b3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.299956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5ea7ac5827e49ca9d04ce863a67c4b3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:15.302006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:15.337398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3321/6643] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:15.339321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:15.348747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:15.381083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc759fb2-3777-45be-b710-06b47f77afcf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:15.395527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:15.397047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.397312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.397594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] PATH_INFO: `/v3/users/7403fcb0a88c49529c19cf01c96d7fd5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.404232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7403fcb0a88c49529c19cf01c96d7fd5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:15.405999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:15.414563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5ea7ac5827e49ca9d04ce863a67c4b3', 'request_id': 'req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.426476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5ea7ac5827e49ca9d04ce863a67c4b3', 'request_id': 'req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.447428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5ea7ac5827e49ca9d04ce863a67c4b3', 'request_id': 'req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.473273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] The token cache is being invalidate because project a5ea7ac5827e49ca9d04ce863a67c4b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:15.473567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.474885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.481022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3323/6644] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:15 2022] DELETE /identity/v3/projects/a5ea7ac5827e49ca9d04ce863a67c4b3 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:15.482015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:15.484160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:15.544262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7403fcb0a88c49529c19cf01c96d7fd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.573605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7403fcb0a88c49529c19cf01c96d7fd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.623194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7403fcb0a88c49529c19cf01c96d7fd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.626042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7403fcb0a88c49529c19cf01c96d7fd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.627058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6027fd-dfc1-446a-ba42-c7ce19ae86eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:15.644908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7403fcb0a88c49529c19cf01c96d7fd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:15.646832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b512e1-8872-466f-983a-ec2b7f25b5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:15.647709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b512e1-8872-466f-983a-ec2b7f25b5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.647989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b512e1-8872-466f-983a-ec2b7f25b5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.648264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b512e1-8872-466f-983a-ec2b7f25b5b4 admin admin] PATH_INFO: `/v3/projects/e5aa1c6b0617487d9abb5086d3a5dcd6/users/38d218bcc1924057a36ca8945d17c119/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.666086 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3322/6645] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:15 2022] DELETE /identity/v3/users/7403fcb0a88c49529c19cf01c96d7fd5 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:15.668036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:15.672059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:15.708644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b512e1-8872-466f-983a-ec2b7f25b5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5aa1c6b0617487d9abb5086d3a5dcd6, user_id=38d218bcc1924057a36ca8945d17c119, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:15.712948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b512e1-8872-466f-983a-ec2b7f25b5b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:15.747762 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:15.764861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3324/6646] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:15 2022] PUT /identity/v3/projects/e5aa1c6b0617487d9abb5086d3a5dcd6/users/38d218bcc1924057a36ca8945d17c119/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:15.766971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ecb58-1f97-41d7-b479-d4ed848b9e1a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.767472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ecb58-1f97-41d7-b479-d4ed848b9e1a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.768750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ecb58-1f97-41d7-b479-d4ed848b9e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:15.812519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c28ecb58-1f97-41d7-b479-d4ed848b9e1a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:15.815565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c28ecb58-1f97-41d7-b479-d4ed848b9e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:15.861500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603e52e-afba-419e-ac8a-70a894ba9833 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:15.872016 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:15.975755 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3325/6647] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:15.977509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088460f-3898-4913-b965-d7d20c414972 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:15.977714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088460f-3898-4913-b965-d7d20c414972 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:15.978000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088460f-3898-4913-b965-d7d20c414972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.011565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:16.014895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.015782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.015782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] PATH_INFO: `/v3/users/f68cb4fd83a34f98a79acd6b5940b289` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.019825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f68cb4fd83a34f98a79acd6b5940b289)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:16.023813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:16.057129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0088460f-3898-4913-b965-d7d20c414972 None None] MFA Rules not processed for user `38d218bcc1924057a36ca8945d17c119`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:16.057129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0088460f-3898-4913-b965-d7d20c414972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:16.210879 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3326/6648] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:15 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:16.212061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088460f-3898-4913-b965-d7d20c414972 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:16.242086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0088460f-3898-4913-b965-d7d20c414972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:16.257567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f68cb4fd83a34f98a79acd6b5940b289'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:16.275571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f68cb4fd83a34f98a79acd6b5940b289'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:16.315589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f68cb4fd83a34f98a79acd6b5940b289'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:16.317691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f68cb4fd83a34f98a79acd6b5940b289'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:16.351607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f68cb4fd83a34f98a79acd6b5940b289'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:16.373442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088460f-3898-4913-b965-d7d20c414972 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:16.395948 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3323/6649] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:15 2022] DELETE /identity/v3/users/f68cb4fd83a34f98a79acd6b5940b289 => generated 0 bytes in 726 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:16.397600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:16.399702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:16.401247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.413707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:16.416212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.416788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.426421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:16.487844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:16.489785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:16.515130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3327/6650] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:16.695780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76b642-fcff-49b3-b8e0-96f46c32c85a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:16.706274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcaba-4a94-4eae-8620-64ee086a53f5 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d218bcc1924057a36ca8945d17c119', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5aa1c6b0617487d9abb5086d3a5dcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:16.706982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcaba-4a94-4eae-8620-64ee086a53f5 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.707283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcaba-4a94-4eae-8620-64ee086a53f5 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.707544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfcaba-4a94-4eae-8620-64ee086a53f5 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] PATH_INFO: `/v3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.715304 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3324/6651] 10.222.0.15 () {58 vars in 1103 bytes} [Tue Jul 19 11:37:16 2022] GET /identity/v3 => generated 255 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:16.717796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:16.737920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd0353-2f4b-4b36-8ac4-8e593ddd2edc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:16.761468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d96ae78-6a51-4dc9-86da-a8e49a4a2117 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d218bcc1924057a36ca8945d17c119', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5aa1c6b0617487d9abb5086d3a5dcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:16.763097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96ae78-6a51-4dc9-86da-a8e49a4a2117 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.764812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96ae78-6a51-4dc9-86da-a8e49a4a2117 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.765105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d96ae78-6a51-4dc9-86da-a8e49a4a2117 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] PATH_INFO: `/v3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.783110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcaba-4a94-4eae-8620-64ee086a53f5 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:16.783344 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3328/6652] 10.222.0.15 () {58 vars in 1103 bytes} [Tue Jul 19 11:37:16 2022] GET /identity/v3 => generated 255 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:16.800032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfcaba-4a94-4eae-8620-64ee086a53f5 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:16.808232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dc3ae1-7f35-413f-9e67-974f2307dd07 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38d218bcc1924057a36ca8945d17c119', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e5aa1c6b0617487d9abb5086d3a5dcd6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:16.809091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3ae1-7f35-413f-9e67-974f2307dd07 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.809381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3ae1-7f35-413f-9e67-974f2307dd07 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.809656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dc3ae1-7f35-413f-9e67-974f2307dd07 tempest-TestApiDiscovery-1075263687 tempest-TestApiDiscovery-1075263687-project] PATH_INFO: `/v3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.816189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3325/6653] 10.222.0.15 () {58 vars in 1103 bytes} [Tue Jul 19 11:37:16 2022] GET /identity/v3 => generated 255 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:16.819393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e50c-a818-4c6d-9e76-9a67baf5cfbd None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.821136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e50c-a818-4c6d-9e76-9a67baf5cfbd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.821865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3634e50c-a818-4c6d-9e76-9a67baf5cfbd None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.824117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3329/6654] 10.222.0.15 () {56 vars in 894 bytes} [Tue Jul 19 11:37:16 2022] GET /identity/ => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:37:16.830035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338a0c-cfb8-4d3d-9147-9ab29702298a None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:16.830343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338a0c-cfb8-4d3d-9147-9ab29702298a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:16.830607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60338a0c-cfb8-4d3d-9147-9ab29702298a None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:16.836518 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3326/6655] 10.222.0.15 () {56 vars in 894 bytes} [Tue Jul 19 11:37:16 2022] GET /identity/ => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:37:16.838896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634e50c-a818-4c6d-9e76-9a67baf5cfbd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:16.841108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3634e50c-a818-4c6d-9e76-9a67baf5cfbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:16.967177 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:17.127723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3634e50c-a818-4c6d-9e76-9a67baf5cfbd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:17.133473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:17.134515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:17.135004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:17.135372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] PATH_INFO: `/v3/users/38d218bcc1924057a36ca8945d17c119` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:17.137665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d218bcc1924057a36ca8945d17c119)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:17.140450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:17.228661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d218bcc1924057a36ca8945d17c119'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:17.230625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d218bcc1924057a36ca8945d17c119'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:17.250079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d218bcc1924057a36ca8945d17c119'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:17.250787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d218bcc1924057a36ca8945d17c119'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:17.264922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d218bcc1924057a36ca8945d17c119'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:17.319320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3330/6656] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:16 2022] DELETE /identity/v3/users/38d218bcc1924057a36ca8945d17c119 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:17.321785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455315-3884-4702-93ba-09b6d57da62d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:17.322829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455315-3884-4702-93ba-09b6d57da62d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:17.323450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89455315-3884-4702-93ba-09b6d57da62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:17.375070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-89455315-3884-4702-93ba-09b6d57da62d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:17.376726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89455315-3884-4702-93ba-09b6d57da62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:17.426784 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:17.498387 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3327/6657] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:17.565873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:17.567447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:17.864548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b839f736-18c2-4a4d-999e-f74cf8c286de admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:17.879819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:17.882730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:17.883020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:17.883305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:18.007578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:18.009096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:18.040774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455315-3884-4702-93ba-09b6d57da62d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:18.058118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-89455315-3884-4702-93ba-09b6d57da62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:18.097425 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3331/6658] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:18.146174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89455315-3884-4702-93ba-09b6d57da62d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:18.163579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:18.165264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:18.167812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:18.168664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] PATH_INFO: `/v3/projects/9631c48ce91049f284999f4d48f1f05d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:18.181961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9631c48ce91049f284999f4d48f1f05d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:18.189974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:18.487418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:18.489623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:18.520909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c85d26-3b72-4beb-b5f0-15b51709d3ea service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:18.547148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9631c48ce91049f284999f4d48f1f05d', 'request_id': 'req-1bc3820d-8b70-44fa-9c44-c681355d5430'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:18.573681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9631c48ce91049f284999f4d48f1f05d', 'request_id': 'req-1bc3820d-8b70-44fa-9c44-c681355d5430'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:18.589518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9631c48ce91049f284999f4d48f1f05d', 'request_id': 'req-1bc3820d-8b70-44fa-9c44-c681355d5430'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:18.628334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] The token cache is being invalidate because project 9631c48ce91049f284999f4d48f1f05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:18.629017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:18.632815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1bc3820d-8b70-44fa-9c44-c681355d5430 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:18.644810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3328/6659] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:18 2022] DELETE /identity/v3/projects/9631c48ce91049f284999f4d48f1f05d => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:18.646851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db49cec-f4fb-4ba7-8d91-e52c9dd8e0d2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:18.647374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db49cec-f4fb-4ba7-8d91-e52c9dd8e0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:18.649586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db49cec-f4fb-4ba7-8d91-e52c9dd8e0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:18.711591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6db49cec-f4fb-4ba7-8d91-e52c9dd8e0d2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:18.713254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6db49cec-f4fb-4ba7-8d91-e52c9dd8e0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:18.731630 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:18.792046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:18.800276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:18.800933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:18.801383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] PATH_INFO: `/v3/projects/689021c7158a4aec8c7640e9be7f3000` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:18.810340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=689021c7158a4aec8c7640e9be7f3000)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:18.817057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:18.972309 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3329/6660] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:18.975296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689021c7158a4aec8c7640e9be7f3000', 'request_id': 'req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:18.982440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:18.982811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:18.983112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:18.994636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689021c7158a4aec8c7640e9be7f3000', 'request_id': 'req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:19.027014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689021c7158a4aec8c7640e9be7f3000', 'request_id': 'req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:19.053680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:19.054990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:19.081860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] The token cache is being invalidate because project 689021c7158a4aec8c7640e9be7f3000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:19.084008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:19.087825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b99b9eb-14ec-4938-bdd0-f734b1e4e5ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:19.100525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3332/6661] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:18 2022] DELETE /identity/v3/projects/689021c7158a4aec8c7640e9be7f3000 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:19.107678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d3022-a7fc-480e-b4bc-168e1177c6de None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.109985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d3022-a7fc-480e-b4bc-168e1177c6de None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.111131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d3022-a7fc-480e-b4bc-168e1177c6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.219065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-de2d3022-a7fc-480e-b4bc-168e1177c6de None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:19.225800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-de2d3022-a7fc-480e-b4bc-168e1177c6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:19.250402 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:19.318865 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3330/6662] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:19.324497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:19.364416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b8ce7-71fb-4b06-bd54-bc88baa9e84d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:19.417824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:19.418838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.419316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.419774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.421199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:19.421798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:19.423669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:19.497998 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3331/6663] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:19.499328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:19.538667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338c0c9b-bf1c-4b1e-93af-7897007cfb90 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:19.555595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:19.557314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.557836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.558336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.559304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:19.563671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:19.570492 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3333/6664] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:19.585220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:19.593431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:19.593923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:19.693700 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3332/6665] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:19 2022] POST /identity/v3/projects => generated 367 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:19.694762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:19.695995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:19.697272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:19.979687 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3334/6666] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:19.980744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:19.989357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:19.991625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d03087-14e7-4ad0-96b9-4d8cbd93232a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.027434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.028311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.031197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.032700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.044305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.046481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.080659 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:20.110314 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3333/6667] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:19 2022] POST /identity/v3/users => generated 284 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:20.111597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.150480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6524c-fe21-47b4-b6ea-6c4584954664 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.174586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.176697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.176697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.176938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.177909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:20.178073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.179668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.217390 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3334/6668] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:20.218859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.271943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3794445-6cba-4189-bb4d-659ca53383b1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.322360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.323003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee70c59-b657-44c6-aa6b-803390a4eb9e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.323331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.323728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.324187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.325215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.327023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.342662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.343353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.343631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.344388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.355543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:20.361687 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3335/6669] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:20.362038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.396455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd13f9-bb7f-4341-a198-2d0fdff4cf90 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.407883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.410245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.423014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.424098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.424578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.425020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.425899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.428076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.442167 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3335/6670] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:20.443773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.467663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3ef0c-5df5-4706-b402-5bee6c69347d service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.484245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.485385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.485753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.486151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.487047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.494196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.531595 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3336/6671] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:20.536474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.537134 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3336/6672] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:20 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:20.542977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.574820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b66b57-bce6-40e1-8631-d51361ff34c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.701624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78dbf29-c5ec-4772-a059-3ad8b7eadb44 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.722137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.725640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.725935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.726219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.727115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.735031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.755091 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:20.804371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd21681-0300-4585-a931-8dc7a35bd144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.805301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd21681-0300-4585-a931-8dc7a35bd144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.805582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd21681-0300-4585-a931-8dc7a35bd144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.805858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd21681-0300-4585-a931-8dc7a35bd144 admin admin] PATH_INFO: `/v3/projects/71c53858c5804f9aafed265eef0d4050/users/b6fd1cce932148e2ad6e4b6a26984733/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.846717 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3337/6673] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:20 2022] POST /identity/v3/users => generated 292 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:20.851016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.872595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d891868-f977-4ac8-b8ae-c7d308ad5407 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.878796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:20.879670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.880314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.880757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.881998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.884255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.884448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd21681-0300-4585-a931-8dc7a35bd144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71c53858c5804f9aafed265eef0d4050, user_id=b6fd1cce932148e2ad6e4b6a26984733, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:20.887160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd21681-0300-4585-a931-8dc7a35bd144 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:20.898145 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3338/6674] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:20.903615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:20.945069 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3337/6675] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:20 2022] PUT /identity/v3/projects/71c53858c5804f9aafed265eef0d4050/users/b6fd1cce932148e2ad6e4b6a26984733/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:20.946925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:20.947533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ef7b65-4e56-486c-8a6a-fc78d6c227cf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:20.952408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:20.952408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:20.988556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] MFA Rules not processed for user `b6fd1cce932148e2ad6e4b6a26984733`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:20.990730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:21.085900 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3338/6676] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:20 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:21.143135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:21.143850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:21.144128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:21.144433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:21.145193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:21.146863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:21.154976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:21.155813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:21.195511 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:21.196470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3339/6677] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:21.197840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:21.216903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fd660c-49ba-458e-8b75-c153df697a01 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:21.232236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5db5e01-fabb-4f6c-9273-641bdbd8cdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:21.233639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5e01-fabb-4f6c-9273-641bdbd8cdbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:21.234150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5e01-fabb-4f6c-9273-641bdbd8cdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:21.234660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5db5e01-fabb-4f6c-9273-641bdbd8cdbb admin admin] PATH_INFO: `/v3/projects/6ad3110006fd46cba0c38f9a63998c11/users/192a8b362250405da8f3cc15be9c3b69/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:21.273942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db5e01-fabb-4f6c-9273-641bdbd8cdbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ad3110006fd46cba0c38f9a63998c11, user_id=192a8b362250405da8f3cc15be9c3b69, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:21.277641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5db5e01-fabb-4f6c-9273-641bdbd8cdbb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:21.340471 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3340/6678] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:21 2022] PUT /identity/v3/projects/6ad3110006fd46cba0c38f9a63998c11/users/192a8b362250405da8f3cc15be9c3b69/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:21.350726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:21.350997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:21.351271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:21.352438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc846d8-1cf1-4222-a0e5-dc508f2b2a97 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:21.424022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] MFA Rules not processed for user `192a8b362250405da8f3cc15be9c3b69`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:21.425872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:21.446441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:21.448721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:21.449429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:21.450375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:21.539130 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3341/6679] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:21.543720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:21.640832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:21.648568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:21.657409 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:21.684882 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3339/6680] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:21.710702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:21.713070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:21.839710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15296449-ea7e-4780-bd32-8cf84c6bdb50 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:21.862691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:21.863763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:21.868964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:21.869667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:21.870593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:21.890109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.036287 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3342/6681] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:21 2022] POST /identity/v3/projects => generated 381 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:22.041998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:22.068656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e997d0-4e42-4b12-bd6d-7ed4b1b66575 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:22.198618 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:22.263084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5697ac6-edb8-4466-bfba-20b911fe6e30 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:22.269447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:22.270540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.271081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.271600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.272686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:22.274967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.301655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:22.305121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.305444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.305729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] PATH_INFO: `/v3/projects/e5aa1c6b0617487d9abb5086d3a5dcd6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.310169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5aa1c6b0617487d9abb5086d3a5dcd6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:22.320592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.335798 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3343/6682] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:22 2022] POST /identity/v3/users => generated 297 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:22.339625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:22.358773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c3310-5353-40ba-beec-20bf49c7c29b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:22.374311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:22.375435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.375967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.376982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.378448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:22.380371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.408773 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3344/6683] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:37:22.413051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:22.434951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95c074c-c6c3-487b-9a23-e61ad9a349e7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:22.480337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5aa1c6b0617487d9abb5086d3a5dcd6', 'request_id': 'req-f6695cd8-aac3-442c-9ce9-947a515e8e2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:22.502112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5aa1c6b0617487d9abb5086d3a5dcd6', 'request_id': 'req-f6695cd8-aac3-442c-9ce9-947a515e8e2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:22.524852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5aa1c6b0617487d9abb5086d3a5dcd6', 'request_id': 'req-f6695cd8-aac3-442c-9ce9-947a515e8e2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:22.561232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:22.562257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.562611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.563077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] PATH_INFO: `/v3/projects/eb31ec3945ba4e18a13b6817ddbe8afa/users/63d540622bfe409fba7a881853cc9425/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.566800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] The token cache is being invalidate because project e5aa1c6b0617487d9abb5086d3a5dcd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:22.568872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:22.570049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f6695cd8-aac3-442c-9ce9-947a515e8e2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:22.577188 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3340/6684] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:21 2022] DELETE /identity/v3/projects/e5aa1c6b0617487d9abb5086d3a5dcd6 => generated 0 bytes in 868 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:22.582717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3c937-bd6f-4cf9-97e9-db549cdc3522 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.583116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3c937-bd6f-4cf9-97e9-db549cdc3522 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.583468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d3c937-bd6f-4cf9-97e9-db549cdc3522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.600004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb31ec3945ba4e18a13b6817ddbe8afa, user_id=63d540622bfe409fba7a881853cc9425, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:22.603223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.634704 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3345/6685] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:22 2022] PUT /identity/v3/projects/eb31ec3945ba4e18a13b6817ddbe8afa/users/63d540622bfe409fba7a881853cc9425/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:22.635895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:22.645951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:22.662349 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:22.674843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-26d3c937-bd6f-4cf9-97e9-db549cdc3522 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:22.676808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-26d3c937-bd6f-4cf9-97e9-db549cdc3522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:22.801479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d7efa4-7e99-4530-a7e0-923cd6bee52a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:22.847189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:22.848641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.850142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.851769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.852797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:22.854743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.901371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3346/6686] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:22.902884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:22.943231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35478738-b089-4baf-ae02-7e51a05f7016 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:22.944399 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3341/6687] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:22.952493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.954180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.956464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.969912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1849b-d6e2-4ab0-927f-3cdcdc3613d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:22.970879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1849b-d6e2-4ab0-927f-3cdcdc3613d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:22.973798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1849b-d6e2-4ab0-927f-3cdcdc3613d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:22.974059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1849b-d6e2-4ab0-927f-3cdcdc3613d5 admin admin] PATH_INFO: `/v3/projects/eb31ec3945ba4e18a13b6817ddbe8afa/users/63d540622bfe409fba7a881853cc9425/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:22.977857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1849b-d6e2-4ab0-927f-3cdcdc3613d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb31ec3945ba4e18a13b6817ddbe8afa, user_id=63d540622bfe409fba7a881853cc9425, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:22.986550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1849b-d6e2-4ab0-927f-3cdcdc3613d5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:22.999201 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3347/6688] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:22 2022] PUT /identity/v3/projects/eb31ec3945ba4e18a13b6817ddbe8afa/users/63d540622bfe409fba7a881853cc9425/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:23.010420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.010420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.010938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.011118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:23.012386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:23.098932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] MFA Rules not processed for user `63d540622bfe409fba7a881853cc9425`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:23.100239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:23.112698 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:23.170766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3342/6689] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:23.175434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.198828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bdcec7-a26a-4e2f-b5a2-80eb4ebfe82f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.207614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.208213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.208529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.208807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.209580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:23.209897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.211608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.247154 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3343/6690] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:37:23.253426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.275156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302127d-9c86-49ea-862d-c5b88116ec4c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.290069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.290069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.290428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.290519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.291268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.293397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.334898 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3348/6691] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:23.338143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.359256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3344/6692] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:23 2022] POST /identity/v3/projects => generated 391 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:23.363625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.368560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9c0cc-4acf-4e4a-bd99-58e6cfcea36a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.526813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ea6e6-003d-4348-b703-eded33e36f42 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.553836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.554705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.555007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.555273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.555988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.558331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.560118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.560860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.561156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.561435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.566547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.569790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invalid input for field 'name': '' is too short Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: '' Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise error Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application '' Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.586721 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:37:23.588968 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application '' Jul 19 11:37:23.590436 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.597486 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3349/6693] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:23 2022] POST /identity/v3/domains => generated 283 bytes in 262 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:37:23.599372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.621110 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3345/6694] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:23 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:23.627212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.640680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbc6d8-2e2e-4f3e-a35f-f9686f4d3828 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.657356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.658222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.658611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.659005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.660527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.662060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.663894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66cf3b7-59d9-4672-ace3-192af991c74f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: On instance['name']: Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise error Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.670457 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Jul 19 11:37:23.672133 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['name']: Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Jul 19 11:37:23.673663 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:23.676308 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3350/6695] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:23 2022] POST /identity/v3/domains => generated 412 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:37:23.680458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.684664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.685154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.685443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.685723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.686472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.690411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.701429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567f1f1-6dd7-4773-a40b-dbdf7400e034 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.715699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.717359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.717933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.719451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.722668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.724046 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3346/6696] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:23.728039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.731486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.759728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130380b-543b-4277-9463-df941cae6ace admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.775324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:23.776015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:23.776514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:23.777116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:23.778133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:23.780044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:23.780252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3351/6697] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:23 2022] POST /identity/v3/domains => generated 277 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:23.783452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.806403 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:23.818733 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3347/6698] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:23.823128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:23.849123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8e81e0-e47f-4424-a9ae-0350733ce061 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:23.982240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6c71c-e5c3-49c1-addd-e3642601cd1f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:24.002425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:24.003335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.003625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.003906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/422cff330b77475eb310077cfa036d96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.008444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7c6714-dc57-4325-8f1f-2f4b349c92c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:24.009364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6714-dc57-4325-8f1f-2f4b349c92c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.009701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6714-dc57-4325-8f1f-2f4b349c92c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.009980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7c6714-dc57-4325-8f1f-2f4b349c92c6 admin admin] PATH_INFO: `/v3/projects/2e09d572d8734e528cd1a191609f5299/users/24118fa2cb5d40589abdc2e15231925d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.047947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=422cff330b77475eb310077cfa036d96)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:24.049641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:24.074396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6714-dc57-4325-8f1f-2f4b349c92c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e09d572d8734e528cd1a191609f5299, user_id=24118fa2cb5d40589abdc2e15231925d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:24.083647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7c6714-dc57-4325-8f1f-2f4b349c92c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:24.087224 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:24.126956 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3348/6699] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:23 2022] PUT /identity/v3/projects/2e09d572d8734e528cd1a191609f5299/users/24118fa2cb5d40589abdc2e15231925d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Jul 19 11:37:24.134082 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Jul 19 11:37:24.135332 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:24.136016 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3352/6700] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:23 2022] DELETE /identity/v3/domains/422cff330b77475eb310077cfa036d96 => generated 120 bytes in 355 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:24.137504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.137794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.138082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.140609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:24.173031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14dc643-b8df-4d4b-b886-76eff85c2b62 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:24.205388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] MFA Rules not processed for user `24118fa2cb5d40589abdc2e15231925d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:24.206623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:24.361714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:24.365474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.367683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.369906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/422cff330b77475eb310077cfa036d96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.374562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=422cff330b77475eb310077cfa036d96)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:24.390223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:24.467479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3349/6701] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:24.473070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:24.481061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '422cff330b77475eb310077cfa036d96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:24.483123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '422cff330b77475eb310077cfa036d96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:24.500774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29356-dedc-423c-9f67-c0f3fd796cd8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:24.550292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '422cff330b77475eb310077cfa036d96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:24.552420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '422cff330b77475eb310077cfa036d96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:24.568218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3353/6702] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:24 2022] PATCH /identity/v3/domains/422cff330b77475eb310077cfa036d96 => generated 278 bytes in 428 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:24.572718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:24.575396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:24.705279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:24.706179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.706444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.706729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.707479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:24.708801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:24.808168 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:24.851542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c5fca-8677-4d14-adee-0b598bc13edd tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:24.858838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3350/6703] 10.222.0.15 () {60 vars in 1313 bytes} [Tue Jul 19 11:37:24 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 788 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:24.859776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:24.861754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:24.872512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:24.873437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.873733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.874011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/422cff330b77475eb310077cfa036d96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.890626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539fcf71-cc71-4c62-818b-8a6bf4aac0fa tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:24.895310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30405197-ccff-453c-97c0-2d688764af19 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:24.896618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405197-ccff-453c-97c0-2d688764af19 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.897078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405197-ccff-453c-97c0-2d688764af19 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.897530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30405197-ccff-453c-97c0-2d688764af19 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/5501a790adc44f7b87c12060595e1017` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.908423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=422cff330b77475eb310077cfa036d96)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:24.910602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:24.919022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30405197-ccff-453c-97c0-2d688764af19 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:get_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=5501a790adc44f7b87c12060595e1017)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:24.920725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30405197-ccff-453c-97c0-2d688764af19 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:24.925335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3351/6704] 10.222.0.15 () {58 vars in 1391 bytes} [Tue Jul 19 11:37:24 2022] GET /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/5501a790adc44f7b87c12060595e1017 => generated 688 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:24.927022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:24.927323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:24.927607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:24.955063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] MFA Rules not processed for user `24118fa2cb5d40589abdc2e15231925d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:24.956322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:24.976906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '422cff330b77475eb310077cfa036d96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:24.985852 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:25.005870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '422cff330b77475eb310077cfa036d96'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.222465 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3352/6705] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:24 2022] POST /identity/v3/auth/tokens => generated 3414 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Jul 19 11:37:25.226724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.240020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '422cff330b77475eb310077cfa036d96', 'request_id': 'req-8cd9e8fa-7c19-4241-8124-1c8add5f2229'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.263785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '422cff330b77475eb310077cfa036d96', 'request_id': 'req-8cd9e8fa-7c19-4241-8124-1c8add5f2229'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.286802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '422cff330b77475eb310077cfa036d96', 'request_id': 'req-8cd9e8fa-7c19-4241-8124-1c8add5f2229'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.316017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] The token cache is being invalidate because project 422cff330b77475eb310077cfa036d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:25.316306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.317129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.346117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '422cff330b77475eb310077cfa036d96', 'request_id': 'req-8cd9e8fa-7c19-4241-8124-1c8add5f2229'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.347638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '422cff330b77475eb310077cfa036d96', 'request_id': 'req-8cd9e8fa-7c19-4241-8124-1c8add5f2229'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.350130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '422cff330b77475eb310077cfa036d96', 'request_id': 'req-8cd9e8fa-7c19-4241-8124-1c8add5f2229'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:25.378025 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3354/6706] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:24 2022] DELETE /identity/v3/domains/422cff330b77475eb310077cfa036d96 => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:25.382998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.384548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:25.406607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3590a60-24d0-4d21-870d-49d50a96b945 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.411472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.412489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.412780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.413064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/5501a790adc44f7b87c12060595e1017` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.425438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=5501a790adc44f7b87c12060595e1017)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:25.427104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:25.457901 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3353/6707] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:25 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/5501a790adc44f7b87c12060595e1017 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:25.459074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.469538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:25.495023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739d0a2f-0581-4d11-bdf5-a0989ca9c2d3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.499527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.500477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.500770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.501059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.501810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:25.503012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:25.562731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd9e8fa-7c19-4241-8124-1c8add5f2229 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.582895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.584863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.585153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.585434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/8f4e1fe1ad944b86be3c8a343becc3db` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.612832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:25.635651 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Could not find domain: 8f4e1fe1ad944b86be3c8a343becc3db.: keystone.exception.DomainNotFound: Could not find domain: 8f4e1fe1ad944b86be3c8a343becc3db. Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 8f4e1fe1ad944b86be3c8a343becc3db. Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:25.643093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:25.644638 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:25.646038 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 8f4e1fe1ad944b86be3c8a343becc3db. Jul 19 11:37:25.647482 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.647657 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3355/6708] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:25 2022] DELETE /identity/v3/domains/8f4e1fe1ad944b86be3c8a343becc3db => generated 112 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:25.652773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.678713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5577b81-14a8-4b10-8fb7-509945edb68b tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.690453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.691473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.691839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.692313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.693848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:25.696488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:25.699847 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3354/6709] 10.222.0.15 () {60 vars in 1314 bytes} [Tue Jul 19 11:37:25 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 921 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:25.714712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.725450 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3356/6710] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:25 2022] POST /identity/v3/domains => generated 252 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:25.726710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.752135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08fd61-8b26-463a-be41-c77be6d66c29 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.756672 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:25.839544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0eb7b-e7cd-4ec0-a0df-098b04157de8 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.850886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.853957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.855408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.855763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.858621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:25.863071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:25.863938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.865137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.872848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.873431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/19d3a8e944de4f3bb49171def3211502` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.880669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.sql.core [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-202433494' for key 'project.ixu_project_name_domain_id'") Jul 19 11:37:25.880669 n-d-master-1 devstack@keystone.service[80580]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 11:37:25.880669 n-d-master-1 devstack@keystone.service[80580]: [parameters: {'id': '30448aa2eb6944b7abc63829d3cf666c', 'name': 'tempest-domain-dup-202433494', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 19 11:37:25.880669 n-d-master-1 devstack@keystone.service[80580]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80580) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-202433494.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-202433494. Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application conn.query(q) Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 11:37:25.898813 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result.read() Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-202433494' for key 'project.ixu_project_name_domain_id'") Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 19 11:37:25.900145 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application next(self.gen) Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application yield resource Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application next(self.gen) Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.session.rollback() Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.force_reraise() Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise self.value Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application session.commit() Jul 19 11:37:25.901699 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._prepare_impl() Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.session.flush() Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._flush(objects) Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application compat.raise_( Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application flush_context.execute() Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 19 11:37:25.903129 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rec.execute(self) Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 19 11:37:25.904619 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result = self._query(query) Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application conn.query(q) Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application result.read() Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 19 11:37:25.905986 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-202433494' for key 'project.ixu_project_name_domain_id'") Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [parameters: {'id': '30448aa2eb6944b7abc63829d3cf666c', 'name': 'tempest-domain-dup-202433494', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.907397 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-202433494. Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:25.908620 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-202433494. Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:25.917111 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3357/6711] 10.222.0.15 () {60 vars in 1148 bytes} [Tue Jul 19 11:37:25 2022] POST /identity/v3/domains => generated 211 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:37:25.918424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=19d3a8e944de4f3bb49171def3211502)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:25.918545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.918658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:25.939570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d7c3e6-0cc8-42b0-97eb-16a9acabffa7 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.954308 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3355/6712] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:25 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/19d3a8e944de4f3bb49171def3211502 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:25.955264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.957935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.957935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.957935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/868479e5240b4b5fa5affd084a627e82` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.959447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:25.983139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6fef6d-d714-4814-9c46-14b9f97b56c3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:25.990877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:25.992078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:25.992586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:25.993037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:25.994027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:25.995437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:26.001024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=868479e5240b4b5fa5affd084a627e82)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:26.007227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:26.068820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '868479e5240b4b5fa5affd084a627e82'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.070204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '868479e5240b4b5fa5affd084a627e82'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.125190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '868479e5240b4b5fa5affd084a627e82'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.126269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '868479e5240b4b5fa5affd084a627e82'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.131978 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3358/6713] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:25 2022] PATCH /identity/v3/domains/868479e5240b4b5fa5affd084a627e82 => generated 253 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:26.137264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:26.146026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:26.223567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3356/6714] 10.222.0.15 () {60 vars in 1314 bytes} [Tue Jul 19 11:37:25 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 812 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:26.226655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:26.229227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:26.283787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23259fc0-7501-45e2-8a47-d5d4308e2925 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:26.411396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf4b15-ccb8-4ef8-afbb-db390a6b535f tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:26.463005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:26.463455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:26.464649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:26.464649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:26.465030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/6ea52cb2865d4342bff656579372c1e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:26.468499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:26.469280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:26.470804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/868479e5240b4b5fa5affd084a627e82` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:26.479641 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:26.485726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=6ea52cb2865d4342bff656579372c1e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:26.487632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:26.509681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=868479e5240b4b5fa5affd084a627e82)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:26.512506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:26.535641 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3357/6715] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:26 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/6ea52cb2865d4342bff656579372c1e9 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:26.542618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:26.567248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9513c2c-0037-4373-89cc-a7ae4589e80e tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:26.580324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:26.581288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:26.581576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:26.581858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:26.582627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:26.583863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:26.613203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '868479e5240b4b5fa5affd084a627e82'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.630359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '868479e5240b4b5fa5affd084a627e82'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.736196 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:26.779720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868479e5240b4b5fa5affd084a627e82', 'request_id': 'req-90584915-cd8b-4eff-aebf-8d46f38c46ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.812850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868479e5240b4b5fa5affd084a627e82', 'request_id': 'req-90584915-cd8b-4eff-aebf-8d46f38c46ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.827968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868479e5240b4b5fa5affd084a627e82', 'request_id': 'req-90584915-cd8b-4eff-aebf-8d46f38c46ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.829716 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3358/6716] 10.222.0.15 () {60 vars in 1313 bytes} [Tue Jul 19 11:37:26 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 788 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:26.831079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:26.863213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e97232f-cb86-49ab-8250-8f5c32c7f14c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:26.879104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] The token cache is being invalidate because project 868479e5240b4b5fa5affd084a627e82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:26.879696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.881455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.902015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '868479e5240b4b5fa5affd084a627e82', 'request_id': 'req-90584915-cd8b-4eff-aebf-8d46f38c46ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.907083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '868479e5240b4b5fa5affd084a627e82', 'request_id': 'req-90584915-cd8b-4eff-aebf-8d46f38c46ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.908044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '868479e5240b4b5fa5affd084a627e82', 'request_id': 'req-90584915-cd8b-4eff-aebf-8d46f38c46ef'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:26.936143 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3359/6717] 10.222.0.15 () {58 vars in 1229 bytes} [Tue Jul 19 11:37:26 2022] DELETE /identity/v3/domains/868479e5240b4b5fa5affd084a627e82 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:26.937176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:26.938647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:27.036670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90584915-cd8b-4eff-aebf-8d46f38c46ef tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.044756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '63d540622bfe409fba7a881853cc9425', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.045959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.046408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.047009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] PATH_INFO: `/v3/domains/422cff330b77475eb310077cfa036d96` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.059640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.060582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.066133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 19 11:37:27.069710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.073172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.076897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Could not find domain: 422cff330b77475eb310077cfa036d96.: keystone.exception.DomainNotFound: Could not find domain: 422cff330b77475eb310077cfa036d96. Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 422cff330b77475eb310077cfa036d96. Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:27.080511 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:27.081979 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:27.083468 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 422cff330b77475eb310077cfa036d96. Jul 19 11:37:27.084922 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:37:27.085024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:27.086634 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3360/6718] 10.222.0.15 () {60 vars in 1248 bytes} [Tue Jul 19 11:37:26 2022] PATCH /identity/v3/domains/422cff330b77475eb310077cfa036d96 => generated 112 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:27.092450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:27.096270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:27.201310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db6292-93d8-4b72-ad37-c06bcfc22076 tempest-DomainsNegativeTestJSON-674956503 tempest-DomainsNegativeTestJSON-674956503-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.216206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.217636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.218085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.218517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] PATH_INFO: `/v3/users/192a8b362250405da8f3cc15be9c3b69` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.220390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=192a8b362250405da8f3cc15be9c3b69)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.227284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:27.323223 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3359/6719] 10.222.0.15 () {60 vars in 1313 bytes} [Tue Jul 19 11:37:26 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 788 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:27.325420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:27.329004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:27.332602 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:27.352199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '192a8b362250405da8f3cc15be9c3b69'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:27.360073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc7ea6-39d4-4fab-a498-a1996ca27208 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.374187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '192a8b362250405da8f3cc15be9c3b69'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:27.376480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.377504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.380114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.380737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.383759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:list_application_credentials(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.387904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:27.407859 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3360/6720] 10.222.0.15 () {58 vars in 1292 bytes} [Tue Jul 19 11:37:27 2022] GET /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 1500 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:27.412094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:27.414997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '192a8b362250405da8f3cc15be9c3b69'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:27.416165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '192a8b362250405da8f3cc15be9c3b69'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:27.434242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-51905f6e-6853-4693-97b0-11556efb11f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '192a8b362250405da8f3cc15be9c3b69'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:27.446856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8a590-c549-4c8f-b825-b2624355c56c tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.457007 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3361/6721] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:27 2022] DELETE /identity/v3/users/192a8b362250405da8f3cc15be9c3b69 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:27.458611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.460870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.461166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.473776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.478895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.479672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.479967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/355176593eef4781bbc2fa09fdb18f5d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.490161 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:27.504630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:27.510237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:27.518052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=355176593eef4781bbc2fa09fdb18f5d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.524003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:27.581440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3361/6722] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:27 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/355176593eef4781bbc2fa09fdb18f5d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:27.585562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:27.592768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:27.627349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd71cca-d1b6-4273-b222-be122dcf7bd3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.654518 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3362/6723] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:27.684703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:27.687395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:27.794375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.795351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.795635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.800110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/82a72ecd952d4af88da09185e68c70de` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.833319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=82a72ecd952d4af88da09185e68c70de)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.835892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:27.874756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3362/6724] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:27 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/82a72ecd952d4af88da09185e68c70de => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:27.882461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:27.902662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793191a2-3748-4e28-9e8d-11fd535de9d0 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.913580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.914963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.915430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.915916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.917365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.919892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc278d9-35b8-4655-ac50-424ace2a0e7f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:27.921214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:27.938364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:27.942730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:27.943016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:27.943750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:27.990726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:27.992627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:28.021531 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3363/6725] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:28.143383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3363/6726] 10.222.0.15 () {60 vars in 1313 bytes} [Tue Jul 19 11:37:27 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 789 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:28.158839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:28.229665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d9efa-41f4-4d1d-98ee-f50a4398e5e9 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:28.249813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:28.255947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:28.256302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:28.256612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:28.263342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:create_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:28.266000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:28.421981 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:28.551717 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3364/6727] 10.222.0.15 () {60 vars in 1313 bytes} [Tue Jul 19 11:37:28 2022] POST /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials => generated 789 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:28.552501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:28.552501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587a96b-bf66-47e4-a101-8fc4974f4eeb tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:28.552501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:28.553003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:28.553003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:28.553003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:28.553003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Adding query filter params (name=tempest-application_credential-1042458778) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:28.553235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:list_application_credentials(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:28.556016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:28.601356 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3364/6728] 10.222.0.15 () {58 vars in 1385 bytes} [Tue Jul 19 11:37:28 2022] GET /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials?name=tempest-application_credential-1042458778 => generated 887 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:28.605606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:28.627124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c5debb-f4fc-4696-88ca-62af0921aa3f tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:28.644786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:28.648789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:28.650042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:28.650809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/baf3fa1491314da582cf0e633cf0463d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:28.693392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=baf3fa1491314da582cf0e633cf0463d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:28.696080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:28.754053 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3365/6729] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:28 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/baf3fa1491314da582cf0e633cf0463d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:28.760148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:28.780179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43781bb9-0039-48bf-8d8e-b72206d48fe5 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:28.799307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1c0185-0be4-430a-8907-2a76ec8cc4e3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '24118fa2cb5d40589abdc2e15231925d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2e09d572d8734e528cd1a191609f5299', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:28.801425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0185-0be4-430a-8907-2a76ec8cc4e3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:28.804185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0185-0be4-430a-8907-2a76ec8cc4e3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:28.804807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1c0185-0be4-430a-8907-2a76ec8cc4e3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/5f8a04ff634440e5bf410f8b4ab1cf7a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:28.846480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c0185-0be4-430a-8907-2a76ec8cc4e3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorizing `identity:delete_application_credential(user_id=24118fa2cb5d40589abdc2e15231925d, application_credential_id=5f8a04ff634440e5bf410f8b4ab1cf7a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:28.852212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1c0185-0be4-430a-8907-2a76ec8cc4e3 tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:28.902480 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3365/6730] 10.222.0.15 () {58 vars in 1394 bytes} [Tue Jul 19 11:37:28 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d/application_credentials/5f8a04ff634440e5bf410f8b4ab1cf7a => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:28.909053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:28.911708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:28.943453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c82f183-7bd3-4558-95c8-1a21a1e79dbe tempest-ApplicationCredentialsV3Test-448641304 tempest-ApplicationCredentialsV3Test-448641304-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:28.956657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:28.957890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:28.958357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:28.958815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] PATH_INFO: `/v3/users/24118fa2cb5d40589abdc2e15231925d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:28.964060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] RBAC: Authorizing `identity:delete_user(user_id=24118fa2cb5d40589abdc2e15231925d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:28.966562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:29.106252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24118fa2cb5d40589abdc2e15231925d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.126561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24118fa2cb5d40589abdc2e15231925d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.189791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24118fa2cb5d40589abdc2e15231925d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.190557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24118fa2cb5d40589abdc2e15231925d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.210571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24118fa2cb5d40589abdc2e15231925d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.222535 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3366/6731] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:28 2022] DELETE /identity/v3/users/24118fa2cb5d40589abdc2e15231925d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:29.227177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:29.227634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:29.228219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:29.301909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:29.307607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:29.321960 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:29.475239 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3366/6732] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:29.523911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:29.525696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:29.675897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:29.677548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:29.699180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445e769-568d-4351-9145-9ff39f86052e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:29.702557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb2e65e-4182-4c82-a45a-2c3d1f603a34 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:29.709343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:29.710039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:29.710343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:29.710618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:29.717125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:29.719261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:29.721057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:29.722461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] PATH_INFO: `/v3/projects/6ad3110006fd46cba0c38f9a63998c11` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:29.728712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ad3110006fd46cba0c38f9a63998c11)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:29.736034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:29.738328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:29.742545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:29.781339 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3367/6733] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:29.897306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ad3110006fd46cba0c38f9a63998c11', 'request_id': 'req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.913358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ad3110006fd46cba0c38f9a63998c11', 'request_id': 'req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.936335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ad3110006fd46cba0c38f9a63998c11', 'request_id': 'req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.976151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] The token cache is being invalidate because project 6ad3110006fd46cba0c38f9a63998c11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:29.976763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.978053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:29.979826 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3367/6734] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:29 2022] DELETE /identity/v3/projects/6ad3110006fd46cba0c38f9a63998c11 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:29.983873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:30.000950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b01d795-5d98-4ec5-aea9-3ebaf5a56d52 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:30.068208 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:DELETE=12 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:30.180585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:30.182872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:30.183162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:30.184567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] PATH_INFO: `/v3/users/63d540622bfe409fba7a881853cc9425` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:30.189246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d540622bfe409fba7a881853cc9425)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:30.194374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:30.402014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d540622bfe409fba7a881853cc9425'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:30.450800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d540622bfe409fba7a881853cc9425'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:30.486978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d540622bfe409fba7a881853cc9425'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:30.490213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d540622bfe409fba7a881853cc9425'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:30.523125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1b48c41-0b2a-403e-9df1-f6f31a9a56a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d540622bfe409fba7a881853cc9425'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:30.543868 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3368/6735] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:29 2022] DELETE /identity/v3/users/63d540622bfe409fba7a881853cc9425 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:31.071685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:31.073744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:31.099086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9bc4c-8fbe-474c-ad58-648642cae4f6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:31.197663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:31.199147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:31.199921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:31.200222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] PATH_INFO: `/v3/projects/2e09d572d8734e528cd1a191609f5299` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:31.201619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e09d572d8734e528cd1a191609f5299)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:31.203978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:31.270614 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:31.302261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e09d572d8734e528cd1a191609f5299', 'request_id': 'req-98ccb226-3383-4aeb-9ad0-506e14e10848'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:31.309160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e09d572d8734e528cd1a191609f5299', 'request_id': 'req-98ccb226-3383-4aeb-9ad0-506e14e10848'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:31.329161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e09d572d8734e528cd1a191609f5299', 'request_id': 'req-98ccb226-3383-4aeb-9ad0-506e14e10848'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:31.346900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] The token cache is being invalidate because project 2e09d572d8734e528cd1a191609f5299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:31.347158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:31.347827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-98ccb226-3383-4aeb-9ad0-506e14e10848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:31.349802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3368/6736] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:31 2022] DELETE /identity/v3/projects/2e09d572d8734e528cd1a191609f5299 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:31.355186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:31.355836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:31.355836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:31.393645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:31.397215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:31.588163 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3369/6737] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:31.598480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:31.598903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:31.599311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:31.659119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:31.661665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:31.703405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:31.718758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe0fdfd-b32f-4f89-b145-68be9e9cad39 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:31.723717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3369/6738] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:31.734674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:31.735711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:31.737212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:31.737769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:31.739265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:31.742150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:31.747211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:31.780946 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3370/6739] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:31.787079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:31.822285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7916ab3-cc22-4568-b4ff-88d269ee365e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:31.831847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:31.833369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:31.833671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:31.833952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:31.835021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:31.845161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:31.926096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3370/6740] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:31 2022] POST /identity/v3/projects => generated 373 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:31.930622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:31.950707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399549eb-2412-44a4-8d5b-bacc38521d86 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:32.061515 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:32.142611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:32.144752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:32.145686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:32.147016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:32.150853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:32.156611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:32.210504 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3371/6741] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:31 2022] POST /identity/v3/users => generated 287 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:32.210812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:32.230662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58768def-0307-4813-86b2-fd22d53c880f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:32.250413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:32.252509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:32.255881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:32.256993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:32.258358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:32.265246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:32.306113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3371/6742] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:32.309932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:32.325959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec17f5-3053-4986-a6ac-7ab43ff1120a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:32.345581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d87855e-57fb-4d1e-ae80-e990bf6198be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:32.346717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87855e-57fb-4d1e-ae80-e990bf6198be admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:32.349324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87855e-57fb-4d1e-ae80-e990bf6198be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:32.350555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d87855e-57fb-4d1e-ae80-e990bf6198be admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:32.353347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87855e-57fb-4d1e-ae80-e990bf6198be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:32.356959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d87855e-57fb-4d1e-ae80-e990bf6198be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:32.386384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3372/6743] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:32.390928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:32.425144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cbbe6f-ab71-407c-a9b9-9d5dd34123a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:32.463500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:32.464935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:32.468302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:32.468745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] PATH_INFO: `/v3/projects/df3c1fbe58104ccba581f14812add852/users/39bc1fd6c5ef467e8b08c85720c917b4/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:32.514794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df3c1fbe58104ccba581f14812add852, user_id=39bc1fd6c5ef467e8b08c85720c917b4, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:32.517944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:32.556781 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3372/6744] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:32 2022] PUT /identity/v3/projects/df3c1fbe58104ccba581f14812add852/users/39bc1fd6c5ef467e8b08c85720c917b4/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:32.568885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:32.569573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:32.570138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:32.637305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] MFA Rules not processed for user `39bc1fd6c5ef467e8b08c85720c917b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:32.639646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:32.850513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3373/6745] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:32.851113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:32.880193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4b9858-d247-4110-a6f4-c6a0b5fe160e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:32.905849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:32.908569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:32.909761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:32.911895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:32.915175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:32.921318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:32.976855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.001962 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3373/6746] 10.222.0.15 () {60 vars in 1298 bytes} [Tue Jul 19 11:37:32 2022] POST /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2 => generated 367 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:33.002451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5f3072-fded-4b8f-b801-bd7e4a3bafeb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.017993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.027769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.027769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.027769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/0802e4852c194e6195c6f3bd1ad35c82` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.038481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4, credential_id=0802e4852c194e6195c6f3bd1ad35c82)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.051932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.134718 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3374/6747] 10.222.0.15 () {58 vars in 1379 bytes} [Tue Jul 19 11:37:32 2022] DELETE /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/0802e4852c194e6195c6f3bd1ad35c82 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:33.135547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.164241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06974a39-ed9c-4612-a06f-b1bf889a8782 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.185901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.190218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.190218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.190218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.190540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.194507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.254326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3374/6748] 10.222.0.15 () {60 vars in 1298 bytes} [Tue Jul 19 11:37:33 2022] POST /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2 => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:33.258975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.275913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0dddee-8398-44ec-901b-2bbe239d8f74 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.289683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.294112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.296093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.296760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/195d429e14e5441d8d5078f978d30897` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.301743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4, credential_id=195d429e14e5441d8d5078f978d30897)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.305777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.352811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3375/6749] 10.222.0.15 () {58 vars in 1379 bytes} [Tue Jul 19 11:37:33 2022] DELETE /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/195d429e14e5441d8d5078f978d30897 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:33.354183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.371620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a0204-bedd-403b-b222-3100c8fe729f tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.401492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.402830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.421900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.422248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/195d429e14e5441d8d5078f978d30897` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Could not find credential: 596e948942fee7086df0a9c8e54fd199e17eba539a129c8b1f23be53717e2c9e.: keystone.exception.CredentialNotFound: Could not find credential: 596e948942fee7086df0a9c8e54fd199e17eba539a129c8b1f23be53717e2c9e. Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Jul 19 11:37:33.485003 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:33.485894 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: 596e948942fee7086df0a9c8e54fd199e17eba539a129c8b1f23be53717e2c9e. Jul 19 11:37:33.486761 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:33.487497 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3375/6750] 10.222.0.15 () {58 vars in 1376 bytes} [Tue Jul 19 11:37:33 2022] GET /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/195d429e14e5441d8d5078f978d30897 => generated 148 bytes in 134 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:33.493000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.518490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61992d3-f887-4210-bc53-db843dff22bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.536529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.538025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.538474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.538907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.539786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.542059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.574000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3376/6751] 10.222.0.15 () {60 vars in 1298 bytes} [Tue Jul 19 11:37:33 2022] POST /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2 => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:33.580064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.592767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026dbb3c-1c16-45b8-bf1e-2124cee6eb33 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.601919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.605586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.606071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.606493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.609118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.616871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.656249 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3376/6752] 10.222.0.15 () {60 vars in 1298 bytes} [Tue Jul 19 11:37:33 2022] POST /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2 => generated 367 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:33.660444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.675202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9979e7-854a-400c-9241-9d4a02993993 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.684724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.685589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.685869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.686146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.686814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.688519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.719662 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3377/6753] 10.222.0.15 () {58 vars in 1277 bytes} [Tue Jul 19 11:37:33 2022] GET /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2 => generated 865 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:33.725107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.739783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee546c4f-4194-4625-8f33-cd6ae067b178 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.768668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.776665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.777142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.778470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/fdc22c9889aa464b9827f4a147489b3e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.785198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4, credential_id=fdc22c9889aa464b9827f4a147489b3e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.789391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.826118 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3377/6754] 10.222.0.15 () {58 vars in 1379 bytes} [Tue Jul 19 11:37:33 2022] DELETE /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/fdc22c9889aa464b9827f4a147489b3e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:33.830969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.845458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99c545e-d7e3-46db-a493-2cbf262b7f97 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.854362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.860333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.860708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.861020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/a84d148426fa4a10a1965fd09233c34b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.871628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4, credential_id=a84d148426fa4a10a1965fd09233c34b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.873323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:33.931552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3378/6755] 10.222.0.15 () {58 vars in 1379 bytes} [Tue Jul 19 11:37:33 2022] DELETE /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/a84d148426fa4a10a1965fd09233c34b => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:33.936895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.955725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add12403-cd04-414d-ba73-de2714a3d2bf tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:33.981049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:33.982779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:33.995141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:33.996040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:33.996329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:33.996633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:33.997330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:33.998896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.074023 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3378/6756] 10.222.0.15 () {60 vars in 1298 bytes} [Tue Jul 19 11:37:33 2022] POST /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2 => generated 367 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:34.083970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:34.119087 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:34.135675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5216b382-ca59-4360-87b7-261de5fe6be7 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:34.163057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:34.164094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.164302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.164557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/0e04eda0ad664ac5a89809f371f2b1f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.174904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4, credential_id=0e04eda0ad664ac5a89809f371f2b1f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:34.184158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.190472 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3379/6757] 10.222.0.15 () {58 vars in 1376 bytes} [Tue Jul 19 11:37:34 2022] GET /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/0e04eda0ad664ac5a89809f371f2b1f5 => generated 367 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:34.194468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395559e4-3cf4-468b-a758-571d2c3a40aa tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:34.201630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:34.202073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:34.202546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.202922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.203206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] PATH_INFO: `/v3/projects/eb31ec3945ba4e18a13b6817ddbe8afa` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.207855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb31ec3945ba4e18a13b6817ddbe8afa)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:34.209648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.233263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649f8d7-4e84-4c0f-ab12-cfc5bca20201 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:34.243637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '39bc1fd6c5ef467e8b08c85720c917b4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'df3c1fbe58104ccba581f14812add852', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:34.245089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.246279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.246893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/0e04eda0ad664ac5a89809f371f2b1f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.252641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=39bc1fd6c5ef467e8b08c85720c917b4, credential_id=0e04eda0ad664ac5a89809f371f2b1f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:34.256082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.297104 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3380/6758] 10.222.0.15 () {58 vars in 1379 bytes} [Tue Jul 19 11:37:34 2022] DELETE /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4/credentials/OS-EC2/0e04eda0ad664ac5a89809f371f2b1f5 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:34.317255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:34.369590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c40ec2-7e54-4f60-98f3-81f42eb95b38 tempest-EC2CredentialsTest-2145002692 tempest-EC2CredentialsTest-2145002692-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:34.375081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'request_id': 'req-5357b02d-851e-4a06-9eb4-015750578751'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.396768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'request_id': 'req-5357b02d-851e-4a06-9eb4-015750578751'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.411145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb31ec3945ba4e18a13b6817ddbe8afa', 'request_id': 'req-5357b02d-851e-4a06-9eb4-015750578751'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.449698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] The token cache is being invalidate because project eb31ec3945ba4e18a13b6817ddbe8afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:34.449982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.456856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5357b02d-851e-4a06-9eb4-015750578751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.460635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3379/6759] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:33 2022] DELETE /identity/v3/projects/eb31ec3945ba4e18a13b6817ddbe8afa => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:34.473735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39f73-5a03-4e27-8982-10222d429585 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.473909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39f73-5a03-4e27-8982-10222d429585 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.474142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b39f73-5a03-4e27-8982-10222d429585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.490408 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=86,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:34.541606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-20b39f73-5a03-4e27-8982-10222d429585 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:34.542863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-20b39f73-5a03-4e27-8982-10222d429585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:34.615196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:34.616125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.616484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.616756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] PATH_INFO: `/v3/users/39bc1fd6c5ef467e8b08c85720c917b4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.618071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39bc1fd6c5ef467e8b08c85720c917b4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:34.620875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.778593 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3380/6760] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:34.780576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.781007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.781476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.803799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39bc1fd6c5ef467e8b08c85720c917b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.806695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:34.806964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39bc1fd6c5ef467e8b08c85720c917b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.808390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:34.818952 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3381/6761] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:34.823915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:34.829251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39bc1fd6c5ef467e8b08c85720c917b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.830522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39bc1fd6c5ef467e8b08c85720c917b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.850267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbe7e4b-bf6b-45e6-a346-efcbdd71132e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:34.857537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:34.858564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.858984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.859665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.860870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:34.861348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:34.864100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-240684ca-d886-41c4-b055-7a38a8bd3f98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39bc1fd6c5ef467e8b08c85720c917b4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:34.865107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.886059 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3382/6762] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:34.887699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:34.900873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a42e179-565d-4b8e-96fe-cfbb1437dfdb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:34.919917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:34.921439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.922089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.923196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.924223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:34.926665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:34.938770 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3381/6763] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:34 2022] DELETE /identity/v3/users/39bc1fd6c5ef467e8b08c85720c917b4 => generated 0 bytes in 635 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:34.953044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:34.953778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:34.953778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:34.989740 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3383/6764] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:34 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:35.002719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.026453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:35.027881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:35.096239 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:35.189619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7de32-6318-46b8-8cc2-6f873cbf3b5c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:35.203509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:35.204145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.204439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.204717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.205417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:35.212503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:35.216706 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3382/6765] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:35.267587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.273027 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3384/6766] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:34 2022] POST /identity/v3/users => generated 284 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:35.283265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553394f4-9540-495e-a687-b55fcf39df85 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:35.296250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:35.297158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.297767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.298105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.298892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:35.301909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:35.338659 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3383/6767] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:35.340387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.341083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.347441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:35.354932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f81859-2492-4d1d-a35a-9b87ea6b4566 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:35.376934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:35.380334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.380639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.380913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.387077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:35.388926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:35.431765 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3385/6768] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:35.442882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.473900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0635dfe8-78c1-4861-acbc-28049da49298 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:35.492906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b3a8a-eb8f-49b6-845b-7f23eca4d477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:35.498013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3a8a-eb8f-49b6-845b-7f23eca4d477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.498297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3a8a-eb8f-49b6-845b-7f23eca4d477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.499053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b3a8a-eb8f-49b6-845b-7f23eca4d477 admin admin] PATH_INFO: `/v3/projects/0e1fadaacd564994b6e175a8999054c1/users/5a7adca222f54c888c8c6d0f9e3d3f41/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.499183 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:35.553302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b3a8a-eb8f-49b6-845b-7f23eca4d477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1fadaacd564994b6e175a8999054c1, user_id=5a7adca222f54c888c8c6d0f9e3d3f41, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:35.556035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b3a8a-eb8f-49b6-845b-7f23eca4d477 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:35.580319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca3180-782e-4a51-9272-8fe86074b0dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:35.599134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:35.599874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.600160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.600455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.612583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3386/6769] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:35 2022] PUT /identity/v3/projects/0e1fadaacd564994b6e175a8999054c1/users/5a7adca222f54c888c8c6d0f9e3d3f41/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:35.617050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.617338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.617618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.645888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:35.647516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:35.660336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3384/6770] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:35.685555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] MFA Rules not processed for user `5a7adca222f54c888c8c6d0f9e3d3f41`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:35.687461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:35.785014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.787102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:35.813484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70ddd13-4db1-4807-9d0e-1e3fc68a61b9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:35.867671 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3387/6771] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:35 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:35.869177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:35.969733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:35.972905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:35.973209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:35.973500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] PATH_INFO: `/v3/users/e5997ac4e85e46a980c29eaeb78f9dd6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:35.984999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5997ac4e85e46a980c29eaeb78f9dd6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:35.987425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:35.991223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f588e-ba8a-4fea-ac31-4262118cc4a6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.007933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.008704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.008990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.009258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.010051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.012012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.039239 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:36.078959 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3388/6772] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:35 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:36.081944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5997ac4e85e46a980c29eaeb78f9dd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:36.082807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5997ac4e85e46a980c29eaeb78f9dd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:36.083655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:36.089260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:36.096227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5997ac4e85e46a980c29eaeb78f9dd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:36.097359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5997ac4e85e46a980c29eaeb78f9dd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:36.108577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2ee89cb6-3b81-41f5-ba34-ea8e1e548a81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5997ac4e85e46a980c29eaeb78f9dd6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:36.138047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3385/6773] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:35 2022] DELETE /identity/v3/users/e5997ac4e85e46a980c29eaeb78f9dd6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:36.140287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.141536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.142212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.169818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:36.171431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:36.255703 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:36.277214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c83c5-ad42-48bf-b24b-283eb9f7894f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.291607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.301253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.301556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.316331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.317128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.325872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3386/6774] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:36.336374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.369052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:36.372189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:36.415660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3389/6775] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:36 2022] POST /identity/v3/users => generated 291 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:36.421522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:36.462295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee0fdc-4329-4227-b200-e20a392fded0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.487055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.488224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.491112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.491686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.492809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.494885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.512471 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3390/6776] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:36.513492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:36.526538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8eb87e-b7ff-480d-8317-f6aae2507f3c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.538387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.539244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.539529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.539810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] PATH_INFO: `/v3/projects/e654ef485da7443980a2c7cc01aca077/users/adfb3b37f7974762a3da052053c14f83/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.559188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffd650-3eb1-4820-805f-de367047b47c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.567969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e654ef485da7443980a2c7cc01aca077, user_id=adfb3b37f7974762a3da052053c14f83, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.568583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.569325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.569638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.570010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.573386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.600482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3391/6777] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:36 2022] PUT /identity/v3/projects/e654ef485da7443980a2c7cc01aca077/users/adfb3b37f7974762a3da052053c14f83/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:36.605070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:36.605298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.606865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.630901 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3387/6778] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:37:36.809962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a71cc4-2b72-4e64-9852-194ae0620814 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.818138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2689b060-e4b6-4820-b08a-a97589f9d807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.819645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b060-e4b6-4820-b08a-a97589f9d807 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.820067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b060-e4b6-4820-b08a-a97589f9d807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.820372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2689b060-e4b6-4820-b08a-a97589f9d807 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.821243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b060-e4b6-4820-b08a-a97589f9d807 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.823413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2689b060-e4b6-4820-b08a-a97589f9d807 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.839860 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3392/6779] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:36.841663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:36.860404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93479c99-24e3-45ba-81e1-32a7f07a8413 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:36.869918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:36.870976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.872057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.873249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] PATH_INFO: `/v3/projects/e654ef485da7443980a2c7cc01aca077/users/adfb3b37f7974762a3da052053c14f83/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.877043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e654ef485da7443980a2c7cc01aca077, user_id=adfb3b37f7974762a3da052053c14f83, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:36.880471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:36.911225 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3388/6780] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:36 2022] PUT /identity/v3/projects/e654ef485da7443980a2c7cc01aca077/users/adfb3b37f7974762a3da052053c14f83/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:36.913479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:36.914032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:36.914432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:36.967193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] MFA Rules not processed for user `adfb3b37f7974762a3da052053c14f83`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:36.969031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.022462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:37.024436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.049456 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:37.187909 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3393/6781] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:37.189316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:37.211450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62c57d5-759d-4377-b333-93ced64fb415 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:37.218454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:37.219393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.219660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.219938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] PATH_INFO: `/v3/projects/2f6df448522a4d2d815db0a1e26bf65c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.222001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f6df448522a4d2d815db0a1e26bf65c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:37.222240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda2cea-5c93-4f6c-94e6-b83377ab67e2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:37.223409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:37.235021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:37.235746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.236038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.236322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.240177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:37.242471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:37.316211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f6df448522a4d2d815db0a1e26bf65c', 'request_id': 'req-4673b17c-31d8-4fbc-8963-90e16760772a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:37.321089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3394/6782] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:37 2022] POST /identity/v3/projects => generated 357 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:37.323612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:37.328141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f6df448522a4d2d815db0a1e26bf65c', 'request_id': 'req-4673b17c-31d8-4fbc-8963-90e16760772a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:37.353832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f6df448522a4d2d815db0a1e26bf65c', 'request_id': 'req-4673b17c-31d8-4fbc-8963-90e16760772a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:37.382481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] The token cache is being invalidate because project 2f6df448522a4d2d815db0a1e26bf65c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:37.384487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:37.386918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4673b17c-31d8-4fbc-8963-90e16760772a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:37.401060 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3389/6783] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:37 2022] DELETE /identity/v3/projects/2f6df448522a4d2d815db0a1e26bf65c => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:37.402877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.403127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.403417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.457915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:37.461563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.465843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4ffa0-18e8-4bb7-a56a-74b807ac9d91 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:37.481662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9854b14-793b-4689-aa80-54fde5e86242 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:37.482388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854b14-793b-4689-aa80-54fde5e86242 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.483425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854b14-793b-4689-aa80-54fde5e86242 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.483719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9854b14-793b-4689-aa80-54fde5e86242 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.494541 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:37.495155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854b14-793b-4689-aa80-54fde5e86242 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:37.498539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9854b14-793b-4689-aa80-54fde5e86242 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:37.563482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3395/6784] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:37 2022] POST /identity/v3/users => generated 371 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:37.567704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.569244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.569785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.644623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] MFA Rules not processed for user `f047ddb9fbfd4b6f8fd66d02e0dbca20`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:37.649927 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3390/6785] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:37.653313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:37.655707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.660107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.700553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097dc02-b168-406a-8068-5b399d87e916 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:37.715623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:37.717888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.718989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.719289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.725708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:37.726179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:37.736927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30364489-5888-4348-bdec-78480f5de0b1 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:37.830437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3391/6786] 10.222.0.15 () {58 vars in 1156 bytes} [Tue Jul 19 11:37:37 2022] GET /identity/v3/users?domain_id=default => generated 7714 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:37.837952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:37.839519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:37.840673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:37.920683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:37.928772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.932182 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3396/6787] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:37.933506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:37.967878 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3392/6788] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:37.976044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:37.979383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:37.986941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089d07c-bf82-4a9e-95ca-8aa9b8b9521e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:38.006380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:38.011194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:38.014178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:38.014699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/users/d0e4a712e56d40849d1f05f16724e2fd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:38.058593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:update_user(user_id=d0e4a712e56d40849d1f05f16724e2fd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:38.066117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:38.089527 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:38.139475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'd0e4a712e56d40849d1f05f16724e2fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.161711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invalidating the token cache because user d0e4a712e56d40849d1f05f16724e2fd was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:38.162277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.163257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.165852 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3397/6789] 10.222.0.15 () {60 vars in 1243 bytes} [Tue Jul 19 11:37:37 2022] PATCH /identity/v3/users/d0e4a712e56d40849d1f05f16724e2fd => generated 485 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:38.167112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:38.169416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:38.195117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d96dd8e-531e-44c0-be50-0584b0f53596 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:38.200574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:38.201483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:38.201870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:38.202246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:38.203225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:38.203864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:38.205785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0ed75-b453-4975-809f-5c1237471bb2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:38.223317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3398/6790] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:38.225108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:38.225490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:38.225863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:38.249661 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.auth.plugins.core [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] User is disabled: d0e4a712e56d40849d1f05f16724e2fd: AssertionError: User is disabled: d0e4a712e56d40849d1f05f16724e2fd Jul 19 11:37:38.259515 n-d-master-1 devstack@keystone.service[80580]: WARNING keystone.server.flask.application [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.15: keystone.exception.Unauthorized: The request you have made requires authentication. Jul 19 11:37:38.261700 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3399/6791] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:38 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 38 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Jul 19 11:37:38.262738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:38.291005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471d6c5-3bd4-4336-9075-27af17092ad5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:38.308503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:38.312555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:38.313164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:38.313642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:38.315333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:38.318798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:38.378351 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3400/6792] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:38 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:38.381882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:38.387538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:38.445614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21bdb4-be8a-4d17-a295-d459d065ddb5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:38.573013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a12aecc-5a03-46e8-881e-f253393df11e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:38.587308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:38.588537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:38.589047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:38.589516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/users/d0e4a712e56d40849d1f05f16724e2fd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:38.622475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d0e4a712e56d40849d1f05f16724e2fd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:38.624919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:38.733736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e4a712e56d40849d1f05f16724e2fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.736707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:38.752524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e4a712e56d40849d1f05f16724e2fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.754473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:38.756758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:38.757268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:38.766770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:38.786261 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:38.793969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e4a712e56d40849d1f05f16724e2fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.794914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e4a712e56d40849d1f05f16724e2fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.808325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e4a712e56d40849d1f05f16724e2fd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:38.822056 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3401/6793] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:38 2022] DELETE /identity/v3/users/d0e4a712e56d40849d1f05f16724e2fd => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:38.826732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:38.832327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:38.861204 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:39.047398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:39.050646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:39.078367 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3393/6794] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:39.079276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:39.084454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:39.372600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dcb929-38fe-405e-ad27-d76a8f147fee tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:39.376621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c66c77-ab55-4981-8741-0b2c63f08a21 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:39.383007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:39.409944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:39.410681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:39.410967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:39.411238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:39.411953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:39.414003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:39.416057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:39.416701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:39.417110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] PATH_INFO: `/v3/users/4538a3d4ccf44e168b498c1319321fc9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:39.418706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4538a3d4ccf44e168b498c1319321fc9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:39.426069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:39.497228 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3402/6795] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:38 2022] POST /identity/v3/users => generated 293 bytes in 674 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:39.498148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:39.515654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:39.588018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4538a3d4ccf44e168b498c1319321fc9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:39.589900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4538a3d4ccf44e168b498c1319321fc9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:39.609856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4538a3d4ccf44e168b498c1319321fc9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:39.611701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4538a3d4ccf44e168b498c1319321fc9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:39.645206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4538a3d4ccf44e168b498c1319321fc9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:39.698234 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3394/6796] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:39 2022] DELETE /identity/v3/users/4538a3d4ccf44e168b498c1319321fc9 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:39.698901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:39.710340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:39.741918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a796c4-5740-4399-98fd-71e19a8f5dee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:39.811513 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:39.962602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:39.963570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:39.963852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:39.964173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/projects/02feaac5880c41b39a34246dc66c0546` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:39.965523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:delete_project(project_id=02feaac5880c41b39a34246dc66c0546)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:39.967578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:39.986157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bebdc9-9cd1-45cc-90cf-ecdb4c002f5c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.001266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.013121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.013667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.014323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] PATH_INFO: `/v3/projects/df3c1fbe58104ccba581f14812add852` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.017081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df3c1fbe58104ccba581f14812add852)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:40.026096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:40.114606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02feaac5880c41b39a34246dc66c0546', 'request_id': 'req-f63b2e53-1b98-4869-b929-037ae664d98e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.116508 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:40.128205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02feaac5880c41b39a34246dc66c0546', 'request_id': 'req-f63b2e53-1b98-4869-b929-037ae664d98e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.141865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02feaac5880c41b39a34246dc66c0546', 'request_id': 'req-f63b2e53-1b98-4869-b929-037ae664d98e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.170643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] The token cache is being invalidate because project 02feaac5880c41b39a34246dc66c0546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:40.171006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df3c1fbe58104ccba581f14812add852', 'request_id': 'req-933ffe11-2f90-4b7b-8a73-bc214cd4319f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.175096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.177524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.180420 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3403/6797] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:39 2022] DELETE /identity/v3/projects/02feaac5880c41b39a34246dc66c0546 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:40.181351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:40.185491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.190693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df3c1fbe58104ccba581f14812add852', 'request_id': 'req-933ffe11-2f90-4b7b-8a73-bc214cd4319f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.205575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df3c1fbe58104ccba581f14812add852', 'request_id': 'req-933ffe11-2f90-4b7b-8a73-bc214cd4319f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.235467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] The token cache is being invalidate because project df3c1fbe58104ccba581f14812add852 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:40.235997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.247287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-933ffe11-2f90-4b7b-8a73-bc214cd4319f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:40.252649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3395/6798] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:39 2022] DELETE /identity/v3/projects/df3c1fbe58104ccba581f14812add852 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:40.259315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.259649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.259941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.341616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:40.342881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.363187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63b2e53-1b98-4869-b929-037ae664d98e tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.497775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c83cd-7b0c-4458-83b5-c399fe4d813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.498497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c83cd-7b0c-4458-83b5-c399fe4d813a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.498781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c83cd-7b0c-4458-83b5-c399fe4d813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.499057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c83cd-7b0c-4458-83b5-c399fe4d813a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.499843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c83cd-7b0c-4458-83b5-c399fe4d813a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:40.501532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c83cd-7b0c-4458-83b5-c399fe4d813a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:40.506329 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3396/6799] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:40.507251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:40.512268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.534629 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3404/6800] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:40.536213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.536534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.536817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.582133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:40.583431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.604370 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3405/6801] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:40.612074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:40.613714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.626296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acb2d4c-0864-437e-bc90-5dbfb0d0f93e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.631517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.632167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.632512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.632876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.633734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:40.635647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:40.685668 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:40.693933 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3406/6802] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:40.695007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:40.702012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.710060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fdc6e1-d2a5-45e8-b48f-e9e168fe2772 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.721939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adfb3b37f7974762a3da052053c14f83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e654ef485da7443980a2c7cc01aca077', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.722799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.723090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.723858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.724249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:40.732458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-464bff64-b857-4d60-9df4-2be3de6fe5c4 tempest-UsersNegativeTest-553943831 tempest-UsersNegativeTest-553943831-project-admin] Could not find domain: 824f0fd0f0af4c61b45baaf8133bbc92.: keystone.exception.DomainNotFound: Could not find domain: 824f0fd0f0af4c61b45baaf8133bbc92. Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 824f0fd0f0af4c61b45baaf8133bbc92. Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:37:40.763147 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Jul 19 11:37:40.764088 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.get_or_create( Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application with Lock( Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._enter() Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.creator() Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application created_value = creator( Jul 19 11:37:40.765080 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 19 11:37:40.765868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 19 11:37:40.765868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 824f0fd0f0af4c61b45baaf8133bbc92. Jul 19 11:37:40.765868 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:37:40.765868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3397/6803] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:40 2022] POST /identity/v3/users => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:37:40.768160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.768310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.768614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.838176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:40.843829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.881459 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3398/6804] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:40.883567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:40.903371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685a13d1-0166-4a95-9417-da293465b179 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.914324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.915090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.915373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.915649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.930911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f98aa-5a00-4c3a-855c-8c72fbee6fd7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.937066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:40.938565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:40.956694 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3407/6805] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:40.957349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.957595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:40.959000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:40.962879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.970912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.971295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] PATH_INFO: `/v3/projects/859c6689b47f4d30ae42504a22370389/users/bf243fabdd3c43e3bd86bfb48e2645c2/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.976188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32d5946-9288-4bcd-bd22-295f6d45a802 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:40.989008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:40.989574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:40.989853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:40.990127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] PATH_INFO: `/v3/users/5a7adca222f54c888c8c6d0f9e3d3f41` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:40.991488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a7adca222f54c888c8c6d0f9e3d3f41)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:40.993616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:40.995557 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:41.047009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=859c6689b47f4d30ae42504a22370389, user_id=bf243fabdd3c43e3bd86bfb48e2645c2, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:41.058778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:41.088766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3399/6806] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:40 2022] PUT /identity/v3/projects/859c6689b47f4d30ae42504a22370389/users/bf243fabdd3c43e3bd86bfb48e2645c2/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:41.090187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:41.105522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a7adca222f54c888c8c6d0f9e3d3f41'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:41.124488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a7adca222f54c888c8c6d0f9e3d3f41'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:41.153173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a7adca222f54c888c8c6d0f9e3d3f41'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:41.155150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a7adca222f54c888c8c6d0f9e3d3f41'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:41.175287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-20254a6e-8085-45ba-a560-e98a25f73fe9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a7adca222f54c888c8c6d0f9e3d3f41'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:41.195971 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3408/6807] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:40 2022] DELETE /identity/v3/users/5a7adca222f54c888c8c6d0f9e3d3f41 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:41.197710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:41.197997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:41.198276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:41.257241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d1a15-47e3-4f96-a93a-b6b4701f7b2f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:41.272534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] MFA Rules not processed for user `bf243fabdd3c43e3bd86bfb48e2645c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:41.274046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:41.410039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:41.410837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:41.411189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:41.411563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:41.412407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:41.413088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:41.415246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c6d1dd-248f-4020-a81b-faa6cf97bcfb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:41.435445 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3400/6808] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:41.437231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:41.437609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:41.437999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:41.479367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:41.495144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:41.506101 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3401/6809] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:41.507302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:41.509879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:41.537791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e339b519-8a83-4717-9d42-8c98454960f3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:41.556599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:41.557621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:41.558023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:41.558511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:41.559297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:41.560254 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3409/6810] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:41.561198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:41.563466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:41.568323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:41.640622 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3402/6811] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:41 2022] POST /identity/v3/projects => generated 385 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:41.642515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:41.645403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:41.779477 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:41.812630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf992a3a-17e0-4e48-b839-bcc1f851a439 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:41.872281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cbef3-d4ae-4509-b99e-7af857001c06 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:41.881829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:41.885955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:41.886570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:41.888722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:41.889992 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:41.997561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:41.998395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:41.999754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.001882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.085831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.088111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.102522 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3403/6812] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:42.103801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.118955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.121730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.137279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3410/6813] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:42.240502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ef042-c4ea-43a9-9d41-b90935e5da5e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.252311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.253364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.255224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.256953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.257864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.263650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.315095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.315691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3404/6814] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:42 2022] POST /identity/v3/users => generated 299 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:42.332634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee7cb7-a57d-47e3-bbca-301faff853f5 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.338730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.339438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.339719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.339993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.340784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.345491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.389915 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3411/6815] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:37:42.394674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.416404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dc4948-61b8-4e80-be28-bcb46db1e791 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.423705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.424876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.425296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.425674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] PATH_INFO: `/v3/projects/b45e63111d3049d997c867d4c088bdd3/users/093e87f216ee45cba200b1eba85548bc/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.438427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.440678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:42.462888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4568e4-f8ed-4281-a3e7-6aa2d4c4fad3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.463573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45e63111d3049d997c867d4c088bdd3, user_id=093e87f216ee45cba200b1eba85548bc, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.470107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.477950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.479374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.480675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.480993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] PATH_INFO: `/v3/projects/d62611cfa6dd409192d32a31599e3f4c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.483201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d62611cfa6dd409192d32a31599e3f4c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.485862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.503166 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3405/6816] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:42 2022] PUT /identity/v3/projects/b45e63111d3049d997c867d4c088bdd3/users/093e87f216ee45cba200b1eba85548bc/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:42.504294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.624484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62611cfa6dd409192d32a31599e3f4c', 'request_id': 'req-c3e30f14-c10d-4576-8c58-161536474c17'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:42.651462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62611cfa6dd409192d32a31599e3f4c', 'request_id': 'req-c3e30f14-c10d-4576-8c58-161536474c17'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:42.664004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62611cfa6dd409192d32a31599e3f4c', 'request_id': 'req-c3e30f14-c10d-4576-8c58-161536474c17'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:42.692430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] The token cache is being invalidate because project d62611cfa6dd409192d32a31599e3f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:42.692954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:42.693946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:42.700162 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:42.702751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3412/6817] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:42 2022] DELETE /identity/v3/projects/d62611cfa6dd409192d32a31599e3f4c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:42.706838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.709416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:42.713015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611f4e-15c0-4a63-a343-bbf74427cf7e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.825169 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:42.867825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e30f14-c10d-4576-8c58-161536474c17 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.871430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.872447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.872808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.873164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.874017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.878097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.882609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.884119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.884708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.884995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] PATH_INFO: `/v3/users/46f2a0175fe74c308452739fa335f87c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.889301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46f2a0175fe74c308452739fa335f87c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.892388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:42.911936 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3406/6818] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:42.917613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:42.921043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:42.964472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f63659-6125-463c-b528-a9d9afce817c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:42.971212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f294e2-c556-49ea-8ecf-4490899b1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:42.972924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f294e2-c556-49ea-8ecf-4490899b1e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:42.973635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f294e2-c556-49ea-8ecf-4490899b1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:42.974246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f294e2-c556-49ea-8ecf-4490899b1e8d admin admin] PATH_INFO: `/v3/projects/b45e63111d3049d997c867d4c088bdd3/users/093e87f216ee45cba200b1eba85548bc/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:42.977247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f294e2-c556-49ea-8ecf-4490899b1e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b45e63111d3049d997c867d4c088bdd3, user_id=093e87f216ee45cba200b1eba85548bc, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:42.980977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f294e2-c556-49ea-8ecf-4490899b1e8d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:43.016320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3407/6819] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:42 2022] PUT /identity/v3/projects/b45e63111d3049d997c867d4c088bdd3/users/093e87f216ee45cba200b1eba85548bc/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:43.027647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:43.028269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:43.028770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:43.036759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46f2a0175fe74c308452739fa335f87c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:43.054676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46f2a0175fe74c308452739fa335f87c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:43.080440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46f2a0175fe74c308452739fa335f87c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:43.084593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46f2a0175fe74c308452739fa335f87c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:43.106600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46f2a0175fe74c308452739fa335f87c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:43.114628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] MFA Rules not processed for user `093e87f216ee45cba200b1eba85548bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:43.116282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:43.140313 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3413/6820] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:42 2022] DELETE /identity/v3/users/46f2a0175fe74c308452739fa335f87c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:43.371335 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3408/6821] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:43.372657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:43.378054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:43.556092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810d451-039c-4008-b7b1-984e37f6d5c4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:43.577987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:43.578709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:43.578995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:43.579280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:43.580026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:43.585691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:43.646105 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3414/6822] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:43 2022] POST /identity/v3/projects => generated 385 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:43.651573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:43.891240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2020867c-edf7-4b5c-b9bd-741856ca6274 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:43.925341 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:44.028436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:44.029171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:44.033338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:44.034945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:44.035839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:44.040093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:44.091753 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3409/6823] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:43 2022] POST /identity/v3/users => generated 293 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:44.092095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:44.113092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087bc5e-98e1-4024-a978-079675bfaa40 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:44.134120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:44.134594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:44.134882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:44.135157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:44.135952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:44.137707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:44.184138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3415/6824] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:44.188398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:44.206442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240b6167-f1fd-428b-80a3-01bf78695c3e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:44.214808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318afafe-8a24-46d9-ac27-095efc196680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:44.215529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318afafe-8a24-46d9-ac27-095efc196680 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:44.215814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318afafe-8a24-46d9-ac27-095efc196680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:44.216099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318afafe-8a24-46d9-ac27-095efc196680 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:44.216929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318afafe-8a24-46d9-ac27-095efc196680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:44.218642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318afafe-8a24-46d9-ac27-095efc196680 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:44.232099 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3410/6825] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:44.236817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:44.252549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33363de2-f8f5-4335-81e8-22b94c023796 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:44.264799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:44.265801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:44.266087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:44.266365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] PATH_INFO: `/v3/projects/46cd809c283241fe839c7759525f394f/users/d0982ab9d0884551a106e442cb83f135/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:44.306000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46cd809c283241fe839c7759525f394f, user_id=d0982ab9d0884551a106e442cb83f135, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:44.317678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:44.349412 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3416/6826] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:44 2022] PUT /identity/v3/projects/46cd809c283241fe839c7759525f394f/users/d0982ab9d0884551a106e442cb83f135/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:44.362185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:44.362590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:44.363023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:44.411210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] MFA Rules not processed for user `d0982ab9d0884551a106e442cb83f135`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:44.412748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:44.575682 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3411/6827] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:44.590412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:44.592289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:44.641369 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:44.807889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c44693-eb2c-48db-a2b1-6b78adb72f80 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:44.824745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:44.830222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:44.830778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:44.833554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:45.071798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:45.073463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:45.099371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3417/6828] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:45.542712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:45.544313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:45.660111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:45.661715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:45.741664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366cabd3-1d00-42b9-84a0-01cf580a064c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:45.764493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:45.765436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:45.765625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:45.765903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] PATH_INFO: `/v3/projects/45e7fca8a6a54433a5e37ff4c591db80` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:45.769052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e7fca8a6a54433a5e37ff4c591db80)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:45.771062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:45.839782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c8d72-56c2-498c-bdfe-68398e992fb4 service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:45.848682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:45.849594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:45.849881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:45.850156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] PATH_INFO: `/v3/projects/0e1fadaacd564994b6e175a8999054c1` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:45.861614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1fadaacd564994b6e175a8999054c1)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:45.863689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:45.884065 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:45.960119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1fadaacd564994b6e175a8999054c1', 'request_id': 'req-0fa75aaa-e88c-498c-be12-95706f43c0be'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:45.969066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e7fca8a6a54433a5e37ff4c591db80', 'request_id': 'req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:45.985395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1fadaacd564994b6e175a8999054c1', 'request_id': 'req-0fa75aaa-e88c-498c-be12-95706f43c0be'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:45.987800 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:45.995401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e7fca8a6a54433a5e37ff4c591db80', 'request_id': 'req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:45.998707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1fadaacd564994b6e175a8999054c1', 'request_id': 'req-0fa75aaa-e88c-498c-be12-95706f43c0be'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.012388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e7fca8a6a54433a5e37ff4c591db80', 'request_id': 'req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.021964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] The token cache is being invalidate because project 0e1fadaacd564994b6e175a8999054c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:46.022980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.023942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.026597 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3418/6829] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:45 2022] DELETE /identity/v3/projects/0e1fadaacd564994b6e175a8999054c1 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:46.030546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:46.032839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:46.039595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] The token cache is being invalidate because project 45e7fca8a6a54433a5e37ff4c591db80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:46.040330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.041085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-25f492c5-a9f2-4a8b-bce4-2d52e0706dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.047526 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3412/6830] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:45 2022] DELETE /identity/v3/projects/45e7fca8a6a54433a5e37ff4c591db80 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:46.049201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.049551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.049886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.077567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:46.079818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:46.210531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa75aaa-e88c-498c-be12-95706f43c0be admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:46.230081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:46.231567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.231778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.232164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] PATH_INFO: `/v3/users/adfb3b37f7974762a3da052053c14f83` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.233848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfb3b37f7974762a3da052053c14f83)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:46.236899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:46.337640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3413/6831] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:46.341888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:46.345251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:46.402665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe12cef-58f4-4fa9-9343-71b8ed8f4a50 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:46.409285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfb3b37f7974762a3da052053c14f83'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.416831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:46.421684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.422291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.422962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] PATH_INFO: `/v3/users/093e87f216ee45cba200b1eba85548bc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.425295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093e87f216ee45cba200b1eba85548bc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:46.427734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:46.434874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfb3b37f7974762a3da052053c14f83'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.501000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfb3b37f7974762a3da052053c14f83'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.501798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfb3b37f7974762a3da052053c14f83'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.543194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-09b9b08f-41da-4d5e-9d92-a96c99e9fe92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfb3b37f7974762a3da052053c14f83'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.548068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093e87f216ee45cba200b1eba85548bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.548619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093e87f216ee45cba200b1eba85548bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.556556 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3419/6832] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:46 2022] DELETE /identity/v3/users/adfb3b37f7974762a3da052053c14f83 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:46.560906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ef3f-6cad-402f-ac51-04d2b53144cb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.560906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ef3f-6cad-402f-ac51-04d2b53144cb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.560906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40ef3f-6cad-402f-ac51-04d2b53144cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.566913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093e87f216ee45cba200b1eba85548bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.567551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093e87f216ee45cba200b1eba85548bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.581126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-43a88f2d-a43e-4ae2-aea5-ae0e73d6d3e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093e87f216ee45cba200b1eba85548bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:46.595071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cb40ef3f-6cad-402f-ac51-04d2b53144cb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:46.596682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cb40ef3f-6cad-402f-ac51-04d2b53144cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:46.655721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3414/6833] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:46 2022] DELETE /identity/v3/users/093e87f216ee45cba200b1eba85548bc => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:46.666208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.668774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.672928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.753367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] MFA Rules not processed for user `f047ddb9fbfd4b6f8fd66d02e0dbca20`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:46.755418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:46.828834 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:46.860490 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3420/6834] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:46.862461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:46.863046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:46.863344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:46.888266 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:46.889647 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3415/6835] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:46.890886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:46.905360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:46.908919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:47.019874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c15a78-d975-487b-9d9b-41076ac6997e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.070892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.071671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.073849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.074152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.074930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:47.075244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.079101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.129853 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3416/6836] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:47.136669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.165750 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3421/6837] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:47.185950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb167ec-7217-4708-92bd-bbdc24200848 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.191629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.192431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.192856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.193097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.193886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.196749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.246943 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3417/6838] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:47 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:47.251282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.260529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.262538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:47.266876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ef8a92-198d-4380-8002-930ed8665a37 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.375337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124a18c5-02ce-4bf5-8ef9-7e5e67c4849e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.383534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.384380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.385423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.387010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.413258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.417142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.417896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.418320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.420305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.424074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.478137 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3422/6839] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:47 2022] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:47.483466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.506460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba15b54-8401-4fc7-8563-41b7c227cec2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.515342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.517004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.520179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.520753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.521132 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:47.521554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.523636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.525669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.526186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.550213 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3418/6840] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:47.553960 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3423/6841] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:47.559159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.571702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ad226-1083-4ad4-9676-98ccfbeb8fc6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.577177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef749b-f88c-46e4-9391-3a6f68db04ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.578175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef749b-f88c-46e4-9391-3a6f68db04ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.578792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef749b-f88c-46e4-9391-3a6f68db04ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.579267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef749b-f88c-46e4-9391-3a6f68db04ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.580992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef749b-f88c-46e4-9391-3a6f68db04ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.583228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef749b-f88c-46e4-9391-3a6f68db04ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.595677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3419/6842] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:47.599936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.612584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f17f289-954d-409f-8a4e-e7846a1379af admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.621701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.623069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.623821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.624491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] PATH_INFO: `/v3/projects/dc95624dd3764298b35c06af677dc725/users/26d2fc6f995e4d47a660a8a1c29db07e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.646489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc95624dd3764298b35c06af677dc725, user_id=26d2fc6f995e4d47a660a8a1c29db07e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.649949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.669525 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3424/6843] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:47 2022] PUT /identity/v3/projects/dc95624dd3764298b35c06af677dc725/users/26d2fc6f995e4d47a660a8a1c29db07e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:47.690492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.691420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.692052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.734760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] MFA Rules not processed for user `26d2fc6f995e4d47a660a8a1c29db07e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:47.736699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:47.820857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3420/6844] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:47.827475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:47.932644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d52b4df-0c5f-45ba-8413-23b7efd92cd5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:47.938581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:47.941403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:47.941829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:47.942211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:47.943332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:47.946281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:47.969124 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:48.052319 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3425/6845] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:47 2022] POST /identity/v3/projects => generated 361 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:48.056828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.099725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16179f15-b37f-40d4-a06e-286bebeaad1e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.203428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.205533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:48.340292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:48.341052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.341340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.341622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.342350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:48.344390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:48.377978 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3421/6846] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:48 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:48.379787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.383213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b24d7-6904-41f2-bc50-168e610bab8e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.411877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:48.412191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f3693-42e3-48ea-94d9-377a2798d4e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.413983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.414797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.415774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] PATH_INFO: `/v3/projects/e654ef485da7443980a2c7cc01aca077` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.426461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:48.426461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.426461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.426461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.427865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:48.429278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e654ef485da7443980a2c7cc01aca077)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:48.431787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:48.435932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:48.475150 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3422/6847] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:37:48.484744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.512243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d626e-1bc6-4f3e-98b6-97af0b13766b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.542063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e654ef485da7443980a2c7cc01aca077', 'request_id': 'req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:48.558402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e654ef485da7443980a2c7cc01aca077', 'request_id': 'req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:48.596171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e654ef485da7443980a2c7cc01aca077', 'request_id': 'req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:48.623836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] The token cache is being invalidate because project e654ef485da7443980a2c7cc01aca077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:48.626039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:48.627354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945391e4-6f1d-4ee1-889b-2aaea20a5fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:48.635508 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3426/6848] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:48 2022] DELETE /identity/v3/projects/e654ef485da7443980a2c7cc01aca077 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:48.639731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78dd66-234c-4479-85e9-7fc7549707ce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.639910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78dd66-234c-4479-85e9-7fc7549707ce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.640164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da78dd66-234c-4479-85e9-7fc7549707ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.665255 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:48.679609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:48.680596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.680879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.681160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] PATH_INFO: `/v3/projects/65b236467f9744308f0f414b90cbc54f/users/7ca4febd1e934c7295d33cab282ae466/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.682162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-da78dd66-234c-4479-85e9-7fc7549707ce None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:48.683414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-da78dd66-234c-4479-85e9-7fc7549707ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:48.700560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b236467f9744308f0f414b90cbc54f, user_id=7ca4febd1e934c7295d33cab282ae466, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:48.703909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:48.705901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3427/6849] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:48.718055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.718388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.718619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.725691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3423/6850] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:48 2022] PUT /identity/v3/projects/65b236467f9744308f0f414b90cbc54f/users/7ca4febd1e934c7295d33cab282ae466/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:48.727682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.729676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:48.763250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:48.768321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:48.812002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77124da-f8c6-48fd-ab55-d42d5e199d00 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.817766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:48.818462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.818751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.819031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.819775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:48.821517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:48.835344 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3424/6851] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:48.842067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.859657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371910e8-667f-4ca4-8e06-0cc2d0518f96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.869951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fcb4f5-2d9d-4030-8f66-49e21e14a83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:48.871612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb4f5-2d9d-4030-8f66-49e21e14a83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.872030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb4f5-2d9d-4030-8f66-49e21e14a83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.872480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fcb4f5-2d9d-4030-8f66-49e21e14a83d admin admin] PATH_INFO: `/v3/projects/65b236467f9744308f0f414b90cbc54f/users/7ca4febd1e934c7295d33cab282ae466/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.875571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb4f5-2d9d-4030-8f66-49e21e14a83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=65b236467f9744308f0f414b90cbc54f, user_id=7ca4febd1e934c7295d33cab282ae466, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:48.879283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fcb4f5-2d9d-4030-8f66-49e21e14a83d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:48.893580 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3425/6852] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:48 2022] PUT /identity/v3/projects/65b236467f9744308f0f414b90cbc54f/users/7ca4febd1e934c7295d33cab282ae466/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:48.906534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca10c-729c-4556-855b-5152affa315a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:48.909224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca10c-729c-4556-855b-5152affa315a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:48.909746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ca10c-729c-4556-855b-5152affa315a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:48.930767 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3428/6853] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:48.931698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:48.947805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a4ff3-ee5f-4073-b5ff-a76542a31485 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:48.955507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-790ca10c-729c-4556-855b-5152affa315a None None] MFA Rules not processed for user `7ca4febd1e934c7295d33cab282ae466`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:48.957698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-790ca10c-729c-4556-855b-5152affa315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:48.968550 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:49.095014 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3426/6854] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:48 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:49.096646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ca10c-729c-4556-855b-5152affa315a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:49.098775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:49.099487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:49.099775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:49.100049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:49.100843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:49.101156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:49.102160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-790ca10c-729c-4556-855b-5152affa315a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:49.102887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:49.125520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790ca10c-729c-4556-855b-5152affa315a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:49.136525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:49.138443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:49.138834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:49.139125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] PATH_INFO: `/v3/projects/b45e63111d3049d997c867d4c088bdd3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:49.141636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b45e63111d3049d997c867d4c088bdd3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:49.146886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:49.160000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3429/6855] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:49.161269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:49.170285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:49.226616 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:49.248836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b45e63111d3049d997c867d4c088bdd3', 'request_id': 'req-dc211f60-363f-4f75-b3da-079b5601639e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.265126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b45e63111d3049d997c867d4c088bdd3', 'request_id': 'req-dc211f60-363f-4f75-b3da-079b5601639e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.274169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b45e63111d3049d997c867d4c088bdd3', 'request_id': 'req-dc211f60-363f-4f75-b3da-079b5601639e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.300038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] The token cache is being invalidate because project b45e63111d3049d997c867d4c088bdd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:49.300879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.302191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.305066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3427/6856] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:49 2022] DELETE /identity/v3/projects/b45e63111d3049d997c867d4c088bdd3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:49.306886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:49.310037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:49.409663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6793906-bb4a-4dc4-866d-482e2bc03052 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:49.503246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc211f60-363f-4f75-b3da-079b5601639e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:49.514794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:49.515502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:49.515792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:49.516073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:49.516817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:49.518833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:49.579718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3428/6857] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:49 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:49.580820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:49.583658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:49.583818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:49.584719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:49.585006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:49.585285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:49.590348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:49.785139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079cc5-ab1d-4c9f-ae6c-1646aedf4e91 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:49.793635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:49.795278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:49.800181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:49.801639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:49.803759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:49.804202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] PATH_INFO: `/v3/users/d0982ab9d0884551a106e442cb83f135` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:49.809344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0982ab9d0884551a106e442cb83f135)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:49.812649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:49.816006 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3430/6858] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:49 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:49.828489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:49.869350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6110b76b-e8ab-41b3-8fdb-72b8333ad967 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:49.893693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:49.894518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:49.897570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:49.897789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:49.906630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:49.912711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:49.917873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0982ab9d0884551a106e442cb83f135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.918691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0982ab9d0884551a106e442cb83f135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.933968 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:49.938542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0982ab9d0884551a106e442cb83f135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.939488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0982ab9d0884551a106e442cb83f135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.941598 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:49.955698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0982ab9d0884551a106e442cb83f135'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:49.960523 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3431/6859] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:49 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:49.966094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:49.970153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:50.021115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0988419-9bbe-4bde-800c-134b2df8024a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:50.026324 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3429/6860] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:49 2022] DELETE /identity/v3/users/d0982ab9d0884551a106e442cb83f135 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:50.220740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:50.221454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:50.221738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:50.222017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:50.222772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:50.225179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:50.240984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3432/6861] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:50.247831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:50.274481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db31257-1055-4152-8c34-c379c6da06a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:50.290390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ede88d-7a14-45fa-b2c4-fb420d7b8701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:50.291643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede88d-7a14-45fa-b2c4-fb420d7b8701 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:50.293458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede88d-7a14-45fa-b2c4-fb420d7b8701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:50.295406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ede88d-7a14-45fa-b2c4-fb420d7b8701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:50.299381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ede88d-7a14-45fa-b2c4-fb420d7b8701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:50.307861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ede88d-7a14-45fa-b2c4-fb420d7b8701 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:50.335527 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3430/6862] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:50.339782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:50.356658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439e027-a5fb-4ac2-ae51-a17412ff2917 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:50.371161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:50.372282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:50.373374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:50.373374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] PATH_INFO: `/v3/projects/d1e7cb33c6ac49ca8e89d005ed4d6f9c/users/e54991347db54480b82aa23a061f3ece/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:50.430458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e7cb33c6ac49ca8e89d005ed4d6f9c, user_id=e54991347db54480b82aa23a061f3ece, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:50.437021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:50.493229 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3433/6863] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:50 2022] PUT /identity/v3/projects/d1e7cb33c6ac49ca8e89d005ed4d6f9c/users/e54991347db54480b82aa23a061f3ece/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:50.507012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:50.507888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:50.509759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:50.646996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] MFA Rules not processed for user `e54991347db54480b82aa23a061f3ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:50.648935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:50.701158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:50.702971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:50.853137 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3431/6864] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:50.867656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:50.870981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:50.948091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e99c50a-eca8-4bde-a393-72fddba9a12a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:50.959499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:50.960442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:50.960729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:50.961075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] PATH_INFO: `/v3/users/26d2fc6f995e4d47a660a8a1c29db07e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:50.964929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26d2fc6f995e4d47a660a8a1c29db07e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:50.967627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:51.026929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdd5389-c490-4435-a17d-22a20e097dd8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:51.042970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7550845-d34d-4ba1-9b6b-6d688663084b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:51.043663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7550845-d34d-4ba1-9b6b-6d688663084b service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:51.043951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7550845-d34d-4ba1-9b6b-6d688663084b service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:51.044739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7550845-d34d-4ba1-9b6b-6d688663084b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:51.067533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7550845-d34d-4ba1-9b6b-6d688663084b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:51.069057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7550845-d34d-4ba1-9b6b-6d688663084b service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:51.075208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26d2fc6f995e4d47a660a8a1c29db07e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:51.092335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26d2fc6f995e4d47a660a8a1c29db07e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:51.099505 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3432/6865] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:51.150224 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=3,keystone:SELECT=88,keystone:DELETE=9 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:51.157512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26d2fc6f995e4d47a660a8a1c29db07e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:51.159290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26d2fc6f995e4d47a660a8a1c29db07e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:51.175770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26d2fc6f995e4d47a660a8a1c29db07e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:51.215496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:51.218624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:51.219148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:51.227609 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3434/6866] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:50 2022] DELETE /identity/v3/users/26d2fc6f995e4d47a660a8a1c29db07e => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:51.244027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:51.245797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:51.429208 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:51.462615 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3433/6867] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:51.556410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:51.558668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:51.713533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed12a0ea-f0a3-41b7-ab65-8112ae46fce8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:51.720970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:51.724280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:51.724698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:51.725048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:51.762822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:51.775614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:51.813477 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3435/6868] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:52.431187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:52.435750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:52.436414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:52.438364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:52.455504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b879e-ecd5-423a-adfb-4616ba82688d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:52.467688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:52.469588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:52.471442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:52.471802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] PATH_INFO: `/v3/users/e54991347db54480b82aa23a061f3ece` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:52.475533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10484fe-e7df-40cf-adf2-a8fd1be4438e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:52.479664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e54991347db54480b82aa23a061f3ece)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:52.482080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:52.489100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:52.490280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:52.491357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:52.491785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] PATH_INFO: `/v3/projects/46cd809c283241fe839c7759525f394f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:52.500585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46cd809c283241fe839c7759525f394f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:52.506224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:52.593383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e54991347db54480b82aa23a061f3ece'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.593629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e54991347db54480b82aa23a061f3ece'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.614885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e54991347db54480b82aa23a061f3ece'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.615516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e54991347db54480b82aa23a061f3ece'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.617818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46cd809c283241fe839c7759525f394f', 'request_id': 'req-bc22becd-3d8c-4b9b-be7c-ef9322bea478'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.631482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46cd809c283241fe839c7759525f394f', 'request_id': 'req-bc22becd-3d8c-4b9b-be7c-ef9322bea478'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.637631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3168b661-0de8-42a5-8e36-edb21b49a71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e54991347db54480b82aa23a061f3ece'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.641098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46cd809c283241fe839c7759525f394f', 'request_id': 'req-bc22becd-3d8c-4b9b-be7c-ef9322bea478'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.660766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] The token cache is being invalidate because project 46cd809c283241fe839c7759525f394f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:52.661253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.662228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bc22becd-3d8c-4b9b-be7c-ef9322bea478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:52.665019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3436/6869] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:52 2022] DELETE /identity/v3/projects/46cd809c283241fe839c7759525f394f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:52.671128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad01ca-0c77-46bc-af63-60ae70fa182e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:52.672280 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3434/6870] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:52 2022] DELETE /identity/v3/users/e54991347db54480b82aa23a061f3ece => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:52.675409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad01ca-0c77-46bc-af63-60ae70fa182e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:52.675901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ad01ca-0c77-46bc-af63-60ae70fa182e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:52.688970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:52.689793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:52.692736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:52.721069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-25ad01ca-0c77-46bc-af63-60ae70fa182e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:52.722356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25ad01ca-0c77-46bc-af63-60ae70fa182e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:52.732889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:52.738890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:52.884484 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3437/6871] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:52.894038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:52.894341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:52.894627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:52.936990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:52.937218 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3435/6872] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:52.938994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:52.959263 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3438/6873] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:52.966060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:52.980789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82275700-bd5b-4cfe-9d4f-403214d7d900 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:52.986909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:52.987847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:52.988275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:52.988718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:52.989612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:52.990091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:52.993715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:52.999096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.008627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:53.026607 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:53.085584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3436/6874] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:53.088297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.135796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf076190-5969-4f96-98fa-5a98386dbcef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:53.166225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:53.167796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.168976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.169683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.170750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:53.175280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:53.242861 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3437/6875] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:53 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:53.248485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.256561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817e1b9-627b-4c2d-aba3-3db096b2158c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:53.351647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:53.353438 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:53.354029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.354510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.354976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.435131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71431430-75e6-454d-9fdd-1c24f44f0a9c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:53.446742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:53.447680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.447757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.447983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.448725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:53.450711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:53.520752 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3438/6876] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:53 2022] POST /identity/v3/users => generated 288 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:53.523835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.551651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738f9f0e-dc2c-4e3a-8fc1-ea607eaddc10 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:53.570730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:53.572216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:53.587274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:53.595416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3439/6877] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:53.595780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.596320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.596829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.597831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:53.602950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:53.629412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3439/6878] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:53.629905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.644795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235e642-2446-4e01-9a99-3144397cb668 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:53.670170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c874a-98bb-4595-857b-6c686a789d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:53.672446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c874a-98bb-4595-857b-6c686a789d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.672736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c874a-98bb-4595-857b-6c686a789d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.673017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c874a-98bb-4595-857b-6c686a789d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.673774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c874a-98bb-4595-857b-6c686a789d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:53.675431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c874a-98bb-4595-857b-6c686a789d0d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:53.720787 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3440/6879] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:37:53.721848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.734959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6c7583-08f5-4c28-8a18-423a7cab6cf2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:53.748537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:53.749368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.749662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.750932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] PATH_INFO: `/v3/projects/0067d9266d3945c6b2af11edb19193fc/users/0f938d6f50254ce9acd6ed93904a1edd/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.794341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0067d9266d3945c6b2af11edb19193fc, user_id=0f938d6f50254ce9acd6ed93904a1edd, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:53.797057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:53.828390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3440/6880] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:53 2022] PUT /identity/v3/projects/0067d9266d3945c6b2af11edb19193fc/users/0f938d6f50254ce9acd6ed93904a1edd/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:53.836479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:53.837469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:53.837734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:53.903796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] MFA Rules not processed for user `0f938d6f50254ce9acd6ed93904a1edd`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:53.906606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:53.929001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:53.932094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:54.083500 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:54.107715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab38916-cd10-4943-9c1e-bbcb7b161895 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.125566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3441/6881] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:54.126914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:54.128463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.129389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.129654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.129927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] PATH_INFO: `/v3/projects/dc95624dd3764298b35c06af677dc725` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.131237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc95624dd3764298b35c06af677dc725)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.133187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.150491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e539ae-132f-49d9-a38c-3bf8854320c2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.162769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.163880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.164737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.166196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.168835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.175335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.204163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc95624dd3764298b35c06af677dc725', 'request_id': 'req-00204925-f132-43a3-b5ca-3c61463d2940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.224013 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3442/6882] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:54 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:54.225019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:54.228535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc95624dd3764298b35c06af677dc725', 'request_id': 'req-00204925-f132-43a3-b5ca-3c61463d2940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.236533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc95624dd3764298b35c06af677dc725', 'request_id': 'req-00204925-f132-43a3-b5ca-3c61463d2940'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.268940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] The token cache is being invalidate because project dc95624dd3764298b35c06af677dc725 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:54.270009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.272750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.276625 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3441/6883] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:53 2022] DELETE /identity/v3/projects/dc95624dd3764298b35c06af677dc725 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:54.280313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:54.282696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:54.334071 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:54.378839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456405-c52d-49c6-ac60-e0d75532c9ec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.407998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.407998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.408681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.408895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.411976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.416171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.462532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204925-f132-43a3-b5ca-3c61463d2940 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.472815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.474561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.475158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.475751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] PATH_INFO: `/v3/users/7ca4febd1e934c7295d33cab282ae466` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.476509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3443/6884] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:54 2022] POST /identity/v3/users => generated 295 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:54.479794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ca4febd1e934c7295d33cab282ae466)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.480456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:54.486401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.486787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:54.525403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc632440-2012-4e35-8fc5-a0a11715f1c3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.535454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.535968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.536260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.536565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.539036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.541241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.556391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3444/6885] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:54.561172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:54.576389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e59ead-e001-43c8-a209-6dc0c3d43b6b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.582250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.584228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.586233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.586705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] PATH_INFO: `/v3/projects/5854a60d8416469ba960adf6a67c82b6/users/ccd7d60a9c404eaa8076efc77856a320/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.607561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5854a60d8416469ba960adf6a67c82b6, user_id=ccd7d60a9c404eaa8076efc77856a320, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.612105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.629155 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3445/6886] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:54 2022] PUT /identity/v3/projects/5854a60d8416469ba960adf6a67c82b6/users/ccd7d60a9c404eaa8076efc77856a320/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:54.636718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:54.638015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ca4febd1e934c7295d33cab282ae466'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.639184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ca4febd1e934c7295d33cab282ae466'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.643740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:54.652279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ca4febd1e934c7295d33cab282ae466'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.653522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ca4febd1e934c7295d33cab282ae466'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.665580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ca4febd1e934c7295d33cab282ae466'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:54.695977 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3442/6887] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:54 2022] DELETE /identity/v3/users/7ca4febd1e934c7295d33cab282ae466 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:54.806995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cbe7-839d-46d1-8c00-ec68e015dbdd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:54.880746 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:54.950820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541ea15-e33b-4229-b619-046b665fe865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:54.951553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ea15-e33b-4229-b619-046b665fe865 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:54.951807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ea15-e33b-4229-b619-046b665fe865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:54.952081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541ea15-e33b-4229-b619-046b665fe865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:54.952930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541ea15-e33b-4229-b619-046b665fe865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:54.954897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e541ea15-e33b-4229-b619-046b665fe865 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:54.968171 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3446/6888] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:54.974534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:55.001616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a723227-98df-4b95-ae8d-bd779df9abdd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:55.018879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:55.022139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.026688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.027239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] PATH_INFO: `/v3/projects/5854a60d8416469ba960adf6a67c82b6/users/ccd7d60a9c404eaa8076efc77856a320/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.030798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5854a60d8416469ba960adf6a67c82b6, user_id=ccd7d60a9c404eaa8076efc77856a320, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:55.034545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:55.116454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3443/6889] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:54 2022] PUT /identity/v3/projects/5854a60d8416469ba960adf6a67c82b6/users/ccd7d60a9c404eaa8076efc77856a320/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:55.125851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.126422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.127026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.131219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:55.139204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:55.203293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] MFA Rules not processed for user `ccd7d60a9c404eaa8076efc77856a320`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:55.207461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:55.336994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835ac28e-482d-4cd6-9715-7096ce1a330b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:55.348000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:55.349079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.349529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.349910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] PATH_INFO: `/v3/projects/d1e7cb33c6ac49ca8e89d005ed4d6f9c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.352454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e7cb33c6ac49ca8e89d005ed4d6f9c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:55.355988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:55.366343 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3447/6890] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:55.413727 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:55.442291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:55.444190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:55.458901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e7cb33c6ac49ca8e89d005ed4d6f9c', 'request_id': 'req-8fda8801-eee1-43e5-a139-795a13fd913d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:55.469216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e7cb33c6ac49ca8e89d005ed4d6f9c', 'request_id': 'req-8fda8801-eee1-43e5-a139-795a13fd913d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:55.477611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e7cb33c6ac49ca8e89d005ed4d6f9c', 'request_id': 'req-8fda8801-eee1-43e5-a139-795a13fd913d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:55.517533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] The token cache is being invalidate because project d1e7cb33c6ac49ca8e89d005ed4d6f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:55.519707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:55.521081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8fda8801-eee1-43e5-a139-795a13fd913d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:55.527640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3444/6891] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:55 2022] DELETE /identity/v3/projects/d1e7cb33c6ac49ca8e89d005ed4d6f9c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:55.530504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac0a0-3526-47c0-8d81-b7e518637fd0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.531508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac0a0-3526-47c0-8d81-b7e518637fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.531944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ac0a0-3526-47c0-8d81-b7e518637fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.564646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4a6ac0a0-3526-47c0-8d81-b7e518637fd0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:55.566081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4a6ac0a0-3526-47c0-8d81-b7e518637fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:55.610332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e3a1d-716f-4e22-a80e-6608282be027 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:55.739727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3445/6892] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:55.754029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.755103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.755534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.769131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:55.769822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.770108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.770386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.782067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:55.812789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:55.819243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:55.820786 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:55.846619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3446/6893] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:55.850893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:55.864401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30b42f-0b54-4022-a680-d8b7018f788e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:55.871787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:55.872525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.873138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.874071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.877443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:55.877912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:55.880121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:55.902588 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3447/6894] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:55.905045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:55.924287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:55.929126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:55.931851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef537ab-92a6-42c4-be14-bbc3133c6159 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:55.942648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:55.946711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:55.946851 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3448/6895] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:37:55.947021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:55.947593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:55.951578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:55.953619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:56.024361 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3448/6896] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:55 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:56.028461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:56.068782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e33fc-6e9a-4147-81e6-032bbe6a9f23 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:56.231327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:56.232290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.234661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.234661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.234661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:56.237469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:56.278496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:56.280407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:56.299014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea726e-373e-469a-aaf2-c98c0d01b8cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:56.302971 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3449/6897] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:56 2022] POST /identity/v3/users => generated 282 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:56.306237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:56.316655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:56.317834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.321917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.322366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] PATH_INFO: `/v3/projects/65b236467f9744308f0f414b90cbc54f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.325383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] RBAC: Authorizing `identity:delete_project(project_id=65b236467f9744308f0f414b90cbc54f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:56.327512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:56.331626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ac4f5-91cc-4783-a43e-5261b1a8ad76 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:56.344274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:56.345146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.345525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.346084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.346969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:56.351516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:56.384799 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3450/6898] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:56.390055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:56.413393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747bf533-da22-468d-80ce-04bdef221df7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:56.434452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:56.439551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.440204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.440967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.442039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:56.452412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:56.467759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65b236467f9744308f0f414b90cbc54f', 'request_id': 'req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:56.478052 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3451/6899] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:56.480305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65b236467f9744308f0f414b90cbc54f', 'request_id': 'req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:56.481440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:56.500659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65b236467f9744308f0f414b90cbc54f', 'request_id': 'req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:56.505572 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:56.513704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f999e90e-7dd2-4425-b8f8-9fc35619db15 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:56.553020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] The token cache is being invalidate because project 65b236467f9744308f0f414b90cbc54f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:37:56.553541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:56.557195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea21de1f-de7d-47ad-bb4f-c4cd106f909d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:56.565097 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3449/6900] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:37:56 2022] DELETE /identity/v3/projects/65b236467f9744308f0f414b90cbc54f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:56.570944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b839a-0b33-401e-b5df-e0fd7a9d79e3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.573541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b839a-0b33-401e-b5df-e0fd7a9d79e3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.575532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534b839a-0b33-401e-b5df-e0fd7a9d79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.667001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-534b839a-0b33-401e-b5df-e0fd7a9d79e3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:56.668744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-534b839a-0b33-401e-b5df-e0fd7a9d79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:56.752694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9b0608-763d-437b-906d-90b4cbe05114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:56.753624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b0608-763d-437b-906d-90b4cbe05114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.753921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b0608-763d-437b-906d-90b4cbe05114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.754180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b0608-763d-437b-906d-90b4cbe05114 admin admin] PATH_INFO: `/v3/projects/c456e9d16f3745d3829084dd624e3301/users/cc9ac943db904a1aaf2d079926652ea1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.801811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b0608-763d-437b-906d-90b4cbe05114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c456e9d16f3745d3829084dd624e3301, user_id=cc9ac943db904a1aaf2d079926652ea1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:56.803598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3450/6901] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:56.804649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9b0608-763d-437b-906d-90b4cbe05114 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:56.815638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.816205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.816710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.838418 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3452/6902] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:56 2022] PUT /identity/v3/projects/c456e9d16f3745d3829084dd624e3301/users/cc9ac943db904a1aaf2d079926652ea1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:56.845596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:56.846268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:56.846741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:56.872533 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:56.874984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:56.878557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:56.901740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] MFA Rules not processed for user `cc9ac943db904a1aaf2d079926652ea1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:56.903303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:57.065071 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3451/6903] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:57.066728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.093750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac1a96-3824-482c-9b70-216ca567a0d2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.112627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.113397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.113622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.113901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.114889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:37:57.115225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.119019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.155999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3452/6904] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:37:57.160685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.166349 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3453/6905] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:57.181807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.183305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:57.201218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e3234-4bc5-4677-a21c-356971f7c876 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.214287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.215214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.216782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.218079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.219774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.224550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.273694 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3453/6906] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:57 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:57.279616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.357791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd66ff4-2b61-4e14-b269-fb4266033b33 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.461915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81db3b-a584-4e05-a397-2e72b80e8f5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.477323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.478121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.478522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.479853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.481704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.485936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.509410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06199a8-97b5-4527-ae3c-a5c901f679a7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.513306 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:57.516317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06199a8-97b5-4527-ae3c-a5c901f679a7 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.516747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06199a8-97b5-4527-ae3c-a5c901f679a7 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.517059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06199a8-97b5-4527-ae3c-a5c901f679a7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.546649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3454/6907] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:57 2022] POST /identity/v3/users => generated 285 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:57.551937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.564643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b98f19b-a039-419e-9736-85e3f205efa7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.570946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.572088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.572438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.572809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.573633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.579251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.611640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3455/6908] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:57.613378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.652808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5f8f3-acd5-4db8-b9e7-ac6ee3ceeac7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.683305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.684275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.684591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.684872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.687624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.687712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.706853 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3456/6909] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:57.710755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:57.748642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06199a8-97b5-4527-ae3c-a5c901f679a7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.750581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06199a8-97b5-4527-ae3c-a5c901f679a7 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.754542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2c4299-374c-4526-9014-e1862f5f899f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:57.763617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:57.769195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.769491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.769787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] PATH_INFO: `/v3/projects/c87703d25a8a468b9b8c87c708be377a/users/b14eb664fa9d4b7ea84d2ed3882914ad/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.781271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3454/6910] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:57 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:57.824139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87703d25a8a468b9b8c87c708be377a, user_id=b14eb664fa9d4b7ea84d2ed3882914ad, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:57.827718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:57.861378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3457/6911] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:57 2022] PUT /identity/v3/projects/c87703d25a8a468b9b8c87c708be377a/users/b14eb664fa9d4b7ea84d2ed3882914ad/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:57.871911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:57.872469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:57.872669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:57.897365 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:57.950457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] MFA Rules not processed for user `b14eb664fa9d4b7ea84d2ed3882914ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:57.951862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:58.127737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3455/6912] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:58.132250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.314232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9b5945-6f21-4d9b-b78c-405287ae190e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:58.336020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:58.336744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.337031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.337315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.338042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:58.340019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:58.420195 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3458/6913] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:37:58 2022] POST /identity/v3/projects => generated 367 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:37:58.421346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.436358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a58b13f-08c8-462f-9e2b-9f47fac0eb45 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:58.516944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.524492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:58.556593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:58.557299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.557589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.557866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.558621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:58.561357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:58.607627 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3456/6914] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:37:58 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:37:58.612537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.626854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6400203-be1f-48a2-b180-dbc6315b756f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:58.633075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:58.633999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.634499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.634973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.635918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:58.638073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:58.659100 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3457/6915] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:58.661214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.674945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1944c-8798-49a7-beb1-5d2ba803585a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:58.682000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:58.683615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.683911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.684194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] PATH_INFO: `/v3/projects/1e24e1d8884646fca9b2d3c6ee321fe4/users/3276cbe01175451fa73aebcf210812a2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.695956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5923-c2ba-4cc0-a513-00a2f44c39d5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:58.707478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e24e1d8884646fca9b2d3c6ee321fe4, user_id=3276cbe01175451fa73aebcf210812a2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:58.710529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:58.710838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:58.713180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.713791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.714260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] PATH_INFO: `/v3/users/cc9ac943db904a1aaf2d079926652ea1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.719670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9ac943db904a1aaf2d079926652ea1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:58.723380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:58.752680 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3458/6916] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:58 2022] PUT /identity/v3/projects/1e24e1d8884646fca9b2d3c6ee321fe4/users/3276cbe01175451fa73aebcf210812a2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:58.753688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.784183 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=5,keystone:SELECT=90,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:58.815238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9ac943db904a1aaf2d079926652ea1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:58.818044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9ac943db904a1aaf2d079926652ea1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:58.843952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9ac943db904a1aaf2d079926652ea1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:58.845717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9ac943db904a1aaf2d079926652ea1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:58.855930 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:58.867205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5b66cbeb-950d-4607-b29a-f9b38ab7c4d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9ac943db904a1aaf2d079926652ea1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:37:58.894588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8305b4-673c-4185-9c14-dbfeaf1c672b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:58.907706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:58.908804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.909099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.909360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.910155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:58.911966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:58.918410 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3459/6917] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:37:58 2022] DELETE /identity/v3/users/cc9ac943db904a1aaf2d079926652ea1 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:37:58.923282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:58.923570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:58.923897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:58.941350 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3459/6918] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:37:58.945851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:58.948324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:58.975451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:58.977257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:59.008267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68aaa-fddf-462f-a08a-eb87d6d571cb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:59.119987 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3460/6919] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:37:59.141640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd3555e-94c1-4f78-b8b9-22d8c8c8541b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:59.143363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3555e-94c1-4f78-b8b9-22d8c8c8541b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:59.144021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3555e-94c1-4f78-b8b9-22d8c8c8541b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:59.144458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd3555e-94c1-4f78-b8b9-22d8c8c8541b admin admin] PATH_INFO: `/v3/projects/1e24e1d8884646fca9b2d3c6ee321fe4/users/3276cbe01175451fa73aebcf210812a2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:59.148382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3555e-94c1-4f78-b8b9-22d8c8c8541b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e24e1d8884646fca9b2d3c6ee321fe4, user_id=3276cbe01175451fa73aebcf210812a2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:59.154086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd3555e-94c1-4f78-b8b9-22d8c8c8541b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:59.172622 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3460/6920] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:37:58 2022] PUT /identity/v3/projects/1e24e1d8884646fca9b2d3c6ee321fe4/users/3276cbe01175451fa73aebcf210812a2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:37:59.185500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:59.186267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:59.187191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:59.187478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:59.188045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:59.267071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] MFA Rules not processed for user `3276cbe01175451fa73aebcf210812a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:37:59.276561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:59.330271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10475b51-c305-45b4-8bee-b58436f2eb06 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:59.518334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:59.519870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:59.520388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:59.520867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:59.529171 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3461/6921] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:37:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:37:59.542742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:59.544435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:59.592320 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:59.680268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093b657e-8db3-403d-910d-96cd9a82b92f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:59.695313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:59.696003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:59.696511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:59.696867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:59.714478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:59.716896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:59.722037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:37:59.723698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:37:59.733485 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:37:59.737251 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3461/6922] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:59.746008 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3462/6923] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:37:59.805443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:37:59.807081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:37:59.829498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e913fd7-fc38-465f-9058-5844caaafd67 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:37:59.847746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:37:59.848734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:37:59.849064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:37:59.849362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:37:59.855035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:00.012167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:00.012167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb5c6f-e8a4-4e33-bf76-b07825366ac8 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:00.034113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3462/6924] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:37:59 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:01.597457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:01.600175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:01.634711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c67f908-b1b3-4aca-8ea9-ca1a00234b88 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:01.666436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:01.667365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:01.667651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:01.667930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] PATH_INFO: `/v3/users/2dcad547720e4fee9e052c97aa918a02` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:01.673055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dcad547720e4fee9e052c97aa918a02)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:01.675354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:01.824098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dcad547720e4fee9e052c97aa918a02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:01.835874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dcad547720e4fee9e052c97aa918a02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:01.859478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dcad547720e4fee9e052c97aa918a02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:01.861153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dcad547720e4fee9e052c97aa918a02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:01.871860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dcad547720e4fee9e052c97aa918a02'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:01.880226 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3463/6925] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:01 2022] DELETE /identity/v3/users/2dcad547720e4fee9e052c97aa918a02 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:01.884785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:01.885254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:01.885354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:01.921595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:01.922873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.122824 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3463/6926] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:02.176139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:02.178646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.200141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:02.206653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.243447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cf19cd-271f-43d2-a875-a1f192349ea0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:02.262591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:02.263564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:02.263849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:02.264179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] PATH_INFO: `/v3/users/0f938d6f50254ce9acd6ed93904a1edd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:02.265814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f938d6f50254ce9acd6ed93904a1edd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:02.270105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:02.388733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f938d6f50254ce9acd6ed93904a1edd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.389369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f938d6f50254ce9acd6ed93904a1edd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.392535 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:02.403974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f938d6f50254ce9acd6ed93904a1edd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.405417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f938d6f50254ce9acd6ed93904a1edd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.433100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5a4c4404-dc5a-46c1-80bd-8bd3c9cf7684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f938d6f50254ce9acd6ed93904a1edd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.442229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0f683-6090-4b52-8a8d-dfbfddedcbf8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:02.451752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:02.457050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:02.457456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:02.458259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:02.461114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.500317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:02.504190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:02.504713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3464/6927] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:02 2022] DELETE /identity/v3/users/0f938d6f50254ce9acd6ed93904a1edd => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:02.509486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:02.509747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:02.510107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:02.534830 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3464/6928] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:02.578426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:02.579894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:02.581731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.595751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.603374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ff479d-9a86-4759-b1fd-ea8ff495b8b5 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:02.751418 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3465/6929] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:02.774179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:02.775633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:02.775747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:02.776722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:02.779159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:02.779486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] PATH_INFO: `/v3/projects/c456e9d16f3745d3829084dd624e3301` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:02.781924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c456e9d16f3745d3829084dd624e3301)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:02.789985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:02.846212 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:02.900673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b90e9-2445-454d-999c-3c77563c6274 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:02.928914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c456e9d16f3745d3829084dd624e3301', 'request_id': 'req-a3e8757f-7848-4eef-a57c-4e1966df7d67'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.944276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c456e9d16f3745d3829084dd624e3301', 'request_id': 'req-a3e8757f-7848-4eef-a57c-4e1966df7d67'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.959544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c456e9d16f3745d3829084dd624e3301', 'request_id': 'req-a3e8757f-7848-4eef-a57c-4e1966df7d67'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.990098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] The token cache is being invalidate because project c456e9d16f3745d3829084dd624e3301 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:02.991128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.993828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a3e8757f-7848-4eef-a57c-4e1966df7d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:02.996183 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3465/6930] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:02 2022] DELETE /identity/v3/projects/c456e9d16f3745d3829084dd624e3301 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:03.002693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.002693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.002990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.010390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.011313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.011748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.012216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.014276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:03.044491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:03.045735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:03.073417 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:03.107097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.109012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57663ec5-0ee1-4091-ba3a-b53a61785823 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.120516 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3466/6931] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:03.151593 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3466/6932] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:03.161050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.161631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.161921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.185668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:03.187215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:03.203871 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3467/6933] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:03.204714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.215738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd99386-f9f5-484c-94c2-fa293cbeb97d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.226607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.228441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.229544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.230528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.241772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:03.242984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.249628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.285816 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3467/6934] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:38:03.288399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.301638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41cc4bb-05b4-47d7-b14a-cbcbc7ee9ffa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.321828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.323072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.334212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.335942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.336824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.339751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.380527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.381068 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3468/6935] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:03 2022] POST /identity/v3/projects => generated 385 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:03.401365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f0cb-671a-49ca-9a64-b3d39bcdc59d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.501584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.503017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.503492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.503998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.505165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.508505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.542413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3468/6936] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:03 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:03.546903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.562036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8bd2ed-20a5-466a-820c-bd8d5a1fb97a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.567159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.567981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.568447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.568776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.569666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.571494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.590831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.603304 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3469/6937] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:03.606532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1823c7bd-1478-4713-b4ab-512f95edfa36 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.612714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.613474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.613762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.614110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.615098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.616976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.635226 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3469/6938] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:03.635955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.649593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb576e-25c3-4b11-9505-6cb3a9e07e46 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.658609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3bd68b-9f2d-412b-98f0-08727cafcfd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.660773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd68b-9f2d-412b-98f0-08727cafcfd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.660773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd68b-9f2d-412b-98f0-08727cafcfd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.661810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3bd68b-9f2d-412b-98f0-08727cafcfd9 admin admin] PATH_INFO: `/v3/projects/96c8e81c2a2a4bacb53fa550f069d405/users/cfeb66b2d68140fa92cd92bcbc2890ba/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.686653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bd68b-9f2d-412b-98f0-08727cafcfd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c8e81c2a2a4bacb53fa550f069d405, user_id=cfeb66b2d68140fa92cd92bcbc2890ba, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.690576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3bd68b-9f2d-412b-98f0-08727cafcfd9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:03.723367 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3470/6939] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:03 2022] PUT /identity/v3/projects/96c8e81c2a2a4bacb53fa550f069d405/users/cfeb66b2d68140fa92cd92bcbc2890ba/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:03.753761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:03.756906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:03.791339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e531ea8-5fb6-4911-8eed-fa551f0d26db admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:03.798617 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:03.832974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0801929-2421-495f-9dfe-138185e77873 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.833806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0801929-2421-495f-9dfe-138185e77873 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.834159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0801929-2421-495f-9dfe-138185e77873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.895869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0801929-2421-495f-9dfe-138185e77873 None None] MFA Rules not processed for user `cfeb66b2d68140fa92cd92bcbc2890ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:03.900225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0801929-2421-495f-9dfe-138185e77873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:03.921997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:03.922896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:03.923173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:03.923556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] PATH_INFO: `/v3/projects/3a8abf9e242641ef8d8b60237d3b4c50` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:03.925130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8abf9e242641ef8d8b60237d3b4c50)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:03.927156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.011570 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3471/6940] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:04.015931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0801929-2421-495f-9dfe-138185e77873 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.027461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8abf9e242641ef8d8b60237d3b4c50', 'request_id': 'req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.034835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0801929-2421-495f-9dfe-138185e77873 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.065840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8abf9e242641ef8d8b60237d3b4c50', 'request_id': 'req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.079551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8abf9e242641ef8d8b60237d3b4c50', 'request_id': 'req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.112767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] The token cache is being invalidate because project 3a8abf9e242641ef8d8b60237d3b4c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:04.113069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.114160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.118579 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3470/6941] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:03 2022] DELETE /identity/v3/projects/3a8abf9e242641ef8d8b60237d3b4c50 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:04.123073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.126939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:04.148203 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:04.161586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.165320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.165897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.166879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.169361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.177339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.255690 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3472/6942] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:04 2022] POST /identity/v3/projects => generated 383 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:04.260994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.263483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:04.319769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4f635-f4af-4ab9-9f2d-e7728ed266b8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.412059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1afd-ec1c-444a-ae3e-318be4a158fc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.418442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.418989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.419460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.419743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.420515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.422752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.426825 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:04.459252 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3473/6943] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:04 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:04.460791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.465353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.466519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.466988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.467435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] PATH_INFO: `/v3/users/af1598b2551748cbb7cedbe1db897857` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.468947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1598b2551748cbb7cedbe1db897857)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.471834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.474664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bb5a8b-1672-438b-9f33-6a06b1a48c63 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.481087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.481882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.482239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.482587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.483693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.486667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.522914 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3474/6944] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:04.524473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.555911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fc4e66-5635-4891-8ec0-0cb0ebcd4301 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.561491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1598b2551748cbb7cedbe1db897857'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.570959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.574269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.575233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.575900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] PATH_INFO: `/v3/projects/53621188e4e548a3a0476bd13771036b/users/8eec6cd5cd7a48a98f19496dcd9cd340/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.583322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1598b2551748cbb7cedbe1db897857'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.614696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1598b2551748cbb7cedbe1db897857'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.619008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1598b2551748cbb7cedbe1db897857'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.623178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53621188e4e548a3a0476bd13771036b, user_id=8eec6cd5cd7a48a98f19496dcd9cd340, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.632736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.641683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1598b2551748cbb7cedbe1db897857'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:04.654232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3471/6945] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:04 2022] DELETE /identity/v3/users/af1598b2551748cbb7cedbe1db897857 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:04.662423 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3475/6946] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:04 2022] PUT /identity/v3/projects/53621188e4e548a3a0476bd13771036b/users/8eec6cd5cd7a48a98f19496dcd9cd340/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:04.666674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.668160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:04.751497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ec588-bbf2-4fd2-ac60-4ae8cc419819 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.761703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.765098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.765098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.765098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.765098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.767151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.785391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3472/6947] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:04 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:04.789991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.901650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:04.906496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:04.933195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b241aa-ec0e-43c5-947f-e9eba9febf63 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.949481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.950389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.950677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.950949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] PATH_INFO: `/v3/users/b14eb664fa9d4b7ea84d2ed3882914ad` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.955816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14eb664fa9d4b7ea84d2ed3882914ad)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.957803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.958454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71a513-945d-497d-ad79-be16f34be422 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:04.969098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5a9d6-9b68-4f95-b5da-9a91dfdf52b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:04.970805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5a9d6-9b68-4f95-b5da-9a91dfdf52b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:04.971465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5a9d6-9b68-4f95-b5da-9a91dfdf52b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:04.971990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5a9d6-9b68-4f95-b5da-9a91dfdf52b5 admin admin] PATH_INFO: `/v3/projects/53621188e4e548a3a0476bd13771036b/users/8eec6cd5cd7a48a98f19496dcd9cd340/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:04.974722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5a9d6-9b68-4f95-b5da-9a91dfdf52b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53621188e4e548a3a0476bd13771036b, user_id=8eec6cd5cd7a48a98f19496dcd9cd340, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:04.978823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5a9d6-9b68-4f95-b5da-9a91dfdf52b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:04.992705 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3476/6948] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:04 2022] PUT /identity/v3/projects/53621188e4e548a3a0476bd13771036b/users/8eec6cd5cd7a48a98f19496dcd9cd340/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:05.002991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:05.003575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:05.004058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:05.079900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] MFA Rules not processed for user `8eec6cd5cd7a48a98f19496dcd9cd340`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:05.082005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:05.102969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14eb664fa9d4b7ea84d2ed3882914ad'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:05.112627 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:05.122383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14eb664fa9d4b7ea84d2ed3882914ad'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:05.131774 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:05.156714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14eb664fa9d4b7ea84d2ed3882914ad'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:05.159558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14eb664fa9d4b7ea84d2ed3882914ad'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:05.170717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-beb95572-aaac-4447-af10-09140c8076db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14eb664fa9d4b7ea84d2ed3882914ad'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:05.183371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3473/6949] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:04 2022] DELETE /identity/v3/users/b14eb664fa9d4b7ea84d2ed3882914ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:05.190527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:05.191115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:05.191840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:05.225349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:05.227412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:05.248718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3477/6950] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:05 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:05.332760 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3474/6951] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:05.400844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:05.402553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:05.411482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:05.413678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:05.604671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3349b894-2d48-4b71-a6ea-29337cc6dad2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:05.671960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2a4ee1-24b7-4c10-85da-4cbdc59b2012 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:05.706001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:05.709792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:05.710241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:05.711511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:05.718904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:05.749563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:05.750459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:05.750845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:05.751356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:05.785954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:05.789695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:05.807715 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3478/6952] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:05.813413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:05.819380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:05.862462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91e51b-7c78-4dbf-8872-da29c7bb3a2b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:05.869743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:05.871169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:05.871662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:05.872139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] PATH_INFO: `/v3/projects/0067d9266d3945c6b2af11edb19193fc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:05.873912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0067d9266d3945c6b2af11edb19193fc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:05.876068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:05.878236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:05.883600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:05.922566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3475/6953] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:05.970639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0067d9266d3945c6b2af11edb19193fc', 'request_id': 'req-2f89e815-8ef0-43ac-8d82-79bf1a409756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:05.984765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0067d9266d3945c6b2af11edb19193fc', 'request_id': 'req-2f89e815-8ef0-43ac-8d82-79bf1a409756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.003619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0067d9266d3945c6b2af11edb19193fc', 'request_id': 'req-2f89e815-8ef0-43ac-8d82-79bf1a409756'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.026146 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:06.032264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] The token cache is being invalidate because project 0067d9266d3945c6b2af11edb19193fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:06.033484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.036680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.039356 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3479/6954] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:05 2022] DELETE /identity/v3/projects/0067d9266d3945c6b2af11edb19193fc => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:06.044134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:06.068811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2be54a-ae64-4dba-b975-cba7322cda3e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:06.129119 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:06.217637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:06.218557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:06.218975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:06.219111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] PATH_INFO: `/v3/users/ccd7d60a9c404eaa8076efc77856a320` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:06.229434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccd7d60a9c404eaa8076efc77856a320)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:06.232049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:06.317299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccd7d60a9c404eaa8076efc77856a320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.332509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:06.335194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:06.348993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccd7d60a9c404eaa8076efc77856a320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.371362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f89e815-8ef0-43ac-8d82-79bf1a409756 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:06.379792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccd7d60a9c404eaa8076efc77856a320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.380688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccd7d60a9c404eaa8076efc77856a320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.391824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0dd732b6-2ecb-4911-a5a5-f66c6964f1be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccd7d60a9c404eaa8076efc77856a320'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.393149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:06.394268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:06.394556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:06.394837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] PATH_INFO: `/v3/projects/086e939158bd42b09e343feeade03e17` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:06.397489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] RBAC: Authorizing `identity:delete_project(project_id=086e939158bd42b09e343feeade03e17)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:06.399348 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3476/6955] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:06 2022] DELETE /identity/v3/users/ccd7d60a9c404eaa8076efc77856a320 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:06.405899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:06.479309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '086e939158bd42b09e343feeade03e17', 'request_id': 'req-130a0a96-277c-4b73-a40e-5b5e71379817'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.487186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '086e939158bd42b09e343feeade03e17', 'request_id': 'req-130a0a96-277c-4b73-a40e-5b5e71379817'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.496763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '086e939158bd42b09e343feeade03e17', 'request_id': 'req-130a0a96-277c-4b73-a40e-5b5e71379817'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.520140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] The token cache is being invalidate because project 086e939158bd42b09e343feeade03e17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:06.520474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.525191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-130a0a96-277c-4b73-a40e-5b5e71379817 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:06.533622 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3480/6956] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:06 2022] DELETE /identity/v3/projects/086e939158bd42b09e343feeade03e17 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:06.538976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:06.539531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:06.540081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:06.568333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:06.570666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:06.711182 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3477/6957] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:06.719038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:06.719038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:06.719316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:06.746640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:06.747826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:06.775155 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3481/6958] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:06.779905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:06.802266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a25c4-f35f-4dd3-ac38-07228275ade8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:06.827087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:06.829419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:06.836818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:06.837166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:06.838945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:06.839316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:06.841580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:06.865392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3478/6959] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:06.870311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:06.886730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa79607-89d0-4709-bf30-60ca011b7ca7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:06.893665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:06.895271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:06.895567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:06.895849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:06.896591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:06.902330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:06.953176 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3482/6960] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:06 2022] POST /identity/v3/projects => generated 387 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:06.956056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:06.971146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04b5138-0fca-4c90-ac6f-d61a76a4671e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:07.050455 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:07.110895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:07.111907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:07.112335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:07.113531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:07.114648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:07.118567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:07.161171 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3479/6961] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:06 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:07.162747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:07.178473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8385e66-d698-4be7-816f-eb5b00c22536 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:07.195124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:07.196060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:07.196368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:07.196645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:07.197396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:07.199069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:07.256619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3483/6962] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:07.261733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:07.276752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21375e9-89be-4252-873f-09e9fef14c44 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:07.290671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bb96b-d920-46dc-a200-68a6db80e318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:07.291391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb96b-d920-46dc-a200-68a6db80e318 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:07.291675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb96b-d920-46dc-a200-68a6db80e318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:07.291954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bb96b-d920-46dc-a200-68a6db80e318 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:07.297718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bb96b-d920-46dc-a200-68a6db80e318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:07.300293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bb96b-d920-46dc-a200-68a6db80e318 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:07.316428 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3480/6963] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:07.321167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:07.335229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292840c-ea84-42ab-93f2-4327829facc1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:07.341810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:07.343019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:07.345638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:07.346143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] PATH_INFO: `/v3/projects/f09a77c08c2c499c9667deab4f6849a9/users/3bfdd6e8f9574e968ae12de04d5e2745/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:07.373171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09a77c08c2c499c9667deab4f6849a9, user_id=3bfdd6e8f9574e968ae12de04d5e2745, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:07.379230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:07.423124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3484/6964] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:07 2022] PUT /identity/v3/projects/f09a77c08c2c499c9667deab4f6849a9/users/3bfdd6e8f9574e968ae12de04d5e2745/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:07.435436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:07.437141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:07.437601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:07.477750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] MFA Rules not processed for user `3bfdd6e8f9574e968ae12de04d5e2745`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:07.479113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:07.626674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3481/6965] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:07.631341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:07.677563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:07.679359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:07.789479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a206b-9466-4a72-bebe-42209077313e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:07.816075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:07.816957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:07.817255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:07.817535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:07.818269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:07.820757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:07.882721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3485/6966] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:07 2022] POST /identity/v3/projects => generated 385 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:07.883039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:07.887846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:07.888182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820238b-8480-4800-92b9-0de08eb0e887 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:07.905254 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:08.026571 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:08.054866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd7a07-3985-4623-9d34-50c518e88102 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.055744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.057067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.057491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.057785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] PATH_INFO: `/v3/projects/c87703d25a8a468b9b8c87c708be377a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.059806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87703d25a8a468b9b8c87c708be377a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.062546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.065634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.067302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.067596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.067874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] PATH_INFO: `/v3/projects/5854a60d8416469ba960adf6a67c82b6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.070340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5854a60d8416469ba960adf6a67c82b6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.073637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.134236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87703d25a8a468b9b8c87c708be377a', 'request_id': 'req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.162535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87703d25a8a468b9b8c87c708be377a', 'request_id': 'req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.166516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5854a60d8416469ba960adf6a67c82b6', 'request_id': 'req-bc47d515-73e6-4c1a-97b7-78b590da184b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.178659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5854a60d8416469ba960adf6a67c82b6', 'request_id': 'req-bc47d515-73e6-4c1a-97b7-78b590da184b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.183303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87703d25a8a468b9b8c87c708be377a', 'request_id': 'req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.186810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5854a60d8416469ba960adf6a67c82b6', 'request_id': 'req-bc47d515-73e6-4c1a-97b7-78b590da184b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.204689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] The token cache is being invalidate because project c87703d25a8a468b9b8c87c708be377a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:08.205075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] The token cache is being invalidate because project 5854a60d8416469ba960adf6a67c82b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:08.205293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.206040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.206483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.207374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.208091 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3486/6967] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:07 2022] DELETE /identity/v3/projects/5854a60d8416469ba960adf6a67c82b6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:08.209043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.210538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.211192 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3482/6968] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:07 2022] DELETE /identity/v3/projects/c87703d25a8a468b9b8c87c708be377a => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:08.212385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.215008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.296095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b264e5-acc4-47f0-b22e-f2ccf2cab3af admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.306910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47d515-73e6-4c1a-97b7-78b590da184b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.316266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4aca2-a707-4a5e-ad36-d95949c2241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.318154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4aca2-a707-4a5e-ad36-d95949c2241a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.318674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4aca2-a707-4a5e-ad36-d95949c2241a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.319241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4aca2-a707-4a5e-ad36-d95949c2241a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.320290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4aca2-a707-4a5e-ad36-d95949c2241a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.324307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4aca2-a707-4a5e-ad36-d95949c2241a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.355421 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3487/6969] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:08 2022] POST /identity/v3/users => generated 299 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:08.358172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.359220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.359647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.392617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:08.400039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.412522 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3488/6970] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:08.415623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.417540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.424720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.425580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.426093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.426470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.429734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.434409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4e99f2-b797-4e6b-96f0-17224b3123dd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.442668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.444197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.444683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.445388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] PATH_INFO: `/v3/users/3276cbe01175451fa73aebcf210812a2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.446990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3276cbe01175451fa73aebcf210812a2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.450333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.467847 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:08.519022 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:08.546179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.550260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.565568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3276cbe01175451fa73aebcf210812a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.566493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3276cbe01175451fa73aebcf210812a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.568801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3483/6971] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:08.570026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.571074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.582848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3276cbe01175451fa73aebcf210812a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.584213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3276cbe01175451fa73aebcf210812a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.588701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e35a0d-505a-48be-86aa-c75974b5111a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.593742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5ab17-e8b6-4ede-a7b4-82b7fc3ad4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.594479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ab17-e8b6-4ede-a7b4-82b7fc3ad4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.594710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ab17-e8b6-4ede-a7b4-82b7fc3ad4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.594983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5ab17-e8b6-4ede-a7b4-82b7fc3ad4f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.596541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5ab17-e8b6-4ede-a7b4-82b7fc3ad4f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.597716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d5ab17-e8b6-4ede-a7b4-82b7fc3ad4f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.600686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3276cbe01175451fa73aebcf210812a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:08.611114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3484/6972] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:08.612703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.612908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.613201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.638615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:08.641327 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3489/6973] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:08 2022] DELETE /identity/v3/users/3276cbe01175451fa73aebcf210812a2 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:08.641927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.643567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.646838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:08.714352 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3485/6974] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:08.719532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.732889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11744bf-405c-427e-a1f1-28f99b1a76c8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.737952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.738802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.739101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.739411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.740167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:08.740651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.742992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.761659 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3486/6975] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:08.762585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.767212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22a162-4df2-465f-a61b-1e5519083812 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.774546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d945c-8904-4d5c-97d5-1eba4a7cc98a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.775760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.778373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.779248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.780592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] PATH_INFO: `/v3/projects/2a7d46d7477349c99c9f234a9d88bcff/users/65c0f97a54bf4ccba6679def8924cc3f/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.780906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.782372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.782372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.783009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.783680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.786500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.810434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7d46d7477349c99c9f234a9d88bcff, user_id=65c0f97a54bf4ccba6679def8924cc3f, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.817051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:08.828777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3487/6976] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:08 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:08.830177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.854331 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3490/6977] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:08 2022] PUT /identity/v3/projects/2a7d46d7477349c99c9f234a9d88bcff/users/65c0f97a54bf4ccba6679def8924cc3f/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:08.858356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:08.928049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc9020-e384-45e8-8db4-c0f4f9f90b8d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.982941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49e48b-5010-46c6-ad75-723a50a98e7b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:08.988775 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:08.991361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:08.993142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:08.994353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:08.994730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:08.996392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:08.998595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.006495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.007564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.007907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.008192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.009124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.011326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.015777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3491/6978] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:09.016996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.031073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d878389-f014-4bf8-95e7-56e43bb319bb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.037379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6560ff-8cab-4191-afc2-0d82db913a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.038454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6560ff-8cab-4191-afc2-0d82db913a0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.038806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6560ff-8cab-4191-afc2-0d82db913a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.039155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6560ff-8cab-4191-afc2-0d82db913a0d admin admin] PATH_INFO: `/v3/projects/2a7d46d7477349c99c9f234a9d88bcff/users/65c0f97a54bf4ccba6679def8924cc3f/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.042697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6560ff-8cab-4191-afc2-0d82db913a0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a7d46d7477349c99c9f234a9d88bcff, user_id=65c0f97a54bf4ccba6679def8924cc3f, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.045779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6560ff-8cab-4191-afc2-0d82db913a0d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.046207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3488/6979] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:08 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:09.047125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.051522 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:09.060896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be0df49-0d31-43d9-be47-b52845c66884 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.065785 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3492/6980] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:09 2022] PUT /identity/v3/projects/2a7d46d7477349c99c9f234a9d88bcff/users/65c0f97a54bf4ccba6679def8924cc3f/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:09.078211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.078791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.079452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.130012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] MFA Rules not processed for user `65c0f97a54bf4ccba6679def8924cc3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:09.131785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:09.137713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.138418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.141989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.141989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.141989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.141989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.155860 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3489/6981] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:09.171280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.212411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577e2de-5913-4b60-9e27-982744b16bdc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.220719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.221483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.221770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.222238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.223248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.227080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.247862 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3490/6982] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:09.249074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.263579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0829dc9b-04b4-49f4-8c19-8793bf3ba648 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.272427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355388a4-4387-4864-bcfb-51201adad712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.275284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355388a4-4387-4864-bcfb-51201adad712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.275744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355388a4-4387-4864-bcfb-51201adad712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.276191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355388a4-4387-4864-bcfb-51201adad712 admin admin] PATH_INFO: `/v3/projects/22d874624d3c4936a30ff19516a3015e/users/52ccd655495c43c8b1d817a2a38f505c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.302008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355388a4-4387-4864-bcfb-51201adad712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d874624d3c4936a30ff19516a3015e, user_id=52ccd655495c43c8b1d817a2a38f505c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.305164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355388a4-4387-4864-bcfb-51201adad712 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.309578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3493/6983] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:09.318291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.320981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:09.338164 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3491/6984] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:09 2022] PUT /identity/v3/projects/22d874624d3c4936a30ff19516a3015e/users/52ccd655495c43c8b1d817a2a38f505c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:09.339948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.340329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.340855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.376792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] MFA Rules not processed for user `52ccd655495c43c8b1d817a2a38f505c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:09.379018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:09.480757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3492/6985] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:09 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:09.481978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.482153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da466a7b-5c60-48e0-a5a9-39d680469667 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.540790 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:09.591969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f524f-04c9-4e8f-b488-87b58332181d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.600900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.608803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.609831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.609928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.610012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.610205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.611582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.612233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.613229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.616614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.676081 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3493/6986] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:09 2022] POST /identity/v3/projects => generated 375 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:09.676081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.680833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:09.714567 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:09.735260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.750889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.780562 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3494/6987] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:09.781412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.811085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3591b97f-0b4f-4143-8d61-f238d4a59db5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.811471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4c9bd-43b9-4430-b763-47337dd9deec service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.822227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.823391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.823750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.824534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.824778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.825018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] PATH_INFO: `/v3/users/bf243fabdd3c43e3bd86bfb48e2645c2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.825879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.826150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.826842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.828918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.829708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf243fabdd3c43e3bd86bfb48e2645c2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.832472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.894015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3495/6988] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:09 2022] POST /identity/v3/users => generated 294 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:09.898402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.929134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cce4697-ed84-4de1-aeb5-549e5994bba1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:09.931360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:09.948893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:09.949201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:09.949648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:09.950489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:09.955322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:09.974090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf243fabdd3c43e3bd86bfb48e2645c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:09.988051 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3496/6989] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:09.989851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:09.991968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf243fabdd3c43e3bd86bfb48e2645c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.009467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf243fabdd3c43e3bd86bfb48e2645c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.010277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf243fabdd3c43e3bd86bfb48e2645c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.012583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713eb510-2798-44b6-8ced-5ba6e819b733 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.025649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.027347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf243fabdd3c43e3bd86bfb48e2645c2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.028059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.031755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.032930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] PATH_INFO: `/v3/users/3bfdd6e8f9574e968ae12de04d5e2745` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.036466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bfdd6e8f9574e968ae12de04d5e2745)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.039213 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3494/6990] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:09 2022] DELETE /identity/v3/users/bf243fabdd3c43e3bd86bfb48e2645c2 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:10.040226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.044555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.048339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.135030 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:10.166760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bfdd6e8f9574e968ae12de04d5e2745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.167861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bfdd6e8f9574e968ae12de04d5e2745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.185622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bfdd6e8f9574e968ae12de04d5e2745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.186360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bfdd6e8f9574e968ae12de04d5e2745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.202851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3de49a69-b28c-450f-bbe4-a801c0602920 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bfdd6e8f9574e968ae12de04d5e2745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.217411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31cb9b4-9769-428b-9e3c-91ceec01afd1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.229419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.230477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.230969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.231306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] PATH_INFO: `/v3/projects/7a9640cfb887402d903247a926c6dee9/users/8db20e85f10348e68639cdb1c6b360ae/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.245265 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3497/6991] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:09 2022] DELETE /identity/v3/users/3bfdd6e8f9574e968ae12de04d5e2745 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:10.249988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b37f-0c3e-4294-9d5e-cc5cdabb99ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.252086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9640cfb887402d903247a926c6dee9, user_id=8db20e85f10348e68639cdb1c6b360ae, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.255500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.258186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b37f-0c3e-4294-9d5e-cc5cdabb99ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.258852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392b37f-0c3e-4294-9d5e-cc5cdabb99ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.292480 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3495/6992] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:10 2022] PUT /identity/v3/projects/7a9640cfb887402d903247a926c6dee9/users/8db20e85f10348e68639cdb1c6b360ae/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:10.292480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.297091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1392b37f-0c3e-4294-9d5e-cc5cdabb99ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:10.298316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.300950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1392b37f-0c3e-4294-9d5e-cc5cdabb99ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.419785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9837f95d-8072-49de-a32e-8d277a225c06 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.429692 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3498/6993] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:10.430641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.431537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.431860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.432132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] PATH_INFO: `/v3/projects/1e24e1d8884646fca9b2d3c6ee321fe4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.433413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.434369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.435298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e24e1d8884646fca9b2d3c6ee321fe4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.435791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.439219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.467564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:10.472204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.491937 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3499/6994] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:10.492554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.494121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.518801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d4c350-5de1-4cb1-9a26-06e1ed12e676 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.527953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e24e1d8884646fca9b2d3c6ee321fe4', 'request_id': 'req-c0350091-d636-4ba5-891f-685cd3eef972'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.540509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e24e1d8884646fca9b2d3c6ee321fe4', 'request_id': 'req-c0350091-d636-4ba5-891f-685cd3eef972'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.550402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e24e1d8884646fca9b2d3c6ee321fe4', 'request_id': 'req-c0350091-d636-4ba5-891f-685cd3eef972'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.559154 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:10.566318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] The token cache is being invalidate because project 1e24e1d8884646fca9b2d3c6ee321fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:10.566615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.567369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:10.569087 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3496/6995] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:10 2022] DELETE /identity/v3/projects/1e24e1d8884646fca9b2d3c6ee321fe4 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:10.569866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.571942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.640531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.641767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.642054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.642449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.643884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.646584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.664841 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3500/6996] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:10.665931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.668660 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:10.682161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0350091-d636-4ba5-891f-685cd3eef972 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.682366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74957462-5981-4e5e-bf4f-58bbbbb7214c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.687888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.688474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.688622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.688848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.689122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.689337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.689693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.690043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.691144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.692215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.705361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.708153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3600c17-2f3b-4cda-809a-256a577394ab service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.710406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.712032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.721602 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3497/6997] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:10.723102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8079-d512-459d-abfe-13c2981f37ad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.723452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8079-d512-459d-abfe-13c2981f37ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.723792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c8079-d512-459d-abfe-13c2981f37ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.724727 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3501/6998] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:10.726334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.727986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.750971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-117c8079-d512-459d-abfe-13c2981f37ad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:10.753266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-117c8079-d512-459d-abfe-13c2981f37ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.758033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9794ad87-1891-47ae-a4e2-f647a82109b0 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:10.762314 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3498/6999] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:10.768622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa6949-ec51-42ad-ae52-ef521634d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:10.771062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.771318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.771732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.773743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6949-ec51-42ad-ae52-ef521634d8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.773916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6949-ec51-42ad-ae52-ef521634d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.774310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6949-ec51-42ad-ae52-ef521634d8f4 admin admin] PATH_INFO: `/v3/projects/7a9640cfb887402d903247a926c6dee9/users/8db20e85f10348e68639cdb1c6b360ae/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.780911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6949-ec51-42ad-ae52-ef521634d8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a9640cfb887402d903247a926c6dee9, user_id=8db20e85f10348e68639cdb1c6b360ae, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:10.786936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6949-ec51-42ad-ae52-ef521634d8f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:10.813581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:10.814272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.815616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3502/7000] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:10 2022] PUT /identity/v3/projects/7a9640cfb887402d903247a926c6dee9/users/8db20e85f10348e68639cdb1c6b360ae/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:10.828738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:10.829060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:10.829314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:10.889775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] MFA Rules not processed for user `8db20e85f10348e68639cdb1c6b360ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:10.893613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:10.974797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3499/7001] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:10.976063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:10.998737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6935192-6c3e-48b6-8878-0728056bbb7f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.011825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.013402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.013843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.014250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.015131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:11.015747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.017635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.051880 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3500/7002] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:38:11.053915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:11.079049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac50164-51d8-418c-a233-891ec0d98a13 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.093524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.094519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.096744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.097185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.098039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.101293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.113570 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3503/7003] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:11.162243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:11.165184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:11.194000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3501/7004] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:11 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:11.195407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:11.358260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c0d746-b8b2-4109-a590-b6c3be77e233 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.395391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ea6e5d-88e8-4a83-b8e7-ee04e8099bec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.410572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.411291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.411576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.411851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.413262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.420489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.453901 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:11.476947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3502/7005] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:11 2022] POST /identity/v3/users => generated 294 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:11.482520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:11.496381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821becdc-57a4-4b3f-a385-b6528e852380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.497085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821becdc-57a4-4b3f-a385-b6528e852380 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.497374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821becdc-57a4-4b3f-a385-b6528e852380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.497650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821becdc-57a4-4b3f-a385-b6528e852380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.500739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aeda38-b9d3-45b4-bb6f-d0c4ea48223a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.506903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.508194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.508194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.508536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.509439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.511195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.539446 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3503/7006] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:11.540537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:11.556154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eba233-94d8-4a5b-b9bc-2c561a6e6f7d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.564692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.565707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.565996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.566278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.567055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.568813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.586441 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3504/7007] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:11.587499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:11.611563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016ffb3-7b5f-42dd-8533-64b4e7e19250 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:11.618907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:11.619877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.620157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.620667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] PATH_INFO: `/v3/projects/ddf6c2d702274caca7f2a8e4bfccb030/users/72b437f7150c4db78d47c3894ee58b12/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.641299 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:11.645685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821becdc-57a4-4b3f-a385-b6528e852380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.646863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf6c2d702274caca7f2a8e4bfccb030, user_id=72b437f7150c4db78d47c3894ee58b12, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:11.647241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821becdc-57a4-4b3f-a385-b6528e852380 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.650568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:11.667716 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3504/7008] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:11 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:11.676403 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3505/7009] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:11 2022] PUT /identity/v3/projects/ddf6c2d702274caca7f2a8e4bfccb030/users/72b437f7150c4db78d47c3894ee58b12/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:11.683567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:11.683860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:11.684138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:11.722025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] MFA Rules not processed for user `72b437f7150c4db78d47c3894ee58b12`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:11.723377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:11.931604 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3505/7010] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:11.936107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.142559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da0d54-382e-42df-aeaa-b987254fada5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:12.171355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:12.173267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.173686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.176060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.184620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:12.187267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:12.227315 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3506/7011] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:11 2022] POST /identity/v3/projects => generated 385 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:12.231047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.247685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24884d8-cae6-41f0-be89-292f009d40e9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:12.359257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:12.360433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.360920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.361415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.362373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:12.365247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:12.401823 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3506/7012] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:12 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:12.405537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.424465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f903f-826e-421a-8fa9-84065aa59190 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:12.437561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:12.438466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.439170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.439454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.440234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:12.441958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:12.483717 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3507/7013] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:12.488253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.501327 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:12.512457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc1bd5-8e81-4ff4-b2de-0a9111de43f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:12.524205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:12.525882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.527611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.528530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] PATH_INFO: `/v3/projects/d4384b8fc1fc4661804376d94154d053/users/fcff789001b6495caff5868fc06692d2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.568412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4384b8fc1fc4661804376d94154d053, user_id=fcff789001b6495caff5868fc06692d2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:12.572239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:12.595320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3507/7014] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:12 2022] PUT /identity/v3/projects/d4384b8fc1fc4661804376d94154d053/users/fcff789001b6495caff5868fc06692d2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:12.600081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.618965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aa834c-e584-4b62-b428-37e99a995db7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:12.716599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8855e5f-70f6-4e07-afe2-8547bd7e34c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:12.717452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855e5f-70f6-4e07-afe2-8547bd7e34c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.717742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855e5f-70f6-4e07-afe2-8547bd7e34c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.718022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8855e5f-70f6-4e07-afe2-8547bd7e34c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.718858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8855e5f-70f6-4e07-afe2-8547bd7e34c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:12.726048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8855e5f-70f6-4e07-afe2-8547bd7e34c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:12.743688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3508/7015] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:12.747764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.764490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e76d003-e568-426f-b296-4c420048dcbc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:12.779179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:12.780662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.780947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.781223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] PATH_INFO: `/v3/projects/d4384b8fc1fc4661804376d94154d053/users/fcff789001b6495caff5868fc06692d2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.783734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4384b8fc1fc4661804376d94154d053, user_id=fcff789001b6495caff5868fc06692d2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:12.786737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:12.803311 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3508/7016] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:12 2022] PUT /identity/v3/projects/d4384b8fc1fc4661804376d94154d053/users/fcff789001b6495caff5868fc06692d2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:12.818204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:12.818574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:12.818831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:12.860431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] MFA Rules not processed for user `fcff789001b6495caff5868fc06692d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:12.862478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:12.919397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:12.925772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:12.951601 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:13.025284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb053d5-9f03-4939-9b7a-1f37bdde9246 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.031846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:13.033820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.034553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.034932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] PATH_INFO: `/v3/projects/859c6689b47f4d30ae42504a22370389` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.036434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=859c6689b47f4d30ae42504a22370389)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:13.038872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:13.047807 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3509/7017] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:12 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:13.067764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.069848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.129335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859c6689b47f4d30ae42504a22370389', 'request_id': 'req-b5470785-3e0b-490c-a667-f8e68f7d6e3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.144698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859c6689b47f4d30ae42504a22370389', 'request_id': 'req-b5470785-3e0b-490c-a667-f8e68f7d6e3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.145380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf50c7ce-8f0e-4126-8a06-43d31c7ed6f1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.155931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859c6689b47f4d30ae42504a22370389', 'request_id': 'req-b5470785-3e0b-490c-a667-f8e68f7d6e3b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.186558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] The token cache is being invalidate because project 859c6689b47f4d30ae42504a22370389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:13.187847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.189654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5470785-3e0b-490c-a667-f8e68f7d6e3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.199533 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3509/7018] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:12 2022] DELETE /identity/v3/projects/859c6689b47f4d30ae42504a22370389 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:13.202469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.202931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.203431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.243109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:13.246067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.275269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:13.276047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.276339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.276648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.279473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.363505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:13.366180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf5acc-4eba-4bd9-86ce-0c972e72cc98 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:13.371723 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:13.380512 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3510/7019] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:13.389373 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3510/7020] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:13.397473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.398127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.398582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.409429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.411015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.434789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:13.436283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.445645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671f9ca-0f25-4652-a2c7-788ad2b7cd41 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.447372 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3511/7021] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:13.451953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.467019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:13.468222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.468543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.468828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] PATH_INFO: `/v3/projects/f09a77c08c2c499c9667deab4f6849a9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.470220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09a77c08c2c499c9667deab4f6849a9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:13.472308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:13.479661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ccf1e-76a7-489b-a0d5-6237b228adba None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.490167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:13.490951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.491243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.491510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.492254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:13.492597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:13.494761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:13.513623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3512/7022] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:13.514534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.520711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.549311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955682db-f26d-43f9-9c5d-cf1cb93a1a04 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.556362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09a77c08c2c499c9667deab4f6849a9', 'request_id': 'req-8d4eb503-e6bd-4d6b-ba91-41147be10f22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.566732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09a77c08c2c499c9667deab4f6849a9', 'request_id': 'req-8d4eb503-e6bd-4d6b-ba91-41147be10f22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.580790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09a77c08c2c499c9667deab4f6849a9', 'request_id': 'req-8d4eb503-e6bd-4d6b-ba91-41147be10f22'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.607198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] The token cache is being invalidate because project f09a77c08c2c499c9667deab4f6849a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:13.607967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.608871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.613109 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3511/7023] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:13 2022] DELETE /identity/v3/projects/f09a77c08c2c499c9667deab4f6849a9 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:13.616388 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:13.619574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.629528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.646521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:13.647855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.648157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.648474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] PATH_INFO: `/v3/users/72b437f7150c4db78d47c3894ee58b12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.650106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b437f7150c4db78d47c3894ee58b12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:13.652242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:13.722996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b437f7150c4db78d47c3894ee58b12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.735310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b437f7150c4db78d47c3894ee58b12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.742383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4eb503-e6bd-4d6b-ba91-41147be10f22 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.747941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f79f1e0-6729-4679-8b72-ebd36fe324de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:13.749342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f1e0-6729-4679-8b72-ebd36fe324de admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.749628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f1e0-6729-4679-8b72-ebd36fe324de admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.749905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f79f1e0-6729-4679-8b72-ebd36fe324de admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.751580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79f1e0-6729-4679-8b72-ebd36fe324de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:13.753569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f79f1e0-6729-4679-8b72-ebd36fe324de admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:13.766052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b437f7150c4db78d47c3894ee58b12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.767164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b437f7150c4db78d47c3894ee58b12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.776706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b437f7150c4db78d47c3894ee58b12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:13.789643 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3513/7024] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:13 2022] DELETE /identity/v3/users/72b437f7150c4db78d47c3894ee58b12 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:13.789643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.792137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.809468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3512/7025] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:13 2022] POST /identity/v3/projects => generated 363 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:13.812010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:13.812478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:13.812913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:13.868457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:13.872940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:13.918362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1e1dc-fc18-4f14-ae63-6e9bc73e827c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:13.992290 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3513/7026] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:13.995410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:13.997997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:14.024282 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:14.031364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cf0ab9-36dd-44fa-b4e0-2d0cf2aa9856 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:14.044060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.045054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.045427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.045796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.046576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.050817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.085087 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3514/7027] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:13 2022] POST /identity/v3/users => generated 282 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:14.086207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:14.091189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:14.094877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.095818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.096100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.097334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] PATH_INFO: `/v3/users/65c0f97a54bf4ccba6679def8924cc3f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.103023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c0f97a54bf4ccba6679def8924cc3f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.107060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.109316 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:14.212269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4135d-bb6a-46ba-973a-d803b477934f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:14.221949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.223422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.223422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.223422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.227298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c0f97a54bf4ccba6679def8924cc3f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:14.239550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c0f97a54bf4ccba6679def8924cc3f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:14.246275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.247794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.263493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c0f97a54bf4ccba6679def8924cc3f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:14.264494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c0f97a54bf4ccba6679def8924cc3f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:14.272681 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3515/7028] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:14.274843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c0f97a54bf4ccba6679def8924cc3f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:14.275831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:14.285334 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3514/7029] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:13 2022] DELETE /identity/v3/users/65c0f97a54bf4ccba6679def8924cc3f => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:14.295951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d02739-371e-4b87-9d85-a78bb00f7b5f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:14.409050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.409797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.410092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.411060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.411821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.414371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.439650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:14.444287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:14.445513 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3516/7030] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:14.472533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd25bc43-0088-479a-8ab8-9048a880b834 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:14.489182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afae50d7-7ad4-438b-8196-c7e6296907f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.491674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae50d7-7ad4-438b-8196-c7e6296907f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.493804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae50d7-7ad4-438b-8196-c7e6296907f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.493804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae50d7-7ad4-438b-8196-c7e6296907f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.496319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae50d7-7ad4-438b-8196-c7e6296907f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.500029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afae50d7-7ad4-438b-8196-c7e6296907f6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.531730 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3515/7031] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:14.533499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:14.548722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3fca4-c95f-481b-87ad-537f79610467 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:14.557671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.558600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.558887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.559160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] PATH_INFO: `/v3/projects/33a7542d80634887bf2affcda10ac260/users/848e5f33bbc04c0d8685ac162a442624/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.601630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] RBAC: Authorizing `identity:create_grant(project_id=33a7542d80634887bf2affcda10ac260, user_id=848e5f33bbc04c0d8685ac162a442624, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.608582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.642467 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3517/7032] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:14 2022] PUT /identity/v3/projects/33a7542d80634887bf2affcda10ac260/users/848e5f33bbc04c0d8685ac162a442624/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:14.650232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.650730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.652430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.706824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] MFA Rules not processed for user `848e5f33bbc04c0d8685ac162a442624`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:14.708999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:14.800291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3516/7033] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:14 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:14.804014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:14.902698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8911c726-4adb-48f9-9143-26bc1aebfccd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:14.910498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:14.911589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:14.912067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:14.912766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:14.914367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:14.916692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:14.922582 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:14.971267 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3518/7034] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:14 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:14.972628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:14.993521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eed8e54-6d61-4331-bc7e-2cdab2e808a0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:15.083001 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:15.094315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:15.095036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.095469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.095755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.096783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:15.098782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:15.125509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3517/7035] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:14 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:15.129208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:15.140878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f933b6e5-c062-4535-913b-4952cceb1177 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:15.146291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:15.146786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.147078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.147357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.148104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:15.149985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:15.167469 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3519/7036] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:15.172091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:15.189700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e964194-1ab1-4680-9213-2d12d61d671d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:15.202549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:15.203609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.204832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.205487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] PATH_INFO: `/v3/projects/88b6d7c1d15a4920a84be281e81a3534/users/ebe7e884fe1745ac8dcbe0e93193bdf4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.227355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b6d7c1d15a4920a84be281e81a3534, user_id=ebe7e884fe1745ac8dcbe0e93193bdf4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:15.230123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:15.253030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3518/7037] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:15 2022] PUT /identity/v3/projects/88b6d7c1d15a4920a84be281e81a3534/users/ebe7e884fe1745ac8dcbe0e93193bdf4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:15.257285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:15.270571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede2bdc-14a0-4e1c-8d03-58065d3b4dea admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:15.376441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:15.377550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.377937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.378316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.379322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:15.386410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:15.400953 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3520/7038] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:15.405265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:15.436060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ea370-3fbc-46ee-bf1d-2a4b6fb094d6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:15.445500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a713d609-fa78-47c1-bd0b-49b07638c1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:15.446686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d609-fa78-47c1-bd0b-49b07638c1c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.447061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d609-fa78-47c1-bd0b-49b07638c1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.447506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a713d609-fa78-47c1-bd0b-49b07638c1c9 admin admin] PATH_INFO: `/v3/projects/88b6d7c1d15a4920a84be281e81a3534/users/ebe7e884fe1745ac8dcbe0e93193bdf4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.449974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:15.453993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:15.467237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713d609-fa78-47c1-bd0b-49b07638c1c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b6d7c1d15a4920a84be281e81a3534, user_id=ebe7e884fe1745ac8dcbe0e93193bdf4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:15.472191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a713d609-fa78-47c1-bd0b-49b07638c1c9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:15.478039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb08967-06f7-47ae-ac6e-5d0b652b7db2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:15.491767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:15.494218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.495857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.496594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] PATH_INFO: `/v3/projects/2a7d46d7477349c99c9f234a9d88bcff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.499985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a7d46d7477349c99c9f234a9d88bcff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:15.504690 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3519/7039] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:15 2022] PUT /identity/v3/projects/88b6d7c1d15a4920a84be281e81a3534/users/ebe7e884fe1745ac8dcbe0e93193bdf4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:15.505476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:15.517728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.518113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.518513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.558068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] MFA Rules not processed for user `ebe7e884fe1745ac8dcbe0e93193bdf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:15.559676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:15.609864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a7d46d7477349c99c9f234a9d88bcff', 'request_id': 'req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:15.634856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a7d46d7477349c99c9f234a9d88bcff', 'request_id': 'req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:15.649767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a7d46d7477349c99c9f234a9d88bcff', 'request_id': 'req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:15.679452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] The token cache is being invalidate because project 2a7d46d7477349c99c9f234a9d88bcff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:15.679756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:15.681655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0b4a6d44-a33c-46fb-be2b-c4c93ac70b85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:15.686802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3521/7040] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:15 2022] DELETE /identity/v3/projects/2a7d46d7477349c99c9f234a9d88bcff => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:15.695097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b305e-7a2e-4ee4-ae2e-c15d37334220 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:15.696466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b305e-7a2e-4ee4-ae2e-c15d37334220 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:15.696772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b305e-7a2e-4ee4-ae2e-c15d37334220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:15.758563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b44b305e-7a2e-4ee4-ae2e-c15d37334220 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:15.763476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b44b305e-7a2e-4ee4-ae2e-c15d37334220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:15.780305 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3520/7041] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:15 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:15.794470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:15.797520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:15.965191 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:15.992214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3522/7042] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:15.998104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf663732-f340-46a1-aeed-990aca360ebc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.002431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.003500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.004657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.072714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:16.073968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:16.087086 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3523/7043] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:16.088096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.100700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10643549-142e-4c2a-a0a1-263d0f10189b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.106517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.107207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.107490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.107767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.108922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:16.109235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.110936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.124710 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3524/7044] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:16.127134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.127898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.128283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.128482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.130019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.133498 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:16.148423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c27c926-f71e-4f83-af30-613bfc59bccb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.162172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.166268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.166607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.167296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.168639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.175738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.231343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.237621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.243759 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3525/7045] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:16 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:16.248198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.253593 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3521/7046] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:15 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:16.329549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.332063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:16.363924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9820ca5e-0cef-4d0e-8f54-73c3eeb105c3 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.366481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c2b462-404b-43bf-96a5-6783c91b15ed admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.391553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.393336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.393625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.393901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.395162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.399283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.399571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.400794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.402182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] PATH_INFO: `/v3/projects/ddf6c2d702274caca7f2a8e4bfccb030` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.406691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf6c2d702274caca7f2a8e4bfccb030)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.409019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.411061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.460385 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3526/7047] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:16 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:16.463800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.503249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf6c2d702274caca7f2a8e4bfccb030', 'request_id': 'req-04974db5-8ac9-48df-9509-b0a7b76537c3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:16.523187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf6c2d702274caca7f2a8e4bfccb030', 'request_id': 'req-04974db5-8ac9-48df-9509-b0a7b76537c3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:16.537132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf6c2d702274caca7f2a8e4bfccb030', 'request_id': 'req-04974db5-8ac9-48df-9509-b0a7b76537c3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:16.558968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] The token cache is being invalidate because project ddf6c2d702274caca7f2a8e4bfccb030 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:16.560542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:16.562314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:16.566332 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3522/7048] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:16 2022] DELETE /identity/v3/projects/ddf6c2d702274caca7f2a8e4bfccb030 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:16.567650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.570145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:16.617307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282852bf-262a-4c94-908a-183a1e45de21 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.731084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04974db5-8ac9-48df-9509-b0a7b76537c3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.741998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.743030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.743772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.744174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.744675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.744843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.745108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.745383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.746823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.749849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:16.750283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.764511 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3523/7049] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:16.767042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.769213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:16.781185 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:16.788840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a568d8-5381-41b4-8eb3-95e87d8e874b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.797541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.798893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.799937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.800325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] PATH_INFO: `/v3/users/fcff789001b6495caff5868fc06692d2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.802150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcff789001b6495caff5868fc06692d2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.804864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.835399 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:16.900846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.906170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.931500 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3527/7050] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:16 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:16.933932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:16.955802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcff789001b6495caff5868fc06692d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:16.958160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479093a6-7d37-49eb-bc47-a1248f36c2f3 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:16.971943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:16.973073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:16.974169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:16.974476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:16.977675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:16.981334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:16.991263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcff789001b6495caff5868fc06692d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:17.010866 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3528/7051] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:17.020485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:17.024882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcff789001b6495caff5868fc06692d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:17.028026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcff789001b6495caff5868fc06692d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:17.048362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94d7118-762a-47f2-83c6-70baf882e60f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:17.049813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7e063e5d-ea4d-4e6e-ba3b-0bed2ade282f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcff789001b6495caff5868fc06692d2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:17.062896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:17.063894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:17.064160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:17.064509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] PATH_INFO: `/v3/projects/65bea0d10d6147658f7fe48e82fcc996/users/904f21944729417c8e71a295f9c33ab6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:17.077425 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3524/7052] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:16 2022] DELETE /identity/v3/users/fcff789001b6495caff5868fc06692d2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:17.103477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bea0d10d6147658f7fe48e82fcc996, user_id=904f21944729417c8e71a295f9c33ab6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:17.114399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:17.166724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3529/7053] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:17 2022] PUT /identity/v3/projects/65bea0d10d6147658f7fe48e82fcc996/users/904f21944729417c8e71a295f9c33ab6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:17.180594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:17.181761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:17.182068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:17.245161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] MFA Rules not processed for user `904f21944729417c8e71a295f9c33ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:17.246482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:17.365684 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3525/7054] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:17.369228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:17.371809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:17.541297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5e2f7-e21e-41f8-9bd5-5de72704715e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:17.547755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:17.549935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:17.550399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:17.551698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:17.552815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:17.556406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:17.603747 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3530/7055] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:17 2022] POST /identity/v3/projects => generated 381 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:17.607430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:17.625795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93adb7d3-6cbd-424e-8345-d6a6c8de550c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:17.788278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:17.789510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:17.789997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:17.791177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:17.794431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:17.797774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:17.853265 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3526/7056] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:17 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:17.854502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:17.895495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed374491-ed0f-40c0-abc3-de5088b9236d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:17.916164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:17.918080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:17.918384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:17.918665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:17.921164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:17.928012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:17.965474 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3531/7057] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:17.971039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:17.990455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0d518-51c4-4c8e-9aea-7b9a481b88d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:17.997122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:17.998056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:17.998880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:17.999162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] PATH_INFO: `/v3/projects/1cd22e939288453ba11fade1ea5439c7/users/bceda7aada5246da82ed4c95ad6ee41e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.018401 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:18.035553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd22e939288453ba11fade1ea5439c7, user_id=bceda7aada5246da82ed4c95ad6ee41e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:18.039274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:18.067195 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3527/7058] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:17 2022] PUT /identity/v3/projects/1cd22e939288453ba11fade1ea5439c7/users/bceda7aada5246da82ed4c95ad6ee41e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:18.072503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:18.097081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d573-a3d8-4f3e-9bb1-048607a2f41d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:18.171195 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:18.192085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ff18a-b999-48ad-9ccb-cb2479bd0d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:18.192872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ff18a-b999-48ad-9ccb-cb2479bd0d94 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:18.193459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ff18a-b999-48ad-9ccb-cb2479bd0d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:18.193728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ff18a-b999-48ad-9ccb-cb2479bd0d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.194597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ff18a-b999-48ad-9ccb-cb2479bd0d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:18.196450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ff18a-b999-48ad-9ccb-cb2479bd0d94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:18.210088 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3532/7059] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:18.214026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:18.231329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f898966-87a5-4fdf-af6d-98072cd9c592 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:18.241408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:18.243486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:18.244512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:18.245778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] PATH_INFO: `/v3/projects/1cd22e939288453ba11fade1ea5439c7/users/bceda7aada5246da82ed4c95ad6ee41e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.249095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cd22e939288453ba11fade1ea5439c7, user_id=bceda7aada5246da82ed4c95ad6ee41e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:18.253245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:18.267070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3528/7060] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:18 2022] PUT /identity/v3/projects/1cd22e939288453ba11fade1ea5439c7/users/bceda7aada5246da82ed4c95ad6ee41e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:18.278038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:18.278356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:18.278599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.314544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] MFA Rules not processed for user `bceda7aada5246da82ed4c95ad6ee41e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:18.316253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:18.361529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:18.363601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:18.507440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3533/7061] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:18 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:18.515860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:18.518341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:18.566281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf2f67d-a020-4942-8577-1191c782936a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:18.584804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:18.588581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:18.590607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:18.590967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] PATH_INFO: `/v3/projects/d4384b8fc1fc4661804376d94154d053` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.598073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4384b8fc1fc4661804376d94154d053)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:18.600059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:18.686872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99214ca-a30f-43ef-84a0-155417016987 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:18.697127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca36c63-0ae7-4afd-9e70-afb7b355768f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:18.697805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36c63-0ae7-4afd-9e70-afb7b355768f service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:18.698087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36c63-0ae7-4afd-9e70-afb7b355768f service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:18.698362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca36c63-0ae7-4afd-9e70-afb7b355768f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.758425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36c63-0ae7-4afd-9e70-afb7b355768f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:18.764856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca36c63-0ae7-4afd-9e70-afb7b355768f service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:18.773935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4384b8fc1fc4661804376d94154d053', 'request_id': 'req-b5024b18-444c-4e14-9fc1-62335090b070'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:18.794397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4384b8fc1fc4661804376d94154d053', 'request_id': 'req-b5024b18-444c-4e14-9fc1-62335090b070'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:18.799911 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3534/7062] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:18 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:18.806194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4384b8fc1fc4661804376d94154d053', 'request_id': 'req-b5024b18-444c-4e14-9fc1-62335090b070'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:18.831647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] The token cache is being invalidate because project d4384b8fc1fc4661804376d94154d053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:18.831904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:18.839265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5024b18-444c-4e14-9fc1-62335090b070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:18.842123 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3529/7063] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:18 2022] DELETE /identity/v3/projects/d4384b8fc1fc4661804376d94154d053 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:18.861552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:18.862118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:18.862334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:18.930350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:18.942733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:19.105684 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3535/7064] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:19.106793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.107124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.107365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.141783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:19.143021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:19.173291 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3530/7065] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:19.176715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.189080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3186b617-9bd7-40ac-b8aa-56268a1174da None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.202972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.204034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.204482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.204833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.205653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:19.206033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:19.208540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:19.264631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.265075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3536/7066] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:19.279143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb04a3b-17f2-4c4e-8671-b93fe54819f7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.301872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.302823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.305831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.312131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.314564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:19.319727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:19.408938 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3531/7067] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:19 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:19.414031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.424578 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:19.430862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e6d204-8553-4d7c-a126-3d883b09b1a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.585593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.587734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:19.593784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.595241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.598254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.598644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.602684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:19.612793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:19.680383 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3537/7068] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:19 2022] POST /identity/v3/users => generated 290 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:19.682827 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:19.683572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.714164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150c16f-b2ef-462f-bce2-c7857758facf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.736444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.739880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.741374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.741768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.742961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:19.746856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:19.787924 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3538/7069] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:19.793156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.817678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d201f-9f9d-494c-9915-487e3449c26a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.830245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cd4b66-11e9-42ec-8f4e-e4515e8df846 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.862001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bceda7aada5246da82ed4c95ad6ee41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd22e939288453ba11fade1ea5439c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.866946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.868576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.869612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.871170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:19.874588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:19.875496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.877821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:19.881456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.881978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:19.884196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:19.885230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:19.888419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:19.923734 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3532/7070] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:19.933830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.940133 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3539/7071] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:19.956028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:19.982940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2112a0e2-2478-4ebb-a092-fedbb503c748 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.987290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a90b1a-f35a-4824-9d87-f085ff2c0788 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:19.996898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bceda7aada5246da82ed4c95ad6ee41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd22e939288453ba11fade1ea5439c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.998472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:19.999277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07269b9-ca84-4cb0-a998-0b20bd743008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:19.999675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:20.000054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:20.001071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07269b9-ca84-4cb0-a998-0b20bd743008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:20.001926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:20.004764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07269b9-ca84-4cb0-a998-0b20bd743008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:20.005201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07269b9-ca84-4cb0-a998-0b20bd743008 admin admin] PATH_INFO: `/v3/projects/4b1ea1a08da6454db73af942d093648e/users/eed82bbba67d4fa1a798540b6bc74a47/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:20.008625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:20.039337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07269b9-ca84-4cb0-a998-0b20bd743008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1ea1a08da6454db73af942d093648e, user_id=eed82bbba67d4fa1a798540b6bc74a47, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:20.064219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07269b9-ca84-4cb0-a998-0b20bd743008 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:20.100402 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3540/7072] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:19 2022] PUT /identity/v3/projects/4b1ea1a08da6454db73af942d093648e/users/eed82bbba67d4fa1a798540b6bc74a47/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:20.111825 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3533/7073] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:19 2022] POST /identity/v3/projects => generated 354 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:20.112180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:20.113020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:20.113928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:20.114479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:20.161052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] MFA Rules not processed for user `eed82bbba67d4fa1a798540b6bc74a47`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:20.164223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:20.246680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc2d17-71d5-403d-ae68-148fe485ecc1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:20.258835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bceda7aada5246da82ed4c95ad6ee41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd22e939288453ba11fade1ea5439c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:20.259524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:20.259811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:20.260088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:20.260860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:20.261311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:20.267800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:20.293567 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3534/7074] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:38:20.342502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:20.345064 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3541/7075] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:20.399001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:20.439301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe8c5f-0571-42c7-ac61-abb329d9ec58 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:20.464068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bceda7aada5246da82ed4c95ad6ee41e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1cd22e939288453ba11fade1ea5439c7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:20.468261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:20.471678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:20.472709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] PATH_INFO: `/v3/projects/1c7a2db8a1034119a82275460c4c40b8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:20.478643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1c7a2db8a1034119a82275460c4c40b8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:20.482245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:20.565925 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:20.572834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55bd18b-182d-4214-86c5-787a3c27d139 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:20.610379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c7a2db8a1034119a82275460c4c40b8', 'request_id': 'req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:20.657643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c7a2db8a1034119a82275460c4c40b8', 'request_id': 'req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:20.667098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c7a2db8a1034119a82275460c4c40b8', 'request_id': 'req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:20.682282 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:20.700563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] The token cache is being invalidate because project 1c7a2db8a1034119a82275460c4c40b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:20.701325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:20.702489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:20.706053 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3542/7076] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:20 2022] DELETE /identity/v3/projects/1c7a2db8a1034119a82275460c4c40b8 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:20.741062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:20.743628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:20.744792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:20.745579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:20.748502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:20.753862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:20.847413 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3535/7077] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:20 2022] POST /identity/v3/projects => generated 377 bytes in 505 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:20.848240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:20.850120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:20.882281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421a0e-85fb-4e3d-afc4-ce0fc8bffdb1 tempest-VolumeQuotaClassesTest-1996926666 tempest-VolumeQuotaClassesTest-1996926666-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.016550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.017256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.017540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.018577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.019300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.021935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.066758 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3543/7078] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:20 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:21.070909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.083914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2ddea4-8e8c-40cc-abaa-3958d56b04a7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.089526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.089934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.092491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.092776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.094014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.095314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.113763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.119862 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3536/7079] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:21.124225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.128147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711b56e4-cd75-4adb-b85b-e757a42dd93e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.131348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.138755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.139450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.139718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.139994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.140761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.142638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.161320 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3544/7080] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:21.162791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.180824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264751d3-574a-4efa-a1a8-9e9bc99a3356 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.188119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.190181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.190469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.190750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] PATH_INFO: `/v3/projects/6a4217f758e3405c82f4a266d53f8ef5/users/c9e62808dd0b40208ef04705fa5e63cf/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.221977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a4217f758e3405c82f4a266d53f8ef5, user_id=c9e62808dd0b40208ef04705fa5e63cf, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.226428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.251889 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3545/7081] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:21 2022] PUT /identity/v3/projects/6a4217f758e3405c82f4a266d53f8ef5/users/c9e62808dd0b40208ef04705fa5e63cf/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:21.253601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.255778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.264789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d44c6-dd33-4687-8a09-3d7c09708ecb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.368265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80549e1-1e10-47b1-84a5-ec0e37e037f8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.375734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.376877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.377161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.377771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] PATH_INFO: `/v3/users/904f21944729417c8e71a295f9c33ab6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.379337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904f21944729417c8e71a295f9c33ab6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.382314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.402831 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:21.403633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.404554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.404985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.405371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.409486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.448075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.450624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.479159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904f21944729417c8e71a295f9c33ab6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:21.481832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904f21944729417c8e71a295f9c33ab6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:21.490279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3537/7082] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:21.495161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.497197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904f21944729417c8e71a295f9c33ab6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:21.498035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904f21944729417c8e71a295f9c33ab6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:21.502201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.516680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-34bb63f7-118a-4ba1-a0ad-21a1d2555890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904f21944729417c8e71a295f9c33ab6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:21.554187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cf7847-2085-49f9-868a-7e7185bc0ff4 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:21.555376 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3546/7083] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:21 2022] DELETE /identity/v3/users/904f21944729417c8e71a295f9c33ab6 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:21.559673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444a369-b34d-4475-bc51-1618424963a7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.560043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444a369-b34d-4475-bc51-1618424963a7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.560247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a444a369-b34d-4475-bc51-1618424963a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.612051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a444a369-b34d-4475-bc51-1618424963a7 None None] MFA Rules not processed for user `c9e62808dd0b40208ef04705fa5e63cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:21.613233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a444a369-b34d-4475-bc51-1618424963a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.666187 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:21.705832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:21.706643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.707082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.707364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.711205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.755678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:21.758253 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3547/7084] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:21.759723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:21.760013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:21.760286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:21.761854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:21.797407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3538/7085] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:21.798353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.799925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:21.801269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.803631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:21.959282 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3548/7086] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:21.986956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:21.988596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:22.043636 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:22.102594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b8394-0ac0-4fee-b6ba-52905e126287 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.121122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bdcaf-a13b-4532-bd27-6ac1934e3921 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.122427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.123324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.123758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.124197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.125087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.127207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.128748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.129425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.129708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.129983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.151832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.153457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.178600 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3549/7087] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:22.188902 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3539/7088] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:21 2022] POST /identity/v3/projects => generated 379 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:22.193293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:22.218169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a3409-544b-4c27-80e9-a4cd1fbbc7fe service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.362384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.363170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.363454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.363736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.365352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.370416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.414139 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3550/7089] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:22 2022] POST /identity/v3/users => generated 296 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:22.418346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:22.439167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8969b5-9eb8-4784-92ac-fe6512e414ca admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.457490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.459180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.459643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.460285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.467071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.469376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.519044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:22.520383 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3540/7090] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:22.543601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b8d20d-bc92-4d8a-9be7-d6312905a774 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.555070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.555992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.556277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.556589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] PATH_INFO: `/v3/projects/903be2c4918746a496c903b76e2a2b58/users/a3abbb2721e34c7ea23a8f2cc2200eff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.595865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903be2c4918746a496c903b76e2a2b58, user_id=a3abbb2721e34c7ea23a8f2cc2200eff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.603776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.653734 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3551/7091] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:22 2022] PUT /identity/v3/projects/903be2c4918746a496c903b76e2a2b58/users/a3abbb2721e34c7ea23a8f2cc2200eff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:22.654983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:22.671151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb50a92-30fe-46f3-bb3d-fe2f1bcdb1fe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.827080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47fe38-6c4c-4586-a803-d07795be1f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.827925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47fe38-6c4c-4586-a803-d07795be1f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.828274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47fe38-6c4c-4586-a803-d07795be1f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.828654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47fe38-6c4c-4586-a803-d07795be1f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.829476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47fe38-6c4c-4586-a803-d07795be1f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.831995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47fe38-6c4c-4586-a803-d07795be1f4c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.848601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3541/7092] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:22 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:22.854103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:22.869571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e0401e-aac1-4800-bdcc-87608ccd98d1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:22.875465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:22.876688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.876971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.877452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] PATH_INFO: `/v3/projects/903be2c4918746a496c903b76e2a2b58/users/a3abbb2721e34c7ea23a8f2cc2200eff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.880210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] RBAC: Authorizing `identity:create_grant(project_id=903be2c4918746a496c903b76e2a2b58, user_id=a3abbb2721e34c7ea23a8f2cc2200eff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:22.883036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:22.913714 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3552/7093] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:22 2022] PUT /identity/v3/projects/903be2c4918746a496c903b76e2a2b58/users/a3abbb2721e34c7ea23a8f2cc2200eff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:22.915970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:22.916267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:22.916578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:22.971218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] MFA Rules not processed for user `a3abbb2721e34c7ea23a8f2cc2200eff`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:22.972534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:23.065260 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:23.118782 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3542/7094] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:23.130912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:23.132696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:23.245790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48091d-2553-4d2f-a3d8-530ca891b268 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:23.249573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:23.250903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:23.251203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:23.251483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:23.261968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:23.263456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:23.286288 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3553/7095] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:23.325881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:23.328211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:23.349099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664a934-4c25-4ffa-8b15-26d70808ef97 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:23.354566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:23.356040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:23.356040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:23.356040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:23.359440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:23.496205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:23.497889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:23.512771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3543/7096] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:23 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:24.108224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:24.109944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:24.203776 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:24.406212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fceba-e42c-40cd-925d-e7c76880829a service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:24.434848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:24.436025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:24.436759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:24.437381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] PATH_INFO: `/v3/projects/65bea0d10d6147658f7fe48e82fcc996` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:24.439762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bea0d10d6147658f7fe48e82fcc996)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:24.443675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:24.531529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bea0d10d6147658f7fe48e82fcc996', 'request_id': 'req-46a0dade-5580-4a2d-b591-75012d1a69f4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.540953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bea0d10d6147658f7fe48e82fcc996', 'request_id': 'req-46a0dade-5580-4a2d-b591-75012d1a69f4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.550953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bea0d10d6147658f7fe48e82fcc996', 'request_id': 'req-46a0dade-5580-4a2d-b591-75012d1a69f4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.567461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] The token cache is being invalidate because project 65bea0d10d6147658f7fe48e82fcc996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:24.568257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.572740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.574655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3554/7097] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:24 2022] DELETE /identity/v3/projects/65bea0d10d6147658f7fe48e82fcc996 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:24.578787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:24.591553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d860fbc-b183-439e-b801-50a0ed9e07df service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:24.732560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:24.733588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:24.733703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:24.734047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] PATH_INFO: `/v3/users/bceda7aada5246da82ed4c95ad6ee41e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:24.735561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bceda7aada5246da82ed4c95ad6ee41e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:24.737788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:24.829539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bceda7aada5246da82ed4c95ad6ee41e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.848563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bceda7aada5246da82ed4c95ad6ee41e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.870357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bceda7aada5246da82ed4c95ad6ee41e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.872137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bceda7aada5246da82ed4c95ad6ee41e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.874881 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:24.893480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6a66509e-18c1-45ea-a6fd-38da75f2438d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bceda7aada5246da82ed4c95ad6ee41e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:24.908646 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3544/7098] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:24 2022] DELETE /identity/v3/users/bceda7aada5246da82ed4c95ad6ee41e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:25.751332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:25.753249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:25.774260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a0dade-5580-4a2d-b591-75012d1a69f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:26.025040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:26.025964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:26.026281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:26.026848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] PATH_INFO: `/v3/projects/1cd22e939288453ba11fade1ea5439c7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:26.029972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cd22e939288453ba11fade1ea5439c7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:26.033048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:26.134857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cd22e939288453ba11fade1ea5439c7', 'request_id': 'req-899d8c96-db79-43e4-b86a-78ce4197ad2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:26.152004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cd22e939288453ba11fade1ea5439c7', 'request_id': 'req-899d8c96-db79-43e4-b86a-78ce4197ad2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:26.156481 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:26.165968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cd22e939288453ba11fade1ea5439c7', 'request_id': 'req-899d8c96-db79-43e4-b86a-78ce4197ad2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:26.189669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] The token cache is being invalidate because project 1cd22e939288453ba11fade1ea5439c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:26.190003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:26.191381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-899d8c96-db79-43e4-b86a-78ce4197ad2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:26.194306 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3555/7099] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:25 2022] DELETE /identity/v3/projects/1cd22e939288453ba11fade1ea5439c7 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:26.199242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:26.199741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:26.199818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:26.233133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:26.234386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:26.371393 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3545/7100] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:26.379033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:26.379326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:26.379600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:26.413916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:26.415241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:26.434464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3556/7101] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:26.438988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:26.453583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a0757-1587-49c4-810d-ab4a34580062 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:26.473546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:26.475490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:26.475780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:26.476061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:26.479456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:26.480824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:26.500283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:26.547713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3546/7102] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:38:26.548966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:26.573198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7432-ae28-4ce5-8ca6-e727bccae6aa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:26.585673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:26.586827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:26.589527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:26.590013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:26.590913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:26.596402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:26.678874 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3557/7103] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:26 2022] POST /identity/v3/projects => generated 393 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:26.682468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:26.701064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc30b9-39e1-42e5-bbe2-b5e029a272ba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:26.922087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:26.922911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:26.923256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:26.923604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:26.924416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:26.928009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:27.009481 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3547/7104] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:26 2022] POST /identity/v3/users => generated 297 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:27.010084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:27.040821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b41d4-1eac-4966-ab30-d64db382239a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:27.053862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:27.054570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:27.054873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:27.055132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:27.055876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:27.057545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:27.100225 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3558/7105] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:27.104756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:27.127134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716816b7-99f1-4e97-a4e1-d738a3f99074 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:27.139227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43cd0e4-0b10-4a88-8e48-6fa49e4f6a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:27.140059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cd0e4-0b10-4a88-8e48-6fa49e4f6a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:27.140508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cd0e4-0b10-4a88-8e48-6fa49e4f6a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:27.140915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43cd0e4-0b10-4a88-8e48-6fa49e4f6a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:27.141759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cd0e4-0b10-4a88-8e48-6fa49e4f6a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:27.143501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43cd0e4-0b10-4a88-8e48-6fa49e4f6a53 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:27.166019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3548/7106] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:27.169975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:27.193290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916c260-b1e0-431f-b46a-a4aff88e16db admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:27.217524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:27.218789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:27.219317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:27.219676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] PATH_INFO: `/v3/projects/de4bcb8891794d1ea01e94a04a9c798f/users/f4d8bb954e354207a8ed40ee10e52c2b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:27.247991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4bcb8891794d1ea01e94a04a9c798f, user_id=f4d8bb954e354207a8ed40ee10e52c2b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:27.258819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:27.312708 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3559/7107] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:27 2022] PUT /identity/v3/projects/de4bcb8891794d1ea01e94a04a9c798f/users/f4d8bb954e354207a8ed40ee10e52c2b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:27.322960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:27.323834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:27.324281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:27.398568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] MFA Rules not processed for user `f4d8bb954e354207a8ed40ee10e52c2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:27.400128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:27.526298 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:27.595832 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3549/7108] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:27.600249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:27.794932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e7f4b4-294e-4752-af39-6c15643e3590 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:27.821586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:27.822910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:27.823305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:27.823693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:27.824599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:27.826739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:27.945856 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3560/7109] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:27 2022] POST /identity/v3/projects => generated 393 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:27.949817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:27.972025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17156223-6dc6-42de-a4b8-6871414af3bf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:28.128488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:28.129796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:28.130372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:28.130854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:28.132141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:28.135682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:28.193361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:28.206608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3550/7110] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:27 2022] POST /identity/v3/users => generated 303 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:28.219546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339bff22-da50-4bab-a498-e4bf3d99a81a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:28.237610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:28.239792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:28.240478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:28.241043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:28.246783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:28.251462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:28.275672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:28.287280 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3561/7111] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:28.289092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca016e1a-f189-415c-97c6-c775d0771c6c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:28.298224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:28.299313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:28.299700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:28.300193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] PATH_INFO: `/v3/projects/6050f56e43ae47bda86d3ccd2f29ae0c/users/a7be02add24d411782f378f0ae60c76a/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:28.359397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6050f56e43ae47bda86d3ccd2f29ae0c, user_id=a7be02add24d411782f378f0ae60c76a, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:28.367568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:28.397917 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3551/7112] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:28 2022] PUT /identity/v3/projects/6050f56e43ae47bda86d3ccd2f29ae0c/users/a7be02add24d411782f378f0ae60c76a/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:28.402903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:28.417076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574bd8aa-2a11-4cee-ae8f-e83bc8a3588f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:28.543828 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:28.566236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a1af6-27c8-4138-b25c-8c83c686ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:28.566948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a1af6-27c8-4138-b25c-8c83c686ab1b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:28.567234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a1af6-27c8-4138-b25c-8c83c686ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:28.567519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a1af6-27c8-4138-b25c-8c83c686ab1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:28.568830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a1af6-27c8-4138-b25c-8c83c686ab1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:28.574330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a1af6-27c8-4138-b25c-8c83c686ab1b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:28.620580 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3562/7113] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:28.625854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:28.642436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3869c75-7c98-44a8-bbaf-3e81cd45a35c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:28.664670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:28.667133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:28.669077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:28.671214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] PATH_INFO: `/v3/projects/6050f56e43ae47bda86d3ccd2f29ae0c/users/a7be02add24d411782f378f0ae60c76a/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:28.676432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6050f56e43ae47bda86d3ccd2f29ae0c, user_id=a7be02add24d411782f378f0ae60c76a, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:28.681256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:28.717573 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3552/7114] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:28 2022] PUT /identity/v3/projects/6050f56e43ae47bda86d3ccd2f29ae0c/users/a7be02add24d411782f378f0ae60c76a/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:28.728519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:28.728759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:28.728967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:28.783220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] MFA Rules not processed for user `a7be02add24d411782f378f0ae60c76a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:28.785034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:28.971721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3563/7115] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:28 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:28.983664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:28.985478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:29.092339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2fdef-192e-488e-84a0-809f62517312 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:29.097672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:29.098999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:29.099596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:29.100011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:29.115764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:29.118189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:29.141294 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3553/7116] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:29.248115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:29.250769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:29.289462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90329e-2d7d-43be-8124-683f2368fae0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:29.299381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa430e4-e541-4c75-8c74-43025c62f5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:29.301940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa430e4-e541-4c75-8c74-43025c62f5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:29.302451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa430e4-e541-4c75-8c74-43025c62f5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:29.302971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa430e4-e541-4c75-8c74-43025c62f5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:29.391584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa430e4-e541-4c75-8c74-43025c62f5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:29.394260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa430e4-e541-4c75-8c74-43025c62f5c9 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:29.406041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3564/7117] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:33.019082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:33.021427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:33.157897 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:33.215089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60421866-2ce2-41c8-bcb9-f27c4d3cb460 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:33.236210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:33.240372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:33.247648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:33.248232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] PATH_INFO: `/v3/users/eed82bbba67d4fa1a798540b6bc74a47` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:33.251066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed82bbba67d4fa1a798540b6bc74a47)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:33.253251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:33.370940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed82bbba67d4fa1a798540b6bc74a47'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:33.391254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed82bbba67d4fa1a798540b6bc74a47'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:33.423222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed82bbba67d4fa1a798540b6bc74a47'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:33.424383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed82bbba67d4fa1a798540b6bc74a47'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:33.438661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed82bbba67d4fa1a798540b6bc74a47'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:33.452198 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3554/7118] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:33 2022] DELETE /identity/v3/users/eed82bbba67d4fa1a798540b6bc74a47 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:33.457855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:33.458529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:33.458529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:33.491622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:33.495761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:33.718604 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3565/7119] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:33.734597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:33.736182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:33.964895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aab3dc-eed6-461d-bf7b-a13abc0e6be2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:33.983230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:33.983930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:33.984209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:33.984536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:34.013099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:34.014891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:34.026670 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3555/7120] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:35.011359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:35.013276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:35.075937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207b4b40-04f6-4ea1-92e8-04af96e1fb18 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:35.093239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:35.097926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:35.098567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:35.098991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] PATH_INFO: `/v3/projects/4b1ea1a08da6454db73af942d093648e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:35.103958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1ea1a08da6454db73af942d093648e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:35.117596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:35.149615 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:35.243520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:35.245601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:35.282050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1ea1a08da6454db73af942d093648e', 'request_id': 'req-cc62bb6a-c85a-4761-9bb5-77feca023f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.294736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1ea1a08da6454db73af942d093648e', 'request_id': 'req-cc62bb6a-c85a-4761-9bb5-77feca023f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.308058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1ea1a08da6454db73af942d093648e', 'request_id': 'req-cc62bb6a-c85a-4761-9bb5-77feca023f58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.345006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] The token cache is being invalidate because project 4b1ea1a08da6454db73af942d093648e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:35.345304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.350089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.357309 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3566/7121] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:35 2022] DELETE /identity/v3/projects/4b1ea1a08da6454db73af942d093648e => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:35.358440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3497c5a0-168c-4df9-8d02-978c36f94397 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:35.360714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:35.366175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:35.370045 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:35.543826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db20e85f10348e68639cdb1c6b360ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a9640cfb887402d903247a926c6dee9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:35.544969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:35.545480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:35.545994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:35.546971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:35.547502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:35.549372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:35.610928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3556/7122] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:35.612334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:35.619081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:35.654624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62bb6a-c85a-4761-9bb5-77feca023f58 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:35.683137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:35.688059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa000ce-1f77-44ef-8134-18466ec4cfa1 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:35.688958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:35.690407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:35.693123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] PATH_INFO: `/v3/users/c9e62808dd0b40208ef04705fa5e63cf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:35.701410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e62808dd0b40208ef04705fa5e63cf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:35.717970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:35.721110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db20e85f10348e68639cdb1c6b360ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a9640cfb887402d903247a926c6dee9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:35.721965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:35.721965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:35.722248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:35.723162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:35.725391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:35.800855 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3557/7123] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:35 2022] POST /identity/v3/projects => generated 349 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:35.802473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:35.935661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e62808dd0b40208ef04705fa5e63cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.936973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e62808dd0b40208ef04705fa5e63cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.950055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e62808dd0b40208ef04705fa5e63cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.951964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e62808dd0b40208ef04705fa5e63cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.977797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e62808dd0b40208ef04705fa5e63cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:35.995255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f9dc9-a8fb-4a69-bad7-279b6851404a tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:36.004683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db20e85f10348e68639cdb1c6b360ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a9640cfb887402d903247a926c6dee9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:36.005467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:36.005763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:36.006044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:36.006799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:36.007111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:36.014700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:36.035016 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3567/7124] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:35 2022] DELETE /identity/v3/users/c9e62808dd0b40208ef04705fa5e63cf => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:36.047743 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3558/7125] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:38:37.846941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:37.848740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:37.885977 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:38.025917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4dc6f-54de-4d7e-a8e0-fd39ca50a09d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:38.062015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8db20e85f10348e68639cdb1c6b360ae', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7a9640cfb887402d903247a926c6dee9', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:38.062614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:38.062966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:38.063308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] PATH_INFO: `/v3/projects/4741561f51e74f8ba64b3777c8d3da69` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:38.064678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4741561f51e74f8ba64b3777c8d3da69)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:38.066757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:38.215849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4741561f51e74f8ba64b3777c8d3da69', 'request_id': 'req-eca45fd0-b776-4ab1-b0fe-f40164256ab4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.238114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4741561f51e74f8ba64b3777c8d3da69', 'request_id': 'req-eca45fd0-b776-4ab1-b0fe-f40164256ab4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.248896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4741561f51e74f8ba64b3777c8d3da69', 'request_id': 'req-eca45fd0-b776-4ab1-b0fe-f40164256ab4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.287913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] The token cache is being invalidate because project 4741561f51e74f8ba64b3777c8d3da69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:38.288207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.289476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.297442 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3568/7126] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:37 2022] DELETE /identity/v3/projects/4741561f51e74f8ba64b3777c8d3da69 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:38.305321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:38.307703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:38.414331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde2930-e184-4964-b698-94d97c4466cd tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:38.425862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:38.428133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:38.480067 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:38.516142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:38.517526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:38.518014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:38.518538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:38.520596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca45fd0-b776-4ab1-b0fe-f40164256ab4 tempest-RoutersIpV6AdminTest-822171476 tempest-RoutersIpV6AdminTest-822171476-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:38.522185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:38.525722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:38.526852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:38.527250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:38.527591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] PATH_INFO: `/v3/projects/6a4217f758e3405c82f4a266d53f8ef5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:38.529018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a4217f758e3405c82f4a266d53f8ef5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:38.532239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:38.610086 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:38.611437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a4217f758e3405c82f4a266d53f8ef5', 'request_id': 'req-a3f31eb5-43e0-448f-a312-84f604fff6ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.625941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a4217f758e3405c82f4a266d53f8ef5', 'request_id': 'req-a3f31eb5-43e0-448f-a312-84f604fff6ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.627898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:38.632200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:38.641720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a4217f758e3405c82f4a266d53f8ef5', 'request_id': 'req-a3f31eb5-43e0-448f-a312-84f604fff6ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.658725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3559/7127] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:38.667281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] The token cache is being invalidate because project 6a4217f758e3405c82f4a266d53f8ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:38.667730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.669960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.672611 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3569/7128] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:38 2022] DELETE /identity/v3/projects/6a4217f758e3405c82f4a266d53f8ef5 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:38.676851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:38.696525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d90ff-f3a7-48cb-b68a-9c84a09fe6f7 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:38.741830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:38.744945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:38.827928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:38.834896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:38.835499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:38.836683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] PATH_INFO: `/v3/users/a3abbb2721e34c7ea23a8f2cc2200eff` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:38.838395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3abbb2721e34c7ea23a8f2cc2200eff)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:38.841375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:38.944225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f31eb5-43e0-448f-a312-84f604fff6ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:38.950834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3abbb2721e34c7ea23a8f2cc2200eff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.957599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:38.958782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:38.959170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:38.959460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] PATH_INFO: `/v3/users/cfeb66b2d68140fa92cd92bcbc2890ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:38.962948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3abbb2721e34c7ea23a8f2cc2200eff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.964050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfeb66b2d68140fa92cd92bcbc2890ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:38.971091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:38.993116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3abbb2721e34c7ea23a8f2cc2200eff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:38.994083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3abbb2721e34c7ea23a8f2cc2200eff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.003683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-95f7bc93-4058-45be-aa0c-c31dfa0238f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3abbb2721e34c7ea23a8f2cc2200eff'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.019229 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3560/7129] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:38 2022] DELETE /identity/v3/users/a3abbb2721e34c7ea23a8f2cc2200eff => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:39.097860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfeb66b2d68140fa92cd92bcbc2890ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.099008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfeb66b2d68140fa92cd92bcbc2890ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.114446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfeb66b2d68140fa92cd92bcbc2890ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.115073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfeb66b2d68140fa92cd92bcbc2890ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.133697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfeb66b2d68140fa92cd92bcbc2890ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:39.163972 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3570/7130] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:38 2022] DELETE /identity/v3/users/cfeb66b2d68140fa92cd92bcbc2890ba => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:39.168498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:39.169085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:39.169542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:39.180126 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:39.216178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:39.226298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:39.398996 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3561/7131] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:39.424893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:39.426474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:39.559901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec45761-3708-410d-99ae-257382df46b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:39.569613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:39.570318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:39.570608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:39.570887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:39.595643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:39.597215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:39.606673 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:39.623092 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3571/7132] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:40.605596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:40.607639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:40.636596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983885-a1fe-4272-a9cd-03dd428c1421 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:40.641695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:40.642856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:40.643344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:40.643768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] PATH_INFO: `/v3/projects/903be2c4918746a496c903b76e2a2b58` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:40.645331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] RBAC: Authorizing `identity:delete_project(project_id=903be2c4918746a496c903b76e2a2b58)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:40.647440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:40.663852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:40.666377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:40.682719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1656a-b07b-4979-a36c-00cb5baa5d1b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:40.691147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:40.696824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:40.696824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:40.696824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] PATH_INFO: `/v3/users/f4d8bb954e354207a8ed40ee10e52c2b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:40.699223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4d8bb954e354207a8ed40ee10e52c2b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:40.702572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:40.781934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '903be2c4918746a496c903b76e2a2b58', 'request_id': 'req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.801578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '903be2c4918746a496c903b76e2a2b58', 'request_id': 'req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.813880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '903be2c4918746a496c903b76e2a2b58', 'request_id': 'req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.833502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] The token cache is being invalidate because project 903be2c4918746a496c903b76e2a2b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:40.833851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.835325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.837896 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3562/7133] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:40 2022] DELETE /identity/v3/projects/903be2c4918746a496c903b76e2a2b58 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:40.838802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:40.845451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:40.860140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4d8bb954e354207a8ed40ee10e52c2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.867108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4d8bb954e354207a8ed40ee10e52c2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.884064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4d8bb954e354207a8ed40ee10e52c2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.885167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4d8bb954e354207a8ed40ee10e52c2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.903640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-97971ff7-49b7-494e-803d-67dcd5542aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4d8bb954e354207a8ed40ee10e52c2b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:40.945190 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3572/7134] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:40 2022] DELETE /identity/v3/users/f4d8bb954e354207a8ed40ee10e52c2b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:40.947506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74316da6-baa4-4e00-b08c-69675263ab75 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:40.948714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74316da6-baa4-4e00-b08c-69675263ab75 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:40.949235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74316da6-baa4-4e00-b08c-69675263ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:40.974790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6fc15e-9a31-48a8-b96a-7d4ae6d1264c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:40.982457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-74316da6-baa4-4e00-b08c-69675263ab75 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:40.984159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74316da6-baa4-4e00-b08c-69675263ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.031371 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:41.112976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.116079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.116650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.119328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] PATH_INFO: `/v3/projects/96c8e81c2a2a4bacb53fa550f069d405` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.125315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c8e81c2a2a4bacb53fa550f069d405)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.128984 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3573/7135] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:41.130697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c66b-3262-4b26-93bb-8bdd04373f23 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.131097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c66b-3262-4b26-93bb-8bdd04373f23 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.131506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153c66b-3262-4b26-93bb-8bdd04373f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.140438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.185615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e153c66b-3262-4b26-93bb-8bdd04373f23 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:41.187110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e153c66b-3262-4b26-93bb-8bdd04373f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.221090 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3574/7136] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:41.229469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.230745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.231576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.272936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:41.275131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.279859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c8e81c2a2a4bacb53fa550f069d405', 'request_id': 'req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.296444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c8e81c2a2a4bacb53fa550f069d405', 'request_id': 'req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.307432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c8e81c2a2a4bacb53fa550f069d405', 'request_id': 'req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.323888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] The token cache is being invalidate because project 96c8e81c2a2a4bacb53fa550f069d405 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:41.324394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.326202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.327371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3563/7137] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:40 2022] DELETE /identity/v3/projects/96c8e81c2a2a4bacb53fa550f069d405 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:41.328265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.331298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.406894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb6b4a9-d640-4d5c-9e0c-eabf4435c617 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.411688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.412671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.413178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.413565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.415461 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3575/7138] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:41.416124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.416376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.419840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.441811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.443644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.448401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ea4a2-4cf9-4bc7-8147-cc7a80e831f8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.452487 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:41.459304 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3564/7139] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:41.460775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.462153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.463284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.463579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.464259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] PATH_INFO: `/v3/users/8eec6cd5cd7a48a98f19496dcd9cd340` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.465797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eec6cd5cd7a48a98f19496dcd9cd340)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.467932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.474475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275118f-a57f-45f5-8423-282f4d548158 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.489463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.490177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.492043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.492700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.493690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:41.495806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.498954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.532534 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3565/7140] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:41.540097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.570341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5272f-db54-4d44-9c51-1786238b258f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.579515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eec6cd5cd7a48a98f19496dcd9cd340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.581312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eec6cd5cd7a48a98f19496dcd9cd340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.582959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.583648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.585218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.585499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.586215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.588178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.600085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eec6cd5cd7a48a98f19496dcd9cd340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.600657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eec6cd5cd7a48a98f19496dcd9cd340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.616092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eec6cd5cd7a48a98f19496dcd9cd340'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:41.653706 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3566/7141] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:41 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:41.656611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.658006 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3576/7142] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:41 2022] DELETE /identity/v3/users/8eec6cd5cd7a48a98f19496dcd9cd340 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:41.661615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:41.709593 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:41.767581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2966cc-5035-4409-85f7-b39e589adf77 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.848008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.848860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.849146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.849470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.850185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.852261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.887783 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3567/7143] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:41 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:41.889380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.904631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea508e4e-40eb-4ad5-bff4-de4ff339687c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.911070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.912090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.912454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.912808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.913569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.915693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.946488 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3577/7144] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:41.947734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:41.962533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07991c43-d3c0-450d-be1d-221f066e030d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:41.969620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1d4b47-3e9e-4ee8-8f8a-a042e50ea9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:41.970443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4b47-3e9e-4ee8-8f8a-a042e50ea9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:41.970829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4b47-3e9e-4ee8-8f8a-a042e50ea9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:41.971206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1d4b47-3e9e-4ee8-8f8a-a042e50ea9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:41.972387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4b47-3e9e-4ee8-8f8a-a042e50ea9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:41.974522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1d4b47-3e9e-4ee8-8f8a-a042e50ea9dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:41.988407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3568/7145] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:41.992123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.011860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfd7d52-75ea-421d-9774-9e095e76c18c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:42.036010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:42.036979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.037266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.037546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] PATH_INFO: `/v3/projects/df9c7f307cd44ae7b534bc8c5aba4047/users/6c6c9ed2a2f44468a906dde5315ec31f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.106612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9c7f307cd44ae7b534bc8c5aba4047, user_id=6c6c9ed2a2f44468a906dde5315ec31f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:42.110800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:42.145292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.146436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.146951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.167364 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3578/7146] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:41 2022] PUT /identity/v3/projects/df9c7f307cd44ae7b534bc8c5aba4047/users/6c6c9ed2a2f44468a906dde5315ec31f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:42.220848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] MFA Rules not processed for user `6c6c9ed2a2f44468a906dde5315ec31f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:42.222529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:42.374000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3569/7147] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:42.378835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.470085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7474f-e50a-4aba-933c-b4d832b6ad2a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:42.477118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:42.477954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.478339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.478733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.479781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:42.482080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:42.528244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3579/7148] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:42 2022] POST /identity/v3/projects => generated 375 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:42.529018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.547115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65d0062-05f1-4fc0-ac80-2fb4ce73adb4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:42.624927 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:42.659097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:42.660685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.661183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.662014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.663156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:42.666184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:42.710494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3570/7149] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:42 2022] POST /identity/v3/users => generated 288 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:42.712300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.729907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b244eeeb-8af5-47f4-ad04-6fb89b31ced8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:42.744238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:42.745181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.745548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.745941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.746978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:42.748887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:42.771724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3580/7150] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:42.773145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.787785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d1752-1c77-402a-bbbe-705f4697354c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:42.795550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:42.796541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.797036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.797467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.798562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:42.803284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:42.832489 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3571/7151] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:42.834901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.848698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a95e3-6ba9-40c1-b005-1abf59cb9a5b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:42.858435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677c0f6-514d-40df-83f3-03112787cd98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:42.874123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c0f6-514d-40df-83f3-03112787cd98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.876013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c0f6-514d-40df-83f3-03112787cd98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.893062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677c0f6-514d-40df-83f3-03112787cd98 admin admin] PATH_INFO: `/v3/projects/ed4cf7769d8a4166aa248a46cadd19e3/users/1af5c1a3f10340b0b9914439ae750f34/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:42.930581 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:42.939747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c0f6-514d-40df-83f3-03112787cd98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed4cf7769d8a4166aa248a46cadd19e3, user_id=1af5c1a3f10340b0b9914439ae750f34, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:42.946321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677c0f6-514d-40df-83f3-03112787cd98 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:42.972679 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3581/7152] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:42 2022] PUT /identity/v3/projects/ed4cf7769d8a4166aa248a46cadd19e3/users/1af5c1a3f10340b0b9914439ae750f34/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:42.977276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:42.979808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:42.983558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:42.983966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:42.984361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:43.011747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f0733-f70a-469c-afd5-08e98f2c4385 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:43.058749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] MFA Rules not processed for user `1af5c1a3f10340b0b9914439ae750f34`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:43.060290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:43.201318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:43.202235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:43.204731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:43.204974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] PATH_INFO: `/v3/projects/53621188e4e548a3a0476bd13771036b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:43.210512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53621188e4e548a3a0476bd13771036b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:43.217833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:43.348525 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3582/7153] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:43.359246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:43.367729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53621188e4e548a3a0476bd13771036b', 'request_id': 'req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:43.394365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53621188e4e548a3a0476bd13771036b', 'request_id': 'req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:43.405365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301a1eb-3301-4a20-aca3-94bd33c4eba7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:43.405857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53621188e4e548a3a0476bd13771036b', 'request_id': 'req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:43.425620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] The token cache is being invalidate because project 53621188e4e548a3a0476bd13771036b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:43.425620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:43.426611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-73d9a8ca-8939-4dd8-83a5-0e83d9b22d64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:43.438276 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3572/7154] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:42 2022] DELETE /identity/v3/projects/53621188e4e548a3a0476bd13771036b => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:43.444483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:43.445412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:43.446833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:43.499859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:43.502989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:43.559695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:43.559966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:43.560245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:43.560556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:43.561646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:43.566125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:43.626055 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3583/7155] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:43 2022] POST /identity/v3/projects => generated 377 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:43.626961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:43.629664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:43.703355 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:43.725412 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3573/7156] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:43.726637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:43.733112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:43.755972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5cfbc-981e-43ff-913a-14c78a05960b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:43.845820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0999dbae-344b-41e4-83f7-6314b1aae3c4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:43.859972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:43.861137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:43.861423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:43.864199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] PATH_INFO: `/v3/projects/de4bcb8891794d1ea01e94a04a9c798f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:43.867358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4bcb8891794d1ea01e94a04a9c798f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:43.877459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:43.896521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b1747-972e-498e-b84f-50887ab1bfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:43.897241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b1747-972e-498e-b84f-50887ab1bfca admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:43.897735 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:43.898602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b1747-972e-498e-b84f-50887ab1bfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:43.898894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b1747-972e-498e-b84f-50887ab1bfca admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:43.899703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b1747-972e-498e-b84f-50887ab1bfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:43.901948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b1747-972e-498e-b84f-50887ab1bfca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:43.957317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3574/7157] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:43 2022] POST /identity/v3/users => generated 295 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:43.959081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:43.970154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:43.970451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:44.005437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4bcb8891794d1ea01e94a04a9c798f', 'request_id': 'req-64e1db11-2de6-40ab-b747-4ee17dc7f745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.023073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4bcb8891794d1ea01e94a04a9c798f', 'request_id': 'req-64e1db11-2de6-40ab-b747-4ee17dc7f745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.038399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:44.039765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4bcb8891794d1ea01e94a04a9c798f', 'request_id': 'req-64e1db11-2de6-40ab-b747-4ee17dc7f745'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.040120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:44.063246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] The token cache is being invalidate because project de4bcb8891794d1ea01e94a04a9c798f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:44.064053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.064713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.074892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3584/7158] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:43 2022] DELETE /identity/v3/projects/de4bcb8891794d1ea01e94a04a9c798f => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:44.078310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:44.085419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:44.241296 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3575/7159] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:44.242193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:44.247355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:44.270412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae943f1-5d6e-4b29-a954-181f13ca8509 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:44.288333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:44.289237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:44.289521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:44.299677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e1db11-2de6-40ab-b747-4ee17dc7f745 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:44.304771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] PATH_INFO: `/v3/users/a7be02add24d411782f378f0ae60c76a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:44.306927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7be02add24d411782f378f0ae60c76a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:44.309126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:44.341960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:44.355130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:44.357688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:44.358106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:44.365744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:44.372981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:44.409284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3585/7160] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:44.409284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:44.435752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2702f8e5-76da-4cd9-aeb2-a194d0cc53b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:44.447756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:44.448953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:44.449255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:44.449541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:44.450484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:44.450805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:44.452949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:44.484392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7be02add24d411782f378f0ae60c76a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.514426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3586/7161] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:44.515857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:44.519134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7be02add24d411782f378f0ae60c76a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.534844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ae307-358c-4455-b258-a507d5d73715 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:44.547093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:44.548918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:44.549434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:44.549794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] PATH_INFO: `/v3/projects/23d5780ed774494a918e97f8ae7d8298/users/da3f98175c164bb99e93016d869c41ba/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:44.570392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7be02add24d411782f378f0ae60c76a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.571922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7be02add24d411782f378f0ae60c76a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.578773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d5780ed774494a918e97f8ae7d8298, user_id=da3f98175c164bb99e93016d869c41ba, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:44.583604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:44.585638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7be02add24d411782f378f0ae60c76a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:44.593992 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:44.600898 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3576/7162] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:44 2022] DELETE /identity/v3/users/a7be02add24d411782f378f0ae60c76a => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:44.606304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:44.613537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:44.617132 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3587/7163] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:44 2022] PUT /identity/v3/projects/23d5780ed774494a918e97f8ae7d8298/users/da3f98175c164bb99e93016d869c41ba/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:44.621735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:44.623690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:44.777499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8be43-c5c4-4bd3-bb87-e5cb2427a0b0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:44.798379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:44.799231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:44.799555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:44.799842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:44.800593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:44.807040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:44.854113 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:44.870566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb209602-1148-40b6-b659-89fcfc7fb48e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:44.871701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3577/7164] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:44 2022] POST /identity/v3/projects => generated 371 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:44.873320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.062635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff22fe7-6fa3-41ed-ad13-c29c483745ea admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:45.074995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.075652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.076420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.076895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.077192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.077333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.077563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.077983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:45.079313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.082942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:45.083773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:45.087011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:45.118991 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3588/7165] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:45.125414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.139680 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3578/7166] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:44 2022] POST /identity/v3/users => generated 286 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:45.140436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbde24a-d412-4a53-b01b-f3573ec0cb4d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:45.146521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.148558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3057ea8-fa21-4894-9e74-8429added1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.150556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057ea8-fa21-4894-9e74-8429added1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.150962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057ea8-fa21-4894-9e74-8429added1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.151355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3057ea8-fa21-4894-9e74-8429added1dc admin admin] PATH_INFO: `/v3/projects/23d5780ed774494a918e97f8ae7d8298/users/da3f98175c164bb99e93016d869c41ba/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.154108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3057ea8-fa21-4894-9e74-8429added1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=23d5780ed774494a918e97f8ae7d8298, user_id=da3f98175c164bb99e93016d869c41ba, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:45.158168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3057ea8-fa21-4894-9e74-8429added1dc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:45.165973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf728e05-eeeb-48a8-b6ea-54716d3b79c6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:45.178730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.179857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.180189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.181025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.183892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:45.188283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:45.197337 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3589/7167] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:45 2022] PUT /identity/v3/projects/23d5780ed774494a918e97f8ae7d8298/users/da3f98175c164bb99e93016d869c41ba/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:45.211270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.211695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.212044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.219494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3579/7168] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:45.220562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.233618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f74a31-9325-4701-adf4-f58c956ad965 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:45.291798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] MFA Rules not processed for user `da3f98175c164bb99e93016d869c41ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:45.295963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:45.300574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.301650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.302085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.302489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.303667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:45.305486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:45.312616 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:45.323839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3580/7169] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:45.325822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.339032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823d37e2-ad81-4337-b097-62447a066865 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:45.345200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e438f-4e9b-467b-8f5f-e6c4f1002a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.347989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e438f-4e9b-467b-8f5f-e6c4f1002a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.348454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e438f-4e9b-467b-8f5f-e6c4f1002a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.349050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e438f-4e9b-467b-8f5f-e6c4f1002a70 admin admin] PATH_INFO: `/v3/projects/9eb22fa2996543908305611fa930e5d7/users/59fa3daedd5b451f9f7b41f28c3df83e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.371755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e438f-4e9b-467b-8f5f-e6c4f1002a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9eb22fa2996543908305611fa930e5d7, user_id=59fa3daedd5b451f9f7b41f28c3df83e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:45.375407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e438f-4e9b-467b-8f5f-e6c4f1002a70 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:45.401725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3581/7170] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:45 2022] PUT /identity/v3/projects/9eb22fa2996543908305611fa930e5d7/users/59fa3daedd5b451f9f7b41f28c3df83e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:45.416860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.417198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.417413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.478038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] MFA Rules not processed for user `59fa3daedd5b451f9f7b41f28c3df83e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:45.480888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:45.521809 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3590/7171] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:45.536004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.538913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:45.666251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7de264-76e0-49ee-98d0-b9d9ac46ad8e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:45.692884 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3582/7172] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:45.722059 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:45.789439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:45.792236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:45.838038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:45.840135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:45.852616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:45.854215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:45.875506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:46.108229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:46.121983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:46.146615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6bb70-e625-4240-8a57-2b4d757f3161 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:46.165535 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3591/7173] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:46.168680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:46.169322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:46.170419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:46.170585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:46.170860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] PATH_INFO: `/v3/projects/6050f56e43ae47bda86d3ccd2f29ae0c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:46.180795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:46.182213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6050f56e43ae47bda86d3ccd2f29ae0c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:46.183697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:46.311266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6050f56e43ae47bda86d3ccd2f29ae0c', 'request_id': 'req-3a7f0536-61ff-4ff4-91b1-1cbc94340071'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:46.338253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6050f56e43ae47bda86d3ccd2f29ae0c', 'request_id': 'req-3a7f0536-61ff-4ff4-91b1-1cbc94340071'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:46.355583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6050f56e43ae47bda86d3ccd2f29ae0c', 'request_id': 'req-3a7f0536-61ff-4ff4-91b1-1cbc94340071'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:46.369818 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:46.386595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] The token cache is being invalidate because project 6050f56e43ae47bda86d3ccd2f29ae0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:46.389573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:46.390803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3a7f0536-61ff-4ff4-91b1-1cbc94340071 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:46.393564 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3583/7174] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:45 2022] DELETE /identity/v3/projects/6050f56e43ae47bda86d3ccd2f29ae0c => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:46.398750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043ffd-afde-4efc-9dd8-7059ddde973d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:46.399156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043ffd-afde-4efc-9dd8-7059ddde973d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:46.399443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6043ffd-afde-4efc-9dd8-7059ddde973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:46.437067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8cc909-7ccf-4727-8cd4-4762e592a770 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:46.446382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a6043ffd-afde-4efc-9dd8-7059ddde973d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:46.449136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6043ffd-afde-4efc-9dd8-7059ddde973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:46.561997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:46.562929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:46.563502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:46.563789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:46.569495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:46.649325 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3584/7175] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:46.657769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:46.658262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:46.658732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:46.683108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:46.684558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:46.697638 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:46.698870 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3585/7176] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:46.704991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:46.722905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:46.723182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c677aa-5466-4cbe-9414-2d4bc182b03b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:46.724696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:46.730926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:46.732303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:46.732698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:46.733095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:46.734133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:46.734738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:46.737010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:46.751449 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3592/7177] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 585 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:46.756581 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3586/7178] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:46.764979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:46.788781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2928244-cb87-4da4-bbe9-1544e70a7cb0 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:46.795086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:46.795787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:46.796074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:46.796544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:46.797258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:46.801997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:46.862742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3593/7179] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:46 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:46.867036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:46.885527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f3330-4bc4-4f66-acd1-3a1d0ce9bc5c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:47.060116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:47.061547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.061835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.062694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.063421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:47.068990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:47.155715 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3587/7180] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:46 2022] POST /identity/v3/users => generated 292 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:47.156834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:47.179157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef304c-046b-424c-a57c-4e25b72771eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:47.194209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:47.194931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.195216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.195491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.196237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:47.197935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:47.222696 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3594/7181] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:47.226520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:47.245810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf843e-ccb8-4d81-92b0-10385d1d25a7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:47.253101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b510ef-3eb1-4bc2-b80f-289465f5f5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:47.253954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b510ef-3eb1-4bc2-b80f-289465f5f5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.254241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b510ef-3eb1-4bc2-b80f-289465f5f5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.254515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b510ef-3eb1-4bc2-b80f-289465f5f5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.255268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b510ef-3eb1-4bc2-b80f-289465f5f5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:47.256960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b510ef-3eb1-4bc2-b80f-289465f5f5d0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:47.285219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3588/7182] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:47.286476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:47.298343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564bfb0a-aff5-45bb-896b-78c3617706d0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:47.318709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:47.323421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.323994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.325927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] PATH_INFO: `/v3/projects/016ba92bb1104474b212ce17750727c0/users/5eb49d78886245818cacdacaf59d85af/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.365377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] RBAC: Authorizing `identity:create_grant(project_id=016ba92bb1104474b212ce17750727c0, user_id=5eb49d78886245818cacdacaf59d85af, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:47.368263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:47.403459 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3595/7183] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:47 2022] PUT /identity/v3/projects/016ba92bb1104474b212ce17750727c0/users/5eb49d78886245818cacdacaf59d85af/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:47.410416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.410416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.410416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.449899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] MFA Rules not processed for user `5eb49d78886245818cacdacaf59d85af`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:47.451315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:47.559522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:47.561520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:47.597212 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:47.710904 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3589/7184] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:47.728522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:47.730393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:47.788983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9517ad1-4cd7-44c2-ac1d-4ad19ea1400d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:47.803630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:47.804550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.807056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.807534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.813369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:47.923729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcda557-d531-45cb-b76b-390b13598c26 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:47.940928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:47.942660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:47.943225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:47.943225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:47.970280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:47.974934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:48.002765 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3590/7185] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:48.012658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:48.021180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0530e9f6-680e-41d3-aa46-75e8103efea9 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:48.069234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:48.098523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3596/7186] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:48.350201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023e7da-f662-48bf-9f76-6f927572ff8b service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:48.363475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:48.371118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:48.372227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:48.372716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] PATH_INFO: `/v3/users/5eb49d78886245818cacdacaf59d85af` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:48.375730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5eb49d78886245818cacdacaf59d85af)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:48.381027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:48.508905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5eb49d78886245818cacdacaf59d85af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:48.529014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5eb49d78886245818cacdacaf59d85af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:48.595899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5eb49d78886245818cacdacaf59d85af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:48.603214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5eb49d78886245818cacdacaf59d85af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:48.616509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5eb49d78886245818cacdacaf59d85af'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:48.631179 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3591/7187] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:48 2022] DELETE /identity/v3/users/5eb49d78886245818cacdacaf59d85af => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:48.638285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:48.638285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:48.638285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:48.714015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:48.729158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:48.820598 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:48.921042 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3597/7188] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:48.933780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:48.935269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:48.950888 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:49.066847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdaee21-1e37-4148-ae7c-1592e385877b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:49.078789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:49.079121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:49.079401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:49.079675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:49.103565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:49.105101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:49.150042 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3592/7189] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:49.512223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:49.514103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:49.645194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b05f55-6ed4-4b8f-8fef-f932b3cf4b09 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:49.652736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:49.653930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:49.654226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:49.654506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:49.657392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:49.681865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:49.683741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:49.706188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3d485-8e41-4196-96b0-3c48e362f2bf service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:49.720151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:49.721203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:49.721537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:49.721903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] PATH_INFO: `/v3/users/59fa3daedd5b451f9f7b41f28c3df83e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:49.723336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=59fa3daedd5b451f9f7b41f28c3df83e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:49.725563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:49.811243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:49.813154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab60371-4ad9-4ca1-88a1-f830fe06220e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:49.826677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59fa3daedd5b451f9f7b41f28c3df83e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:49.841183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59fa3daedd5b451f9f7b41f28c3df83e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:49.847744 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3598/7190] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:49.873971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59fa3daedd5b451f9f7b41f28c3df83e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:49.874825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59fa3daedd5b451f9f7b41f28c3df83e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:49.892541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59fa3daedd5b451f9f7b41f28c3df83e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:49.905965 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3593/7191] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:49 2022] DELETE /identity/v3/users/59fa3daedd5b451f9f7b41f28c3df83e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:49.908715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:49.909905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:49.910380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:49.951053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:49.953230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:50.017910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:50.018815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:50.195315 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3599/7192] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:50.220217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86f4b79-2f01-4b37-922e-4a6955acf19f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:50.233359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:50.234308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:50.234856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:50.235776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] PATH_INFO: `/v3/projects/016ba92bb1104474b212ce17750727c0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:50.247300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=016ba92bb1104474b212ce17750727c0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:50.249337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:50.266468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:50.268617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:50.286738 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:50.365408 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:50.373514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '016ba92bb1104474b212ce17750727c0', 'request_id': 'req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:50.400843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '016ba92bb1104474b212ce17750727c0', 'request_id': 'req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:50.418774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '016ba92bb1104474b212ce17750727c0', 'request_id': 'req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:50.438409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92358b9f-c8a7-4e0b-bd42-c41872f4ce1b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:50.457797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] The token cache is being invalidate because project 016ba92bb1104474b212ce17750727c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:50.458508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:50.461165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8476db7f-42c9-4cf1-9534-12ab7c3ceb17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:50.470639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3594/7193] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:50 2022] DELETE /identity/v3/projects/016ba92bb1104474b212ce17750727c0 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:50.477160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ba983-36e5-4356-a034-1f115822988f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:50.478351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ba983-36e5-4356-a034-1f115822988f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:50.479427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ba983-36e5-4356-a034-1f115822988f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:50.538369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-567ba983-36e5-4356-a034-1f115822988f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:50.543152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-567ba983-36e5-4356-a034-1f115822988f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:50.578853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:50.581333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:50.582590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:50.583243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:50.588829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:50.748984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3595/7194] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:50.759919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:50.760233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:50.760509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:50.771408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:50.772792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:50.787963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3600/7195] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:50.821885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:50.822875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:50.858685 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3596/7196] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:50.860297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:50.890577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ff2c4b-6125-4bcd-8a9e-6588374ba142 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:50.896221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:50.897048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:50.897398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:50.897752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:50.898541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:50.899679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:50.901555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:50.928162 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3601/7197] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:38:50.929552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:50.944473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98a1286-7823-4b1a-bc2c-9487a7d9d100 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:50.954699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:50.956945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:50.959605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:50.959968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:50.961094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:50.967087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:51.063537 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3597/7198] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:50 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:51.064079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.079531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9d0e6-ddb1-464d-ab50-b75534daaa1d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:51.224380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:51.226144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.227846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.229827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.231766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:51.236239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:51.293051 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3602/7199] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:51 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:51.295181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.297895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:51.309173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.334183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c939f8-194c-48b0-bb29-b32d78159b7a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:51.347046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:51.348874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.351755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.352302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.353292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:51.360062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:51.379390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3603/7200] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:51.384331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.402007 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:51.414616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb77eed-c200-47ec-bb13-2a6d8a4c3e70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:51.430525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:51.433144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.438119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.438655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.442633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c91d4-99ae-41f8-a906-81a616243b71 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:51.442773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:51.446528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:51.447262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:51.447373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.447642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.448072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.450930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:51.478296 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3604/7201] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:51.490024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.500101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485aef6a-01ba-4258-94b3-baa66ce0d7c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:51.517332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a985c5a-e546-41f6-b525-1af6d1fb1f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:51.517951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985c5a-e546-41f6-b525-1af6d1fb1f12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.518232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985c5a-e546-41f6-b525-1af6d1fb1f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.518508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a985c5a-e546-41f6-b525-1af6d1fb1f12 admin admin] PATH_INFO: `/v3/projects/28a0adabb8d24e3f989afb4d6f0805f0/users/98bdc31ef35f488fb4ad62120bfeb34e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.532448 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:51.547616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a985c5a-e546-41f6-b525-1af6d1fb1f12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28a0adabb8d24e3f989afb4d6f0805f0, user_id=98bdc31ef35f488fb4ad62120bfeb34e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:51.550550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a985c5a-e546-41f6-b525-1af6d1fb1f12 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:51.580385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:51.582438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:51.593244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3605/7202] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:51 2022] PUT /identity/v3/projects/28a0adabb8d24e3f989afb4d6f0805f0/users/98bdc31ef35f488fb4ad62120bfeb34e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:51.604731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.605257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.605669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.610398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3598/7203] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:51.656998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] MFA Rules not processed for user `98bdc31ef35f488fb4ad62120bfeb34e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:51.658191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:51.671896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.674713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:51.707347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e3ce7-227f-4add-90be-ffb785129395 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:51.833985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3606/7204] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:51.835417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:51.877316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:51.878212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:51.878553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:51.878825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] PATH_INFO: `/v3/projects/9eb22fa2996543908305611fa930e5d7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:51.884281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9eb22fa2996543908305611fa930e5d7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:51.885977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.025141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df18d60-8119-4381-b772-f57fae022d54 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.028531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9eb22fa2996543908305611fa930e5d7', 'request_id': 'req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.044656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9eb22fa2996543908305611fa930e5d7', 'request_id': 'req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.057037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9eb22fa2996543908305611fa930e5d7', 'request_id': 'req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.071591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] The token cache is being invalidate because project 9eb22fa2996543908305611fa930e5d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:52.072201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.072660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.078084 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3599/7205] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:51 2022] DELETE /identity/v3/projects/9eb22fa2996543908305611fa930e5d7 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:52.078084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.079310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:52.156242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8609901-b29d-4fc3-9933-4221fc74c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.157141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609901-b29d-4fc3-9933-4221fc74c029 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.157523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609901-b29d-4fc3-9933-4221fc74c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.157905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8609901-b29d-4fc3-9933-4221fc74c029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.158723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609901-b29d-4fc3-9933-4221fc74c029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.160889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8609901-b29d-4fc3-9933-4221fc74c029 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.167237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e5738-4e75-4ab3-bcac-98d7b90dea7b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.172867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.173868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.174155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.174433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] PATH_INFO: `/v3/users/848e5f33bbc04c0d8685ac162a442624` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.175705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=848e5f33bbc04c0d8685ac162a442624)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.176058 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:52.179077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.185898 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:52.225049 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3607/7206] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:51 2022] POST /identity/v3/projects => generated 383 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:52.226415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e87e-33f4-484d-bb16-82bd1d226dfd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.226813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e87e-33f4-484d-bb16-82bd1d226dfd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.227193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1189e87e-33f4-484d-bb16-82bd1d226dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.266092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1189e87e-33f4-484d-bb16-82bd1d226dfd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:52.267490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1189e87e-33f4-484d-bb16-82bd1d226dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:52.271170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '848e5f33bbc04c0d8685ac162a442624'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.284966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '848e5f33bbc04c0d8685ac162a442624'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.304648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '848e5f33bbc04c0d8685ac162a442624'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.305563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '848e5f33bbc04c0d8685ac162a442624'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.315323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '848e5f33bbc04c0d8685ac162a442624'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:52.323975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3600/7207] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:52 2022] DELETE /identity/v3/users/848e5f33bbc04c0d8685ac162a442624 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:52.324968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.326649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:52.398364 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3608/7208] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:52.399879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d9a1-87cf-4f85-92f2-8a22c11eb7ba None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.400275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d9a1-87cf-4f85-92f2-8a22c11eb7ba None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.400672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab2d9a1-87cf-4f85-92f2-8a22c11eb7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.427782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b02ea-98fb-4da7-9d42-e8b78bdeff02 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.429044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bab2d9a1-87cf-4f85-92f2-8a22c11eb7ba None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:52.433199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.434250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.434545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.434825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.434947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bab2d9a1-87cf-4f85-92f2-8a22c11eb7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:52.435754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.439684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.456750 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3609/7209] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:52.461073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.461465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.461846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.466972 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3601/7210] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:52 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:52.469112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.482796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638211b-01ef-42ea-9460-a6c8c28b9e30 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.489392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.489942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.490235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.490510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.491267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.493450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.494594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:52.505619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:52.520000 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3610/7211] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:52.523961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.536079 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3602/7212] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:52.537638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.542420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b630-791c-489e-bca7-79484c590f43 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.558843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.559663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.560044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.560447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.561297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:52.561707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.563451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.564218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0516313b-0cab-47ac-bc03-b15b2aec076e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.574936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.577206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.577498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.577781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.578537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.585002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.588858 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3611/7213] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:52.589877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.593027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:52.613709 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3603/7214] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:52 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:52.614728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.640061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa8fb-61eb-4616-95d7-a6d9072fceb3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.652754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.653477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.653765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.656726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.657573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.662122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.724036 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3604/7215] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:52 2022] POST /identity/v3/projects => generated 389 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:52.725033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:52.727193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0409b7-4def-4420-a419-bf82704f44b2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.826067 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:52.842920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.844615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.854043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.854528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.908521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c375a94b-e219-4c0e-b74f-803e1071d6be admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:52.923115 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:52.923682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78063-f637-4e40-940d-532865beea45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:52.924807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78063-f637-4e40-940d-532865beea45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:52.925105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78063-f637-4e40-940d-532865beea45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:52.925566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78063-f637-4e40-940d-532865beea45 admin admin] PATH_INFO: `/v3/projects/b279099adfaf43808ab6c0ea75a678e9/users/45119ddb8ac7480b92d716ed9d6a7dbf/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:52.967364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b78063-f637-4e40-940d-532865beea45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b279099adfaf43808ab6c0ea75a678e9, user_id=45119ddb8ac7480b92d716ed9d6a7dbf, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.970694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b78063-f637-4e40-940d-532865beea45 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.979133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:52.982821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:52.997077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3612/7216] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:52.998222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.010147 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3605/7217] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:52 2022] PUT /identity/v3/projects/b279099adfaf43808ab6c0ea75a678e9/users/45119ddb8ac7480b92d716ed9d6a7dbf/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:53.011809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.012103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.012424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.018638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a89d0d-5424-4218-9aea-d06d1b246c6a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.128152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] MFA Rules not processed for user `45119ddb8ac7480b92d716ed9d6a7dbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:53.131671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:53.205355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.210261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.211023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.211768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.214763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.219579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.250737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3606/7218] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:53.256580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.267693 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3613/7219] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:52 2022] POST /identity/v3/users => generated 295 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:53.271922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.287269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905bfb3d-0f1d-4ac6-bff0-862719c39e7c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.290304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bda9c1c-85c0-49c3-bbf5-48c55fadf7d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.292813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.293507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.293805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.294070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.294779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.297315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.297494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.298349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.298891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.299314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.300430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.302441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.317583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3614/7220] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:53.321539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.342370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb1a57f-be08-47ec-94d9-990750bcf5eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.351737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3607/7221] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:53 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:53.355999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.358226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.358920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.359205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.359483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.360245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.379299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.414616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3615/7222] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:38:53.418482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.429954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6ac35-6d07-4dd0-9286-65ebd662f163 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.492076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1a1a0-02ea-4af2-813d-fd482b3b0aed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.501071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.504832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.505267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.505647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.506482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.511292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.550033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3608/7223] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:53 2022] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:53.556176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.561218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10dbe16-d3ff-45b7-a4be-b28559581e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.562576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbe16-d3ff-45b7-a4be-b28559581e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.563736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbe16-d3ff-45b7-a4be-b28559581e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.564152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10dbe16-d3ff-45b7-a4be-b28559581e2f admin admin] PATH_INFO: `/v3/projects/0c96a71df84b44e4a55a30e767965062/users/f465498c91ca43d7894473ca93aef394/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.577352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71869a5-5ebe-4d8b-8b5b-a1e701a8fa89 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.583855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.584956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.585427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.585970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.587225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.589617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.590423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dbe16-d3ff-45b7-a4be-b28559581e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c96a71df84b44e4a55a30e767965062, user_id=f465498c91ca43d7894473ca93aef394, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.593356 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:53.594784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10dbe16-d3ff-45b7-a4be-b28559581e2f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.610913 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3609/7224] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:53.613866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.626113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3616/7225] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:53 2022] PUT /identity/v3/projects/0c96a71df84b44e4a55a30e767965062/users/f465498c91ca43d7894473ca93aef394/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:53.627933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.629237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.629648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.634834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db190c8-cc4d-452d-a323-885ab56cf49f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.663289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] MFA Rules not processed for user `f465498c91ca43d7894473ca93aef394`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:53.665000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:53.693765 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:53.745620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.747420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.747712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.748000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] PATH_INFO: `/v3/projects/3a5529c1a5fc48e59009e3eacaf525ff/users/714ef55ed16f449c815bd9008c73ab30/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.771631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5529c1a5fc48e59009e3eacaf525ff, user_id=714ef55ed16f449c815bd9008c73ab30, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.775459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.806110 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3610/7226] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:53 2022] PUT /identity/v3/projects/3a5529c1a5fc48e59009e3eacaf525ff/users/714ef55ed16f449c815bd9008c73ab30/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:53.808195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.819857 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3617/7227] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:53.823948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:53.845434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e668c-a11a-4d58-ba31-57d6bfdf3b03 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.915192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6a063-4014-4b76-8001-87965c4fa412 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:53.951333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.952144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.952576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.952860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.954983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.960073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.962671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:53.963362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:53.963648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:53.963923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:53.964657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:53.966597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:53.989168 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3611/7228] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:53.994946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.009832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acafeb7-03c9-4a2c-aee5-47f1c81693ec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.019261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213887b-5907-49ca-b230-5103232230e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.019478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213887b-5907-49ca-b230-5103232230e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.019944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213887b-5907-49ca-b230-5103232230e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.020375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213887b-5907-49ca-b230-5103232230e4 admin admin] PATH_INFO: `/v3/projects/3a5529c1a5fc48e59009e3eacaf525ff/users/714ef55ed16f449c815bd9008c73ab30/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.023618 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3618/7229] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:53 2022] POST /identity/v3/projects => generated 389 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:54.024140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213887b-5907-49ca-b230-5103232230e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a5529c1a5fc48e59009e3eacaf525ff, user_id=714ef55ed16f449c815bd9008c73ab30, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.027525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213887b-5907-49ca-b230-5103232230e4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.029324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.061906 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3612/7230] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:53 2022] PUT /identity/v3/projects/3a5529c1a5fc48e59009e3eacaf525ff/users/714ef55ed16f449c815bd9008c73ab30/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:54.072359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.073594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.074564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.128681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] MFA Rules not processed for user `714ef55ed16f449c815bd9008c73ab30`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:54.133947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:54.184205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63972c43-0b8d-4c8a-acc7-1406cbdebdbd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.212366 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:54.276734 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:54.282495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3613/7231] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:54 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:54.319852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.320962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.321387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.321861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.322926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.332514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.334471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:54.349324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.381143 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3619/7232] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:54 2022] POST /identity/v3/users => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:54.385264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.411031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9c39d-330a-4504-ad22-e39132a6a37e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.423339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.423877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.424164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.424480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.425779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.427294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.450894 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3620/7233] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:54.455534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.459009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0c76e8-5895-4853-94ae-0db50667fee2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.463893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.464860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.466033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.466512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.469291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:54.473060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9c778-6af9-4fb3-9903-36cd0f6eb056 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.487593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.488792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.489074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.489349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] PATH_INFO: `/v3/projects/c76cfe6f446946adbf19087ac5fd19d0/users/68287a8b47664fbd9e05a8d8b69ad6db/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.523095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76cfe6f446946adbf19087ac5fd19d0, user_id=68287a8b47664fbd9e05a8d8b69ad6db, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.525899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.553793 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3621/7234] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:54 2022] PUT /identity/v3/projects/c76cfe6f446946adbf19087ac5fd19d0/users/68287a8b47664fbd9e05a8d8b69ad6db/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:54.558589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.560857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.563153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.578271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3614/7235] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:54.701447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3314c-7f48-48f5-a615-ddc98f4efc9c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.713984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864dfaf-5a06-4973-a223-943f5bb94f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.714767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864dfaf-5a06-4973-a223-943f5bb94f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.715128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864dfaf-5a06-4973-a223-943f5bb94f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.715476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864dfaf-5a06-4973-a223-943f5bb94f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.716476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864dfaf-5a06-4973-a223-943f5bb94f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.720375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864dfaf-5a06-4973-a223-943f5bb94f42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.746951 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3622/7236] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:54.748214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.767006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee97b2-34dd-440a-9336-7c791ba7a3fa service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:54.784177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:54.785292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.785796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.786145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] PATH_INFO: `/v3/projects/c76cfe6f446946adbf19087ac5fd19d0/users/68287a8b47664fbd9e05a8d8b69ad6db/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.790550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c76cfe6f446946adbf19087ac5fd19d0, user_id=68287a8b47664fbd9e05a8d8b69ad6db, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:54.799568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:54.821807 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3615/7237] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:54 2022] PUT /identity/v3/projects/c76cfe6f446946adbf19087ac5fd19d0/users/68287a8b47664fbd9e05a8d8b69ad6db/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:54.833675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:54.833950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:54.834241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:54.878959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] MFA Rules not processed for user `68287a8b47664fbd9e05a8d8b69ad6db`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:54.885539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:54.920840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:54.923551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:55.119794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3623/7238] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:54 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:55.122558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc9a455-fab6-4ba0-8ce8-519914027696 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:55.147334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:55.148455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:55.148878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:55.149281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] PATH_INFO: `/v3/projects/33a7542d80634887bf2affcda10ac260` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:55.150700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33a7542d80634887bf2affcda10ac260)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:55.152895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:55.157165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:55.212742 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:55.231001 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:55.258673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33a7542d80634887bf2affcda10ac260', 'request_id': 'req-d94b09fb-6940-4951-97c1-d827c100bbb8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.276995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33a7542d80634887bf2affcda10ac260', 'request_id': 'req-d94b09fb-6940-4951-97c1-d827c100bbb8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.290446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33a7542d80634887bf2affcda10ac260', 'request_id': 'req-d94b09fb-6940-4951-97c1-d827c100bbb8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.312771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] The token cache is being invalidate because project 33a7542d80634887bf2affcda10ac260 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:55.312771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.313981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.326252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3616/7239] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:54 2022] DELETE /identity/v3/projects/33a7542d80634887bf2affcda10ac260 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:55.332038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:55.333517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:55.340571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1011aa0-53b5-4ea3-ade2-2964eb987e04 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:55.503860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:55.504834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:55.505311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:55.505744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:55.507958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:55.531253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b09fb-6940-4951-97c1-d827c100bbb8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:55.546631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:55.547845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:55.548135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:55.548434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] PATH_INFO: `/v3/users/ebe7e884fe1745ac8dcbe0e93193bdf4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:55.550226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebe7e884fe1745ac8dcbe0e93193bdf4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:55.552307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:55.646215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:55.648141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:55.673643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebe7e884fe1745ac8dcbe0e93193bdf4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.687638 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3624/7240] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:38:55.690826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebe7e884fe1745ac8dcbe0e93193bdf4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.705605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:55.711601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:55.712733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebe7e884fe1745ac8dcbe0e93193bdf4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.713494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebe7e884fe1745ac8dcbe0e93193bdf4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.731581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-35611a5b-b1fd-4858-a01b-24665a961fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebe7e884fe1745ac8dcbe0e93193bdf4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:55.742901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3617/7241] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:55 2022] DELETE /identity/v3/users/ebe7e884fe1745ac8dcbe0e93193bdf4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:55.772603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ec2241-bb7f-423a-bc3f-e3d9eae14420 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:55.974754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:55.977836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:55.978238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:55.979659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] PATH_INFO: `/v3/users/7b105d780d804b41a3b44de9a7464ca4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:55.982292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b105d780d804b41a3b44de9a7464ca4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:55.985850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:56.062991 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:56.110268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b105d780d804b41a3b44de9a7464ca4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:56.114075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b105d780d804b41a3b44de9a7464ca4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:56.131170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b105d780d804b41a3b44de9a7464ca4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:56.131948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b105d780d804b41a3b44de9a7464ca4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:56.146182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b105d780d804b41a3b44de9a7464ca4'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:56.201772 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3625/7242] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:55 2022] DELETE /identity/v3/users/7b105d780d804b41a3b44de9a7464ca4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:56.203512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:56.203977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:56.204177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:56.236722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:56.240015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:56.356327 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:56.431000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3618/7243] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:56.555368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:56.556904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:56.733492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b0051d-2267-42a5-a141-606c5b6b89c3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:56.744206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:56.744933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:56.745217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:56.745493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:56.781582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:56.783076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:56.816412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3626/7244] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:57.145090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:57.148420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:57.169160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f955ca-bb6c-44ec-becb-41a408428868 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:57.178563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:57.179958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:57.180496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:57.181297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] PATH_INFO: `/v3/projects/88b6d7c1d15a4920a84be281e81a3534` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:57.183822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:57.184847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b6d7c1d15a4920a84be281e81a3534)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:57.185334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:57.188414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:57.212491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51259d23-5e92-4f83-aac8-1841a972e2a3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:57.230944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:57.231867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:57.232229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:57.232443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] PATH_INFO: `/v3/users/f465498c91ca43d7894473ca93aef394` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:57.241365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f465498c91ca43d7894473ca93aef394)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:57.243409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:57.293705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b6d7c1d15a4920a84be281e81a3534', 'request_id': 'req-5c1305d9-35fb-467c-a8a6-1ca715336ba3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.323949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b6d7c1d15a4920a84be281e81a3534', 'request_id': 'req-5c1305d9-35fb-467c-a8a6-1ca715336ba3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.346335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b6d7c1d15a4920a84be281e81a3534', 'request_id': 'req-5c1305d9-35fb-467c-a8a6-1ca715336ba3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.381316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] The token cache is being invalidate because project 88b6d7c1d15a4920a84be281e81a3534 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:57.383432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.385566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5c1305d9-35fb-467c-a8a6-1ca715336ba3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.387258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f465498c91ca43d7894473ca93aef394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.388224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f465498c91ca43d7894473ca93aef394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.393189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3619/7245] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:57 2022] DELETE /identity/v3/projects/88b6d7c1d15a4920a84be281e81a3534 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:57.407537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f465498c91ca43d7894473ca93aef394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.408393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f465498c91ca43d7894473ca93aef394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.411358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf141b7-450c-4c6e-bb58-75e7b4ba52db None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:57.411919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf141b7-450c-4c6e-bb58-75e7b4ba52db None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:57.412472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf141b7-450c-4c6e-bb58-75e7b4ba52db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:57.428693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f465498c91ca43d7894473ca93aef394'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.458547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1cf141b7-450c-4c6e-bb58-75e7b4ba52db None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:57.462766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1cf141b7-450c-4c6e-bb58-75e7b4ba52db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:57.469140 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3627/7246] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:38:57 2022] DELETE /identity/v3/users/f465498c91ca43d7894473ca93aef394 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:38:57.472443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:57.473425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:57.526480 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:57.633717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5a27d7-41e8-475c-85f8-18e0a8d44b7b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:57.659125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:57.660098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:57.660409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:57.660693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] PATH_INFO: `/v3/projects/4f9ed6af4a07400a861c792e62097438` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:57.662079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f9ed6af4a07400a861c792e62097438)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:57.664036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:57.680537 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3620/7247] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:57.682216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e253b9-db6c-4b00-86d9-e70fe687c7e2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:57.687490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e253b9-db6c-4b00-86d9-e70fe687c7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:57.688427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e253b9-db6c-4b00-86d9-e70fe687c7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:57.730237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-43e253b9-db6c-4b00-86d9-e70fe687c7e2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:57.731754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-43e253b9-db6c-4b00-86d9-e70fe687c7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:57.754635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3621/7248] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:57.759194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7f50-964b-4756-9409-e085726ac7c9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:57.759779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7f50-964b-4756-9409-e085726ac7c9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:57.760748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4d7f50-964b-4756-9409-e085726ac7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:57.805813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fe4d7f50-964b-4756-9409-e085726ac7c9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:57.811533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fe4d7f50-964b-4756-9409-e085726ac7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:57.815076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f9ed6af4a07400a861c792e62097438', 'request_id': 'req-cda99f1c-47b4-4573-b8a2-2063d9786d13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.833442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f9ed6af4a07400a861c792e62097438', 'request_id': 'req-cda99f1c-47b4-4573-b8a2-2063d9786d13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.857154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f9ed6af4a07400a861c792e62097438', 'request_id': 'req-cda99f1c-47b4-4573-b8a2-2063d9786d13'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.889104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] The token cache is being invalidate because project 4f9ed6af4a07400a861c792e62097438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:38:57.889442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.892846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:38:57.897123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3628/7249] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:38:57 2022] DELETE /identity/v3/projects/4f9ed6af4a07400a861c792e62097438 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:57.900486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:57.903736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:58.046914 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:58.085033 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3622/7250] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:58.090284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.090655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.090925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.100546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda99f1c-47b4-4573-b8a2-2063d9786d13 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.120924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.121715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.122001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.122285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.135464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:58.141957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:58.159161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:58.184898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.191648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31b16eb-c739-496c-b04c-847af8a9ec84 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.194037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3623/7251] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:58.194785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.229260 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3629/7252] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:58.229957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d960813-3de7-4cf4-80e5-12ff4bdeb4d2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.233685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.233991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.234278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.243960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.252800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.253255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.253547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.257912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:58.258238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.265012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.309236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:58.310625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:58.317348 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3624/7253] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:58.322098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.343252 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3630/7254] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:38:58.345484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82b3a1-18fe-46b6-accb-3fcf622da97f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.352272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.364097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.369041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.369411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.369765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.376817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.379066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.388895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543b9b7-269d-45b1-82eb-7649c70829ab None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.406529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.407219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.407509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.407785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.409210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:38:58.409328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.410970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.468713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3625/7255] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:58 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:58.472920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.488495 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3631/7256] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:38:58.500560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.537875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8902303f-75ac-4981-a378-2fd0448fe1ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.644184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224c1cf-5678-4931-a88d-2ebf840169fd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.663468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.666334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.668019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.668584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.669838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.673107 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:58.676042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.734669 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3626/7257] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:58 2022] POST /identity/v3/users => generated 289 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:38:58.740063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.775159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.775856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.776143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.776470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.777363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.779339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.780743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23321b5f-6c58-49b8-bba5-f303535cd620 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.798605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:58.800912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:58.801201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:58.802391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:58.805184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:58.807675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:58.819340 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3632/7258] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:58 2022] POST /identity/v3/projects => generated 393 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:58.827363 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3627/7259] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:58.827363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.828227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:58.850263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fac77-5f40-45cc-83f9-6183f28970e7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:58.856643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:59.074177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b7656-8a57-423c-9c62-70ef2fa00305 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.075717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.077195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.078241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.079073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.079415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.079817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.080116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.080369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.080708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.089700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.091179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:59.156016 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3628/7260] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:38:58 2022] POST /identity/v3/users => generated 297 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:38:59.156016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:59.182069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ec09e-e888-4c2f-bd87-53aa0208b889 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.199425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.199950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.200313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.200548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.201466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.203124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.240276 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3629/7261] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:59.240276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:59.273605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.277056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.287539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41024a44-aefc-4cbe-a7f6-68aca2fdf6ad admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.313908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.314959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.317329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.317820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.319210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.319561 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3633/7262] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:38:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:38:59.321749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:59.327138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.347282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771c4e66-0a08-4c6c-9447-f8e57448382e service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.363972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236fd31-de79-4e8a-8568-c34eac227c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.367415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236fd31-de79-4e8a-8568-c34eac227c63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.367876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236fd31-de79-4e8a-8568-c34eac227c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.368258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236fd31-de79-4e8a-8568-c34eac227c63 admin admin] PATH_INFO: `/v3/projects/6da6a4303719489f8ecbe3a48559e4cc/users/1dfa9a2eb3354037a2745325288afd27/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.377757 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3630/7263] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:59.377757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:59.403037 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:59.411205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236fd31-de79-4e8a-8568-c34eac227c63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6da6a4303719489f8ecbe3a48559e4cc, user_id=1dfa9a2eb3354037a2745325288afd27, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.412174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fee675-31e1-428a-b3a6-d7d410a339c9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.418734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236fd31-de79-4e8a-8568-c34eac227c63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.426657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.427926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.428591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.429860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.430952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.433014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.460284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3634/7264] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:59 2022] PUT /identity/v3/projects/6da6a4303719489f8ecbe3a48559e4cc/users/1dfa9a2eb3354037a2745325288afd27/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:59.472132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.472859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.473697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.482298 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3631/7265] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:38:59.486392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:59.527295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab7e9f-14b5-419d-ab0d-aded9d96bd6d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.576851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] MFA Rules not processed for user `1dfa9a2eb3354037a2745325288afd27`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:59.580703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:38:59.674881 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:38:59.699455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6eb087-fa8d-4dae-9b15-7723b601a2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:38:59.701845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb087-fa8d-4dae-9b15-7723b601a2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.702275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb087-fa8d-4dae-9b15-7723b601a2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.703479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6eb087-fa8d-4dae-9b15-7723b601a2b1 admin admin] PATH_INFO: `/v3/projects/1764d3910dff4cf2a5285da44b5b49d9/users/a12309a589f44c24827408b58aadceb4/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.749282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eb087-fa8d-4dae-9b15-7723b601a2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1764d3910dff4cf2a5285da44b5b49d9, user_id=a12309a589f44c24827408b58aadceb4, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:38:59.761884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6eb087-fa8d-4dae-9b15-7723b601a2b1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:38:59.766529 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3635/7266] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:38:59.774015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:38:59.799939 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3632/7267] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:38:59 2022] PUT /identity/v3/projects/1764d3910dff4cf2a5285da44b5b49d9/users/a12309a589f44c24827408b58aadceb4/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:38:59.819007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651a78f-af5b-4270-814c-1ac8255eb3c0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:38:59.819779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:38:59.822607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:38:59.823227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:38:59.933838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] MFA Rules not processed for user `a12309a589f44c24827408b58aadceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:38:59.937996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:00.110405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:00.112477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:00.112804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:00.113091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:00.119304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:00.124948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:00.148271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3633/7268] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:38:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:00.165914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:00.167439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:00.203769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3636/7269] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:38:59 2022] POST /identity/v3/projects => generated 379 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:00.206773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:00.347737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7467c56-2624-431b-826d-db79a25a9f38 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:00.378432 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:00.465639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126958be-4d64-48d9-9480-940a1b9b8c3f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:00.495231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:00.499169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:00.499460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:00.499711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:00.500740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:00.501025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:00.502121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:00.503232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:00.506245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:00.512994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:00.585307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3637/7270] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:00 2022] POST /identity/v3/users => generated 296 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:00.589078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:00.604411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:00.642466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2922eaf6-6909-452b-b49e-e7fb59e0a3a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:00.657586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:00.658499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:00.658988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:00.659173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] PATH_INFO: `/v3/projects/0c96a71df84b44e4a55a30e767965062` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:00.661787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c96a71df84b44e4a55a30e767965062)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:00.664111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:00.666891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:00.668214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:00.697462 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3634/7271] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:00.697462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:00.708979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de5f63-2204-47b6-ac8a-d78b9aba546f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:00.721406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:00.722075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:00.722360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:00.722633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:00.723374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:00.725050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:00.755550 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3635/7272] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:00.759806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:00.768043 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:00.777166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c96a71df84b44e4a55a30e767965062', 'request_id': 'req-a91af521-ee9a-4b9c-bf70-f92657a14635'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:00.803735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53c4c8-9bf6-446e-b1be-223b92d1e3a4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:00.812068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c96a71df84b44e4a55a30e767965062', 'request_id': 'req-a91af521-ee9a-4b9c-bf70-f92657a14635'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:00.830274 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c96a71df84b44e4a55a30e767965062', 'request_id': 'req-a91af521-ee9a-4b9c-bf70-f92657a14635'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:00.861453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] The token cache is being invalidate because project 0c96a71df84b44e4a55a30e767965062 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:00.862226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:00.862736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:00.879998 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3638/7273] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:00 2022] DELETE /identity/v3/projects/0c96a71df84b44e4a55a30e767965062 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:00.881186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:00.887364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:00.984894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:00.986130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:00.988102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:00.988102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] PATH_INFO: `/v3/projects/bd2c3e61296f45f1a91ef71eeefbd529/users/564c1b27c20a47e3bff473beb71e74dd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:01.031472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2c3e61296f45f1a91ef71eeefbd529, user_id=564c1b27c20a47e3bff473beb71e74dd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:01.036889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:01.084078 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3636/7274] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:00 2022] PUT /identity/v3/projects/bd2c3e61296f45f1a91ef71eeefbd529/users/564c1b27c20a47e3bff473beb71e74dd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:01.085588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91af521-ee9a-4b9c-bf70-f92657a14635 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:01.086471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:01.089545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:01.200719 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:01.213781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:01.215227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:01.217688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:01.218020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd6a234-b801-4ac3-a477-eba7e0e91c4b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:01.218903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] PATH_INFO: `/v3/users/68287a8b47664fbd9e05a8d8b69ad6db` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:01.221858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68287a8b47664fbd9e05a8d8b69ad6db)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:01.228951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:01.229822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:01.230512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:01.230796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:01.231093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:01.237422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:01.348828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68287a8b47664fbd9e05a8d8b69ad6db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:01.351530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68287a8b47664fbd9e05a8d8b69ad6db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:01.378350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68287a8b47664fbd9e05a8d8b69ad6db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:01.383224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68287a8b47664fbd9e05a8d8b69ad6db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:01.419373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68287a8b47664fbd9e05a8d8b69ad6db'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:01.480133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:01.484094 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:01.488446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:01.499932 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3639/7275] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:00 2022] DELETE /identity/v3/users/68287a8b47664fbd9e05a8d8b69ad6db => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:01.499932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:01.505048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:01.523470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3637/7276] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:01.728299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36923c6-2052-49a5-8173-c355a133d0a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:01.734856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5967664e-96bc-4150-8668-8f69d3f67533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:01.737281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967664e-96bc-4150-8668-8f69d3f67533 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:01.737763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967664e-96bc-4150-8668-8f69d3f67533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:01.738181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5967664e-96bc-4150-8668-8f69d3f67533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:01.739280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967664e-96bc-4150-8668-8f69d3f67533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:01.764607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5967664e-96bc-4150-8668-8f69d3f67533 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:01.790058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:01.790820 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3640/7277] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:01.792977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:01.824410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c647568-edb2-43be-a184-4b4a80dfffb1 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:01.837492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:01.840413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:01.841435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:01.841903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] PATH_INFO: `/v3/projects/bd2c3e61296f45f1a91ef71eeefbd529/users/564c1b27c20a47e3bff473beb71e74dd/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:01.849080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2c3e61296f45f1a91ef71eeefbd529, user_id=564c1b27c20a47e3bff473beb71e74dd, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:01.857681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:01.897952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:01.902507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:01.902910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:01.920388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3638/7278] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:01 2022] PUT /identity/v3/projects/bd2c3e61296f45f1a91ef71eeefbd529/users/564c1b27c20a47e3bff473beb71e74dd/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:01.987467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] MFA Rules not processed for user `564c1b27c20a47e3bff473beb71e74dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:01.992991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:02.158263 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3641/7279] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:02.170794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:02.172667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:02.270090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:02.273664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:02.316467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a129d8-a98f-41d1-b830-f501eaae8c89 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:02.328435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:02.329145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:02.329421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:02.329700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:02.335362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:02.495441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f7a04-22ac-4887-8d4d-3d4a19ff8fb9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:02.510228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:02.513162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42038f17-b9e6-43f0-aa8a-c6bddfceb83e service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:02.513388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:02.517018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:02.517310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:02.517592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] PATH_INFO: `/v3/projects/c76cfe6f446946adbf19087ac5fd19d0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:02.525700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c76cfe6f446946adbf19087ac5fd19d0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:02.527561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:02.543468 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3639/7280] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:02.611168 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:02.677246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c76cfe6f446946adbf19087ac5fd19d0', 'request_id': 'req-cc0009d1-beee-4031-88b9-7f7cd153e9c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:02.697004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c76cfe6f446946adbf19087ac5fd19d0', 'request_id': 'req-cc0009d1-beee-4031-88b9-7f7cd153e9c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:02.721268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c76cfe6f446946adbf19087ac5fd19d0', 'request_id': 'req-cc0009d1-beee-4031-88b9-7f7cd153e9c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:02.749171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] The token cache is being invalidate because project c76cfe6f446946adbf19087ac5fd19d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:02.749462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:02.751377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cc0009d1-beee-4031-88b9-7f7cd153e9c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:02.758794 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3642/7281] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:02 2022] DELETE /identity/v3/projects/c76cfe6f446946adbf19087ac5fd19d0 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:02.765404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:02.765887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:02.766754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:02.835176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:02.840451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:02.986615 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:03.087502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.087958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.088252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3640/7282] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:03.088682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.127773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:03.129095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:03.151148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3643/7283] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:39:03.156408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:03.170830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a17f0-b51c-4e25-8e97-a3e9cbbb9be5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:03.178521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:03.180992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.181671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.182189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.183544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:03.184265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:03.187535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:03.211006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:03.211411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3641/7284] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:03.226095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fb429-ade2-49e6-97aa-91eb5a408778 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:03.245135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:03.245830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.246117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.246401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.247122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:03.249121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:03.342170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3644/7285] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:03 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:39:03.346667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:03.362799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fccb4e3-b9ae-434e-9211-8a221b04e605 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:03.589418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:03.590778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.591244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.591801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.592709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:03.594909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:03.661216 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3642/7286] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:03 2022] POST /identity/v3/users => generated 290 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:03.662309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:03.679285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa9d77-63fc-4de6-ac70-866edc9db2ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:03.697604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:03.698315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.698600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.698881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.699632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:03.713089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:03.757801 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3645/7287] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:03.762738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:03.779288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2fa8a-6c7c-4fe2-b478-433d5e00a07f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:03.829871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09282c8e-863a-478a-b404-e87c4bd2b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:03.833816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282c8e-863a-478a-b404-e87c4bd2b16a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.834110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282c8e-863a-478a-b404-e87c4bd2b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.835764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09282c8e-863a-478a-b404-e87c4bd2b16a admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.837416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282c8e-863a-478a-b404-e87c4bd2b16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:03.841646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09282c8e-863a-478a-b404-e87c4bd2b16a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:03.892309 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3643/7288] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:03.895766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:03.919186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b182f5d0-7922-43ac-b743-1ed3c2c01f17 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:03.941143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:03.942389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:03.942684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:03.942967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] PATH_INFO: `/v3/projects/ae66de78148c4a4f80d0f8e9cac7edc5/users/544431eeacd84cb8bc361c2b222e0318/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:03.999322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae66de78148c4a4f80d0f8e9cac7edc5, user_id=544431eeacd84cb8bc361c2b222e0318, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:04.006597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:04.033495 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3646/7289] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:03 2022] PUT /identity/v3/projects/ae66de78148c4a4f80d0f8e9cac7edc5/users/544431eeacd84cb8bc361c2b222e0318/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:04.051615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:04.052060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:04.052371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:04.139616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] MFA Rules not processed for user `544431eeacd84cb8bc361c2b222e0318`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:04.140871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:04.285951 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3644/7290] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:04.290605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:04.464040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b067c0-c43f-4bc7-85a5-15b1ddfd160f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:04.479375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:04.480231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:04.480551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:04.480832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:04.481548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:04.490264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:04.564052 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3647/7291] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:04 2022] POST /identity/v3/projects => generated 377 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:04.568025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:04.594581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadae429-bf8c-4847-8683-c49723c4c67c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:04.729130 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:04.799859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:04.800944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:04.801240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:04.801517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:04.802240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:04.809356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:04.853945 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3645/7292] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:04 2022] POST /identity/v3/users => generated 295 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:04.858021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:04.881968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeaa94b-791c-46cf-9517-263d3f396d68 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:04.890048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:04.891003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:04.891478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:04.891912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:04.893041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:04.894995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:04.925338 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3648/7293] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:04.929701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:04.949961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a3d7f-709f-49a3-baa6-b4ab7cb95c89 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:04.967075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:04.968441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:04.968742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:04.969027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] PATH_INFO: `/v3/projects/da21467c291b426c87cd2370126090c0/users/88f798d291ca4f9f807067d38a10635c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:05.020898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] RBAC: Authorizing `identity:create_grant(project_id=da21467c291b426c87cd2370126090c0, user_id=88f798d291ca4f9f807067d38a10635c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:05.029846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:05.068061 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3646/7294] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:04 2022] PUT /identity/v3/projects/da21467c291b426c87cd2370126090c0/users/88f798d291ca4f9f807067d38a10635c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:05.072043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:05.088485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7323e8b8-e751-483b-905b-b09479e642c6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:05.134127 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:05.249230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b307d1-60c0-46b1-b599-50434e4c0649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:05.249945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b307d1-60c0-46b1-b599-50434e4c0649 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:05.250234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b307d1-60c0-46b1-b599-50434e4c0649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:05.250516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b307d1-60c0-46b1-b599-50434e4c0649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:05.251273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b307d1-60c0-46b1-b599-50434e4c0649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:05.253228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b307d1-60c0-46b1-b599-50434e4c0649 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:05.292216 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3649/7295] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:05.296629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:05.316222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cacd94d-2781-45e2-9ca1-ee2418fb809e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:05.341515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:05.342472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:05.342755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:05.343052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] PATH_INFO: `/v3/projects/da21467c291b426c87cd2370126090c0/users/88f798d291ca4f9f807067d38a10635c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:05.354703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] RBAC: Authorizing `identity:create_grant(project_id=da21467c291b426c87cd2370126090c0, user_id=88f798d291ca4f9f807067d38a10635c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:05.357501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:05.396771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3647/7296] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:05 2022] PUT /identity/v3/projects/da21467c291b426c87cd2370126090c0/users/88f798d291ca4f9f807067d38a10635c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:05.410134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:05.410803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:05.411091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:05.531560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] MFA Rules not processed for user `88f798d291ca4f9f807067d38a10635c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:05.532919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:05.661083 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3650/7297] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:05.667552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:05.670328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:05.753703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfbe7ef-2b99-4920-bae6-9748a562c87f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:05.761888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:05.762965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:05.763493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:05.763993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:05.778768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:05.782029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:05.815790 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3648/7298] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:06.708295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:06.864957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3fda01-ec45-4df7-87d5-763e0de48a72 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:06.890407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:06.893549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:06.894752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:06.896224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] PATH_INFO: `/v3/users/544431eeacd84cb8bc361c2b222e0318` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:06.901960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:06.905490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:06.918346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=544431eeacd84cb8bc361c2b222e0318)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:06.926668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:06.951109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cb29a-e238-4985-a6ec-715df54b4ec9 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:06.963997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:06.965449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:06.966184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:06.966708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:06.970609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:07.132333 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:07.136709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '544431eeacd84cb8bc361c2b222e0318'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.149556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '544431eeacd84cb8bc361c2b222e0318'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.173781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '544431eeacd84cb8bc361c2b222e0318'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.174589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '544431eeacd84cb8bc361c2b222e0318'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.205720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '544431eeacd84cb8bc361c2b222e0318'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.268325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3651/7299] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:06 2022] DELETE /identity/v3/users/544431eeacd84cb8bc361c2b222e0318 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:07.268325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:07.270099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:07.281237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:07.286968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255034f-d988-4b40-ad07-f5dd8183659a service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:07.315114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3649/7300] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:06 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:07.319986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:07.320286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:07.320660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:07.368506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:07.370757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:07.398368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838a10-f749-4be6-bdb9-b969b28cf157 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:07.414357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:07.415298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:07.415655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:07.416011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] PATH_INFO: `/v3/users/6c6c9ed2a2f44468a906dde5315ec31f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:07.419556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c6c9ed2a2f44468a906dde5315ec31f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:07.422048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:07.434399 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3650/7301] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:07.506138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:07.508598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:07.582962 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:07.584878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c6c9ed2a2f44468a906dde5315ec31f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.588508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c6c9ed2a2f44468a906dde5315ec31f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.610601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c6c9ed2a2f44468a906dde5315ec31f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.611654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c6c9ed2a2f44468a906dde5315ec31f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.640702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc0d3afd-c111-4117-af81-7e398cc7b24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c6c9ed2a2f44468a906dde5315ec31f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:07.710943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cafcd56-976f-4baf-8bc9-2d43f910e112 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:07.730057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:07.730903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:07.732186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:07.733618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:07.734117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3652/7302] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:07 2022] DELETE /identity/v3/users/6c6c9ed2a2f44468a906dde5315ec31f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:07.737622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:07.746602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:07.747521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:07.748071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:07.767445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:07.771807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:07.821140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:07.836735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:07.845963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3651/7303] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:07.949020 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:08.004120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3653/7304] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:08.027747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:08.029331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:08.076432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fabb26-1a1c-463b-8689-6c943ba77e4a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:08.212166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:08.214341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:08.214654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:08.215606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:08.238643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:08.240043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:08.264777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3652/7305] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:08.708212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:08.709825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:08.739589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e200-6238-40da-ab52-7a696948c95f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:08.785378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:08.786120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:08.786407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:08.786685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] PATH_INFO: `/v3/projects/ae66de78148c4a4f80d0f8e9cac7edc5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:08.806130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae66de78148c4a4f80d0f8e9cac7edc5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:08.813959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:09.093159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae66de78148c4a4f80d0f8e9cac7edc5', 'request_id': 'req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.120084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae66de78148c4a4f80d0f8e9cac7edc5', 'request_id': 'req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.149685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae66de78148c4a4f80d0f8e9cac7edc5', 'request_id': 'req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.191458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] The token cache is being invalidate because project ae66de78148c4a4f80d0f8e9cac7edc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:09.191906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.194545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.202158 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3654/7306] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:08 2022] DELETE /identity/v3/projects/ae66de78148c4a4f80d0f8e9cac7edc5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:09.206192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:09.223069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c08891-2562-495b-97a6-6903a62b6ce2 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:09.514383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:09.515394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:09.517997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:09.519459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] PATH_INFO: `/v3/users/88f798d291ca4f9f807067d38a10635c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:09.529461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=88f798d291ca4f9f807067d38a10635c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:09.535649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:09.686062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88f798d291ca4f9f807067d38a10635c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.705929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88f798d291ca4f9f807067d38a10635c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.733992 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:09.753993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88f798d291ca4f9f807067d38a10635c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.755896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88f798d291ca4f9f807067d38a10635c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.776897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88f798d291ca4f9f807067d38a10635c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:09.794526 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3653/7307] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:09 2022] DELETE /identity/v3/users/88f798d291ca4f9f807067d38a10635c => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:11.863116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:11.865442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:11.882478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77e9fe8-dfc2-4ca9-891b-6705cf2ac6c5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:11.996497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:11.999072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:12.011127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:12.012547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.012885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.013222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] PATH_INFO: `/v3/projects/df9c7f307cd44ae7b534bc8c5aba4047` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.015333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9c7f307cd44ae7b534bc8c5aba4047)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:12.017762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:12.022936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfdf87-c342-4069-9689-7d1303cac9eb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:12.035057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:12.036783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.037075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.037573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] PATH_INFO: `/v3/projects/da21467c291b426c87cd2370126090c0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.039976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da21467c291b426c87cd2370126090c0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:12.041967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:12.113568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9c7f307cd44ae7b534bc8c5aba4047', 'request_id': 'req-ffabd96c-dd38-4ccd-8ca6-331970644590'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.125583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9c7f307cd44ae7b534bc8c5aba4047', 'request_id': 'req-ffabd96c-dd38-4ccd-8ca6-331970644590'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.141455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9c7f307cd44ae7b534bc8c5aba4047', 'request_id': 'req-ffabd96c-dd38-4ccd-8ca6-331970644590'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.162597 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:12.186557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] The token cache is being invalidate because project df9c7f307cd44ae7b534bc8c5aba4047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:12.186878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.188641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.191058 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3655/7308] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:11 2022] DELETE /identity/v3/projects/df9c7f307cd44ae7b534bc8c5aba4047 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:12.195040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:12.197706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:12.205659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da21467c291b426c87cd2370126090c0', 'request_id': 'req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.224303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da21467c291b426c87cd2370126090c0', 'request_id': 'req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.235775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da21467c291b426c87cd2370126090c0', 'request_id': 'req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.264370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] The token cache is being invalidate because project da21467c291b426c87cd2370126090c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:12.264926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.270462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2d89abf2-6f0c-4e24-b535-adf0fb3a6a93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.273131 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3654/7309] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:11 2022] DELETE /identity/v3/projects/da21467c291b426c87cd2370126090c0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:12.281711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982c37-4616-487f-bfb5-3db869d159ad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.282205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982c37-4616-487f-bfb5-3db869d159ad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.282952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85982c37-4616-487f-bfb5-3db869d159ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.322435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-85982c37-4616-487f-bfb5-3db869d159ad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:12.324176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-85982c37-4616-487f-bfb5-3db869d159ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:12.337086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabd96c-dd38-4ccd-8ca6-331970644590 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:12.470053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:12.471949 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3655/7310] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:12.478482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.478673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.478771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.479041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.481263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.481674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] PATH_INFO: `/v3/users/1af5c1a3f10340b0b9914439ae750f34` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.521822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1af5c1a3f10340b0b9914439ae750f34)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:12.526415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:12.528247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:12.539025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:12.577361 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3656/7311] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:12.582941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:12.605079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c534b-2df7-40c7-8c2b-67d9cd348c89 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:12.634582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:12.635603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.635965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.636553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.637580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:12.638260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:12.643608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:12.693699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3657/7312] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:12.695404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:12.703819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1af5c1a3f10340b0b9914439ae750f34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.704567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1af5c1a3f10340b0b9914439ae750f34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.718550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1af5c1a3f10340b0b9914439ae750f34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.719486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1af5c1a3f10340b0b9914439ae750f34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.729576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fdf36-502c-4004-861c-097084bc026a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:12.733378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1af5c1a3f10340b0b9914439ae750f34'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:12.738364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:12.739207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:12.739501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:12.739770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:12.740530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:12.744077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:12.774191 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3656/7313] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:12 2022] DELETE /identity/v3/users/1af5c1a3f10340b0b9914439ae750f34 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:12.834362 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3658/7314] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:12 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:12.842951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:12.844525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:12.896994 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:12.950345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af41f00-b44b-42b4-b77a-8023ad9711f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:13.066949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:13.068327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.068752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.069115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.069833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:13.072498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:13.122967 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3657/7315] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:12 2022] POST /identity/v3/users => generated 287 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:13.124991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:13.139010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc546c6-32bf-4c9f-9cd9-675fb92a1d1f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:13.144821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:13.145679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.146062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.146628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.147860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:13.150445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:13.168438 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3659/7316] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:13.170237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:13.186242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d7053-8689-481e-aac2-7d34a37b6627 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:13.194689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0a230-9e6d-4543-9cc1-a1d5a7e0a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:13.195694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a230-9e6d-4543-9cc1-a1d5a7e0a45c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.196169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a230-9e6d-4543-9cc1-a1d5a7e0a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.196664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0a230-9e6d-4543-9cc1-a1d5a7e0a45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.197578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0a230-9e6d-4543-9cc1-a1d5a7e0a45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:13.200668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0a230-9e6d-4543-9cc1-a1d5a7e0a45c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:13.220223 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3658/7317] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:13.222622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:13.235124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8bd55-30c5-442c-80ba-629483c54d5e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:13.241161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:13.242309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.242962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.243503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] PATH_INFO: `/v3/projects/1ece8708ef3d4392af01f1969b31dfd7/users/ac9f09236a9a43bebb2be9d6275346b7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.256241 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:13.267636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ece8708ef3d4392af01f1969b31dfd7, user_id=ac9f09236a9a43bebb2be9d6275346b7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:13.271902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:13.316470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3660/7318] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:13 2022] PUT /identity/v3/projects/1ece8708ef3d4392af01f1969b31dfd7/users/ac9f09236a9a43bebb2be9d6275346b7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:13.322343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74821d-d168-4dd3-b551-9b715b45a218 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.322737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74821d-d168-4dd3-b551-9b715b45a218 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.323151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f74821d-d168-4dd3-b551-9b715b45a218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.386780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4f74821d-d168-4dd3-b551-9b715b45a218 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:13.389953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4f74821d-d168-4dd3-b551-9b715b45a218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:13.537312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3659/7319] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:13.556603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:13.558890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:13.635091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.637341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.637772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.691649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] MFA Rules not processed for user `f047ddb9fbfd4b6f8fd66d02e0dbca20`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:13.693084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:13.730439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6708b809-176f-4fca-900c-4a5ad130a166 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:13.748832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:13.749629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.750022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.750670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.767801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:13.769530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:13.789457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3661/7320] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:13.802970 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:13.824407 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3660/7321] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:39:13.942037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:13.945052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:13.962123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfd8f1a-c16b-4d71-8dc2-dbe5dc7eb26d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:13.967709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:13.969029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:13.969310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:13.969585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] PATH_INFO: `/v3/projects/ed4cf7769d8a4166aa248a46cadd19e3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:13.971015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed4cf7769d8a4166aa248a46cadd19e3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:13.973091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:14.065599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed4cf7769d8a4166aa248a46cadd19e3', 'request_id': 'req-25fe0af3-c6a2-4291-9ada-77e991143d73'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.083237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed4cf7769d8a4166aa248a46cadd19e3', 'request_id': 'req-25fe0af3-c6a2-4291-9ada-77e991143d73'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.096039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed4cf7769d8a4166aa248a46cadd19e3', 'request_id': 'req-25fe0af3-c6a2-4291-9ada-77e991143d73'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.121198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] The token cache is being invalidate because project ed4cf7769d8a4166aa248a46cadd19e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:14.121482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.122162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.127739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3662/7322] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:13 2022] DELETE /identity/v3/projects/ed4cf7769d8a4166aa248a46cadd19e3 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:14.131669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:14.167450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37907dc-c2a7-4af8-bbce-62b6f3b632e9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:14.338904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:14.339885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:14.340173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:14.340482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] PATH_INFO: `/v3/users/da3f98175c164bb99e93016d869c41ba` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:14.342375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da3f98175c164bb99e93016d869c41ba)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:14.344481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:14.417556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da3f98175c164bb99e93016d869c41ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.418669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da3f98175c164bb99e93016d869c41ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.429826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da3f98175c164bb99e93016d869c41ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.430941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da3f98175c164bb99e93016d869c41ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.441024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da3f98175c164bb99e93016d869c41ba'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:14.473899 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3661/7323] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:14 2022] DELETE /identity/v3/users/da3f98175c164bb99e93016d869c41ba => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:14.684856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:14.686340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:14.820390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fe0af3-c6a2-4291-9ada-77e991143d73 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:14.872714 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:14.900960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:14.901872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:14.902257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:14.902632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:14.905020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:14.919442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:14.921132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:14.933962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3663/7324] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:16.004139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:16.005755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.148832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e7502-3708-4d80-8768-97e8c43907b2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:16.155491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:16.156744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:16.157271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:16.157797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] PATH_INFO: `/v3/users/98bdc31ef35f488fb4ad62120bfeb34e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:16.159546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98bdc31ef35f488fb4ad62120bfeb34e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:16.161782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:16.181628 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:16.204602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:16.206836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.226254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eebbb25-96e0-4f2b-a016-0fa43e42e143 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:16.231830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:16.232881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:16.233354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:16.233807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:16.236164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.283718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98bdc31ef35f488fb4ad62120bfeb34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.284926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98bdc31ef35f488fb4ad62120bfeb34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.314807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98bdc31ef35f488fb4ad62120bfeb34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.316074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98bdc31ef35f488fb4ad62120bfeb34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.337897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98bdc31ef35f488fb4ad62120bfeb34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.368869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3662/7325] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:16 2022] DELETE /identity/v3/users/98bdc31ef35f488fb4ad62120bfeb34e => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:16.373620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:16.373840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:16.373840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f8be9-1ad7-4e5f-be90-7a3a570ca72d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:16.374677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.438519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3664/7326] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:16.446248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d3e4-24df-45ba-bf73-fc484a18f06b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:16.447465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d3e4-24df-45ba-bf73-fc484a18f06b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:16.447954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5385d3e4-24df-45ba-bf73-fc484a18f06b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:16.491805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5385d3e4-24df-45ba-bf73-fc484a18f06b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:16.495435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5385d3e4-24df-45ba-bf73-fc484a18f06b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.548505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a6710-2b68-4fa7-95d9-693bbb314503 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:16.563894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:16.565083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:16.565199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:16.565394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] PATH_INFO: `/v3/projects/23d5780ed774494a918e97f8ae7d8298` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:16.568902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23d5780ed774494a918e97f8ae7d8298)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:16.576489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:16.679545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3665/7327] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:16.703265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef990ff-f784-4898-9397-9000aa50db00 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:16.703753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef990ff-f784-4898-9397-9000aa50db00 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:16.704172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef990ff-f784-4898-9397-9000aa50db00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:16.759620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23d5780ed774494a918e97f8ae7d8298', 'request_id': 'req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.782011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23d5780ed774494a918e97f8ae7d8298', 'request_id': 'req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.792300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8ef990ff-f784-4898-9397-9000aa50db00 None None] MFA Rules not processed for user `ac9f09236a9a43bebb2be9d6275346b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:16.793607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8ef990ff-f784-4898-9397-9000aa50db00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.810441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23d5780ed774494a918e97f8ae7d8298', 'request_id': 'req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.848557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] The token cache is being invalidate because project 23d5780ed774494a918e97f8ae7d8298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:16.848890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.850633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:16.863489 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3663/7328] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:16 2022] DELETE /identity/v3/projects/23d5780ed774494a918e97f8ae7d8298 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:16.863489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:16.875853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:16.969839 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:16.978051 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:17.078590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0b9d-2f54-439f-97d9-b1f45f22c0e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.091528 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3666/7329] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:39:17.094070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.096690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.097376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.097659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.097939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.100113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.101747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.104049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:17.165733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:17.171752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:17.333181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.335013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d541a5-59c4-44af-828b-f1218fd2cc5b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.336275 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3667/7330] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:17.338492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.343589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:17.372015 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3664/7331] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:17.373566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.373856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.374005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f8e3a-73fb-4b04-9eed-8292e95b880d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.374141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.402206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.406670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.408422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.410332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.412479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.420714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.431887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:17.434417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:17.454125 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3665/7332] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:17.458278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.469396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f58b2-ecb9-4e81-9b1a-8e570b69ac39 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.475467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.476566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.476854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.477139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.478425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:17.478740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.480658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.498668 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3668/7333] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:17 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:17.500713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.502261 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3666/7334] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:17.507368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.547775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e890ffb4-fedb-46ab-8ef6-d80bdcd846c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.625456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9afbb45-a4da-4577-b484-6187b1a03773 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.632128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.632882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.633172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.633509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.634430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.636529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.689506 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3669/7335] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:17 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:17.694486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.712992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a120e6c-7682-4b43-9fff-22878899c0e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.729252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.730779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.732717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.738410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.740478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.740890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.743341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.743709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.744784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.744904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.745632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.749292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.763058 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3670/7336] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:17.767795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.809531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f78b9ad-70f6-45f7-9b07-e60cb414f531 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:17.844486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:17.850579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:17.850879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:17.852658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] PATH_INFO: `/v3/projects/11740ce555b64c6c8b00c81bcb292483/users/2979d9351aa7452384d086da38a2f794/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:17.870274 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3667/7337] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:17 2022] POST /identity/v3/projects => generated 365 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:17.871265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.898002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11740ce555b64c6c8b00c81bcb292483, user_id=2979d9351aa7452384d086da38a2f794, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:17.901521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:17.929344 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3671/7338] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:17 2022] PUT /identity/v3/projects/11740ce555b64c6c8b00c81bcb292483/users/2979d9351aa7452384d086da38a2f794/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:17.933601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:17.961293 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:17.995560 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:18.064696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc169416-375e-4edf-8ea9-d1c347e17987 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:18.136816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1bc1e7-f59d-430e-a0b3-843d64d63d87 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:18.152724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:18.154193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.155153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.156480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.157649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:18.160940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:18.183245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3672/7339] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:18.187350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:18.216990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb966e18-11e6-4c00-ad4a-8d4de069ceed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:18.230584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:18.231370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:18.232742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.233020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.234045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.234321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.234592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.235266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] PATH_INFO: `/v3/projects/11740ce555b64c6c8b00c81bcb292483/users/2979d9351aa7452384d086da38a2f794/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.236609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:18.238598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:18.241238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11740ce555b64c6c8b00c81bcb292483, user_id=2979d9351aa7452384d086da38a2f794, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:18.243907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:18.274589 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3673/7340] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:18 2022] PUT /identity/v3/projects/11740ce555b64c6c8b00c81bcb292483/users/2979d9351aa7452384d086da38a2f794/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:18.327667 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3668/7341] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:17 2022] POST /identity/v3/users => generated 283 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:18.328998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:18.479341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e717cb1-3554-4ccc-a863-aa0b0825612b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:18.485032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:18.485730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.486080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.486545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.487297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:18.489031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:18.500962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3674/7342] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:18.504807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:18.516159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007d9816-fddb-4a83-a23b-a09460ef7b20 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:18.522656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee56c13-dfa2-4e8e-b3c5-4e8e42ed15e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:18.523488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee56c13-dfa2-4e8e-b3c5-4e8e42ed15e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.523838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee56c13-dfa2-4e8e-b3c5-4e8e42ed15e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.524175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee56c13-dfa2-4e8e-b3c5-4e8e42ed15e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.525081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee56c13-dfa2-4e8e-b3c5-4e8e42ed15e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:18.527625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee56c13-dfa2-4e8e-b3c5-4e8e42ed15e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:18.541114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3669/7343] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:18.547636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:18.562988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a0d4b-3f53-41a9-b92c-96d3d5f6714e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:18.570043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:18.571070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.571439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.571805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] PATH_INFO: `/v3/projects/c7e9520f9db94ca9ac2871682ae9f06d/users/fea6427c4c8e48e59fc07c831981ec0e/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.593171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7e9520f9db94ca9ac2871682ae9f06d, user_id=fea6427c4c8e48e59fc07c831981ec0e, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:18.596392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:18.633104 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3675/7344] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:18 2022] PUT /identity/v3/projects/c7e9520f9db94ca9ac2871682ae9f06d/users/fea6427c4c8e48e59fc07c831981ec0e/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:18.644236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:18.644551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:18.644838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:18.702655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] MFA Rules not processed for user `fea6427c4c8e48e59fc07c831981ec0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:18.703901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:18.878262 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3670/7345] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:18 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:18.889929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:18.892455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:18.976251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:18.978235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:19.052546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a1fd9-f99c-4eb5-adee-9bd425b338e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:19.061368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:19.062645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:19.063262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:19.063871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:19.081229 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:19.085107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:19.089489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:19.103408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3676/7346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:18 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:19.104558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776def2a-2be6-4d46-b84f-f6c3feebd5ed None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:19.117969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:19.118974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:19.119326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:19.119687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] PATH_INFO: `/v3/users/1dfa9a2eb3354037a2745325288afd27` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:19.121330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dfa9a2eb3354037a2745325288afd27)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:19.123367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:19.202027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:19.206051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:19.216279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dfa9a2eb3354037a2745325288afd27'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.217331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dfa9a2eb3354037a2745325288afd27'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.234954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dfa9a2eb3354037a2745325288afd27'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.236748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dfa9a2eb3354037a2745325288afd27'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.252734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f533b5-ce61-413a-9f2a-fd278d3765ef service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:19.254465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-cd04ce8e-0b3c-4edc-acf0-5ab42a83310a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dfa9a2eb3354037a2745325288afd27'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.266964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:19.274365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:19.275065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:19.275693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] PATH_INFO: `/v3/projects/28a0adabb8d24e3f989afb4d6f0805f0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:19.298065 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3671/7347] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:18 2022] DELETE /identity/v3/users/1dfa9a2eb3354037a2745325288afd27 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:19.302678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28a0adabb8d24e3f989afb4d6f0805f0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:19.303852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:19.304675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:19.305019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:19.315592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:19.356841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:19.358181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:19.370687 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:19.444881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28a0adabb8d24e3f989afb4d6f0805f0', 'request_id': 'req-25e35500-cee3-4b20-89ac-a5067432c157'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.462235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28a0adabb8d24e3f989afb4d6f0805f0', 'request_id': 'req-25e35500-cee3-4b20-89ac-a5067432c157'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.472540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28a0adabb8d24e3f989afb4d6f0805f0', 'request_id': 'req-25e35500-cee3-4b20-89ac-a5067432c157'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.493630 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3672/7348] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:19.500763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] The token cache is being invalidate because project 28a0adabb8d24e3f989afb4d6f0805f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:19.501221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.502773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.505480 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3677/7349] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:19 2022] DELETE /identity/v3/projects/28a0adabb8d24e3f989afb4d6f0805f0 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:19.510601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:19.512911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:19.534974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2937737-4ed1-4c51-a1c3-c9910b3d906b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:19.553944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:19.555760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:19.685067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:19.686038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:19.686396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:19.686760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] PATH_INFO: `/v3/users/45119ddb8ac7480b92d716ed9d6a7dbf` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:19.691295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45119ddb8ac7480b92d716ed9d6a7dbf)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:19.693716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:19.724151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e35500-cee3-4b20-89ac-a5067432c157 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:19.743708 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:19.744719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:19.745410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:19.745691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:19.746046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:19.754644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:19.797146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:19.798713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:19.809576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45119ddb8ac7480b92d716ed9d6a7dbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.810665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45119ddb8ac7480b92d716ed9d6a7dbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.824679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45119ddb8ac7480b92d716ed9d6a7dbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.825647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45119ddb8ac7480b92d716ed9d6a7dbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.830736 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3678/7350] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:19.842856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-49246440-19fe-444b-9737-c1118b941d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45119ddb8ac7480b92d716ed9d6a7dbf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:19.876008 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3673/7351] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:19 2022] DELETE /identity/v3/users/45119ddb8ac7480b92d716ed9d6a7dbf => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:21.475538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:21.477921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:21.493310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca72516-e4c9-4298-b00a-8d380d4feede service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:21.576641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:21.577463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:21.577836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:21.578117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] PATH_INFO: `/v3/users/a12309a589f44c24827408b58aadceb4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:21.579438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12309a589f44c24827408b58aadceb4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:21.582292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:21.640606 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:21.643539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12309a589f44c24827408b58aadceb4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:21.659539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12309a589f44c24827408b58aadceb4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:21.675442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12309a589f44c24827408b58aadceb4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:21.676202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12309a589f44c24827408b58aadceb4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:21.684918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12309a589f44c24827408b58aadceb4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:21.695030 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3679/7352] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:21 2022] DELETE /identity/v3/users/a12309a589f44c24827408b58aadceb4 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:21.696809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:21.697275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:21.697354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:21.715584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:21.716810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:21.799470 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3674/7353] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:21.827569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:21.829138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:21.920417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c72998-baa6-4502-9654-1b70b3f83b43 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:21.925797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:21.926848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:21.927403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:21.928007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:21.943533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:21.951582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:21.953177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:21.967547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d68df-d2b5-4130-830b-61d9d37a7db2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:21.977864 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3680/7354] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:21.981442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:21.983658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:21.984127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:21.984973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:21.991267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.019476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.022992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.049307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3675/7355] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:22.312860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:22.314445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.330529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a74f8-d2a3-407f-aca4-6e40d80532f0 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:22.336479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:22.337328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.337604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.337894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] PATH_INFO: `/v3/projects/6da6a4303719489f8ecbe3a48559e4cc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.339335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6da6a4303719489f8ecbe3a48559e4cc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.341998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.427572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:22.429174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.451551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fca6b-10a8-4dd8-8c84-702ffe2b8b3c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:22.466567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6da6a4303719489f8ecbe3a48559e4cc', 'request_id': 'req-18931269-f261-4563-8b6f-3b4c24649505'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.481915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6da6a4303719489f8ecbe3a48559e4cc', 'request_id': 'req-18931269-f261-4563-8b6f-3b4c24649505'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.493162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6da6a4303719489f8ecbe3a48559e4cc', 'request_id': 'req-18931269-f261-4563-8b6f-3b4c24649505'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.521174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] The token cache is being invalidate because project 6da6a4303719489f8ecbe3a48559e4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:22.521748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.523145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.530028 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3681/7356] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:22 2022] DELETE /identity/v3/projects/6da6a4303719489f8ecbe3a48559e4cc => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:22.533972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:22.537950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.564759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:22.566504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.566950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.567587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] PATH_INFO: `/v3/projects/b279099adfaf43808ab6c0ea75a678e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.570007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b279099adfaf43808ab6c0ea75a678e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.573974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.622457 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:22.672490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b279099adfaf43808ab6c0ea75a678e9', 'request_id': 'req-6de54671-9175-4c48-8a93-3e23a485158b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.690408 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:22.692421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b279099adfaf43808ab6c0ea75a678e9', 'request_id': 'req-6de54671-9175-4c48-8a93-3e23a485158b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.712731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b279099adfaf43808ab6c0ea75a678e9', 'request_id': 'req-6de54671-9175-4c48-8a93-3e23a485158b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.715173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18931269-f261-4563-8b6f-3b4c24649505 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:22.751413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] The token cache is being invalidate because project b279099adfaf43808ab6c0ea75a678e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:22.753005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.754656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:22.759394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3676/7357] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:22 2022] DELETE /identity/v3/projects/b279099adfaf43808ab6c0ea75a678e9 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:22.759394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:22.761556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:22.881347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:22.882701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.882701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.882906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] PATH_INFO: `/v3/users/564c1b27c20a47e3bff473beb71e74dd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.885246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=564c1b27c20a47e3bff473beb71e74dd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.890678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.899531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de54671-9175-4c48-8a93-3e23a485158b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:22.911172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:22.913381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:22.913381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:22.913822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] PATH_INFO: `/v3/projects/1764d3910dff4cf2a5285da44b5b49d9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:22.915940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1764d3910dff4cf2a5285da44b5b49d9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:22.919267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:22.995257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '564c1b27c20a47e3bff473beb71e74dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.010689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1764d3910dff4cf2a5285da44b5b49d9', 'request_id': 'req-1177a12c-4c5d-4249-8196-fef50144e922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.012911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '564c1b27c20a47e3bff473beb71e74dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.033518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1764d3910dff4cf2a5285da44b5b49d9', 'request_id': 'req-1177a12c-4c5d-4249-8196-fef50144e922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.064070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '564c1b27c20a47e3bff473beb71e74dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.065602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '564c1b27c20a47e3bff473beb71e74dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.068642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1764d3910dff4cf2a5285da44b5b49d9', 'request_id': 'req-1177a12c-4c5d-4249-8196-fef50144e922'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.088088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3e5f35b9-1aa3-47a3-acc5-326c99a52366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '564c1b27c20a47e3bff473beb71e74dd'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.093318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] The token cache is being invalidate because project 1764d3910dff4cf2a5285da44b5b49d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:23.093791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.094980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.102161 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3677/7358] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:22 2022] DELETE /identity/v3/projects/1764d3910dff4cf2a5285da44b5b49d9 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:23.106439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:23.110860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:23.115495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3682/7359] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:22 2022] DELETE /identity/v3/users/564c1b27c20a47e3bff473beb71e74dd => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:23.117306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419207ce-e289-471b-8485-50fd8b958324 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:23.117921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419207ce-e289-471b-8485-50fd8b958324 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:23.118645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419207ce-e289-471b-8485-50fd8b958324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:23.145120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-419207ce-e289-471b-8485-50fd8b958324 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:23.147055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-419207ce-e289-471b-8485-50fd8b958324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:23.278126 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:23.312093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3683/7360] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:23.327323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:23.327882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:23.328232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:23.360282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1177a12c-4c5d-4249-8196-fef50144e922 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:23.378006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:23.378940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:23.379228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:23.380896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] PATH_INFO: `/v3/users/714ef55ed16f449c815bd9008c73ab30` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:23.386462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714ef55ed16f449c815bd9008c73ab30)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:23.391015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:23.395375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:23.396723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:23.429011 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3684/7361] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:39:23.432417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:23.467330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f31763-2d74-40a1-8a30-4c6a20e09ee6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:23.481518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:23.482435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:23.484875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:23.484875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:23.484875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:23.484875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:23.488224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e558babf-4fea-4dca-b8e3-790fba8b5d72 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:23.493865 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:23.532195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714ef55ed16f449c815bd9008c73ab30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.537422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714ef55ed16f449c815bd9008c73ab30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.567164 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3685/7362] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:23.569605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ef06-a348-45e5-96a5-dccf20e487da None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:23.569922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ef06-a348-45e5-96a5-dccf20e487da None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:23.570266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df6ef06-a348-45e5-96a5-dccf20e487da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:23.573418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714ef55ed16f449c815bd9008c73ab30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.574144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714ef55ed16f449c815bd9008c73ab30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.603105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714ef55ed16f449c815bd9008c73ab30'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:23.687426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4df6ef06-a348-45e5-96a5-dccf20e487da None None] MFA Rules not processed for user `2979d9351aa7452384d086da38a2f794`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:23.690126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3678/7363] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:23 2022] DELETE /identity/v3/users/714ef55ed16f449c815bd9008c73ab30 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:23.691711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4df6ef06-a348-45e5-96a5-dccf20e487da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:23.693920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:23.696420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:24.009925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940c3e0-de61-490b-90c8-22e33a523084 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.042467 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3686/7364] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:23 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:24.047661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.048259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.048785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:24.049272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.052156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.052751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.053221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.055193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:24.059504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:24.113547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] MFA Rules not processed for user `ac9f09236a9a43bebb2be9d6275346b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:24.116253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:24.138437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3679/7365] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:23 2022] POST /identity/v3/projects => generated 369 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:24.149445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:24.242810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3687/7366] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:24.256718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:24.260453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:24.268850 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:24.334813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967a9239-640d-461d-a18e-d90eb0211ad5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.346819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:24.347531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.347819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.348105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.349596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:24.351588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:24.381751 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3680/7367] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:24 2022] POST /identity/v3/users => generated 285 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:24.389275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:24.409434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae123d-d09a-41e8-b413-011bbf7925dd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.420177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e01b9af-fe0a-496f-ae9a-9e73b37dacb7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.434306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:24.436986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.436986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.436986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.436986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:24.438289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:24.497519 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3681/7368] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:24.509272 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:24.523235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:24.550492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa52ad34-fe19-4cd4-bf97-0c1a2a4c9d19 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.572287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:24.574357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.574772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.575274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.577930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:24.583238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:24.584109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.592009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.592481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.593301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:24.595031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:24.637283 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3682/7369] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:24.638214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:24.671470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cacf2-372d-4fe5-9594-b620b5682317 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.683775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8903b26-f659-4c06-991a-b526623d0eb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:24.685071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8903b26-f659-4c06-991a-b526623d0eb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.685355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8903b26-f659-4c06-991a-b526623d0eb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.685688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8903b26-f659-4c06-991a-b526623d0eb4 admin admin] PATH_INFO: `/v3/projects/53ffb0369e3a4b05aadaa93840d21cc8/users/88006946dff84331b75748294fd91966/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.727097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8903b26-f659-4c06-991a-b526623d0eb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ffb0369e3a4b05aadaa93840d21cc8, user_id=88006946dff84331b75748294fd91966, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:24.730882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8903b26-f659-4c06-991a-b526623d0eb4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:24.743845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:24.756432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:24.769315 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3683/7370] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:24 2022] PUT /identity/v3/projects/53ffb0369e3a4b05aadaa93840d21cc8/users/88006946dff84331b75748294fd91966/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:24.772078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:24.772078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:24.773729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:24.804293 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3688/7371] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:24.830982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] MFA Rules not processed for user `88006946dff84331b75748294fd91966`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:24.832717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:24.937436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:24.938972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:24.969707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b29aff-577c-411d-af8f-e54234f53a0f service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:24.982677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3684/7372] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:24 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:39:25.017464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:25.019174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:25.123438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:25.124485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.124839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.125177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] PATH_INFO: `/v3/projects/bd2c3e61296f45f1a91ef71eeefbd529` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.127230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2c3e61296f45f1a91ef71eeefbd529)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:25.129311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:25.177136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379013a0-4ede-4796-858a-ad23bcd6432e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:25.187712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:25.189207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.189751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.190297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.214302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:25.216088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:25.241232 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3685/7373] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:25 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:25.275958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2c3e61296f45f1a91ef71eeefbd529', 'request_id': 'req-b5546294-5200-43a6-be23-156a4eb80f2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:25.294082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2c3e61296f45f1a91ef71eeefbd529', 'request_id': 'req-b5546294-5200-43a6-be23-156a4eb80f2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:25.303878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2c3e61296f45f1a91ef71eeefbd529', 'request_id': 'req-b5546294-5200-43a6-be23-156a4eb80f2b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:25.306928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:25.309284 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:25.321835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea75fb8d-1139-46e3-ab78-4f39697f735a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:25.338730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] The token cache is being invalidate because project bd2c3e61296f45f1a91ef71eeefbd529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:25.339032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:25.339816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b5546294-5200-43a6-be23-156a4eb80f2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:25.345356 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3689/7374] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:24 2022] DELETE /identity/v3/projects/bd2c3e61296f45f1a91ef71eeefbd529 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:25.358377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.358544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.358750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.367278 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:25.438510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:25.443959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:25.453542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:25.454573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.455001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.455432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.462674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:25.510473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:25.511956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62353ad-c419-4fbe-b2cc-e429382518b5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:25.538244 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3686/7375] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:25.582112 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3690/7376] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:25.589917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.590490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.590794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.622558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:25.623714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:25.650226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3687/7377] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:25.651588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:25.671081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d240dda-ed0e-4ced-81bd-24fe5ac43426 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:25.685107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:25.686020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.686300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.686572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.687330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:25.687639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:25.699535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:25.747526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:25.752621 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3691/7378] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:25.758951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca09d8-c1d4-4c7d-80cd-5fe681c0c18d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:25.785996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:25.786948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:25.787476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:25.787902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:25.788807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:25.790916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:25.854447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3688/7379] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:25 2022] POST /identity/v3/projects => generated 399 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:25.861530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:25.879245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152375c-b13d-4c68-9389-628eadc668fa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.011967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.012920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.013096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.013335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.014048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.016289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.045095 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3692/7380] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:25 2022] POST /identity/v3/users => generated 300 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:26.049428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:26.081704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab8d39a-cecf-46d7-84bd-4a50fd7936af admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.104219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.105297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.105702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.106197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.107364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.109356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.124538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3689/7381] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:26.129069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:26.142386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f783805-92e3-442c-8f7f-56c6a909312a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.148455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85a3a37-ecc4-41f9-8b2f-981c12610560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.149586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3a37-ecc4-41f9-8b2f-981c12610560 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.150072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3a37-ecc4-41f9-8b2f-981c12610560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.150740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85a3a37-ecc4-41f9-8b2f-981c12610560 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.151707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a3a37-ecc4-41f9-8b2f-981c12610560 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.153682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85a3a37-ecc4-41f9-8b2f-981c12610560 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.169905 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3693/7382] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:39:26.174085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:26.232040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd2eaa5-a0e8-4cf1-82c8-34fd61ec8f72 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.248067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.249810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.250214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.250627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] PATH_INFO: `/v3/projects/136e4ed47afb4b138f79e7c3758a2bfb/users/a9668e2091e04be08781e959f18b25c7/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.294456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=136e4ed47afb4b138f79e7c3758a2bfb, user_id=a9668e2091e04be08781e959f18b25c7, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.299717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.336703 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3690/7383] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:26 2022] PUT /identity/v3/projects/136e4ed47afb4b138f79e7c3758a2bfb/users/a9668e2091e04be08781e959f18b25c7/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:26.352954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.353383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.354168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.372464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:26.375107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:26.418564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] MFA Rules not processed for user `a9668e2091e04be08781e959f18b25c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:26.424409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:26.573353 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:26.609272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29296b7-0751-4e32-99a9-ca8f9a554b78 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.617346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.618258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.618544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.618827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] PATH_INFO: `/v3/projects/3a5529c1a5fc48e59009e3eacaf525ff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.621635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a5529c1a5fc48e59009e3eacaf525ff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.624186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.628530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3694/7384] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:26.633096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:26.649539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c385932-e31a-4307-9a72-38c5debfafe1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.658031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.659061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.659490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.659910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.661720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.664154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.716534 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3695/7385] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:26 2022] POST /identity/v3/projects => generated 399 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:26.721182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:26.746550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a5529c1a5fc48e59009e3eacaf525ff', 'request_id': 'req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:26.757946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a5529c1a5fc48e59009e3eacaf525ff', 'request_id': 'req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:26.772844 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:26.781122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a5529c1a5fc48e59009e3eacaf525ff', 'request_id': 'req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:26.806882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] The token cache is being invalidate because project 3a5529c1a5fc48e59009e3eacaf525ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:26.820540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:26.821717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2de5f48-e8fb-46b9-85fc-6f1cfd42d120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:26.830208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3691/7386] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:26 2022] DELETE /identity/v3/projects/3a5529c1a5fc48e59009e3eacaf525ff => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:26.834824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a827-34b8-42a2-b4d5-18c2b83bcc74 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.840034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a827-34b8-42a2-b4d5-18c2b83bcc74 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.840574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480a827-34b8-42a2-b4d5-18c2b83bcc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.879708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d480a827-34b8-42a2-b4d5-18c2b83bcc74 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:26.881731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d480a827-34b8-42a2-b4d5-18c2b83bcc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:26.917208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23321bf-e83b-4dd1-95b3-a12bcb973489 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:26.917984 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3692/7387] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:26.919880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.922191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.922666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.942891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:26.943878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:26.944165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:26.944463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:26.945876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:26.947881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:26.971307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:26.974354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:26.998286 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3693/7388] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:27.002132 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3696/7389] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:26 2022] POST /identity/v3/users => generated 306 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:39:27.002132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.003568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.009572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:27.029388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec21ffdf-46f8-4053-81c7-e79a27dba6e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.040663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5dd0fb-94ac-4c5f-91a6-2b5ac8c57887 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.057014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.058497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.058992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.059587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.060546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.065308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.080034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.080809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.081094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.081371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.087247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:27.087671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.089387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.100773 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3694/7390] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:27.102162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.126432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d8bdd-ba24-4112-ad12-7ad508566a95 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.135594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.142500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.143283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.143860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] PATH_INFO: `/v3/projects/58f2e0e63a0d4a70908f649e08ee4a4a/users/2bb0ade520c840a5956afa6ac411aeab/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.150997 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3697/7391] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:27.155176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.173795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f2e0e63a0d4a70908f649e08ee4a4a, user_id=2bb0ade520c840a5956afa6ac411aeab, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.177021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.187487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d143fb4-8f2f-4ce8-b958-04b2db206e8d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.202575 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3695/7392] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:27 2022] PUT /identity/v3/projects/58f2e0e63a0d4a70908f649e08ee4a4a/users/2bb0ade520c840a5956afa6ac411aeab/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:27.208021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.211702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.212430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.212862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.213143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.213863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.224634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.282850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3698/7393] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:27 2022] POST /identity/v3/projects => generated 399 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:27.288187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.334444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1a31d9-1184-4dc7-89cd-fbcc5f90dbaf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.448000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.449100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.449765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.450225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.452522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.455959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669efaf-b9b1-4a3e-8fec-1308f5b689e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.456666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.480634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.481648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.489314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.489617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.492438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.494457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.510361 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3696/7394] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:27.511697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.525249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c2fb89-fe0d-44f4-80da-fcb5b765f28f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.534254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8491dcc-f6be-4818-a024-2d8340500ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.536248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491dcc-f6be-4818-a024-2d8340500ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.537415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491dcc-f6be-4818-a024-2d8340500ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.537972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8491dcc-f6be-4818-a024-2d8340500ce9 admin admin] PATH_INFO: `/v3/projects/58f2e0e63a0d4a70908f649e08ee4a4a/users/2bb0ade520c840a5956afa6ac411aeab/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.543536 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3699/7395] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:27 2022] POST /identity/v3/users => generated 300 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:27.544664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8491dcc-f6be-4818-a024-2d8340500ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58f2e0e63a0d4a70908f649e08ee4a4a, user_id=2bb0ade520c840a5956afa6ac411aeab, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.544781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.548193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8491dcc-f6be-4818-a024-2d8340500ce9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.565094 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3697/7396] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:27 2022] PUT /identity/v3/projects/58f2e0e63a0d4a70908f649e08ee4a4a/users/2bb0ade520c840a5956afa6ac411aeab/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:27.575251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.575649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42612ea0-2d92-4843-84f7-647e2edc99ed admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.576239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.576771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.584789 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:27.657400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] MFA Rules not processed for user `2bb0ade520c840a5956afa6ac411aeab`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:27.658816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:27.706634 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:27.755040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.755856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.761877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.762761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.764831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.767859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.792392 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3700/7397] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:27.794843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.813281 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3698/7398] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:27.822405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592d16d-6c62-4177-af68-78cdc3c50354 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.826799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.829437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:27.831716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.832663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.833133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.834807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.835437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.837541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.856306 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3701/7399] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:27.859042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:27.879077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b439dd3a-f4a9-4225-bbac-f3dc504dcc20 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.888162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6edfed-b734-411d-a76e-610839ddd623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:27.891522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6edfed-b734-411d-a76e-610839ddd623 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.891898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6edfed-b734-411d-a76e-610839ddd623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.892187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6edfed-b734-411d-a76e-610839ddd623 admin admin] PATH_INFO: `/v3/projects/444d1381e56e45bf868e82158b388e87/users/c4d9294c462e4024a4cb1edd70069fc4/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.929106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6edfed-b734-411d-a76e-610839ddd623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=444d1381e56e45bf868e82158b388e87, user_id=c4d9294c462e4024a4cb1edd70069fc4, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:27.932934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6edfed-b734-411d-a76e-610839ddd623 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:27.950889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c9c939-b5d9-4795-97d4-d489ebc4b25d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:27.965213 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3702/7400] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:27 2022] PUT /identity/v3/projects/444d1381e56e45bf868e82158b388e87/users/c4d9294c462e4024a4cb1edd70069fc4/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:27.967258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:27.967769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:27.968266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:27.997811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] MFA Rules not processed for user `c4d9294c462e4024a4cb1edd70069fc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:27.999421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:28.088808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:28.089301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:28.089398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:28.089632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:28.137839 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3703/7401] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:28.176662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:28.194721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:28.255329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb671b70-ba09-4ba1-aea2-42955980430e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:28.275585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:28.276494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:28.276786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:28.277162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:28.305418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:28.310550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:28.313369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:28.314998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:28.347295 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3699/7402] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:27 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:28.377359 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3704/7403] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:28.604256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:28.626841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b6b00-db58-400a-9d47-c73c88d2d04a service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:28.645671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:28.646384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:28.646669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:28.647971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:28.649222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:28.728213 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:28.931299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:28.931491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac38da1-b22a-487f-9a70-c73135358ff9 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:28.956290 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3700/7404] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:38.335424 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=78,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:38.943564 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=18 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:42.064514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:42.309196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ee88d2-9bb0-40c7-bbb2-340678af3cb2 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:42.330731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:42.332200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:42.332200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:42.338156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] PATH_INFO: `/v3/users/a9668e2091e04be08781e959f18b25c7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:42.340041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9668e2091e04be08781e959f18b25c7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:42.347877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:42.484858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9668e2091e04be08781e959f18b25c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:42.502124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9668e2091e04be08781e959f18b25c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:42.534137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9668e2091e04be08781e959f18b25c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:42.537879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9668e2091e04be08781e959f18b25c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:42.558830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9668e2091e04be08781e959f18b25c7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:42.578695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3705/7405] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:42 2022] DELETE /identity/v3/users/a9668e2091e04be08781e959f18b25c7 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:42.583380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:42.584547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:42.585076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:42.644241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:42.645699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:42.898133 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3701/7406] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:42.975877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:42.977577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:43.205586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f36e75-172a-4555-97bb-aefcba346277 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:43.213344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:43.214646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:43.214646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:43.215046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:43.243911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:43.246780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:43.288246 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3706/7407] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:45.637461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:45.641427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:45.720691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6bdb27-e234-4db6-9daf-3cdf4b14c735 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:45.744839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:45.745673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:45.746235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:45.746235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] PATH_INFO: `/v3/projects/136e4ed47afb4b138f79e7c3758a2bfb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:45.756742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=136e4ed47afb4b138f79e7c3758a2bfb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:45.758885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:45.983059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '136e4ed47afb4b138f79e7c3758a2bfb', 'request_id': 'req-fd8a61b2-575c-40d3-ab7d-0756206910ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.016019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '136e4ed47afb4b138f79e7c3758a2bfb', 'request_id': 'req-fd8a61b2-575c-40d3-ab7d-0756206910ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.040191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '136e4ed47afb4b138f79e7c3758a2bfb', 'request_id': 'req-fd8a61b2-575c-40d3-ab7d-0756206910ef'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.075688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] The token cache is being invalidate because project 136e4ed47afb4b138f79e7c3758a2bfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:46.076061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.078412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.081721 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3702/7408] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:45 2022] DELETE /identity/v3/projects/136e4ed47afb4b138f79e7c3758a2bfb => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:46.085616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:46.098991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc366f-d2ee-4dad-acf0-e2baed0b18ff service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:46.145925 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:46.241469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:46.243776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:46.244505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:46.245020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] PATH_INFO: `/v3/users/2bb0ade520c840a5956afa6ac411aeab` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:46.249815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bb0ade520c840a5956afa6ac411aeab)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:46.256272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:46.374939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bb0ade520c840a5956afa6ac411aeab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.393791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bb0ade520c840a5956afa6ac411aeab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.417253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bb0ade520c840a5956afa6ac411aeab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.418242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bb0ade520c840a5956afa6ac411aeab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.436513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-68e923ad-9216-40d4-aa25-8d235481a107 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bb0ade520c840a5956afa6ac411aeab'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:46.455011 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3707/7409] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:46 2022] DELETE /identity/v3/users/2bb0ade520c840a5956afa6ac411aeab => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:49.325232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:49.327376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:49.360787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a61b2-575c-40d3-ab7d-0756206910ef admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:49.594375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93512010-2491-4727-ac05-90af11269936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:49.595286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512010-2491-4727-ac05-90af11269936 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:49.595571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512010-2491-4727-ac05-90af11269936 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:49.596045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93512010-2491-4727-ac05-90af11269936 admin admin] PATH_INFO: `/v3/projects/58f2e0e63a0d4a70908f649e08ee4a4a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:49.605830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512010-2491-4727-ac05-90af11269936 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58f2e0e63a0d4a70908f649e08ee4a4a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:49.608661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93512010-2491-4727-ac05-90af11269936 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:49.676855 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:49.721175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93512010-2491-4727-ac05-90af11269936 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58f2e0e63a0d4a70908f649e08ee4a4a', 'request_id': 'req-93512010-2491-4727-ac05-90af11269936'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:49.740834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93512010-2491-4727-ac05-90af11269936 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58f2e0e63a0d4a70908f649e08ee4a4a', 'request_id': 'req-93512010-2491-4727-ac05-90af11269936'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:49.753516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93512010-2491-4727-ac05-90af11269936 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58f2e0e63a0d4a70908f649e08ee4a4a', 'request_id': 'req-93512010-2491-4727-ac05-90af11269936'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:49.781844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93512010-2491-4727-ac05-90af11269936 admin admin] The token cache is being invalidate because project 58f2e0e63a0d4a70908f649e08ee4a4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:49.782234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93512010-2491-4727-ac05-90af11269936 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:49.783000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-93512010-2491-4727-ac05-90af11269936 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:49.785163 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3703/7410] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:49 2022] DELETE /identity/v3/projects/58f2e0e63a0d4a70908f649e08ee4a4a => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:49.790698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:49.791303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:49.791503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:49.865296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:49.868634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:50.044555 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3708/7411] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:50.049385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.050271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.050708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.105143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:50.106452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:50.122512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.124362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:50.130182 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3704/7412] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:50.134211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.153788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763a0540-41b3-401d-9bea-a22e41ef522d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.155309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b5c789-b126-4f88-a043-e95222dd49d0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.168805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.169491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.169785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.170066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.170818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:50.171225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.171778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.172815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.172995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:50.179243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.179796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] PATH_INFO: `/v3/users/c4d9294c462e4024a4cb1edd70069fc4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.184852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4d9294c462e4024a4cb1edd70069fc4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.187244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:50.203678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3705/7413] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:39:50.207587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.230841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471bb62-484d-436a-b412-6bfd673eca91 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.258433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.272308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.272732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.272973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.273748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.275752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:50.288329 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:50.313096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4d9294c462e4024a4cb1edd70069fc4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:50.328408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4d9294c462e4024a4cb1edd70069fc4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:50.366948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4d9294c462e4024a4cb1edd70069fc4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:50.371198 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3706/7414] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:50 2022] POST /identity/v3/projects => generated 407 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:50.372029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4d9294c462e4024a4cb1edd70069fc4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:50.376282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.380439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:50.396152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-381dbfdd-9e30-4245-a9ee-5e8b392b8002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4d9294c462e4024a4cb1edd70069fc4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:50.419505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3709/7415] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:39:50 2022] DELETE /identity/v3/users/c4d9294c462e4024a4cb1edd70069fc4 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:39:50.426189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.426869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.427356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.463268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:50.464806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:50.582816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95395c69-b6d6-416c-8316-b05e570c7fe8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.634416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3710/7416] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:50.645176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.646416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:50.740626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.741533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.741966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.742381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.743254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.748692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:50.798159 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3707/7417] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:50 2022] POST /identity/v3/users => generated 304 bytes in 422 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:50.803151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.833519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e254ce-52e6-49be-a825-9d32fd20a381 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.835565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e27a09-614a-44c8-8ce8-8c5775427bb4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.843836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.844560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.844848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.845124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.851937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.852743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.853573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.853930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.855670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.859670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:50.872634 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:50.884603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.888602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:50.907029 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3708/7418] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:50.912534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:50.938703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e2d03f-b966-412b-add5-4ee47a2da6bc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:50.948963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3711/7419] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:39:50.953305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2cca23-68c1-45ef-ae02-af5a322cb084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:50.953505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cca23-68c1-45ef-ae02-af5a322cb084 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:50.953630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cca23-68c1-45ef-ae02-af5a322cb084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:50.953920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2cca23-68c1-45ef-ae02-af5a322cb084 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:50.958029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cca23-68c1-45ef-ae02-af5a322cb084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:50.959839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2cca23-68c1-45ef-ae02-af5a322cb084 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:51.023866 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3709/7420] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:50 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:51.028481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:51.053354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c4494-b7e9-4dae-b51e-b9e800faaa42 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:51.071778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:51.078286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:51.078726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:51.081669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] PATH_INFO: `/v3/projects/bcb744b8fba24e9ab2d52fef245801da/users/930a8742a434496ca8c6cb4be58ca594/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:51.142543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcb744b8fba24e9ab2d52fef245801da, user_id=930a8742a434496ca8c6cb4be58ca594, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:51.148191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:51.204937 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3712/7421] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:51 2022] PUT /identity/v3/projects/bcb744b8fba24e9ab2d52fef245801da/users/930a8742a434496ca8c6cb4be58ca594/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:51.215587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:51.215869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:51.216145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:51.338073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] MFA Rules not processed for user `930a8742a434496ca8c6cb4be58ca594`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:51.339314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:51.526711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3710/7422] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:51 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:51.530720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:51.636550 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:51.719004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10bc9f-1a57-44d8-8d49-b72ea85ef83b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:51.727980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:51.729092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:51.729911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:51.729911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:51.730747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:51.733064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:51.810863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3713/7423] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:51 2022] POST /identity/v3/projects => generated 409 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:39:51.816691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:51.832773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d16271-efe9-4f7e-b6d3-2b1d6a25f738 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:52.004567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:52.005367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.005756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.006175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.007169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:52.009339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:52.088285 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3711/7424] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:51 2022] POST /identity/v3/users => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:52.092044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:52.106961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173334f-82e2-451e-80bb-feced9886d42 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:52.117762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:52.122871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.123684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.124091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.125071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:52.126882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:52.157606 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3714/7425] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:52.161718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:52.177486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38650d3-8031-44fb-8441-c418d2adfa77 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:52.196301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:52.197434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.197824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.198328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] PATH_INFO: `/v3/projects/9ec86cb2223f411ababc9bcccec45e07/users/f4b0183038b249d9b2bb52e14acf6e3d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.230938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec86cb2223f411ababc9bcccec45e07, user_id=f4b0183038b249d9b2bb52e14acf6e3d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:52.238557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:52.273384 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3712/7426] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:52 2022] PUT /identity/v3/projects/9ec86cb2223f411ababc9bcccec45e07/users/f4b0183038b249d9b2bb52e14acf6e3d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:52.277308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:52.296162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af3de8-6a19-401d-af9a-b82f29d80ae5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:52.454094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c7df3c-cfcf-4427-b59d-8e75884320e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:52.454976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7df3c-cfcf-4427-b59d-8e75884320e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.455370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7df3c-cfcf-4427-b59d-8e75884320e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.455748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c7df3c-cfcf-4427-b59d-8e75884320e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.456640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7df3c-cfcf-4427-b59d-8e75884320e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:52.458386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c7df3c-cfcf-4427-b59d-8e75884320e9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:52.489668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:52.490457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3715/7427] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:52 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:52.505438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7489f3-4878-46d6-8b21-cf305a956e6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:52.514762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:52.516793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.517295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.517780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] PATH_INFO: `/v3/projects/9ec86cb2223f411ababc9bcccec45e07/users/f4b0183038b249d9b2bb52e14acf6e3d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.522082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ec86cb2223f411ababc9bcccec45e07, user_id=f4b0183038b249d9b2bb52e14acf6e3d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:52.528959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:52.558964 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3713/7428] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:52 2022] PUT /identity/v3/projects/9ec86cb2223f411ababc9bcccec45e07/users/f4b0183038b249d9b2bb52e14acf6e3d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:52.568872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.569487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.569980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.619258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] MFA Rules not processed for user `f4b0183038b249d9b2bb52e14acf6e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:52.620668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:52.759146 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3716/7429] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:52.771977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:52.773905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:52.858254 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:52.931428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e12542-073d-40b9-94bf-ffddc751dc54 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:52.945387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:52.947726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:52.948181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:52.948692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:52.967534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:52.970538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:53.002614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3714/7430] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:52 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:53.399763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:53.427136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f510d-7a01-475c-9fda-9b5e99cad584 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:53.457336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1efd8-49d3-417c-8b01-1d873f61a00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:53.460546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1efd8-49d3-417c-8b01-1d873f61a00a service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:53.461000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1efd8-49d3-417c-8b01-1d873f61a00a service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:53.461873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1efd8-49d3-417c-8b01-1d873f61a00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:53.541169 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:53.658238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1efd8-49d3-417c-8b01-1d873f61a00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:53.659749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1efd8-49d3-417c-8b01-1d873f61a00a service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:53.702402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3717/7431] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:39:54.331894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:54.336332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:54.573350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afffbe94-303d-4b81-bfba-ab17b3d6b964 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:54.596992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:54.612024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:54.613981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:54.618230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] PATH_INFO: `/v3/projects/444d1381e56e45bf868e82158b388e87` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:54.631190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] RBAC: Authorizing `identity:delete_project(project_id=444d1381e56e45bf868e82158b388e87)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:54.642040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:54.892383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '444d1381e56e45bf868e82158b388e87', 'request_id': 'req-9030429d-d7e7-45fd-ade4-551b09afe90f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:54.954446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '444d1381e56e45bf868e82158b388e87', 'request_id': 'req-9030429d-d7e7-45fd-ade4-551b09afe90f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:55.007707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '444d1381e56e45bf868e82158b388e87', 'request_id': 'req-9030429d-d7e7-45fd-ade4-551b09afe90f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:55.071823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] The token cache is being invalidate because project 444d1381e56e45bf868e82158b388e87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:39:55.072730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:55.073430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9030429d-d7e7-45fd-ade4-551b09afe90f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:39:55.084877 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3715/7432] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:39:54 2022] DELETE /identity/v3/projects/444d1381e56e45bf868e82158b388e87 => generated 0 bytes in 753 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:55.094687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:55.095354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:55.095689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:55.174652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:55.177015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:55.397880 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3718/7433] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:39:55.418059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:55.418494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:55.418611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:55.485569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:55.486897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:55.533921 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3716/7434] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:55.542373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:55.573735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdafcca-45df-405c-ba33-13fdd753df1f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:55.602108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:55.602969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:55.603076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:55.603343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:55.610356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:39:55.610557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:55.616648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:55.668367 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3719/7435] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:39:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:39:55.679908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:55.706298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1539339d-2e03-4038-8979-ab0e49b6ef91 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:55.768013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:55.777075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:55.777478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:55.777990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:55.800290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:55.813162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:56.007746 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3717/7436] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:39:55 2022] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:56.008758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:56.030325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9e092-a892-4ea9-86da-4729fcf79ab2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:56.445550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:56.446388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:56.446545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:56.446827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:56.447543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:56.449531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:56.507255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:56.519552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3720/7437] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:39:56 2022] POST /identity/v3/users => generated 290 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:39:56.532102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fff6440-419d-4ed4-9f34-9e9615088c70 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:56.550853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:56.556255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:56.557803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:56.558131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:56.561515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:56.567767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:56.610830 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3718/7438] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:39:56.618596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:56.643124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ee33d-4cd2-4abc-ba35-b31dda87537d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:56.649337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfe914-b2cd-4055-bf99-819fdc84efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:56.650048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe914-b2cd-4055-bf99-819fdc84efb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:56.650326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe914-b2cd-4055-bf99-819fdc84efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:56.650604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfe914-b2cd-4055-bf99-819fdc84efb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:56.651886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe914-b2cd-4055-bf99-819fdc84efb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:56.653981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcfe914-b2cd-4055-bf99-819fdc84efb1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:56.677989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3721/7439] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:39:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:39:56.682049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:56.697912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d51cbe-5e45-418e-8e89-b81c6b3c9da0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:56.717202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:56.718194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:56.718484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:56.718929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] PATH_INFO: `/v3/projects/a2d2222960cf4dbaa5bc2a2021e42dab/users/2f79341afb0c4d758e7a3184d385494d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:56.776470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d2222960cf4dbaa5bc2a2021e42dab, user_id=2f79341afb0c4d758e7a3184d385494d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:56.780672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:56.801697 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:56.817033 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3719/7440] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:39:56 2022] PUT /identity/v3/projects/a2d2222960cf4dbaa5bc2a2021e42dab/users/2f79341afb0c4d758e7a3184d385494d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:39:56.821481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823471f-3f0a-42f8-98e8-d1122099d970 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:56.821776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823471f-3f0a-42f8-98e8-d1122099d970 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:56.822059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823471f-3f0a-42f8-98e8-d1122099d970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:56.861538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8823471f-3f0a-42f8-98e8-d1122099d970 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:39:56.867039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8823471f-3f0a-42f8-98e8-d1122099d970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:56.976817 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:39:57.118176 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3722/7441] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:39:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:39:57.148740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:39:57.151010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:39:57.418233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e458ad-115e-4e07-aac1-4456ee50a13b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:39:57.434557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:39:57.435540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:39:57.435540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:39:57.440065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:39:57.451567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:39:57.453159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:39:57.473271 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3720/7442] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:39:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:02.616214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:02.617077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:02.617523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:02.685518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] MFA Rules not processed for user `2f79341afb0c4d758e7a3184d385494d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:02.687104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:02.802822 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3723/7443] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:02.808794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:02.825824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5edb17-8151-4d27-aae9-caadf04e93a9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:02.854538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:02.861851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:02.862183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:02.862451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:02.863500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:02.883307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:02.971945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3721/7444] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:40:02 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:40:02.975108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:03.006910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf0b875-ac5b-4307-8849-31573e2da29a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:03.225370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:03.226771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:03.227263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:03.229729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:03.230937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:03.236134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:03.293950 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3724/7445] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:40:02 2022] POST /identity/v3/users => generated 296 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:03.295143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:03.314605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e0dbc-8867-4c55-af20-5e0d8ec03c18 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:03.322838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:03.323556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:03.323841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:03.325685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:03.326546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:03.331708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:03.347404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3722/7446] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:40:03.353517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:03.370883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de6e543-5e1e-44a9-9190-c6650045ae68 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:03.390414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:03.391756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:03.392901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:03.393296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] PATH_INFO: `/v3/projects/17c0f8032bbe47448fa272dfb761b164/users/14712ef6f4954579ab433bb29cb62f84/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:03.422063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c0f8032bbe47448fa272dfb761b164, user_id=14712ef6f4954579ab433bb29cb62f84, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:03.426068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:03.450602 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3725/7447] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:03 2022] PUT /identity/v3/projects/17c0f8032bbe47448fa272dfb761b164/users/14712ef6f4954579ab433bb29cb62f84/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:03.457000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:03.470223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c48239-8ee2-441e-a411-885aa1a32b21 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:03.665046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:03.665755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:03.666044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:03.666326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:03.667068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:03.669360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:03.699684 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3723/7448] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:03 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:03.704711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:03.720091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0556f60-e080-47d4-b6e4-3ab4d72852f9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:03.731611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:03.732742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:03.733278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:03.733554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] PATH_INFO: `/v3/projects/17c0f8032bbe47448fa272dfb761b164/users/14712ef6f4954579ab433bb29cb62f84/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:03.737305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17c0f8032bbe47448fa272dfb761b164, user_id=14712ef6f4954579ab433bb29cb62f84, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:03.744854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:03.771738 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3726/7449] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:03 2022] PUT /identity/v3/projects/17c0f8032bbe47448fa272dfb761b164/users/14712ef6f4954579ab433bb29cb62f84/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:04.057624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:04.064467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:04.212050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b70d3-e6f0-4c60-8d2b-eb0209eb2806 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:04.273442 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:04.356957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:04.358242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:04.359103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:04.360550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:04.366737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:04.515524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:04.521442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec9a1c-581f-46bd-9ea7-ed355cd215c6 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:04.555961 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3724/7450] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:04 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:09.353657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:09.355421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:09.403746 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:09.406279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb103a-3230-4b68-9e6b-0bf90df3341b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:09.406763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb103a-3230-4b68-9e6b-0bf90df3341b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:09.407091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb103a-3230-4b68-9e6b-0bf90df3341b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:09.474523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3cfb103a-3230-4b68-9e6b-0bf90df3341b None None] MFA Rules not processed for user `14712ef6f4954579ab433bb29cb62f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:09.477336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3cfb103a-3230-4b68-9e6b-0bf90df3341b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:09.586370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f4391-8498-4b0e-bb6a-e58cef31e331 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:09.611447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:09.615820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:09.617489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:09.619402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:09.627327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:09.692210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:09.702317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:09.764838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3725/7451] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:40:09.778004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3727/7452] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:09.917628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:09.917922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:09.918204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:09.971342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] MFA Rules not processed for user `2f79341afb0c4d758e7a3184d385494d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:09.973908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:10.211961 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:10.250098 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3726/7453] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:10.259082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:10.260561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:10.301858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0094d4-5100-4660-b19f-9062bb967756 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:10.316212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:10.316936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:10.317216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:10.317491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:10.336148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:10.337879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:10.350937 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3728/7454] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:11.572585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:11.766050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c41869-8a8c-4a59-ade2-bf333d7ec325 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:11.771881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:11.774844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:11.776339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:11.776656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:11.783536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:11.812752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:11.814504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:11.832590 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3727/7455] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:13.531752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:13.537494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:13.757679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1f7af6-aa91-4f1e-85ff-347302dccf97 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:13.774802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:13.776554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:13.777509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:13.778074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] PATH_INFO: `/v3/users/930a8742a434496ca8c6cb4be58ca594` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:13.801850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] RBAC: Authorizing `identity:delete_user(user_id=930a8742a434496ca8c6cb4be58ca594)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:13.806372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:13.899606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:13.902118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:13.948849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930a8742a434496ca8c6cb4be58ca594'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:13.967925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930a8742a434496ca8c6cb4be58ca594'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:13.995281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930a8742a434496ca8c6cb4be58ca594'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:13.996729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930a8742a434496ca8c6cb4be58ca594'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:14.018725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2a67c4f8-47e8-44d7-882e-dc6e0425d95d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930a8742a434496ca8c6cb4be58ca594'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:14.028432 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3729/7456] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:13 2022] DELETE /identity/v3/users/930a8742a434496ca8c6cb4be58ca594 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:14.033210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:14.033210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:14.033478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:14.091025 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:14.105059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebb4de5-2f84-4bc7-aec3-d5ff2e4d0ae3 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:14.127099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:14.132862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:14.342500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:14.343417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:14.354148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:14.354632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:14.365294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:14.373701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3730/7457] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:14.416403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:14.418259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:14.452895 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3728/7458] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:40:14.653473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:14.655720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:14.871136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ce687-8dd1-49b3-bf93-2392bc13c0f3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:14.879575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225769b9-f90f-4063-9e45-1c669913c09c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:14.880364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225769b9-f90f-4063-9e45-1c669913c09c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:14.880740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225769b9-f90f-4063-9e45-1c669913c09c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:14.881126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225769b9-f90f-4063-9e45-1c669913c09c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:14.910969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225769b9-f90f-4063-9e45-1c669913c09c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:14.912437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225769b9-f90f-4063-9e45-1c669913c09c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:14.932245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3731/7459] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:19.407772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:19.410521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:19.442419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6822a5-99ad-4e52-a226-60dcb7bd0ef1 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:19.451770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:19.453856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:19.455225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:19.459675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] PATH_INFO: `/v3/users/52ccd655495c43c8b1d817a2a38f505c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:19.462055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ccd655495c43c8b1d817a2a38f505c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:19.467500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:19.582240 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:19.622205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ccd655495c43c8b1d817a2a38f505c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:19.623052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ccd655495c43c8b1d817a2a38f505c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:19.642165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ccd655495c43c8b1d817a2a38f505c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:19.642924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ccd655495c43c8b1d817a2a38f505c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:19.659074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ccd655495c43c8b1d817a2a38f505c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:19.703431 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3729/7460] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:19 2022] DELETE /identity/v3/users/52ccd655495c43c8b1d817a2a38f505c => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:19.708246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:19.708721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:19.709188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:19.779375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:19.785062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:19.989586 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3732/7461] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:20.008239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:20.009953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:20.162707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:20.164427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:20.176638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997be17f-2656-4273-8d5b-accba8d8508c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:20.194361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:20.195053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:20.195340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:20.195698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:20.198075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc680ca2-d638-481a-8607-10f4bb105302 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:20.224463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:20.234708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:20.237239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:20.237886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] PATH_INFO: `/v3/projects/bcb744b8fba24e9ab2d52fef245801da` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:20.247757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcb744b8fba24e9ab2d52fef245801da)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:20.254038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:20.257993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:20.263056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:20.301573 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3730/7462] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:20.486051 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:20.498923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcb744b8fba24e9ab2d52fef245801da', 'request_id': 'req-63759607-2c26-4d45-b8c1-9c63013a6f28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.523455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcb744b8fba24e9ab2d52fef245801da', 'request_id': 'req-63759607-2c26-4d45-b8c1-9c63013a6f28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.539220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcb744b8fba24e9ab2d52fef245801da', 'request_id': 'req-63759607-2c26-4d45-b8c1-9c63013a6f28'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.577646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] The token cache is being invalidate because project bcb744b8fba24e9ab2d52fef245801da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:20.579344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.580694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.586232 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3733/7463] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:20 2022] DELETE /identity/v3/projects/bcb744b8fba24e9ab2d52fef245801da => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:20.590154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:20.609528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204c1512-350c-4e72-815e-56e02579d7f2 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:20.815497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:20.819792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:20.820106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:20.820451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] PATH_INFO: `/v3/users/f4b0183038b249d9b2bb52e14acf6e3d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:20.827917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b0183038b249d9b2bb52e14acf6e3d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:20.829981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:20.950569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b0183038b249d9b2bb52e14acf6e3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.951925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b0183038b249d9b2bb52e14acf6e3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.960383 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:20.971044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b0183038b249d9b2bb52e14acf6e3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.972278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b0183038b249d9b2bb52e14acf6e3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:20.991875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b0183038b249d9b2bb52e14acf6e3d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.037771 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3731/7464] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:20 2022] DELETE /identity/v3/users/f4b0183038b249d9b2bb52e14acf6e3d => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:21.109086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:21.111216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:21.139628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63759607-2c26-4d45-b8c1-9c63013a6f28 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:21.384886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:21.399274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:21.400876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:21.401348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] PATH_INFO: `/v3/projects/22d874624d3c4936a30ff19516a3015e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:21.404134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d874624d3c4936a30ff19516a3015e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:21.407773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:21.518114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d874624d3c4936a30ff19516a3015e', 'request_id': 'req-2c6a0b9b-917f-4939-bef1-24695089e283'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.544193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d874624d3c4936a30ff19516a3015e', 'request_id': 'req-2c6a0b9b-917f-4939-bef1-24695089e283'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.554399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d874624d3c4936a30ff19516a3015e', 'request_id': 'req-2c6a0b9b-917f-4939-bef1-24695089e283'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.580919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] The token cache is being invalidate because project 22d874624d3c4936a30ff19516a3015e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:21.581205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.585149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.587776 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3734/7465] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:21 2022] DELETE /identity/v3/projects/22d874624d3c4936a30ff19516a3015e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:21.592163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:21.594331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:21.624866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f2a47f-b731-446e-8f36-b7bd8c5411b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:21.720758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:21.722130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:21.722561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:21.723033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] PATH_INFO: `/v3/users/8db20e85f10348e68639cdb1c6b360ae` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:21.724510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8db20e85f10348e68639cdb1c6b360ae)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:21.727259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:21.730852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:21.732883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:21.764689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6a0b9b-917f-4939-bef1-24695089e283 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:21.777768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:21.778283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:21.778608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:21.778869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] PATH_INFO: `/v3/projects/9ec86cb2223f411ababc9bcccec45e07` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:21.782842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ec86cb2223f411ababc9bcccec45e07)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:21.792224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:21.854572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8db20e85f10348e68639cdb1c6b360ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.856885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8db20e85f10348e68639cdb1c6b360ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.877715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8db20e85f10348e68639cdb1c6b360ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.878613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8db20e85f10348e68639cdb1c6b360ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.895521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-50251d30-a937-4e3e-8957-2e953d579e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8db20e85f10348e68639cdb1c6b360ae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.925733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ec86cb2223f411ababc9bcccec45e07', 'request_id': 'req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.947998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ec86cb2223f411ababc9bcccec45e07', 'request_id': 'req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.948571 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3732/7466] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:21 2022] DELETE /identity/v3/users/8db20e85f10348e68639cdb1c6b360ae => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:21.956313 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:21.968131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ec86cb2223f411ababc9bcccec45e07', 'request_id': 'req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:21.997668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] The token cache is being invalidate because project 9ec86cb2223f411ababc9bcccec45e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:21.998814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.000437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b4ba1fb0-9d9b-457a-bbaf-5053f7a2d053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.008445 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3735/7467] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:21 2022] DELETE /identity/v3/projects/9ec86cb2223f411ababc9bcccec45e07 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:22.010876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.011160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.011443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.068064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:22.074374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:22.162886 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:22.226141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.226682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.226785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.231227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3733/7468] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:22.300360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:22.306835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:22.357025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:22.359292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:22.376970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3736/7469] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:22.381217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:22.413038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d0cc8-1849-4701-830e-84686d1782b6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:22.417671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e10b816-52a2-43bb-abf0-96281803d165 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:22.446380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:22.447631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:22.447993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.448324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.448643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.448918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.449229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.449673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:40:22.449983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:22.452977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] PATH_INFO: `/v3/projects/7a9640cfb887402d903247a926c6dee9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.459016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a9640cfb887402d903247a926c6dee9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:22.469592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:22.472022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:22.540982 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3737/7470] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:40:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:40:22.545979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:22.592833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781da60-4a40-4872-8d42-e0e2727a27c9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:22.612663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:22.613375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.613662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.613950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.614664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:22.622356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:22.650347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a9640cfb887402d903247a926c6dee9', 'request_id': 'req-2b725435-01d5-4a88-be7e-e9b1f5d511a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.670512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a9640cfb887402d903247a926c6dee9', 'request_id': 'req-2b725435-01d5-4a88-be7e-e9b1f5d511a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.691645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a9640cfb887402d903247a926c6dee9', 'request_id': 'req-2b725435-01d5-4a88-be7e-e9b1f5d511a2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.700087 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3738/7471] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:40:22 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:22.702363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:22.730441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] The token cache is being invalidate because project 7a9640cfb887402d903247a926c6dee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:22.731025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.734224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2b725435-01d5-4a88-be7e-e9b1f5d511a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:22.738397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3734/7472] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:22 2022] DELETE /identity/v3/projects/7a9640cfb887402d903247a926c6dee9 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:40:22.744989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494b5d-e18c-44f5-8a43-7aa17a7c544c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.746612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494b5d-e18c-44f5-8a43-7aa17a7c544c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.748483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62494b5d-e18c-44f5-8a43-7aa17a7c544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.804542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-62494b5d-e18c-44f5-8a43-7aa17a7c544c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:22.808380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62494b5d-e18c-44f5-8a43-7aa17a7c544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:22.872002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307ea08-6cad-486f-9b52-1dfdebd8b4da admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:22.890754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:22.891725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.892159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.892618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.893493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:22.898161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:22.955063 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3739/7473] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:40:22 2022] POST /identity/v3/users => generated 284 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:40:22.956235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:22.960352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:22.963594 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3735/7474] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:22.972707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.973149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.973432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.987966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78bcb1a-f4bb-47fd-9358-b7d751d13b45 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:22.993784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:22.994483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:22.994788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:22.995899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:22.996815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:22.998660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.013824 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3740/7475] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:22 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:40:23.014898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:23.016078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.016378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:23.028952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4db98d-039e-48ef-9bad-e0697c9c6163 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.034371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.035071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.035352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.035630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.036459 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3736/7476] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:40:23.039823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.040781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.064009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6949fdb3-ef57-435a-9c17-915c8bb09ef5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.064923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.074667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.075425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.075709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.075984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.081490 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3741/7477] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:23.081677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:40:23.081677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.082853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.083246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.115477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d7c52-f72f-4eb9-8b97-f0c55284f867 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.116863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3737/7478] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:40:23.121076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.127800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecf9507-72cf-4e66-8655-e6bc374ff0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.128989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf9507-72cf-4e66-8655-e6bc374ff0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.129418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf9507-72cf-4e66-8655-e6bc374ff0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.129866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecf9507-72cf-4e66-8655-e6bc374ff0e0 admin admin] PATH_INFO: `/v3/projects/92d32c32551e4c2288775333d77dbba3/users/5d69e7ca5f104f4a8d9a8097c178f7ec/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.150432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7cb16e-272a-475a-8aeb-139557ec0c50 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.165694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.166389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.166937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.167212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.167910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.168963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf9507-72cf-4e66-8655-e6bc374ff0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92d32c32551e4c2288775333d77dbba3, user_id=5d69e7ca5f104f4a8d9a8097c178f7ec, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.175181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.175883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecf9507-72cf-4e66-8655-e6bc374ff0e0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.213090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3742/7479] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:23 2022] PUT /identity/v3/projects/92d32c32551e4c2288775333d77dbba3/users/5d69e7ca5f104f4a8d9a8097c178f7ec/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:40:23.215308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.217690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.218159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.240415 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3738/7480] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:40:23 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:40:23.244764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.272369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] MFA Rules not processed for user `5d69e7ca5f104f4a8d9a8097c178f7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:23.293573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:23.336852 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:23.458449 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:23.488848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246b85a7-f5f7-455b-953b-fd23085660d8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.505445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.506449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.506898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.507468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.508775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.514434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.536777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3743/7481] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:23 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:23.541676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.569974 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3739/7482] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:40:23 2022] POST /identity/v3/users => generated 290 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:40:23.572779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.578529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3373fa53-62bb-4dd9-b6bc-5acaf58507fb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.593972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.594672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.594957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.595232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.597870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.599822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.602217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca44d0-6a1f-4bbd-a86f-5b0f98867afa admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.612834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.614826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.615475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.616797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.627638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.634662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.664089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3744/7483] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:40:23 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:23.666152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.666284 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3740/7484] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:40:23.675735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.706869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aca93be-ab6b-48d4-998a-2bced9acbaa3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.864609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc710ab6-c6d7-46d7-b7fc-8f6510e971ae admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.871034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.872304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.872843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.873292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.875209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.877798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.878254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.879924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.880216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.881277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.883355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.890398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.917245 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3741/7485] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:23.922266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.935519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3745/7486] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:40:23 2022] POST /identity/v3/users => generated 290 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:23.936952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:23.954438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246c07f1-a9fc-4627-aa83-32b849339bc5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.964230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3518eb49-ec6e-45c5-8f79-19bcf00de402 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:23.967677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.969381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.971072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.971510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:23.974330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:23.978453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f6233-13be-4a4d-8528-315e8ced968c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:23.979691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:23.981472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f6233-13be-4a4d-8528-315e8ced968c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:23.983331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f6233-13be-4a4d-8528-315e8ced968c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:23.983624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f6233-13be-4a4d-8528-315e8ced968c admin admin] PATH_INFO: `/v3/projects/42e96216df5945ca8a83caf61b3cdee5/users/e1353e498ec84fc2ac9dc4bba79d0869/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.000092 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3746/7487] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:23 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:24.001111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:24.014594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a25d1-1a61-449a-920c-6f786e17eae2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:24.020222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:24.021200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.021488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.022348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] PATH_INFO: `/v3/projects/a00e753ae8b3475582dba3cf3862d878/users/bb07bb20b75f43808673b518fe759ce0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.040753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00e753ae8b3475582dba3cf3862d878, user_id=bb07bb20b75f43808673b518fe759ce0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:24.041903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f6233-13be-4a4d-8528-315e8ced968c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42e96216df5945ca8a83caf61b3cdee5, user_id=e1353e498ec84fc2ac9dc4bba79d0869, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:24.044199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:24.052646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658f6233-13be-4a4d-8528-315e8ced968c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:24.075048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3747/7488] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:24 2022] PUT /identity/v3/projects/a00e753ae8b3475582dba3cf3862d878/users/bb07bb20b75f43808673b518fe759ce0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:24.079700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:24.084096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3742/7489] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:23 2022] PUT /identity/v3/projects/42e96216df5945ca8a83caf61b3cdee5/users/e1353e498ec84fc2ac9dc4bba79d0869/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:40:24.099279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.099778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.100276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.177678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] MFA Rules not processed for user `e1353e498ec84fc2ac9dc4bba79d0869`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:24.181496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:24.232699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f06ea-d4f8-4e6a-8ff6-262c9f16fff9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:24.279238 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:24.328472 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3743/7490] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:40:24.382528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:24.383551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.384006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.384516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.385922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:24.388174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:24.407694 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3748/7491] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:24 2022] GET /identity/v3/roles => generated 1420 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:24.410490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:24.412190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:24.417791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:24.448855 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:24.455545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0ae4e6-1535-4df2-8ee8-180e699065c5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:24.474508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eeb911-b3d3-46d3-af63-6a631f170141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:24.475441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeb911-b3d3-46d3-af63-6a631f170141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.475741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeb911-b3d3-46d3-af63-6a631f170141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.475989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eeb911-b3d3-46d3-af63-6a631f170141 admin admin] PATH_INFO: `/v3/projects/a00e753ae8b3475582dba3cf3862d878/users/bb07bb20b75f43808673b518fe759ce0/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.485495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeb911-b3d3-46d3-af63-6a631f170141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00e753ae8b3475582dba3cf3862d878, user_id=bb07bb20b75f43808673b518fe759ce0, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:24.488257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eeb911-b3d3-46d3-af63-6a631f170141 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:24.512503 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3749/7492] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:24 2022] PUT /identity/v3/projects/a00e753ae8b3475582dba3cf3862d878/users/bb07bb20b75f43808673b518fe759ce0/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:24.525148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.525441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.525721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.597220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a0d0a-54c6-415e-a51a-c5f7e6aa9640 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:24.599513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] MFA Rules not processed for user `bb07bb20b75f43808673b518fe759ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:24.600775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:24.697187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:24.698131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.698428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.698710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:24.794710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3750/7493] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:24 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:40:24.803284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:24.805986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:24.843625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:24.849711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:24.893560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3744/7494] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:24 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:24.962313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347f802f-5c0b-4733-a4c7-c09a106d48ff None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:24.973760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:24.976092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:24.977184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:24.978294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:25.003360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:25.003360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:25.025055 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3751/7495] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:24 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:40:25.199322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:25.228692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab8e8d-c93d-46e5-9b09-4167caa1fd60 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:25.247825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:25.249192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:25.251418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:25.251835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:25.444987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:25.447547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:25.460537 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3745/7496] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:35.018314 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:35.454125 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:40.590609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:40.593287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:40.820809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:40.985539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e7737-c4c9-401f-8219-cbca37d96b49 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:40.996881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23c345f-6436-468b-be2e-3d1555eaccb6 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:41.014233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:41.015160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:41.015283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:41.015438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:41.015797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] PATH_INFO: `/v3/users/5d69e7ca5f104f4a8d9a8097c178f7ec` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:41.016456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:41.016911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:41.017186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:41.018545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d69e7ca5f104f4a8d9a8097c178f7ec)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:41.020631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:41.021051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:41.112774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:41.114589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee124719-2f95-4be9-b2ff-f08aa3dc5d8f service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:41.147661 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3752/7497] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:41.260803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d69e7ca5f104f4a8d9a8097c178f7ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:41.264278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d69e7ca5f104f4a8d9a8097c178f7ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:41.290168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d69e7ca5f104f4a8d9a8097c178f7ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:41.292492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d69e7ca5f104f4a8d9a8097c178f7ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:41.309994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d69e7ca5f104f4a8d9a8097c178f7ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:41.362222 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3746/7498] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:40 2022] DELETE /identity/v3/users/5d69e7ca5f104f4a8d9a8097c178f7ec => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:41.366335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:41.366623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:41.366897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:41.406630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:41.412782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:41.661552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3753/7499] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:41.675835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:41.676893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:41.918951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be4bae-27ea-4c9a-825f-444bd306b64e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:41.951088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:41.951795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:41.952611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:41.954036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:41.995035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:42.003138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:42.088702 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3747/7500] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:44.355014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:44.356704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:44.383466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468676dc-28da-46cb-b46b-6e427d8211db None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:44.394495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:44.397353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:44.400845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:44.401672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] PATH_INFO: `/v3/projects/92d32c32551e4c2288775333d77dbba3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:44.404559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92d32c32551e4c2288775333d77dbba3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:44.410237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:44.573940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92d32c32551e4c2288775333d77dbba3', 'request_id': 'req-48472104-5af3-4521-b8f7-ffcc5e311118'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:44.608936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92d32c32551e4c2288775333d77dbba3', 'request_id': 'req-48472104-5af3-4521-b8f7-ffcc5e311118'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:44.635760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92d32c32551e4c2288775333d77dbba3', 'request_id': 'req-48472104-5af3-4521-b8f7-ffcc5e311118'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:44.677131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] The token cache is being invalidate because project 92d32c32551e4c2288775333d77dbba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:44.677431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:44.678125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:44.682984 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3754/7501] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:44 2022] DELETE /identity/v3/projects/92d32c32551e4c2288775333d77dbba3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:44.686817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:44.721700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be22bad-8dfe-42ad-b092-a623f56fb54a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:44.776462 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:44.897133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:44.897918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:44.898203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:44.898480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] PATH_INFO: `/v3/users/bb07bb20b75f43808673b518fe759ce0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:44.904422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb07bb20b75f43808673b518fe759ce0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:44.917823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:45.051996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb07bb20b75f43808673b518fe759ce0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:45.055313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb07bb20b75f43808673b518fe759ce0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:45.071262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb07bb20b75f43808673b518fe759ce0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:45.073216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb07bb20b75f43808673b518fe759ce0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:45.093417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb07bb20b75f43808673b518fe759ce0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:45.120750 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3748/7502] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:44 2022] DELETE /identity/v3/users/bb07bb20b75f43808673b518fe759ce0 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:46.600016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:46.601487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:46.628722 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:46.912555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48472104-5af3-4521-b8f7-ffcc5e311118 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:47.123159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:47.123983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:47.124275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:47.124608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:47.126922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:47.164026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:47.172664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba666c-053a-4cf3-ac75-d01dab915be8 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:47.225827 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3755/7503] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 626 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:48.145527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:48.147005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:48.334402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c8804d-d692-421e-b4f2-c6120742739b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:48.350248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:48.351612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:48.352329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:48.352827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] PATH_INFO: `/v3/projects/a00e753ae8b3475582dba3cf3862d878` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:48.355775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00e753ae8b3475582dba3cf3862d878)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:48.363227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:48.495522 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:48.511929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00e753ae8b3475582dba3cf3862d878', 'request_id': 'req-9d82933b-0112-4319-90de-501a32c943d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:48.541053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00e753ae8b3475582dba3cf3862d878', 'request_id': 'req-9d82933b-0112-4319-90de-501a32c943d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:48.556641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00e753ae8b3475582dba3cf3862d878', 'request_id': 'req-9d82933b-0112-4319-90de-501a32c943d1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:48.581822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] The token cache is being invalidate because project a00e753ae8b3475582dba3cf3862d878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:48.582118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:48.583691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9d82933b-0112-4319-90de-501a32c943d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:48.585386 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3749/7504] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:48 2022] DELETE /identity/v3/projects/a00e753ae8b3475582dba3cf3862d878 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:48.590687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:48.591242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:48.591464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:48.626695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:48.628530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:48.792608 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3756/7505] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:48.800579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:48.800882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:48.801149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:48.864784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:48.866324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:48.904979 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3750/7506] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:48.911609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:48.934368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c505cb-3aed-4188-a3f2-7015cecea31d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:48.968816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:48.970637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:48.970637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:48.970637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:48.981146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:40:48.981816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:48.988836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:49.043426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3757/7507] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:40:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:40:49.044739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:49.061090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9169b1-f30b-4218-b19c-ff1b7167025f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:49.086037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:49.087350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:49.088645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:49.089507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:49.090986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:49.095925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:49.147470 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3751/7508] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:40:49 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:49.153664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:49.183819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475783c9-f0a6-4cd9-a608-54e1b92d585e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:49.276823 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:49.439944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:49.440767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:49.441062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:49.441329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:49.442141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:49.445382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:49.486002 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3758/7509] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:40:49 2022] POST /identity/v3/users => generated 292 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:40:49.491072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:49.515976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955733a-2d13-4c61-a061-7d24f87c2740 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:49.559377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:49.560753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:49.564161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:49.566870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:49.567831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:49.586646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:49.639870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3752/7510] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:49.641368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:49.657127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a93bcb-2525-4185-a16d-e73289bbf31a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:49.670430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c3cd0-074c-472b-a4d4-3f6e3d149bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:49.672966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3cd0-074c-472b-a4d4-3f6e3d149bab admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:49.674103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3cd0-074c-472b-a4d4-3f6e3d149bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:49.677565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c3cd0-074c-472b-a4d4-3f6e3d149bab admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:49.679912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c3cd0-074c-472b-a4d4-3f6e3d149bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:49.688870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c3cd0-074c-472b-a4d4-3f6e3d149bab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:49.720601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3759/7511] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:49.724982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:49.741167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37f3d8-7fa1-4833-b997-3a76037b0f0f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:49.756236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:49.761736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:49.762272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:49.762825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] PATH_INFO: `/v3/projects/3ea41b9a7e094ae28a4523a92ecad6ca/users/7c97eb686f2c4934bebc4d97260a26b6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:49.803490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea41b9a7e094ae28a4523a92ecad6ca, user_id=7c97eb686f2c4934bebc4d97260a26b6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:49.809952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:49.848414 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3753/7512] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:49 2022] PUT /identity/v3/projects/3ea41b9a7e094ae28a4523a92ecad6ca/users/7c97eb686f2c4934bebc4d97260a26b6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:40:49.859145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:49.859982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:49.860534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:49.921875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] MFA Rules not processed for user `7c97eb686f2c4934bebc4d97260a26b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:49.925585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:50.109158 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3760/7513] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:50.118833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:50.120812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:50.264052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefc888a-2d84-4e62-aba5-f5760e2ca4f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:50.275018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df86a94-66fa-4061-aac2-c087f3776e77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:50.276126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86a94-66fa-4061-aac2-c087f3776e77 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:50.276723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86a94-66fa-4061-aac2-c087f3776e77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:50.277057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df86a94-66fa-4061-aac2-c087f3776e77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:50.298062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df86a94-66fa-4061-aac2-c087f3776e77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:50.302776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df86a94-66fa-4061-aac2-c087f3776e77 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:50.325107 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3754/7514] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:40:51.732372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:51.737925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:51.987899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c0e0e-5e00-4a66-bf0a-4dc995b40758 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:51.992989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:51.999140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:51.999692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:52.000109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] PATH_INFO: `/v3/users/88006946dff84331b75748294fd91966` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:52.001679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] RBAC: Authorizing `identity:delete_user(user_id=88006946dff84331b75748294fd91966)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:52.003798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:52.141831 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:52.194186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88006946dff84331b75748294fd91966'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:52.238555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88006946dff84331b75748294fd91966'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:52.273771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88006946dff84331b75748294fd91966'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:52.274686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88006946dff84331b75748294fd91966'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:52.289564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88006946dff84331b75748294fd91966'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:52.308070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3761/7515] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:51 2022] DELETE /identity/v3/users/88006946dff84331b75748294fd91966 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:52.312814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:52.313710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:52.314142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:52.338675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:52.339963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:52.516005 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3755/7516] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:40:52.560852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:52.565138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:52.736372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945932f9-1afd-447a-8e81-3681e8ff723c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:52.736372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d049062c-ee16-4ea9-b4c8-3ba25be7a01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:52.737152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049062c-ee16-4ea9-b4c8-3ba25be7a01a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:52.739259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049062c-ee16-4ea9-b4c8-3ba25be7a01a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:52.739752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d049062c-ee16-4ea9-b4c8-3ba25be7a01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:52.763082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049062c-ee16-4ea9-b4c8-3ba25be7a01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:52.764980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d049062c-ee16-4ea9-b4c8-3ba25be7a01a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:52.790049 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3762/7517] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:53.896649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:53.898665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:53.918388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c47ced-af87-4597-817e-7b78d50fc77b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:53.934348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:53.935423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:53.940299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:53.940764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] PATH_INFO: `/v3/projects/53ffb0369e3a4b05aadaa93840d21cc8` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:53.942315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ffb0369e3a4b05aadaa93840d21cc8)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:53.945763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:53.965762 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:54.081345 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ffb0369e3a4b05aadaa93840d21cc8', 'request_id': 'req-d88a0d9c-2526-416f-a963-f4eb787319fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:54.104958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ffb0369e3a4b05aadaa93840d21cc8', 'request_id': 'req-d88a0d9c-2526-416f-a963-f4eb787319fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:54.126287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ffb0369e3a4b05aadaa93840d21cc8', 'request_id': 'req-d88a0d9c-2526-416f-a963-f4eb787319fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:54.162134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] The token cache is being invalidate because project 53ffb0369e3a4b05aadaa93840d21cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:40:54.162435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:54.165442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d88a0d9c-2526-416f-a963-f4eb787319fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:54.167654 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3756/7518] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:40:53 2022] DELETE /identity/v3/projects/53ffb0369e3a4b05aadaa93840d21cc8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:54.172607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.173091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.173311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.205834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:54.213984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:54.346562 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3763/7519] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:54.354281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.354623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.355495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.378348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:54.379884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:54.389027 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3757/7520] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:54.395307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:54.419517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227ecaf-9b76-401f-99c4-58daf31eeb39 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:54.440080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:54.441538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.441848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.442130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.442891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:40:54.443201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:54.444868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:54.487196 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3764/7521] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:40:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:40:54.488268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:54.510446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f69e9-f9ab-4d09-bce8-b45674f0e54a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:54.520593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:54.521283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.521568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.521846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.522551 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:54.529621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:54.609986 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3758/7522] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:40:54 2022] POST /identity/v3/projects => generated 369 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:54.611080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:54.623613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3b8c8-fe79-4cad-b52d-24eccb20cf64 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:54.711534 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:54.778204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:54.780510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.780979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.781266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.783973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:54.790439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:54.834748 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3765/7523] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:40:54 2022] POST /identity/v3/users => generated 285 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:40:54.839282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:54.853848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09493ca2-14f0-4a80-8ee0-cc82071b9454 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:54.871096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:54.871830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.871830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.871830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.872471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:54.885063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:54.901832 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3759/7524] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:40:54.905295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:54.917064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1291ee-8aef-47b2-b79c-5bd931f468c3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:54.923927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c53c51-fde1-4f8c-bfde-b591fdd7f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:54.924667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53c51-fde1-4f8c-bfde-b591fdd7f6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.924954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53c51-fde1-4f8c-bfde-b591fdd7f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.925231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c53c51-fde1-4f8c-bfde-b591fdd7f6e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:54.925980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c53c51-fde1-4f8c-bfde-b591fdd7f6e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:54.927836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c53c51-fde1-4f8c-bfde-b591fdd7f6e5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:54.954823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:54.968584 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3766/7525] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:40:54 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:40:54.973511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e4d2b5-639e-4219-93e9-00fdf4cc00c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:54.985832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:54.986753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:54.987037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:54.987314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] PATH_INFO: `/v3/projects/a5049d1f8e3d4e068a1690245fd7261b/users/0bb8e7e9ce4b4df0808120246c0ea085/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:55.032885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5049d1f8e3d4e068a1690245fd7261b, user_id=0bb8e7e9ce4b4df0808120246c0ea085, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:55.038239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:55.058977 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3760/7526] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:40:54 2022] PUT /identity/v3/projects/a5049d1f8e3d4e068a1690245fd7261b/users/0bb8e7e9ce4b4df0808120246c0ea085/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:55.072992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7e6a-904d-4762-bbf8-d94983e68add None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:55.074465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7e6a-904d-4762-bbf8-d94983e68add None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:55.074758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc7e6a-904d-4762-bbf8-d94983e68add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:55.215987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-96bc7e6a-904d-4762-bbf8-d94983e68add None None] MFA Rules not processed for user `0bb8e7e9ce4b4df0808120246c0ea085`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:55.223406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96bc7e6a-904d-4762-bbf8-d94983e68add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:55.427690 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3767/7527] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:55.487592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:55.489628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:55.618967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22d89f-3f70-454f-ab81-b94424168138 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:55.629872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:55.630651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:55.630933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:55.631256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:55.652959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:55.655943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:55.679095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3761/7528] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:40:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:40:57.348151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc44a78-028b-4cc6-adeb-813a8c402e04 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:57.348881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc44a78-028b-4cc6-adeb-813a8c402e04 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:57.348881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc44a78-028b-4cc6-adeb-813a8c402e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:57.393850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cfc44a78-028b-4cc6-adeb-813a8c402e04 None None] MFA Rules not processed for user `f047ddb9fbfd4b6f8fd66d02e0dbca20`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:57.395348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cfc44a78-028b-4cc6-adeb-813a8c402e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:57.659210 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3768/7529] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:40:59.412375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:40:59.414864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:40:59.516403 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:40:59.590747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef97dc4-deaf-48b4-a380-662934728c2d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:40:59.603537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:40:59.604424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:59.604980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:59.605477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] PATH_INFO: `/v3/users/7c97eb686f2c4934bebc4d97260a26b6` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:59.607032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c97eb686f2c4934bebc4d97260a26b6)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:40:59.609789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:40:59.715515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c97eb686f2c4934bebc4d97260a26b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:59.716749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c97eb686f2c4934bebc4d97260a26b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:59.734713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c97eb686f2c4934bebc4d97260a26b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:59.735522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c97eb686f2c4934bebc4d97260a26b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:59.755365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c97eb686f2c4934bebc4d97260a26b6'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:40:59.794677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3762/7530] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:40:59 2022] DELETE /identity/v3/users/7c97eb686f2c4934bebc4d97260a26b6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:40:59.799528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:40:59.800483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:40:59.800941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:40:59.865732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:40:59.870417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:00.028106 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:00.083013 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3769/7531] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:40:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:00.174593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:00.176149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:00.334255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8320341-e5ff-4e10-b771-e1f124a6d549 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:00.350701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01c56-ebff-4f00-96b3-f48202544e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:00.351537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01c56-ebff-4f00-96b3-f48202544e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:00.351999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01c56-ebff-4f00-96b3-f48202544e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:00.352308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01c56-ebff-4f00-96b3-f48202544e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:00.370334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01c56-ebff-4f00-96b3-f48202544e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:00.371990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01c56-ebff-4f00-96b3-f48202544e64 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:00.396638 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3763/7532] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:02.002209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:02.003697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:02.021684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b99b22-b52a-43d6-92d4-ec08bd1c19ea None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:02.039006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:02.040172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.040644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.041067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] PATH_INFO: `/v3/projects/3ea41b9a7e094ae28a4523a92ecad6ca` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.048497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea41b9a7e094ae28a4523a92ecad6ca)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:02.050804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:02.150617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea41b9a7e094ae28a4523a92ecad6ca', 'request_id': 'req-1984c141-a4c9-460c-b097-3e2355370a50'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:02.166503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea41b9a7e094ae28a4523a92ecad6ca', 'request_id': 'req-1984c141-a4c9-460c-b097-3e2355370a50'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:02.178957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea41b9a7e094ae28a4523a92ecad6ca', 'request_id': 'req-1984c141-a4c9-460c-b097-3e2355370a50'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:02.203122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] The token cache is being invalidate because project 3ea41b9a7e094ae28a4523a92ecad6ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:02.203638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:02.205483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1984c141-a4c9-460c-b097-3e2355370a50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:02.210932 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3770/7533] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:02 2022] DELETE /identity/v3/projects/3ea41b9a7e094ae28a4523a92ecad6ca => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:02.212879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.213401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.214496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.324612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:02.332688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:02.465271 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:02.492562 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3764/7534] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:02.503550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336238e-f771-4161-b861-b70a3c181aad None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.503801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336238e-f771-4161-b861-b70a3c181aad None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.504079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336238e-f771-4161-b861-b70a3c181aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.544331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0336238e-f771-4161-b861-b70a3c181aad None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:02.547397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0336238e-f771-4161-b861-b70a3c181aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:02.568400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3771/7535] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:02.573494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:02.587341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3669449e-918a-4e75-814f-bd44e04fc54a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:02.594332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:02.595141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.595896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.595896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.596905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:02.597290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:02.599720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:02.617422 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3765/7536] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:02.622532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336238e-f771-4161-b861-b70a3c181aad None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:02.638119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336238e-f771-4161-b861-b70a3c181aad None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:02.644854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:02.645733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.646389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.646775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.647743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:02.650877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:02.691282 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3772/7537] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:02 2022] POST /identity/v3/projects => generated 375 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:02.695423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:02.712938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3b724-7d67-4479-8f3a-afc31f7fd3b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:02.817634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:02.819969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.820830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.821374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.822416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:02.826357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:02.855001 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3766/7538] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:02 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:02.859404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:02.878787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb99341-5ce1-48dd-b72d-bf8bc37203fe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:02.892978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:02.893835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:02.894126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:02.894969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:02.895746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:02.902449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:02.981620 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3773/7539] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:02.987737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:02.999290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38636aaa-8bda-4607-8290-35af286748f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:03.021447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61164367-3f69-49b5-b32f-3e0041bc9246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:03.022157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164367-3f69-49b5-b32f-3e0041bc9246 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:03.022734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164367-3f69-49b5-b32f-3e0041bc9246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:03.023037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61164367-3f69-49b5-b32f-3e0041bc9246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:03.023879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61164367-3f69-49b5-b32f-3e0041bc9246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:03.026219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61164367-3f69-49b5-b32f-3e0041bc9246 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:03.060059 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3767/7540] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:02 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:03.064540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:03.079306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975b4b72-5e92-4da0-b637-ae12b15197b0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:03.095748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:03.097115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:03.097559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:03.097991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] PATH_INFO: `/v3/projects/450a2d12cb49428db80aebdf27b732a1/users/e4ed4f4360484ef18640f0f42e0d1fa3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:03.158659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] RBAC: Authorizing `identity:create_grant(project_id=450a2d12cb49428db80aebdf27b732a1, user_id=e4ed4f4360484ef18640f0f42e0d1fa3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:03.161780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:03.236547 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3774/7541] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:03 2022] PUT /identity/v3/projects/450a2d12cb49428db80aebdf27b732a1/users/e4ed4f4360484ef18640f0f42e0d1fa3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:03.253954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:03.254966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:03.255894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:03.328871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] MFA Rules not processed for user `e4ed4f4360484ef18640f0f42e0d1fa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:03.330641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:03.502482 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3768/7542] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:03.516725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:03.520431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:03.673063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b986d2-46af-46a9-8827-3ef3ee32363e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:03.679471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:03.680314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:03.680628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:03.680902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:03.692138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:03.693594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:03.705197 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3775/7543] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:07.715955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:07.718579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:07.865363 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:07.896623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b25110-2eea-4ffb-a7c7-21934137d56e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:07.912814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:07.913838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:07.914576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:07.914952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] PATH_INFO: `/v3/users/ac9f09236a9a43bebb2be9d6275346b7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:07.916486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac9f09236a9a43bebb2be9d6275346b7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:07.919057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:08.001744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac9f09236a9a43bebb2be9d6275346b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:08.002570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac9f09236a9a43bebb2be9d6275346b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:08.017339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac9f09236a9a43bebb2be9d6275346b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:08.019870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac9f09236a9a43bebb2be9d6275346b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:08.044825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac9f09236a9a43bebb2be9d6275346b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:08.088973 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3769/7544] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:07 2022] DELETE /identity/v3/users/ac9f09236a9a43bebb2be9d6275346b7 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:10.568663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:10.587741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ccbd10-f7ee-4b5d-ac42-339b285daf8f service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:10.611918 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:10.759838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:10.761075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:10.761504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:10.761944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] PATH_INFO: `/v3/projects/1ece8708ef3d4392af01f1969b31dfd7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:10.763450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ece8708ef3d4392af01f1969b31dfd7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:10.765749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:10.890088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ece8708ef3d4392af01f1969b31dfd7', 'request_id': 'req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:10.904616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ece8708ef3d4392af01f1969b31dfd7', 'request_id': 'req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:10.921528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ece8708ef3d4392af01f1969b31dfd7', 'request_id': 'req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:10.941981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] The token cache is being invalidate because project 1ece8708ef3d4392af01f1969b31dfd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:10.942275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:10.943032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:10.944724 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3776/7545] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:10 2022] DELETE /identity/v3/projects/1ece8708ef3d4392af01f1969b31dfd7 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:10.950154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:10.953754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:10.997076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad58f704-ec6b-4e2f-83a7-90d337ac3a62 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:11.201971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:11.206284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:11.207830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:11.209260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] PATH_INFO: `/v3/users/2979d9351aa7452384d086da38a2f794` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:11.213541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2979d9351aa7452384d086da38a2f794)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:11.218399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:11.344778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2979d9351aa7452384d086da38a2f794'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:11.345928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2979d9351aa7452384d086da38a2f794'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:11.359982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2979d9351aa7452384d086da38a2f794'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:11.360762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2979d9351aa7452384d086da38a2f794'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:11.379053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2979d9351aa7452384d086da38a2f794'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:11.406234 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:11.448395 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3770/7546] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:10 2022] DELETE /identity/v3/users/2979d9351aa7452384d086da38a2f794 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:12.293975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:12.295484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:12.309930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f85269-58de-43dc-92b4-93b1cb8e9d9c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:12.380202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:12.381479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:12.381930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:12.382478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] PATH_INFO: `/v3/users/b6fd1cce932148e2ad6e4b6a26984733` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:12.384301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fd1cce932148e2ad6e4b6a26984733)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:12.386621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:12.448131 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:12.452768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fd1cce932148e2ad6e4b6a26984733'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.468862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fd1cce932148e2ad6e4b6a26984733'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.499545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fd1cce932148e2ad6e4b6a26984733'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.501695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fd1cce932148e2ad6e4b6a26984733'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.515126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c44a4c05-015e-4ea2-834c-3f2cbcf539d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fd1cce932148e2ad6e4b6a26984733'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.517380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:12.519203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:12.527518 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3777/7547] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:12 2022] DELETE /identity/v3/users/b6fd1cce932148e2ad6e4b6a26984733 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:12.532267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:12.532661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:12.532948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:12.539743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f02bcb-3e2f-4e1e-ac3e-50c024e23e7c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:12.558242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:12.559691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:12.618902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:12.619939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:12.620224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:12.620536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] PATH_INFO: `/v3/projects/11740ce555b64c6c8b00c81bcb292483` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:12.622886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11740ce555b64c6c8b00c81bcb292483)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:12.625446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:12.661015 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3778/7548] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:12.678547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:12.680203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:12.774827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11740ce555b64c6c8b00c81bcb292483', 'request_id': 'req-805a8e79-d99e-4f87-a643-edebdb3c07e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.789979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11740ce555b64c6c8b00c81bcb292483', 'request_id': 'req-805a8e79-d99e-4f87-a643-edebdb3c07e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.813243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d32b1b-14cd-4227-a287-915777ab56e3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:12.813509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11740ce555b64c6c8b00c81bcb292483', 'request_id': 'req-805a8e79-d99e-4f87-a643-edebdb3c07e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.825079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] The token cache is being invalidate because project 11740ce555b64c6c8b00c81bcb292483 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:12.825982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.827307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-805a8e79-d99e-4f87-a643-edebdb3c07e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:12.831031 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3771/7549] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:12 2022] DELETE /identity/v3/projects/11740ce555b64c6c8b00c81bcb292483 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:12.836875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b870b5-f3f4-4a75-85b3-866be95da11d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:12.837165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b870b5-f3f4-4a75-85b3-866be95da11d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:12.837547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b870b5-f3f4-4a75-85b3-866be95da11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:12.874215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-82b870b5-f3f4-4a75-85b3-866be95da11d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:12.875570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82b870b5-f3f4-4a75-85b3-866be95da11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:12.969214 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3772/7550] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:12.977430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:12.977722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:12.978846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:12.985811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:12.986631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:12.987017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:12.987696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:12.989812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:13.008652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.010704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.027245 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3779/7551] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:13.048633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:13.048633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:13.085928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3773/7552] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:13.091519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.105493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7598f1b4-6a9c-476f-8c26-ba4539ac04ee service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.112990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.114347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.114347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.114347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.115395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:13.115769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.118530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.169415 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3780/7553] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:13.174019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.187875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957056d-053d-4343-9a48-b5e6a0fa1868 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.199335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.200025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.200307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.200608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.201309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.203262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.231139 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:13.264749 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3774/7554] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:13 2022] POST /identity/v3/projects => generated 359 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:13.269096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.287509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49807d5-7fc2-448f-a4c7-6a843bb91190 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.297056 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:13.431710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.432336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.432637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.432916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.433630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.435615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.485891 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3781/7555] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:13 2022] POST /identity/v3/users => generated 280 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:13.490115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.510080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce4449d-a46c-42b0-8180-8f2de024af14 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.514969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.515675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.515916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.516187 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.516947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.518562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.533103 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3775/7556] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:13.536801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.549674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7a6b7-dd7e-436f-b83c-b6de5364b9b4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.562419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.563179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.563465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.563737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.564505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.568066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.591302 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3782/7557] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:13.595875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.608907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c850091-29d5-4d25-b06b-d59b63ec4749 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.624171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a232004c-1e46-4381-a0c3-c99fb2cc6eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.625439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232004c-1e46-4381-a0c3-c99fb2cc6eff admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.625870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232004c-1e46-4381-a0c3-c99fb2cc6eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.626295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a232004c-1e46-4381-a0c3-c99fb2cc6eff admin admin] PATH_INFO: `/v3/projects/55cc82f82ca948cc8821c293cd30d917/users/ae4b08bc70c94bb3a7da92970c60b2df/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.657500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232004c-1e46-4381-a0c3-c99fb2cc6eff admin admin] RBAC: Authorizing `identity:create_grant(project_id=55cc82f82ca948cc8821c293cd30d917, user_id=ae4b08bc70c94bb3a7da92970c60b2df, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.663167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a232004c-1e46-4381-a0c3-c99fb2cc6eff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:13.686825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:13.688917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:13.707649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3776/7558] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:13 2022] PUT /identity/v3/projects/55cc82f82ca948cc8821c293cd30d917/users/ae4b08bc70c94bb3a7da92970c60b2df/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:13.722785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.723250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.723671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.727588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9293223-c2bf-4302-82bc-40fd1af1c85d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:13.795650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] MFA Rules not processed for user `ae4b08bc70c94bb3a7da92970c60b2df`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:13.796647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:13.895271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:13.896478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:13.897126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:13.897425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] PATH_INFO: `/v3/users/2f79341afb0c4d758e7a3184d385494d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:13.899479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f79341afb0c4d758e7a3184d385494d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:13.901693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:14.005209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f79341afb0c4d758e7a3184d385494d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.024464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f79341afb0c4d758e7a3184d385494d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.034024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3777/7559] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:13 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:14.037573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:14.044862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.065963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f79341afb0c4d758e7a3184d385494d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.071319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f79341afb0c4d758e7a3184d385494d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.085030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4138b23-78a8-4038-abaf-73239c50c2b5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:14.090201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f79341afb0c4d758e7a3184d385494d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.099359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:14.100200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.101986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.101986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] PATH_INFO: `/v3/projects/71c53858c5804f9aafed265eef0d4050` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.106418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=71c53858c5804f9aafed265eef0d4050)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:14.113433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:14.119972 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3783/7560] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:13 2022] DELETE /identity/v3/users/2f79341afb0c4d758e7a3184d385494d => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:14.232801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71c53858c5804f9aafed265eef0d4050', 'request_id': 'req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.248761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71c53858c5804f9aafed265eef0d4050', 'request_id': 'req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.253072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:14.254608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.270931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71c53858c5804f9aafed265eef0d4050', 'request_id': 'req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.271706 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:14.293388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] The token cache is being invalidate because project 71c53858c5804f9aafed265eef0d4050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:14.293967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.294930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dfbe5650-2a59-481f-bfda-e6a4e8433a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.301872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3778/7561] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:14 2022] DELETE /identity/v3/projects/71c53858c5804f9aafed265eef0d4050 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:14.303891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.304362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.304821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.345210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:14.349083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.429100 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:14.445489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5a441-ca1c-40df-910f-d12fa1dabf57 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:14.551945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3779/7562] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:14.553564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:14.557599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.573036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e387e367-1e75-4f15-8989-02c5d2141e81 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:14.579928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:14.581399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.581870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.582293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] PATH_INFO: `/v3/projects/a2d2222960cf4dbaa5bc2a2021e42dab` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.583697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d2222960cf4dbaa5bc2a2021e42dab)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:14.585969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:14.599938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:14.601391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.601684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.601960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.609274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.702831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d2222960cf4dbaa5bc2a2021e42dab', 'request_id': 'req-5356cc2f-5410-4566-a450-c82fb6f84d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.724013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d2222960cf4dbaa5bc2a2021e42dab', 'request_id': 'req-5356cc2f-5410-4566-a450-c82fb6f84d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.744335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:14.746275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b32e0c4-f6de-40b8-9c77-f99310189c5e service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:14.755083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d2222960cf4dbaa5bc2a2021e42dab', 'request_id': 'req-5356cc2f-5410-4566-a450-c82fb6f84d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.765698 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3784/7563] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:14 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:14.768241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.768564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.768922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.781394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] The token cache is being invalidate because project a2d2222960cf4dbaa5bc2a2021e42dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:14.781794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.784512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:14.788829 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3780/7564] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:14 2022] DELETE /identity/v3/projects/a2d2222960cf4dbaa5bc2a2021e42dab => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:14.792904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:14.802846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.812081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:14.814587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.962831 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3785/7565] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:14.963733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:14.965985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:14.966782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356cc2f-5410-4566-a450-c82fb6f84d07 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:14.983404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de7316-3ac2-419c-a5c2-af80cffb59cb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:14.983649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:14.984365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.984678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.984958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] PATH_INFO: `/v3/users/ae4b08bc70c94bb3a7da92970c60b2df` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.986670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae4b08bc70c94bb3a7da92970c60b2df)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:14.988785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:14.988913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:14.990292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:14.990673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:14.990986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] PATH_INFO: `/v3/users/14712ef6f4954579ab433bb29cb62f84` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:14.993550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14712ef6f4954579ab433bb29cb62f84)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:14.998510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:15.030161 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:15.105948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae4b08bc70c94bb3a7da92970c60b2df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.109159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae4b08bc70c94bb3a7da92970c60b2df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.130071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae4b08bc70c94bb3a7da92970c60b2df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.131488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae4b08bc70c94bb3a7da92970c60b2df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.134551 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:15.142372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14712ef6f4954579ab433bb29cb62f84'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.156808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae4b08bc70c94bb3a7da92970c60b2df'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.178626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14712ef6f4954579ab433bb29cb62f84'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.216806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14712ef6f4954579ab433bb29cb62f84'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.220407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14712ef6f4954579ab433bb29cb62f84'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.232563 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3781/7566] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:14 2022] DELETE /identity/v3/users/ae4b08bc70c94bb3a7da92970c60b2df => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:15.239012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:15.246387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7a5138ab-7cb5-4bf4-9b27-da2644012747 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14712ef6f4954579ab433bb29cb62f84'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.247446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:15.264334 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3786/7567] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:14 2022] DELETE /identity/v3/users/14712ef6f4954579ab433bb29cb62f84 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:15.266136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:15.267512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:15.268833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:15.315133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:15.317721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:15.433321 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3787/7568] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:15.462397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:15.464133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:15.466802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3f1cce-c41d-4a05-bd5e-ad0154391cb6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:15.481485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:15.482400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:15.482658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:15.483520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:15.484283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:15.484621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:15.486297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:15.526466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3782/7569] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:15.527753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:15.537538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:15.564302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5df6ca-12bb-404f-9d46-9a714806b020 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:15.582354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d393-b639-403d-965e-274262093e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:15.583064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d393-b639-403d-965e-274262093e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:15.583349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d393-b639-403d-965e-274262093e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:15.583625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d393-b639-403d-965e-274262093e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:15.584330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d393-b639-403d-965e-274262093e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:15.586316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d393-b639-403d-965e-274262093e64 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:15.667040 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3783/7570] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:15 2022] POST /identity/v3/projects => generated 381 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:15.668137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d393-b639-403d-965e-274262093e64 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:15.674212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f448d393-b639-403d-965e-274262093e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:15.701761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78067dfc-0a91-41a4-aac1-6e613e2a3c9f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:15.815608 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:15.838403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:15.839197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:15.839565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:15.839754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:15.841883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d393-b639-403d-965e-274262093e64 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:15.865583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:15.866957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:15.867138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:15.868005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:15.870109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:15.870492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] PATH_INFO: `/v3/projects/17c0f8032bbe47448fa272dfb761b164` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:15.876050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] RBAC: Authorizing `identity:delete_project(project_id=17c0f8032bbe47448fa272dfb761b164)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:15.878932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:15.916813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3788/7571] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:15.917785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:15.939866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9138e0f-1251-4542-a7ed-e0a6d6d2ff75 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:15.960914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:15.961632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:15.961916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:15.962191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:15.962982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:15.965242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:15.978600 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:15.982158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17c0f8032bbe47448fa272dfb761b164', 'request_id': 'req-a63f178f-cd38-40b8-9638-401ccd94215a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:15.997400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17c0f8032bbe47448fa272dfb761b164', 'request_id': 'req-a63f178f-cd38-40b8-9638-401ccd94215a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:16.010267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17c0f8032bbe47448fa272dfb761b164', 'request_id': 'req-a63f178f-cd38-40b8-9638-401ccd94215a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:16.016966 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3789/7572] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:15 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:16.022202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:16.040277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] The token cache is being invalidate because project 17c0f8032bbe47448fa272dfb761b164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:16.040649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:16.047669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4126f-76cc-46bc-bdcf-83a8a5a0b113 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:16.048037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:16.048037 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3784/7573] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:15 2022] DELETE /identity/v3/projects/17c0f8032bbe47448fa272dfb761b164 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:16.213751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:16.213751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:16.213751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:16.215102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:16.215102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:16.217519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:16.238869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:16.241347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:16.244691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3790/7574] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:41:16.258050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f178f-cd38-40b8-9638-401ccd94215a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:16.265631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b3a96-8ed3-4b9f-a9b9-94fcf96d05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:16.267979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b3a96-8ed3-4b9f-a9b9-94fcf96d05bb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:16.267979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b3a96-8ed3-4b9f-a9b9-94fcf96d05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:16.268240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b3a96-8ed3-4b9f-a9b9-94fcf96d05bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:16.269523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b3a96-8ed3-4b9f-a9b9-94fcf96d05bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:16.271517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b3a96-8ed3-4b9f-a9b9-94fcf96d05bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:16.293458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:16.294052 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3785/7575] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:16.307583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864eedee-5105-4023-b0ca-ac76b42d17c7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:16.315482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:16.316547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:16.317033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:16.317189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] PATH_INFO: `/v3/projects/7b0d6d05486546c1bba5faaad95badd3/users/1b5a9b18f9b046eb840c568819456189/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:16.339724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0d6d05486546c1bba5faaad95badd3, user_id=1b5a9b18f9b046eb840c568819456189, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:16.347036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:16.390075 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3791/7576] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:16 2022] PUT /identity/v3/projects/7b0d6d05486546c1bba5faaad95badd3/users/1b5a9b18f9b046eb840c568819456189/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:16.406876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:16.407467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:16.407950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:16.490337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] MFA Rules not processed for user `1b5a9b18f9b046eb840c568819456189`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:16.492303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:16.655152 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3786/7577] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:16.695926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:16.697765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:16.865390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac10f22-3ae6-4dbe-9639-f458a9925c8d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:16.875481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:16.876604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:16.877083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:16.879233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:16.886855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:16.889789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:16.918827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:16.920310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:16.945942 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3792/7578] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:16.970443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:17.057176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915b3bcf-9dd4-4b97-b71e-de24fb8b5690 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:17.070493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:17.071315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.071663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.071997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] PATH_INFO: `/v3/projects/55cc82f82ca948cc8821c293cd30d917` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.073783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55cc82f82ca948cc8821c293cd30d917)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:17.075749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:17.086244 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:17.127866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d2cac2-8811-45e0-8c06-6c806dedf991 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:17.135738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:17.136683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.136963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.137238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] PATH_INFO: `/v3/users/1b5a9b18f9b046eb840c568819456189` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.140130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b5a9b18f9b046eb840c568819456189)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:17.142137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:17.182337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cc82f82ca948cc8821c293cd30d917', 'request_id': 'req-e108a3cc-f88d-4671-8fb8-468ed311f0b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.191701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cc82f82ca948cc8821c293cd30d917', 'request_id': 'req-e108a3cc-f88d-4671-8fb8-468ed311f0b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.193928 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:17.205598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cc82f82ca948cc8821c293cd30d917', 'request_id': 'req-e108a3cc-f88d-4671-8fb8-468ed311f0b7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.239020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] The token cache is being invalidate because project 55cc82f82ca948cc8821c293cd30d917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:17.239935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.241105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e108a3cc-f88d-4671-8fb8-468ed311f0b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.249205 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3787/7579] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:16 2022] DELETE /identity/v3/projects/55cc82f82ca948cc8821c293cd30d917 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:17.254120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539d3c-39fc-4214-9e66-f9edc5f0354d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.254488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539d3c-39fc-4214-9e66-f9edc5f0354d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.254680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94539d3c-39fc-4214-9e66-f9edc5f0354d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.293253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b5a9b18f9b046eb840c568819456189'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.307689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-94539d3c-39fc-4214-9e66-f9edc5f0354d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:17.312282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b5a9b18f9b046eb840c568819456189'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.313665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94539d3c-39fc-4214-9e66-f9edc5f0354d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:17.356021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b5a9b18f9b046eb840c568819456189'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.356902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b5a9b18f9b046eb840c568819456189'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.368534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-143dd9e3-af32-40b2-bc39-ccab2c547c18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b5a9b18f9b046eb840c568819456189'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:17.386327 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3793/7580] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:16 2022] DELETE /identity/v3/users/1b5a9b18f9b046eb840c568819456189 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:17.391763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.392393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.393553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.415370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:17.416995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:17.517341 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3788/7581] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:17.526324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.526876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.527306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.563055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:17.564304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:17.573093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3794/7582] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:17.589537 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3789/7583] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:17.594506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:17.613933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:17.615840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:17.616929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50456a-e08f-4c73-8b95-e2acf2fd4751 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:17.643133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:17.654406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.655127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.655494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.657050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:17.657380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:17.663674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:17.712983 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3795/7584] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:17.717919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:17.753377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2d85b3-e4b0-4e2f-b098-a06e16e67104 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:17.759884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:17.761733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.761995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee7ed89-af65-44f5-a067-d82bd5134134 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:17.762411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.762411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.764713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:17.769507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:17.771354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:17.772040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:17.772326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:17.772631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:17.797525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:17.799049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:17.823166 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3790/7585] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:17.829591 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3796/7586] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:17 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:17.834106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:17.857676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b797691-454f-4052-b9fe-1ba15905f94b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:18.017519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:18.022556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:18.022682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:18.022923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:18.028543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:18.031483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:18.101870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3791/7587] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:17 2022] POST /identity/v3/users => generated 286 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:18.108027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:18.124067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006b07c1-3029-41aa-853d-60c4c2d13840 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:18.144080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:18.144871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:18.145151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:18.145423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:18.146230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:18.149989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:18.181461 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3797/7588] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:18.183141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:18.199826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8a93-2222-4d02-aff8-5b6ca0b8e39e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:18.216323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b5bf70-ecd5-489d-8987-ab3debe4616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:18.216955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bf70-ecd5-489d-8987-ab3debe4616b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:18.217239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bf70-ecd5-489d-8987-ab3debe4616b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:18.217514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b5bf70-ecd5-489d-8987-ab3debe4616b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:18.218262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5bf70-ecd5-489d-8987-ab3debe4616b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:18.219926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b5bf70-ecd5-489d-8987-ab3debe4616b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:18.226433 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:18.250326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3792/7589] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:18.251650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:18.267224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58200243-c58a-4a8a-a570-d05b41a2b060 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:18.281189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:18.282376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:18.282667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:18.283064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] PATH_INFO: `/v3/projects/b754e9c2edf54a7f8aa736500f2de2dc/users/be83cb3486a94a249e3281b1fbad3142/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:18.309381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b754e9c2edf54a7f8aa736500f2de2dc, user_id=be83cb3486a94a249e3281b1fbad3142, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:18.312274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:18.316531 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:18.339648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3798/7590] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:18 2022] PUT /identity/v3/projects/b754e9c2edf54a7f8aa736500f2de2dc/users/be83cb3486a94a249e3281b1fbad3142/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:18.342020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:18.342354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:18.342637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:18.390626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:18.391841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:18.560663 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3793/7591] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:18.583544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:18.752871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa1b8d4-9e7e-4aa2-8179-44285fd0b540 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:18.767430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1f968e-993d-4070-a1ce-a200f49de027 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:18.768129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f968e-993d-4070-a1ce-a200f49de027 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:18.768500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f968e-993d-4070-a1ce-a200f49de027 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:18.768725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1f968e-993d-4070-a1ce-a200f49de027 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:18.809229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f968e-993d-4070-a1ce-a200f49de027 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:18.810746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1f968e-993d-4070-a1ce-a200f49de027 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:18.846777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3799/7592] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:19.096922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:19.099261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:19.123148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85374f2b-c4a8-4da3-aa39-92cdbdb47a53 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:19.131511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:19.132454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.132748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.134483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] PATH_INFO: `/v3/projects/7b0d6d05486546c1bba5faaad95badd3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.145414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0d6d05486546c1bba5faaad95badd3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:19.147458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:19.243661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0d6d05486546c1bba5faaad95badd3', 'request_id': 'req-ca2f6377-9c43-445d-a302-cce2fce3c5fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:19.265255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0d6d05486546c1bba5faaad95badd3', 'request_id': 'req-ca2f6377-9c43-445d-a302-cce2fce3c5fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:19.287876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0d6d05486546c1bba5faaad95badd3', 'request_id': 'req-ca2f6377-9c43-445d-a302-cce2fce3c5fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:19.309022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] The token cache is being invalidate because project 7b0d6d05486546c1bba5faaad95badd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:19.309444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:19.310547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca2f6377-9c43-445d-a302-cce2fce3c5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:19.312799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3794/7593] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:19 2022] DELETE /identity/v3/projects/7b0d6d05486546c1bba5faaad95badd3 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:19.317686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.317963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.318245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.348336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:19.351906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:19.492844 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3800/7594] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:19.501195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.501734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.502223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.545827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:19.547094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:19.564815 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3795/7595] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:19.569589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:19.586819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6f3cb-a1af-4716-af44-73d69753ae3c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:19.602820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:19.603795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.604257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.606384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.607498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:19.607967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:19.612581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:19.633085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3801/7596] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:19.637443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:19.651232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06324571-ea4a-4841-ad68-e8e57d700986 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:19.666963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:19.668268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.678909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.681457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.683292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:19.687201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:19.744908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:19.746734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:19.762469 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3796/7597] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:19 2022] POST /identity/v3/projects => generated 353 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:19.765305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:19.800303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ef008-5c77-44fb-8a0e-32226c8efa78 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:19.857969 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:19.896809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e49984-8252-4b17-9c7d-6df3f828b7b3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:19.911606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:19.912323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.912714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.912987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.913699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:19.915755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:19.956491 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3797/7598] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:19 2022] POST /identity/v3/users => generated 277 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:41:19.960529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:19.974723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252b69d4-fb1a-4756-b027-8dbf4b91015d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:19.974938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:19.975719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:19.976007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:19.976278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] PATH_INFO: `/v3/users/fea6427c4c8e48e59fc07c831981ec0e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:19.978869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fea6427c4c8e48e59fc07c831981ec0e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:19.981270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:20.018832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:20.020192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.020588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.020917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.021826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:20.026605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:20.030505 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:20.067711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3798/7599] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:41:20.071021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:20.090204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fea6427c4c8e48e59fc07c831981ec0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:20.103762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be59dc8e-e020-4453-95c8-27c10399e29b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:20.112834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fea6427c4c8e48e59fc07c831981ec0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:20.115230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:20.116658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.117254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.117966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.119503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:20.122177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:20.144002 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3799/7600] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:20.149578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:20.150443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fea6427c4c8e48e59fc07c831981ec0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:20.151180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fea6427c4c8e48e59fc07c831981ec0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:20.163625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33591a03-fcf1-429b-a19f-caa21c7b5d60 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:20.164709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-600847e0-9e22-426e-9209-9a317efe5fd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fea6427c4c8e48e59fc07c831981ec0e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:20.171140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efacf8-391a-412d-ad0e-5f36839cb3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:20.172472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efacf8-391a-412d-ad0e-5f36839cb3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.172903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efacf8-391a-412d-ad0e-5f36839cb3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.173322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efacf8-391a-412d-ad0e-5f36839cb3d0 admin admin] PATH_INFO: `/v3/projects/7eb1a3dc7f534be2b5bc9aee3ed1a3c7/users/318e471a06f949618f6f586665cc5ac9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.180113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3802/7601] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:19 2022] DELETE /identity/v3/users/fea6427c4c8e48e59fc07c831981ec0e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:20.182731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.183086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.183426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.215255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:20.217404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efacf8-391a-412d-ad0e-5f36839cb3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb1a3dc7f534be2b5bc9aee3ed1a3c7, user_id=318e471a06f949618f6f586665cc5ac9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:20.220526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:20.222425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efacf8-391a-412d-ad0e-5f36839cb3d0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:20.257070 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3800/7602] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:20 2022] PUT /identity/v3/projects/7eb1a3dc7f534be2b5bc9aee3ed1a3c7/users/318e471a06f949618f6f586665cc5ac9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:20.261368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.261773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.262142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.343516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] MFA Rules not processed for user `318e471a06f949618f6f586665cc5ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:20.345497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:20.386666 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3803/7603] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:20.459089 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3801/7604] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3220 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:20.465452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:20.467574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:20.497929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:20.499566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:20.569051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45724968-8a4c-48a6-98a2-878159697d35 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:20.659960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc3e8c-b591-4065-a172-e82d7e41cb2b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:20.677042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde4c04-3d03-4d69-9989-e4c9a97b54e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:20.692204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:20.693055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.693430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.693800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.697781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4c04-3d03-4d69-9989-e4c9a97b54e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.699324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4c04-3d03-4d69-9989-e4c9a97b54e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.699914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde4c04-3d03-4d69-9989-e4c9a97b54e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.732730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde4c04-3d03-4d69-9989-e4c9a97b54e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:20.736201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde4c04-3d03-4d69-9989-e4c9a97b54e4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:20.737910 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:20.750363 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3802/7605] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:20 2022] GET /identity/v3/auth/tokens => generated 3220 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:20.751911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:20.752809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:20.752809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:20.808557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] MFA Rules not processed for user `be83cb3486a94a249e3281b1fbad3142`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:20.810048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:20.819516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:20.821230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:20.833231 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3804/7606] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:20.839195 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:21.029542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3803/7607] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:21.066349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:21.074099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:21.265846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b37a-f5df-4fe6-ab59-4c5ab39444ee service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:21.271361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35860351-7395-4a91-ac13-424639c00ae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:21.272856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35860351-7395-4a91-ac13-424639c00ae8 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:21.273471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35860351-7395-4a91-ac13-424639c00ae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:21.274506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35860351-7395-4a91-ac13-424639c00ae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:21.301858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35860351-7395-4a91-ac13-424639c00ae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:21.308219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35860351-7395-4a91-ac13-424639c00ae8 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:21.347175 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3805/7608] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:21 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:22.524899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:22.527958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:22.571818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55300bc5-e99e-4fe0-b97c-3efd464baef8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:22.607778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:22.609092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:22.609587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:22.610088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] PATH_INFO: `/v3/projects/c7e9520f9db94ca9ac2871682ae9f06d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:22.615748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7e9520f9db94ca9ac2871682ae9f06d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:22.626424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:22.769583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7e9520f9db94ca9ac2871682ae9f06d', 'request_id': 'req-8f0529d1-57a9-4bc6-b078-2a966086f362'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:22.781965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7e9520f9db94ca9ac2871682ae9f06d', 'request_id': 'req-8f0529d1-57a9-4bc6-b078-2a966086f362'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:22.806287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7e9520f9db94ca9ac2871682ae9f06d', 'request_id': 'req-8f0529d1-57a9-4bc6-b078-2a966086f362'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:22.833444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] The token cache is being invalidate because project c7e9520f9db94ca9ac2871682ae9f06d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:22.834135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:22.834963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8f0529d1-57a9-4bc6-b078-2a966086f362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:22.838815 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3804/7609] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:22 2022] DELETE /identity/v3/projects/c7e9520f9db94ca9ac2871682ae9f06d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:22.845017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:22.845481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:22.845618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:22.875918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:22.877245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:23.026561 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3806/7610] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:23.034436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.034740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.035024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.110259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:23.112059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:23.144814 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3805/7611] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:23.148915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:23.163907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e350479-8d46-40ec-8ecd-d32fe7640859 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:23.177728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:23.178984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.179514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.179999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.181091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:23.181919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:23.186005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:23.227178 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3807/7612] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:23.233393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:23.244057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae983c6-6f9f-4ca4-89f8-25aa52f1ddd7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:23.256006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:23.257284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.258016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.259083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.262267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:23.265576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:23.307581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3806/7613] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:23 2022] POST /identity/v3/projects => generated 387 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:23.314630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:23.335577 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b53db0e-10d9-49a7-ac6c-2454f81f875f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:23.455894 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:23.496206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:23.497083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.497276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.497644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.498233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:23.500200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:23.548847 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3808/7614] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:23 2022] POST /identity/v3/users => generated 294 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:23.552876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:23.579326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9107c785-ecda-4d26-a04d-453701e1f5c0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:23.598325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:23.600665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.601595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.602720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.606502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:23.612027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:23.632895 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3807/7615] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:23.636669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:23.650812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a565e1a-766c-40d6-854b-6aa8ee76bf7c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:23.657253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5690c-fd3b-4490-8b7c-897ba07ce30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:23.658368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5690c-fd3b-4490-8b7c-897ba07ce30d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.658915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5690c-fd3b-4490-8b7c-897ba07ce30d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.659472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5690c-fd3b-4490-8b7c-897ba07ce30d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.661586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5690c-fd3b-4490-8b7c-897ba07ce30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:23.663772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5690c-fd3b-4490-8b7c-897ba07ce30d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:23.681715 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3809/7616] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:23.685741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:23.704191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d0c08e-a233-4447-a843-a15e936ca5ce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:23.712252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:23.713705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.714564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.715552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] PATH_INFO: `/v3/projects/c8e93a9815324f298658c79882b3852f/users/1606571535374e72af86252c2754a9c5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.777318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e93a9815324f298658c79882b3852f, user_id=1606571535374e72af86252c2754a9c5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:23.782667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:23.823680 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3808/7617] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:23 2022] PUT /identity/v3/projects/c8e93a9815324f298658c79882b3852f/users/1606571535374e72af86252c2754a9c5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:23.834979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635097d-aa9a-4464-98be-0cb10e8b95cf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:23.835681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635097d-aa9a-4464-98be-0cb10e8b95cf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:23.836312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e635097d-aa9a-4464-98be-0cb10e8b95cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:23.883491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e635097d-aa9a-4464-98be-0cb10e8b95cf None None] MFA Rules not processed for user `1606571535374e72af86252c2754a9c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:23.886374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e635097d-aa9a-4464-98be-0cb10e8b95cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:24.040018 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3810/7618] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:24.050904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:24.142302 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:24.203878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdad51ee-556d-4982-9a24-c9ac923bed7b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:24.226305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:24.227060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:24.227402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:24.227688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:24.228502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:24.230472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:24.242279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:24.243517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:24.243968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:24.280978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] MFA Rules not processed for user `be83cb3486a94a249e3281b1fbad3142`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:24.282453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:24.288800 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3809/7619] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:24 2022] POST /identity/v3/projects => generated 387 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:24.291392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:24.409867 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3811/7620] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:24.495779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b9735-9222-4cd3-b93e-95a7b8fb3f71 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:24.507036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:24.507909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:24.510639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:24.510938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:24.511680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:24.522127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:24.569355 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3810/7621] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:24 2022] POST /identity/v3/users => generated 301 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:24.570843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:24.585980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eadf3-7cec-47d2-ae22-14b7dbba714e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:24.595044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda426b0-3e32-40ee-9316-aeebe410a4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:24.596090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda426b0-3e32-40ee-9316-aeebe410a4f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:24.596389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda426b0-3e32-40ee-9316-aeebe410a4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:24.596681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda426b0-3e32-40ee-9316-aeebe410a4f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:24.597580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda426b0-3e32-40ee-9316-aeebe410a4f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:24.600762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda426b0-3e32-40ee-9316-aeebe410a4f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:24.619755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3812/7622] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:24.623201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:24.636482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0862b94-a5da-496c-b011-86d54460421f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:24.641811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:24.643010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:24.643303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:24.643891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] PATH_INFO: `/v3/projects/a8e469d3bfc44442a0da1cf281185db9/users/9dd1a531cb774c6796bc24e3ba49eca9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:24.668215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8e469d3bfc44442a0da1cf281185db9, user_id=9dd1a531cb774c6796bc24e3ba49eca9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:24.672108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:24.704372 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3811/7623] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:24 2022] PUT /identity/v3/projects/a8e469d3bfc44442a0da1cf281185db9/users/9dd1a531cb774c6796bc24e3ba49eca9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:24.716299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:24.716902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:24.717417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:24.780444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] MFA Rules not processed for user `9dd1a531cb774c6796bc24e3ba49eca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:24.782182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:24.881636 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:24.941318 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3813/7624] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:24 2022] POST /identity/v3/auth/tokens => generated 3261 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:24.987059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:24.989005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:25.130192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2bbf2-6ce0-43e3-b412-37a184b3ad74 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:25.136521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d58f8a-4c42-4a13-86ac-02ff9c87f04c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:25.137503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d58f8a-4c42-4a13-86ac-02ff9c87f04c service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:25.137835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d58f8a-4c42-4a13-86ac-02ff9c87f04c service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:25.138183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d58f8a-4c42-4a13-86ac-02ff9c87f04c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:25.150463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d58f8a-4c42-4a13-86ac-02ff9c87f04c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:25.151753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d58f8a-4c42-4a13-86ac-02ff9c87f04c service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:25.158270 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:25.185980 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3812/7625] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:41:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:41:26.206662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:26.331706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f53b37-7404-4c9d-b55f-4236cf1fc126 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:26.341814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:26.344957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:26.345246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:26.345523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] PATH_INFO: `/v3/users/1606571535374e72af86252c2754a9c5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:26.349961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1606571535374e72af86252c2754a9c5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:26.352030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:26.442058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1606571535374e72af86252c2754a9c5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.458879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1606571535374e72af86252c2754a9c5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.485498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1606571535374e72af86252c2754a9c5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.486321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1606571535374e72af86252c2754a9c5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.504443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1606571535374e72af86252c2754a9c5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.528115 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3814/7626] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:26 2022] DELETE /identity/v3/users/1606571535374e72af86252c2754a9c5 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:26.532468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:26.534144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:26.534589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:26.581266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:26.583109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:26.709959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:26.712228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:26.732743 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3813/7627] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:26.736565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0b304-58f6-420a-8731-83b5c75c2628 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:26.736864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:26.745911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:26.749983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:26.750945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:26.751486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:26.751779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] PATH_INFO: `/v3/users/318e471a06f949618f6f586665cc5ac9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:26.755036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=318e471a06f949618f6f586665cc5ac9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:26.757073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:26.890498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '318e471a06f949618f6f586665cc5ac9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.897370 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:26.917703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '318e471a06f949618f6f586665cc5ac9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.942505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64c585-0d3d-4166-a6cc-da6f1d8e5b8e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:26.947090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '318e471a06f949618f6f586665cc5ac9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.948186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '318e471a06f949618f6f586665cc5ac9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.948617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:26.949588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:26.950061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:26.950513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:26.953175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:26.969387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5347d8d4-e86b-4c91-99b8-e371a568c035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '318e471a06f949618f6f586665cc5ac9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:26.972622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:26.974575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:26.985488 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3815/7628] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:26 2022] DELETE /identity/v3/users/318e471a06f949618f6f586665cc5ac9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:26.989270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3814/7629] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:26.989902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:26.990184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:26.990469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:27.020125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:27.022543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:27.178690 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3816/7630] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:27.209828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:27.211388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:27.238736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a653c7d-2914-4f5f-835e-29790817469e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:27.413554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3db061-bdf4-4630-b285-c9911ebd0b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:27.414508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db061-bdf4-4630-b285-c9911ebd0b16 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:27.414939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db061-bdf4-4630-b285-c9911ebd0b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:27.415235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3db061-bdf4-4630-b285-c9911ebd0b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:27.438145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db061-bdf4-4630-b285-c9911ebd0b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:27.439693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3db061-bdf4-4630-b285-c9911ebd0b16 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:27.472561 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3815/7631] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:28.642216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:28.645545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:28.661031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e764fcfd-26de-4df8-b876-dda5cb2f0297 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:28.666587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:28.668436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:28.668982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:28.669423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] PATH_INFO: `/v3/users/e1353e498ec84fc2ac9dc4bba79d0869` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:28.671790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1353e498ec84fc2ac9dc4bba79d0869)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:28.674327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:28.851078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1353e498ec84fc2ac9dc4bba79d0869'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:28.872902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1353e498ec84fc2ac9dc4bba79d0869'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:28.905007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1353e498ec84fc2ac9dc4bba79d0869'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:28.905874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1353e498ec84fc2ac9dc4bba79d0869'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:28.922403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1353e498ec84fc2ac9dc4bba79d0869'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:28.939513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:28.940090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:28.940090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:28.942697 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3817/7632] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:28 2022] DELETE /identity/v3/users/e1353e498ec84fc2ac9dc4bba79d0869 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:28.974670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:28.975943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.044784 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:29.115285 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3816/7633] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:29.134240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:29.134240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.245205 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:29.282246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c17b4b-03d0-44b2-9305-3d68742b6607 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:29.299339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:29.299993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:29.300423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:29.300834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:29.318705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:29.320907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:29.336398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3818/7634] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:29.441193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:29.443449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.477167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:29.479364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.493990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da62d-2fcf-4834-bacc-4a3ae150191a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:29.508085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c73268-4207-4b79-a396-5ce350042876 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:29.508553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:29.509728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:29.510632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:29.511020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] PATH_INFO: `/v3/projects/c8e93a9815324f298658c79882b3852f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:29.514913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e93a9815324f298658c79882b3852f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:29.517880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:29.522043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:29.522586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:29.524423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:29.525156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] PATH_INFO: `/v3/projects/7eb1a3dc7f534be2b5bc9aee3ed1a3c7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:29.527537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb1a3dc7f534be2b5bc9aee3ed1a3c7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:29.532539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:29.654751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e93a9815324f298658c79882b3852f', 'request_id': 'req-1955b0b2-22e3-4ed3-b761-8d126f2d4698'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.661272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb1a3dc7f534be2b5bc9aee3ed1a3c7', 'request_id': 'req-7b778f5a-3857-47f6-91a6-505dd0182973'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.665706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e93a9815324f298658c79882b3852f', 'request_id': 'req-1955b0b2-22e3-4ed3-b761-8d126f2d4698'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.679392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb1a3dc7f534be2b5bc9aee3ed1a3c7', 'request_id': 'req-7b778f5a-3857-47f6-91a6-505dd0182973'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.681937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e93a9815324f298658c79882b3852f', 'request_id': 'req-1955b0b2-22e3-4ed3-b761-8d126f2d4698'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.690215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb1a3dc7f534be2b5bc9aee3ed1a3c7', 'request_id': 'req-7b778f5a-3857-47f6-91a6-505dd0182973'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.707936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] The token cache is being invalidate because project 7eb1a3dc7f534be2b5bc9aee3ed1a3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:29.708384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.709046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.711366 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3819/7635] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:29 2022] DELETE /identity/v3/projects/7eb1a3dc7f534be2b5bc9aee3ed1a3c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:29.712377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:29.713906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.722571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] The token cache is being invalidate because project c8e93a9815324f298658c79882b3852f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:29.723199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.724880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1955b0b2-22e3-4ed3-b761-8d126f2d4698 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.729847 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3817/7636] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:29 2022] DELETE /identity/v3/projects/c8e93a9815324f298658c79882b3852f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:29.730434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:29.730434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:29.730612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:29.796627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:29.798025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.880265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b778f5a-3857-47f6-91a6-505dd0182973 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:29.887154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:29.891428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:29.891869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:29.892282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] PATH_INFO: `/v3/projects/42e96216df5945ca8a83caf61b3cdee5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:29.893743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42e96216df5945ca8a83caf61b3cdee5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:29.896220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:29.934378 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3818/7637] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:29.935498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:29.937015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:29.951564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97907f2-2319-4796-a50c-41f806552ff9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:29.960117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:29.960633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:29.961018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:29.961472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] PATH_INFO: `/v3/users/9dd1a531cb774c6796bc24e3ba49eca9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:29.962846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd1a531cb774c6796bc24e3ba49eca9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:29.965041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:29.979095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42e96216df5945ca8a83caf61b3cdee5', 'request_id': 'req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:29.994633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42e96216df5945ca8a83caf61b3cdee5', 'request_id': 'req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.006906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42e96216df5945ca8a83caf61b3cdee5', 'request_id': 'req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.020103 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:30.043324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] The token cache is being invalidate because project 42e96216df5945ca8a83caf61b3cdee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:30.043861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.045853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-81c5330c-4163-4dcf-a6e7-c89c8f8aa308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.049019 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3820/7638] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:29 2022] DELETE /identity/v3/projects/42e96216df5945ca8a83caf61b3cdee5 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:30.051761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.052617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.053139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.064923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd1a531cb774c6796bc24e3ba49eca9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.065642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd1a531cb774c6796bc24e3ba49eca9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.079822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd1a531cb774c6796bc24e3ba49eca9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.081527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd1a531cb774c6796bc24e3ba49eca9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.082263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:30.083094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:30.100677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-2df58378-d8e6-4c7c-ae0d-f764597b5b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd1a531cb774c6796bc24e3ba49eca9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:30.102172 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:30.153250 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3819/7639] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:29 2022] DELETE /identity/v3/users/9dd1a531cb774c6796bc24e3ba49eca9 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:30.160623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3821/7640] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:30.161510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745dd29-a8f2-444d-8bf2-90d84b1037da None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.161969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745dd29-a8f2-444d-8bf2-90d84b1037da None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.162400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745dd29-a8f2-444d-8bf2-90d84b1037da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.167342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.187839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd98c9b-ba90-4cad-98de-1bffd9b45f84 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.229929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b745dd29-a8f2-444d-8bf2-90d84b1037da None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:30.231289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b745dd29-a8f2-444d-8bf2-90d84b1037da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:30.356852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.357552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.357830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.358101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.360291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:30.360638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:30.380812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:30.399141 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3820/7641] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:30.407879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.408290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.408675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.420894 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3822/7642] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:30.425854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.457615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:30.459017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:30.460940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf58b41-aa8c-473b-bbf5-2b328062a31e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.475603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.476301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.476610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.476943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.477712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:30.483404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:30.493538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3821/7643] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:30.501019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.524942 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3823/7644] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/projects => generated 403 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:30.526864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.528262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642382d-0442-4161-8dfd-d2cfe4f7baf2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.678328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb589d5-6c56-4758-8626-4bc884c649e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.678885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.679781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.680277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.681240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.682175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:30.682698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:30.685475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:30.693668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.694382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.694670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.694951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.705423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:30.707437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:30.736251 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:30.739715 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3822/7645] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:30.744746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.760819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3824/7646] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/users => generated 302 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:30.766092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.769896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cfc0b-3c33-4f20-92b2-86ac0b0ecb6d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.787167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.787856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.788138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.794079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.796311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:30.798824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1146f8c6-4509-4a3f-90d4-2e8c2ee32f72 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.800699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:30.811872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.813122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.814776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.815416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.816069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:30.820207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:30.873081 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3825/7647] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:30.874920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.885911 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3823/7648] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:30.891056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:30.901580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e574fceb-8353-4a13-9ae2-a5f32a267e25 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.966883 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:30.989899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bc19b-422a-44f5-b329-318e478a0590 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:30.997337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:30.998159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:30.998684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:30.999055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:30.999894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.002254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.032389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3824/7649] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:30 2022] POST /identity/v3/users => generated 282 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:41:31.035497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:31.079566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5ae43-2cdf-409b-aefe-5ca4229b741b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:31.096675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.097446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.097739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.098017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.098778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.102232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.149696 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3825/7650] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:41:31.154407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.155132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.155416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.155736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.156688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.158179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.158406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:31.187890 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3826/7651] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:31.189347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:31.196655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bd359e-f0e0-4761-9eb7-8e71b3c66e1d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:31.208014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07934574-6b08-4331-b6ba-25428e79f0aa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:31.218328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.221455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1a5bf-3a9b-48d8-b849-f20cd0a4da6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.221659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.222519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a5bf-3a9b-48d8-b849-f20cd0a4da6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.222811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a5bf-3a9b-48d8-b849-f20cd0a4da6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.223087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1a5bf-3a9b-48d8-b849-f20cd0a4da6c admin admin] PATH_INFO: `/v3/projects/f64d9f23323f47b488b7dc232ed0a502/users/808e0d2c2c944c09943eae760081f658/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.224110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.224557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.225814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.236719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.276677 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3826/7652] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:31.277746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a5bf-3a9b-48d8-b849-f20cd0a4da6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f64d9f23323f47b488b7dc232ed0a502, user_id=808e0d2c2c944c09943eae760081f658, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.278230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:31.281405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1a5bf-3a9b-48d8-b849-f20cd0a4da6c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.321269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636e0fc-443c-4919-8d36-4a722664a0b4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:31.322001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3827/7653] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:31 2022] PUT /identity/v3/projects/f64d9f23323f47b488b7dc232ed0a502/users/808e0d2c2c944c09943eae760081f658/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:31.328532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.329024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.331338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.397802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:31.399486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:31.484695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a0bca-c37d-4d27-b710-e91fe494eb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.485702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0bca-c37d-4d27-b710-e91fe494eb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.486100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0bca-c37d-4d27-b710-e91fe494eb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.486271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a0bca-c37d-4d27-b710-e91fe494eb05 admin admin] PATH_INFO: `/v3/projects/7bde7fb864064938bd67aff91f496ad8/users/5f712df6419249dcab69d9843e24a258/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.523529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a0bca-c37d-4d27-b710-e91fe494eb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bde7fb864064938bd67aff91f496ad8, user_id=5f712df6419249dcab69d9843e24a258, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.526389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a0bca-c37d-4d27-b710-e91fe494eb05 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.555914 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3827/7654] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:31 2022] PUT /identity/v3/projects/7bde7fb864064938bd67aff91f496ad8/users/5f712df6419249dcab69d9843e24a258/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:31.566806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.567256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.567376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.589983 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3828/7655] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:31.627438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] MFA Rules not processed for user `5f712df6419249dcab69d9843e24a258`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:31.628702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:31.633692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:31.641173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:31.808946 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3828/7656] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:31.809869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:31.811196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:31.811480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa16de-147d-4c9e-883c-dc1f98bcecd5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:31.827081 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:31.888206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.889866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.889866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.890382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.890823 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:31.960073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c27631-30ad-4fd8-89a1-9e9e95359a0f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:31.969067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:31.973121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:31.980648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:31.981227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] PATH_INFO: `/v3/projects/a8e469d3bfc44442a0da1cf281185db9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:31.982686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.983569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8e469d3bfc44442a0da1cf281185db9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:31.984514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.991974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:31.998498 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3829/7657] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:31.999857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:32.022006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98927dc5-a7d7-4507-a53f-95795f529948 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:32.032184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:32.033537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:32.034033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:32.034527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:32.055847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:32.057772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:32.078777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3830/7658] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:31 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:32.080041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:32.081267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8e469d3bfc44442a0da1cf281185db9', 'request_id': 'req-32adea70-6618-41cc-ada3-614d64a707a3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.083412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:32.092400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8e469d3bfc44442a0da1cf281185db9', 'request_id': 'req-32adea70-6618-41cc-ada3-614d64a707a3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.104738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8e469d3bfc44442a0da1cf281185db9', 'request_id': 'req-32adea70-6618-41cc-ada3-614d64a707a3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.115067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e359e9f9-19c2-452c-b224-82176bd04137 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:32.147055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] The token cache is being invalidate because project a8e469d3bfc44442a0da1cf281185db9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:32.147441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.151454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-32adea70-6618-41cc-ada3-614d64a707a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.153608 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3829/7659] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:31 2022] DELETE /identity/v3/projects/a8e469d3bfc44442a0da1cf281185db9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:32.323883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:32.332408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:32.332408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:32.332408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] PATH_INFO: `/v3/users/e4ed4f4360484ef18640f0f42e0d1fa3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:32.332408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ed4f4360484ef18640f0f42e0d1fa3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:32.351898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:32.493070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ed4f4360484ef18640f0f42e0d1fa3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.508516 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:32.523754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ed4f4360484ef18640f0f42e0d1fa3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.570755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ed4f4360484ef18640f0f42e0d1fa3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.571854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ed4f4360484ef18640f0f42e0d1fa3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.592141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ed4f4360484ef18640f0f42e0d1fa3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:32.618093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3831/7660] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:32 2022] DELETE /identity/v3/users/e4ed4f4360484ef18640f0f42e0d1fa3 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:32.619129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:32.619421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:32.619703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:32.662427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:32.663703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:32.788819 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3830/7661] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:32.820748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:32.823249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:32.935086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a49975-6021-4daf-bc00-8fea20ce3efc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:32.942318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc8006b-bc31-4df7-97d1-8fe4c965f9dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:32.943609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8006b-bc31-4df7-97d1-8fe4c965f9dc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:32.944198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8006b-bc31-4df7-97d1-8fe4c965f9dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:32.944673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc8006b-bc31-4df7-97d1-8fe4c965f9dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:32.959042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8006b-bc31-4df7-97d1-8fe4c965f9dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:32.960756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc8006b-bc31-4df7-97d1-8fe4c965f9dc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:32.978485 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3832/7662] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:33.379598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:33.381311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:33.398865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927f2d0-7dc8-42ac-9b35-4fe89fd692db None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:33.416447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:33.417373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:33.417647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:33.418105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] PATH_INFO: `/v3/projects/450a2d12cb49428db80aebdf27b732a1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:33.420481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=450a2d12cb49428db80aebdf27b732a1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:33.422473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:33.484188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '450a2d12cb49428db80aebdf27b732a1', 'request_id': 'req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:33.487534 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:33.494108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '450a2d12cb49428db80aebdf27b732a1', 'request_id': 'req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:33.509707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '450a2d12cb49428db80aebdf27b732a1', 'request_id': 'req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:33.529540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] The token cache is being invalidate because project 450a2d12cb49428db80aebdf27b732a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:33.529991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:33.530965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c1a14ace-924e-40c8-8f54-fa2f9613e2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:33.532843 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3831/7663] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:33 2022] DELETE /identity/v3/projects/450a2d12cb49428db80aebdf27b732a1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:33.538297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:33.538586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:33.538861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:33.560249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:33.561216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:33.637282 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3833/7664] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:33.746744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:33.747312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:33.748164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:33.792893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:33.795270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:33.839832 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3832/7665] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:33.843970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:33.872558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094d3bc-0b73-4c17-8669-e7c57b396d2e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:33.881234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:33.882405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:33.882981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:33.884438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:33.885348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:33.885902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:33.890797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:33.917500 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3834/7666] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:33.921735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:33.935406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d78a78-5a87-4850-9922-f05c5b9839d4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:33.943877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:33.945241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:33.945881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:33.946467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:33.947911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:33.952310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.009818 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3833/7667] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:33 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:34.014022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:34.033093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721203de-aad9-4fe5-a67b-8d121030c72c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:34.137770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:34.138655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.138936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.139221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.140031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:34.142159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.151641 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:34.176553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3835/7668] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:34 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:34.179130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:34.194263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff38870-a118-4e52-ab6a-2282a3598391 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:34.202635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:34.204526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.204933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.205317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.206185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:34.209378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.246961 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3834/7669] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:34.251278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:34.270245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251425c5-a144-4d22-9ea7-a90850498c73 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:34.281215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6206b73-f24b-463a-bc59-d5c48c08a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:34.283642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206b73-f24b-463a-bc59-d5c48c08a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.284920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206b73-f24b-463a-bc59-d5c48c08a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.285653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6206b73-f24b-463a-bc59-d5c48c08a0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.287491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6206b73-f24b-463a-bc59-d5c48c08a0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:34.291267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6206b73-f24b-463a-bc59-d5c48c08a0d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.343371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3836/7670] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:34.351068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:34.398836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3582c-7d84-4a74-bd35-1920894407d7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:34.416913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2e392-b0bb-4744-bba1-58073f589b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:34.420068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e392-b0bb-4744-bba1-58073f589b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.420330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e392-b0bb-4744-bba1-58073f589b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.420642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2e392-b0bb-4744-bba1-58073f589b3c admin admin] PATH_INFO: `/v3/projects/ba88502ff7534d2cacf1989bb4ba5b06/users/c6d16c41cc3d4368b18961ded33d267d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.460392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e392-b0bb-4744-bba1-58073f589b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba88502ff7534d2cacf1989bb4ba5b06, user_id=c6d16c41cc3d4368b18961ded33d267d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:34.463208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2e392-b0bb-4744-bba1-58073f589b3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.487120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3835/7671] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:34 2022] PUT /identity/v3/projects/ba88502ff7534d2cacf1989bb4ba5b06/users/c6d16c41cc3d4368b18961ded33d267d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:34.497588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.497902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.503010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.575892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.576580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.577023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.617868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] MFA Rules not processed for user `c6d16c41cc3d4368b18961ded33d267d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:34.621638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:34.632448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] MFA Rules not processed for user `808e0d2c2c944c09943eae760081f658`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:34.633915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:34.772513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3837/7672] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:34.777388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:34.797572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3836/7673] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:34 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:41:34.799460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:34.801707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:34.911517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0294f32f-9508-414b-92fe-5b63690c9f8c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:34.918575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:34.920331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.920786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.921256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.922127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:34.924687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.939728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ed137-58a8-443f-9f68-28b8170555d6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:34.957573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:34.958313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:34.958617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:34.958886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:34.959831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:34.963279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:34.978201 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3838/7674] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:34 2022] POST /identity/v3/projects => generated 393 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:34.979177 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:34.982381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.010571 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3837/7675] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:34 2022] POST /identity/v3/projects => generated 405 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:35.022149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.074383 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:35.092161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12883bf9-0c59-4404-94da-00949b9233aa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.097851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.098555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.099001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.099287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.100495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.102311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.105048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020cdaf9-5bc8-41d0-8092-2d18823dbf0e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.110103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.110954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.111306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.111659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.112685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.115177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.124458 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3839/7676] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:34 2022] POST /identity/v3/users => generated 303 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:35.131118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.146082 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3838/7677] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:35 2022] POST /identity/v3/users => generated 309 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:35.146297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195670b-5c2e-446b-8654-a89644ed9bfe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.147652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.151322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.152074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.152418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.153178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.153604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.155035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.162889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff1d99-8d55-4974-82ab-980149be22e5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.168606 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3840/7678] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:35.172765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.173189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.175410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.175410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.175410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.176020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.177894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.188887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912a9f8-cd69-4ed2-ab8e-ccf87f531c5c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.191341 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3839/7679] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:35.201223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.202930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.203231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.203372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.203563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] PATH_INFO: `/v3/projects/4e6b52bde8344250ba9a1c3993fef18b/users/f5f3d69647aa4e6898f5e5f70f697aca/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.224632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b52bde8344250ba9a1c3993fef18b, user_id=f5f3d69647aa4e6898f5e5f70f697aca, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.224955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0a7cf6-f6db-4d5a-a729-28be7a687057 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.227472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.231887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.233083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.233415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.233950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] PATH_INFO: `/v3/projects/1d591b8f1f2344c2bd1e3c33b3ae3650/users/4c74e6750a1743049b8e4a89888d6f13/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.244552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3841/7680] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:35 2022] PUT /identity/v3/projects/4e6b52bde8344250ba9a1c3993fef18b/users/f5f3d69647aa4e6898f5e5f70f697aca/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:35.254650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.254880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d591b8f1f2344c2bd1e3c33b3ae3650, user_id=4c74e6750a1743049b8e4a89888d6f13, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.257662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.275057 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3840/7681] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:35 2022] PUT /identity/v3/projects/1d591b8f1f2344c2bd1e3c33b3ae3650/users/4c74e6750a1743049b8e4a89888d6f13/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:35.279354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.371092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f095db4-44b2-480e-a2e4-55490900cc9b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.376069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.376805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.376969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d4756-2177-4ea7-9332-86fb940553b2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.377170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.377372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.378306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.379961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.383226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.383226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.383499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.383672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.385445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.387048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.402649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3841/7682] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:35.409895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.429250 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3842/7683] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:35 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:35.430813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.439446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ddb5c-1bc2-4128-89aa-dd4c36305501 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.448398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72b778-e5ca-43cd-ae25-f81217723770 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.455153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a83b1-0545-4ea2-a971-1fefbaf3d499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.456326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a83b1-0545-4ea2-a971-1fefbaf3d499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.457347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a83b1-0545-4ea2-a971-1fefbaf3d499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.458285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a83b1-0545-4ea2-a971-1fefbaf3d499 admin admin] PATH_INFO: `/v3/projects/1d591b8f1f2344c2bd1e3c33b3ae3650/users/4c74e6750a1743049b8e4a89888d6f13/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.462489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a83b1-0545-4ea2-a971-1fefbaf3d499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d591b8f1f2344c2bd1e3c33b3ae3650, user_id=4c74e6750a1743049b8e4a89888d6f13, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.463385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.466301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.466624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986a83b1-0545-4ea2-a971-1fefbaf3d499 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.467224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.467566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] PATH_INFO: `/v3/projects/4e6b52bde8344250ba9a1c3993fef18b/users/f5f3d69647aa4e6898f5e5f70f697aca/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.471398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b52bde8344250ba9a1c3993fef18b, user_id=f5f3d69647aa4e6898f5e5f70f697aca, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.474804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.479470 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3842/7684] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:35 2022] PUT /identity/v3/projects/1d591b8f1f2344c2bd1e3c33b3ae3650/users/4c74e6750a1743049b8e4a89888d6f13/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:35.504036 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3843/7685] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:35 2022] PUT /identity/v3/projects/4e6b52bde8344250ba9a1c3993fef18b/users/f5f3d69647aa4e6898f5e5f70f697aca/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:35.506253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2fee9-0736-4af6-95ad-4f9a9c59405a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.506436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2fee9-0736-4af6-95ad-4f9a9c59405a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.506883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf2fee9-0736-4af6-95ad-4f9a9c59405a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.542974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-caf2fee9-0736-4af6-95ad-4f9a9c59405a None None] MFA Rules not processed for user `f5f3d69647aa4e6898f5e5f70f697aca`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:35.544281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-caf2fee9-0736-4af6-95ad-4f9a9c59405a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:35.563772 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:35.657447 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3843/7686] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:35.677018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:35.680604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:35.823337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52468bf-ebc0-4f99-b3fc-0ff91da50567 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:35.832308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:35.834010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:35.834306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:35.834584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:35.876815 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:35.950832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:35.952813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:35.966555 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3844/7687] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:37.461481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:37.461983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:37.462174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:37.503809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] MFA Rules not processed for user `4c74e6750a1743049b8e4a89888d6f13`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:37.505170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:37.625283 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3844/7688] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:37 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:40.098973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:40.206008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428bcb9f-c6df-4a71-94fd-86b2fec3c4fc service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:40.212791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:40.214139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:40.214696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:40.215117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] PATH_INFO: `/v3/users/808e0d2c2c944c09943eae760081f658` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:40.216835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] RBAC: Authorizing `identity:delete_user(user_id=808e0d2c2c944c09943eae760081f658)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:40.219052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:40.308437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '808e0d2c2c944c09943eae760081f658'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:40.323234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '808e0d2c2c944c09943eae760081f658'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:40.344965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '808e0d2c2c944c09943eae760081f658'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:40.345839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '808e0d2c2c944c09943eae760081f658'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:40.358335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '808e0d2c2c944c09943eae760081f658'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:40.370775 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3845/7689] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:40 2022] DELETE /identity/v3/users/808e0d2c2c944c09943eae760081f658 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:40.796525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:40.812169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354927b-d607-407c-804b-6d2c83d42bd8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:40.923910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:40.924875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:40.925313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:40.926155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] PATH_INFO: `/v3/projects/f64d9f23323f47b488b7dc232ed0a502` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:40.927436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f64d9f23323f47b488b7dc232ed0a502)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:40.932193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:41.010585 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:41.024031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f64d9f23323f47b488b7dc232ed0a502', 'request_id': 'req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.038035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f64d9f23323f47b488b7dc232ed0a502', 'request_id': 'req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.066511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f64d9f23323f47b488b7dc232ed0a502', 'request_id': 'req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.085147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] The token cache is being invalidate because project f64d9f23323f47b488b7dc232ed0a502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:41.085837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.087059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.092269 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3845/7690] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:40 2022] DELETE /identity/v3/projects/f64d9f23323f47b488b7dc232ed0a502 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:41.093371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:41.095325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:41.117828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d372-5716-4953-929b-06e8e8f4113f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:41.185302 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:41.209788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:41.210993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:41.211371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:41.211719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] PATH_INFO: `/v3/users/4c74e6750a1743049b8e4a89888d6f13` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:41.213584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c74e6750a1743049b8e4a89888d6f13)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:41.215722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:41.286072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c74e6750a1743049b8e4a89888d6f13'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.297064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c74e6750a1743049b8e4a89888d6f13'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.314787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c74e6750a1743049b8e4a89888d6f13'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.315646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c74e6750a1743049b8e4a89888d6f13'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.326532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c5dd12e6-95de-4cd7-88a2-13cb4183c2b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c74e6750a1743049b8e4a89888d6f13'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.343882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3846/7691] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:41:41 2022] DELETE /identity/v3/users/4c74e6750a1743049b8e4a89888d6f13 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:41.589080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:41.590871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:41.616862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0079e5-d3fc-4bf1-89a5-a4f6e9238a3c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:41.759471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:41.760566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:41.760969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:41.761319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] PATH_INFO: `/v3/projects/1d591b8f1f2344c2bd1e3c33b3ae3650` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:41.770489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d591b8f1f2344c2bd1e3c33b3ae3650)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:41.774358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:41.898324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d591b8f1f2344c2bd1e3c33b3ae3650', 'request_id': 'req-d4254646-9b02-4451-9968-100bb75c82bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.910597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d591b8f1f2344c2bd1e3c33b3ae3650', 'request_id': 'req-d4254646-9b02-4451-9968-100bb75c82bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.937592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d591b8f1f2344c2bd1e3c33b3ae3650', 'request_id': 'req-d4254646-9b02-4451-9968-100bb75c82bc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.962470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] The token cache is being invalidate because project 1d591b8f1f2344c2bd1e3c33b3ae3650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:41:41.962707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.963557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d4254646-9b02-4451-9968-100bb75c82bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:41:41.974417 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3846/7692] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:41:41 2022] DELETE /identity/v3/projects/1d591b8f1f2344c2bd1e3c33b3ae3650 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:41.982303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:41.983423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:41.985318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.015702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:42.018066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:42.164444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3847/7693] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:42.173746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.174470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.174964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.219150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:42.221253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:42.235739 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3847/7694] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:42.240056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:42.254103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee8f4fb-4a4c-4ad7-b6f7-12fc87a6ad1c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:42.272195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:42.275194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.276496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.277039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.278145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:41:42.278788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:42.280984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:42.305726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3848/7695] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:41:42.306324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:42.327179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d9825-4775-4c76-a506-cd0e9ebb4973 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:42.338338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:42.339771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.340648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.341360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.342878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:42.348008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:42.399792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:42.414560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3848/7696] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:42 2022] POST /identity/v3/projects => generated 387 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:42.416639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e35da9e-b684-4b56-8cf8-ed0733221dc0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:42.485605 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:42.499401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:42.500535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.501341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.501718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.503304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:42.506214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:42.544585 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3849/7697] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:42 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:42.548103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:42.564155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac111b-4e57-40c2-9c66-19dd0bc6a8e4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:42.575148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:42.576059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.576599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.577220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.578827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:42.580894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:42.606013 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3849/7698] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:42.610956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:42.624942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f74f39f-a184-4d35-86d0-f415947b39be admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:42.633568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a358d42e-cc37-4c95-9205-cd1d59fff1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:42.634349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358d42e-cc37-4c95-9205-cd1d59fff1bf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.634731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358d42e-cc37-4c95-9205-cd1d59fff1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.635105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a358d42e-cc37-4c95-9205-cd1d59fff1bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.635956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358d42e-cc37-4c95-9205-cd1d59fff1bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:42.637762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a358d42e-cc37-4c95-9205-cd1d59fff1bf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:42.673689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:42.698324 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3850/7699] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:42.700776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54d28f-18e0-43e4-be6b-8020800cf666 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:42.713168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:42.714727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.715685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.715685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] PATH_INFO: `/v3/projects/4458796ca2184a54a608db97bc15d6ec/users/efce3ca57f6747ba8714ff7db06866e1/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.737491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4458796ca2184a54a608db97bc15d6ec, user_id=efce3ca57f6747ba8714ff7db06866e1, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:42.741419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:42.746736 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:42.768164 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3850/7700] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:42 2022] PUT /identity/v3/projects/4458796ca2184a54a608db97bc15d6ec/users/efce3ca57f6747ba8714ff7db06866e1/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:42.783916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:42.784336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:42.784835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:42.822450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] MFA Rules not processed for user `efce3ca57f6747ba8714ff7db06866e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:42.823917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:43.086552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3851/7701] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:43.091181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:43.299043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e479bf2-2cb3-4e23-a93b-be130c9bac9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:43.314272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:43.315309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.315595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.315930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.316664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:43.321636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:43.368587 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3851/7702] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:43 2022] POST /identity/v3/projects => generated 387 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:43.372871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:43.388105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b5f89-6fa9-4fb6-9fd1-0654dd622a26 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:43.477929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:43.478836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.479260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.479683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.480568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:43.485070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:43.512020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3852/7703] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:43 2022] POST /identity/v3/users => generated 294 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:43.515843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:43.538008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade55da-4da5-4cc4-9f9f-98dccf355174 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:43.546475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:43.547414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.547839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.548218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.561477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:43.563656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:43.583352 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3852/7704] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:41:43.587998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:43.604596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83fd55-9bfe-4926-83b6-0a631b7c8908 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:43.611662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cca7cb3-bf97-40bc-a5d3-fdfdba986e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:43.612592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7cb3-bf97-40bc-a5d3-fdfdba986e03 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.612988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7cb3-bf97-40bc-a5d3-fdfdba986e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.613564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cca7cb3-bf97-40bc-a5d3-fdfdba986e03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.614667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7cb3-bf97-40bc-a5d3-fdfdba986e03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:43.616615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cca7cb3-bf97-40bc-a5d3-fdfdba986e03 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:43.634199 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3853/7705] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:43.638482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:43.650324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0c0b9-1748-4e1d-9ed4-47018d6c7175 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:43.655700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:43.656658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.656944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.657219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] PATH_INFO: `/v3/projects/6fd5aa2bcdcd4e6d82a171121f5ff229/users/191fd53afc914729afb40f8986ba5277/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.676222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fd5aa2bcdcd4e6d82a171121f5ff229, user_id=191fd53afc914729afb40f8986ba5277, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:43.678975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:43.712056 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3853/7706] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:43 2022] PUT /identity/v3/projects/6fd5aa2bcdcd4e6d82a171121f5ff229/users/191fd53afc914729afb40f8986ba5277/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:41:43.714952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.715249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.715540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.754699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] MFA Rules not processed for user `191fd53afc914729afb40f8986ba5277`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:43.756470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:43.798891 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:43.878259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3854/7707] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:43.882910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:43.962954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65330df0-55bf-4feb-a580-c7c9c539a69e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:43.975837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:43.977036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:43.977430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:43.977811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:43.978704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:43.983705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:44.083362 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3854/7708] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:41:43 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:41:44.087803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:44.115707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b2fda-4c97-4623-8f1b-5744f7ee4a01 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:44.293093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:44.295360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:44.298421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:44.299069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:44.300505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:44.302776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:44.343623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3855/7709] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:41:44 2022] POST /identity/v3/users => generated 299 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:41:44.347620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:44.364676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c0cd3-dfd1-4d95-b8b1-8f5be84edfb9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:44.378559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:44.379279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:44.379563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:44.379836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:44.380720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:44.383094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:44.411813 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3855/7710] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:41:44.413482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:44.431282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af88f7d-2e24-4b04-8ce6-043e797783eb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:44.446540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:44.447630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:44.448306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:44.448948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] PATH_INFO: `/v3/projects/e7609476e3ad437a92df7cda26585ff6/users/7bda006f40c64f31ac3334e83008743e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:44.475544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7609476e3ad437a92df7cda26585ff6, user_id=7bda006f40c64f31ac3334e83008743e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:44.486440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:44.516823 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3856/7711] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:44 2022] PUT /identity/v3/projects/e7609476e3ad437a92df7cda26585ff6/users/7bda006f40c64f31ac3334e83008743e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:44.517350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:44.534313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80125015-166a-4269-a38b-0c62d141f45b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:44.590139 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:44.777564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9373bd2-b115-4222-99d9-55be54732ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:44.778795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9373bd2-b115-4222-99d9-55be54732ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:44.779322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9373bd2-b115-4222-99d9-55be54732ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:44.779807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9373bd2-b115-4222-99d9-55be54732ae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:44.792820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9373bd2-b115-4222-99d9-55be54732ae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:44.799207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9373bd2-b115-4222-99d9-55be54732ae3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:44.830942 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3856/7712] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:41:44.835423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:44.853396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58573a9-9f6d-487f-b336-ea6e400c15ce admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:44.869930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:44.871076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:44.871432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:44.871784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] PATH_INFO: `/v3/projects/e7609476e3ad437a92df7cda26585ff6/users/7bda006f40c64f31ac3334e83008743e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:44.874422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7609476e3ad437a92df7cda26585ff6, user_id=7bda006f40c64f31ac3334e83008743e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:44.877625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:44.906767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:44.907062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:44.907349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:44.908813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3857/7713] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:41:44 2022] PUT /identity/v3/projects/e7609476e3ad437a92df7cda26585ff6/users/7bda006f40c64f31ac3334e83008743e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:41:44.943958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] MFA Rules not processed for user `7bda006f40c64f31ac3334e83008743e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:44.945796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:45.047212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:45.065112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:45.104732 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3857/7714] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:45.117566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:45.119042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:45.264774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e8840-6172-42a2-90d6-64afa21b2ad9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:45.276705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:45.277394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:45.277680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:45.277958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:45.281680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:45.307685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cda773-07a1-4e4c-8712-8eca24ecb4af None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:45.321741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9a2c2-d58b-4014-b4b2-7b6ff0b5c242 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:45.322821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a2c2-d58b-4014-b4b2-7b6ff0b5c242 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:45.323260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a2c2-d58b-4014-b4b2-7b6ff0b5c242 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:45.323688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9a2c2-d58b-4014-b4b2-7b6ff0b5c242 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:45.345312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9a2c2-d58b-4014-b4b2-7b6ff0b5c242 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:45.349838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9a2c2-d58b-4014-b4b2-7b6ff0b5c242 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:45.360673 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:45.380325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3858/7715] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:45 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:45.469346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:45.475974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:45.519248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3858/7716] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:41:46.438176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7566-adae-4f83-8df7-b5929e6062f6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:46.438754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7566-adae-4f83-8df7-b5929e6062f6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:46.438754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a7566-adae-4f83-8df7-b5929e6062f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:46.481104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5a6a7566-adae-4f83-8df7-b5929e6062f6 None None] MFA Rules not processed for user `be83cb3486a94a249e3281b1fbad3142`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:46.485334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5a6a7566-adae-4f83-8df7-b5929e6062f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:46.582852 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:46.605511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:46.611128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:46.620724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3859/7717] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:46.629372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a673e8-8ceb-4275-aec0-592b7eb4407f service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:46.639203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:46.640007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:46.640372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:46.640740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:46.801661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:46.803165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:46.826716 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3859/7718] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:41:55.435209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:55.436881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:55.437109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:55.477097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] MFA Rules not processed for user `c6d16c41cc3d4368b18961ded33d267d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:41:55.478352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:41:55.628130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3860/7719] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:41:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:41:56.816011 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=41 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:41:57.806112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:41:57.818337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5abf664-d367-41ed-aeec-3d51bf60fba7 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:41:57.843051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f68f2-02b5-4764-9066-ef6b6a7a6c40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:41:57.845427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f68f2-02b5-4764-9066-ef6b6a7a6c40 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:41:57.845732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f68f2-02b5-4764-9066-ef6b6a7a6c40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:41:57.846015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f68f2-02b5-4764-9066-ef6b6a7a6c40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:41:58.106161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f68f2-02b5-4764-9066-ef6b6a7a6c40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:41:58.108732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f68f2-02b5-4764-9066-ef6b6a7a6c40 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:41:58.148284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3860/7720] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:41:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:03.953166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:04.130957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84aad7-9db9-4436-b6ce-27dccadcfa62 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:04.140561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:04.143100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:04.143429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:04.143718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] PATH_INFO: `/v3/users/efce3ca57f6747ba8714ff7db06866e1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:04.148159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efce3ca57f6747ba8714ff7db06866e1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:04.152972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:04.310514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efce3ca57f6747ba8714ff7db06866e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:04.316242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efce3ca57f6747ba8714ff7db06866e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:04.339464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efce3ca57f6747ba8714ff7db06866e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:04.340480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efce3ca57f6747ba8714ff7db06866e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:04.378796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efce3ca57f6747ba8714ff7db06866e1'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:04.425074 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3861/7721] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:42:03 2022] DELETE /identity/v3/users/efce3ca57f6747ba8714ff7db06866e1 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:04.429639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:04.430170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:04.430170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:04.480254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:04.486140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:04.689146 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3861/7722] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:04.747493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:04.749366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:04.781365 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:04.904468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a085a3e-eeb6-4c59-8d1a-caf333f06a96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:04.913368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:04.916979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:04.917286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:04.918132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:04.944194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:04.951299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:04.980873 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3862/7723] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:06.180228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:06.183518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:06.219930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210ba5e-e5f1-4951-848d-536bb3c327ae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:06.226938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:06.228728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:06.229272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:06.229754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] PATH_INFO: `/v3/projects/4458796ca2184a54a608db97bc15d6ec` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:06.231784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4458796ca2184a54a608db97bc15d6ec)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:06.234401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:06.345568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4458796ca2184a54a608db97bc15d6ec', 'request_id': 'req-9c6424e7-137a-42d1-a14e-e47091041710'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.361971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4458796ca2184a54a608db97bc15d6ec', 'request_id': 'req-9c6424e7-137a-42d1-a14e-e47091041710'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.382990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4458796ca2184a54a608db97bc15d6ec', 'request_id': 'req-9c6424e7-137a-42d1-a14e-e47091041710'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.414868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] The token cache is being invalidate because project 4458796ca2184a54a608db97bc15d6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:42:06.415548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.417593 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.422980 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3862/7724] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:42:06 2022] DELETE /identity/v3/projects/4458796ca2184a54a608db97bc15d6ec => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:06.426757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:06.439900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93d7e6-7615-4ed7-807b-5dc223c03183 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:06.541169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:06.542287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:06.542754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:06.543230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] PATH_INFO: `/v3/users/191fd53afc914729afb40f8986ba5277` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:06.545585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=191fd53afc914729afb40f8986ba5277)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:06.548965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:06.627102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '191fd53afc914729afb40f8986ba5277'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.627967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '191fd53afc914729afb40f8986ba5277'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.641298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '191fd53afc914729afb40f8986ba5277'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.644303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '191fd53afc914729afb40f8986ba5277'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.657750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '191fd53afc914729afb40f8986ba5277'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:06.687297 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3863/7725] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:42:06 2022] DELETE /identity/v3/users/191fd53afc914729afb40f8986ba5277 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:07.300399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:07.302244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:07.318662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6424e7-137a-42d1-a14e-e47091041710 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:07.384011 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:07.450312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:07.452159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:07.452305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:07.452653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] PATH_INFO: `/v3/projects/6fd5aa2bcdcd4e6d82a171121f5ff229` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:07.454497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fd5aa2bcdcd4e6d82a171121f5ff229)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:07.456488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:07.541069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fd5aa2bcdcd4e6d82a171121f5ff229', 'request_id': 'req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.555854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fd5aa2bcdcd4e6d82a171121f5ff229', 'request_id': 'req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.567573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fd5aa2bcdcd4e6d82a171121f5ff229', 'request_id': 'req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.592778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] The token cache is being invalidate because project 6fd5aa2bcdcd4e6d82a171121f5ff229 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:42:07.593906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.595433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.599427 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3863/7726] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:42:07 2022] DELETE /identity/v3/projects/6fd5aa2bcdcd4e6d82a171121f5ff229 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:07.603473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:07.605657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:07.626788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176c95d-04a5-405f-817a-9a386ac621ee admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:07.702062 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:07.751557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:07.751557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:07.751557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:07.751557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] PATH_INFO: `/v3/users/7bda006f40c64f31ac3334e83008743e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:07.755302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bda006f40c64f31ac3334e83008743e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:07.758844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:07.826412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bda006f40c64f31ac3334e83008743e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.827460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bda006f40c64f31ac3334e83008743e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.850553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bda006f40c64f31ac3334e83008743e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.851629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bda006f40c64f31ac3334e83008743e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.871819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e39c3159-c7c0-4e76-af55-f4a4140ff411 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bda006f40c64f31ac3334e83008743e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:07.917775 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3864/7727] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:42:07 2022] DELETE /identity/v3/users/7bda006f40c64f31ac3334e83008743e => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:08.447611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:08.451267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:08.474408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41c7686-e163-4ffc-bc5a-95ab4e21cd7b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:08.591050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:08.597050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:08.597363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:08.597661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] PATH_INFO: `/v3/projects/e7609476e3ad437a92df7cda26585ff6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:08.600031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7609476e3ad437a92df7cda26585ff6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:08.602616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:08.686195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7609476e3ad437a92df7cda26585ff6', 'request_id': 'req-aad9e478-fa31-4013-87d3-7c354552d8be'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:08.694699 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:08.704776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7609476e3ad437a92df7cda26585ff6', 'request_id': 'req-aad9e478-fa31-4013-87d3-7c354552d8be'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:08.731967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7609476e3ad437a92df7cda26585ff6', 'request_id': 'req-aad9e478-fa31-4013-87d3-7c354552d8be'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:08.768040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] The token cache is being invalidate because project e7609476e3ad437a92df7cda26585ff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:42:08.768535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:08.769895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-aad9e478-fa31-4013-87d3-7c354552d8be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:08.775994 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3864/7728] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:42:08 2022] DELETE /identity/v3/projects/e7609476e3ad437a92df7cda26585ff6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:08.784885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:08.785451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:08.785569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:08.862045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:08.872281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:08.955678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3865/7729] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:08.965147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:08.966095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:08.966982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:08.991640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:08.995090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:09.012807 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3865/7730] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:09.013468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.031232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0334e-417d-479a-a7cd-c45115295211 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:09.040130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:09.041055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.041444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.041824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.043020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:42:09.043435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:09.046118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:09.069157 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3866/7731] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:42:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:42:09.072958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.091301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddc0e9d-1a9b-4a53-a33f-4850e8ae1d35 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:09.102482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:09.103329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.103619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.106397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.119961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:09.122542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:09.196672 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3866/7732] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:42:09 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:42:09.197504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.212120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb56ea-b5b9-4965-9d3b-da0c5f7eead4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:09.331017 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:09.357619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:09.358320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.358604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.359077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.359586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:09.361571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:09.405499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.407124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3867/7733] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:42:09 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:42:09.419889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46719bc2-9815-46dd-899d-17256b1a4f35 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:09.436576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:09.437303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.438137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.438427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.440403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:09.446182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:09.487473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.496267 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3867/7734] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:42:09.502990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf37775-aac0-4543-9bd5-4ebdb43e2c3b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:09.516236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad33454b-c189-47a6-9ae1-e716465bbbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:09.517009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33454b-c189-47a6-9ae1-e716465bbbbf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.517297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33454b-c189-47a6-9ae1-e716465bbbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.517835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33454b-c189-47a6-9ae1-e716465bbbbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.518650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33454b-c189-47a6-9ae1-e716465bbbbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:09.520401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad33454b-c189-47a6-9ae1-e716465bbbbf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:09.568822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.582793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4649e4-a171-4528-ac0e-7431d3e430c3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:09.584151 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3868/7735] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:42:09 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:42:09.591645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:09.593493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.593493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.593493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] PATH_INFO: `/v3/projects/fd7ae35caac9411a96201fb2b13d2397/users/4c1caa644dfb43fcab4c4fef611e4d82/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.614199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd7ae35caac9411a96201fb2b13d2397, user_id=4c1caa644dfb43fcab4c4fef611e4d82, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:09.617033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:09.657780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3868/7736] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:42:09 2022] PUT /identity/v3/projects/fd7ae35caac9411a96201fb2b13d2397/users/4c1caa644dfb43fcab4c4fef611e4d82/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:09.669612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:09.669890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:09.670203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:09.715380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] MFA Rules not processed for user `4c1caa644dfb43fcab4c4fef611e4d82`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:09.716838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:09.924802 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3869/7737] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:09.943259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:09.945282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:10.116468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a839954-7be4-47a1-aeeb-ead616d708d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:10.121585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347732fa-d395-4f02-a42e-eb3c980619ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:10.122426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347732fa-d395-4f02-a42e-eb3c980619ab service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:10.122717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347732fa-d395-4f02-a42e-eb3c980619ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:10.122996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347732fa-d395-4f02-a42e-eb3c980619ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:10.137960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347732fa-d395-4f02-a42e-eb3c980619ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:10.139992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347732fa-d395-4f02-a42e-eb3c980619ab service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:10.180903 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3869/7738] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:10.191195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:10.360612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1abb71-2515-4951-8deb-5bbfb365874d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:10.380848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:10.382369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:10.385594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:10.386775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] PATH_INFO: `/v3/users/4c1caa644dfb43fcab4c4fef611e4d82` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:10.400746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c1caa644dfb43fcab4c4fef611e4d82)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:10.412437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:10.559760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c1caa644dfb43fcab4c4fef611e4d82'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:10.561633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c1caa644dfb43fcab4c4fef611e4d82'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:10.573689 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:10.596861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c1caa644dfb43fcab4c4fef611e4d82'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:10.598298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c1caa644dfb43fcab4c4fef611e4d82'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:10.611503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c1caa644dfb43fcab4c4fef611e4d82'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:10.668823 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3870/7739] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:42:10 2022] DELETE /identity/v3/users/4c1caa644dfb43fcab4c4fef611e4d82 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:10.670389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:10.670855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:10.671615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:10.721558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:10.723479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:10.929146 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3870/7740] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:42:10.955914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:10.959628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:11.069715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e7a47-c8bd-4062-8490-9e69dc350b9c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:11.085559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b9fe4c-31a2-40d7-b871-73d1a72d34eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:11.086389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9fe4c-31a2-40d7-b871-73d1a72d34eb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:11.086772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9fe4c-31a2-40d7-b871-73d1a72d34eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:11.087237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b9fe4c-31a2-40d7-b871-73d1a72d34eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:11.119235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9fe4c-31a2-40d7-b871-73d1a72d34eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:11.123994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b9fe4c-31a2-40d7-b871-73d1a72d34eb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:11.155728 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3871/7741] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:12.232642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:12.234688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:12.258428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94fc16d-d9c1-4a2f-b6d9-9886882dc816 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:12.265821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:12.282428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:12.283398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:12.287339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] PATH_INFO: `/v3/projects/fd7ae35caac9411a96201fb2b13d2397` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:12.290800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd7ae35caac9411a96201fb2b13d2397)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:12.293687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:12.356819 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:12.432302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd7ae35caac9411a96201fb2b13d2397', 'request_id': 'req-389700f8-d170-4b7d-9370-b6ce72dd613a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:12.452028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd7ae35caac9411a96201fb2b13d2397', 'request_id': 'req-389700f8-d170-4b7d-9370-b6ce72dd613a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:12.469125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd7ae35caac9411a96201fb2b13d2397', 'request_id': 'req-389700f8-d170-4b7d-9370-b6ce72dd613a'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:12.483443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] The token cache is being invalidate because project fd7ae35caac9411a96201fb2b13d2397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:42:12.483812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:12.498694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-389700f8-d170-4b7d-9370-b6ce72dd613a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:42:12.505307 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3871/7742] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:42:12 2022] DELETE /identity/v3/projects/fd7ae35caac9411a96201fb2b13d2397 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:12.511442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:12.511886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:12.512418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:12.553455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:12.558487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:12.677594 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3872/7743] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:12.685822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:12.686114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:12.686399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:12.733183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:12.739370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:12.757282 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3872/7744] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:42:12.761579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:12.776406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88909e69-09d5-4dcc-8f35-4b1f02d21789 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:12.792081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:12.793087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:12.793536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:12.793957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:12.795167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:42:12.795745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:12.797667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:12.819061 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3873/7745] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:42:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:42:12.820146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:12.833455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8733c-3199-47f2-97c5-aaa2b256dddd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:12.845244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:12.845942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:12.846233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:12.846506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:12.848248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:12.857950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:12.909625 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3873/7746] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:42:12 2022] POST /identity/v3/projects => generated 379 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:42:12.914023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:12.929403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a81a95-ec7b-49ce-992d-5819a1dc8fba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:13.074585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:13.075302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:13.075588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:13.075865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:13.076603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:13.082624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:13.101118 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:13.136243 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3874/7747] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:42:12 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:42:13.137771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:13.152235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aa359c-d573-48b5-8e07-db49594f8ebd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:13.164363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:13.165078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:13.166179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:13.166512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:13.167281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:13.169043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:13.202265 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3874/7748] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:42:13.208639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:13.233660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8830b201-7503-40d1-9a26-611f24078a22 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:13.250678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056b8ee-d92d-4b5b-b15a-e373b58ba664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:13.253697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b8ee-d92d-4b5b-b15a-e373b58ba664 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:13.256301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b8ee-d92d-4b5b-b15a-e373b58ba664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:13.259524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056b8ee-d92d-4b5b-b15a-e373b58ba664 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:13.260442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056b8ee-d92d-4b5b-b15a-e373b58ba664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:13.264988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c056b8ee-d92d-4b5b-b15a-e373b58ba664 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:13.297439 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3875/7749] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:42:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:42:13.301308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:13.316908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677c5ae-0be2-4d4d-9a31-46581721d9cd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:13.331131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:13.332249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:13.332560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:13.333687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] PATH_INFO: `/v3/projects/39edaa4447ec412eb0d82bbc309615b0/users/2f1df85cdc5747a18c413f5a111e876d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:13.355908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39edaa4447ec412eb0d82bbc309615b0, user_id=2f1df85cdc5747a18c413f5a111e876d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:13.358819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:13.385802 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3875/7750] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:42:13 2022] PUT /identity/v3/projects/39edaa4447ec412eb0d82bbc309615b0/users/2f1df85cdc5747a18c413f5a111e876d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:42:13.397697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c3d0-f4a7-444d-91fd-fa711e0470b1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:13.398008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c3d0-f4a7-444d-91fd-fa711e0470b1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:13.398255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9c3d0-f4a7-444d-91fd-fa711e0470b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:13.457495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70e9c3d0-f4a7-444d-91fd-fa711e0470b1 None None] MFA Rules not processed for user `2f1df85cdc5747a18c413f5a111e876d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:13.458783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70e9c3d0-f4a7-444d-91fd-fa711e0470b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:13.557177 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3876/7751] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:13.569521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:13.572318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:13.695510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f837bf2-c9c5-410b-b3d5-3109ee810826 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:13.708698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:13.710263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:13.710263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:13.710263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:13.728208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:13.729957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:13.750361 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3876/7752] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:13 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:14.786512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:14.787065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:14.787272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:14.962749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:14.964198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:15.227645 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3877/7753] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:42:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:15.330160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:15.334352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:15.441740 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:15.488097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff79d8c-82bc-4f88-91fd-032d72f66221 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:15.495017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:15.495885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:15.496556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:15.496931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:15.523944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:15.525922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:15.539093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3877/7754] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:42:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:42:16.638805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:16.640680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:16.783321 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:16.915532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c9131-b013-4cb0-b8cd-e0565e39f22e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:16.934411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:16.935111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:16.935447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:16.935733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:16.937739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:16.978516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:16.980161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:16.998799 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3878/7755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:23.743799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:23.745303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:23.798864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4dcd0-4684-47f5-8ba5-6ce5e22729f2 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:23.812706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:23.815962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:23.816255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:23.816576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:23.833509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:23.899194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:23.903288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:23.939480 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3878/7756] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:26.987992 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=18 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:33.915381 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=18 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:39.249445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:39.251420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:39.469955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73274029-20e0-4875-b55a-3519e51758eb service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:39.483114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:39.484183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:39.484796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:39.485422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:39.489807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:39.630197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:39.640936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c170b6c8-d873-4e60-ba8f-15a3ef3a68b8 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:39.679126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3879/7757] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:43.563738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:43.593124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d51cba-a385-4669-9225-7006f89aa4d7 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:43.617471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:43.618544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:43.618984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:43.620017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:43.639953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:43.641899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:43.669237 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3879/7758] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:42:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:42:44.535816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:44.537741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:44.538501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:44.568705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] MFA Rules not processed for user `f047ddb9fbfd4b6f8fd66d02e0dbca20`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:44.570389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:44.579354 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3880/7759] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:42:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:53.656583 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:54.561508 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=59 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:42:57.367505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:57.390336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9e60bb-2dbc-4586-84f4-f246d2692bd7 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:57.401748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:57.402968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:57.404311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:57.404781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:57.412971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:57.455036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:57.457172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265a3f3-7995-46b5-8148-3a9b3b122fd4 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:57.489914 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3880/7760] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:57.910206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:57.911804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:57.976907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:57.977194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:57.977734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:57.993858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf7ad3-84b7-4f66-a420-d526eb3fa1cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:58.001844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:58.002835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:58.003275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:58.003733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:58.013389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:58.014377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:58.015768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:58.029855 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3881/7761] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:42:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:42:58.038806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:58.045280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:58.050038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e93d23-3bde-499f-b7de-5c6d0a973b70 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:58.075880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a77080-8ba3-49e3-aa8c-514d4910f589 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:58.081869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4a00ea-63d8-449e-b571-aa6add2ee7d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:58.085624 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3881/7762] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:58.086022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a00ea-63d8-449e-b571-aa6add2ee7d2 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:58.086319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a00ea-63d8-449e-b571-aa6add2ee7d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:58.088106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4a00ea-63d8-449e-b571-aa6add2ee7d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:58.129840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a00ea-63d8-449e-b571-aa6add2ee7d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:58.131477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4a00ea-63d8-449e-b571-aa6add2ee7d2 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:58.167268 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3882/7763] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:42:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:42:58.346029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713296-b86e-4411-95a2-c13ac6d83e5e None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:58.346324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713296-b86e-4411-95a2-c13ac6d83e5e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:58.346609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07713296-b86e-4411-95a2-c13ac6d83e5e None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:58.348381 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3882/7764] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:42:58.362099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:58.362386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:58.362663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:58.421410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:42:58.423138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:58.435543 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3883/7765] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:42:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:42:58.460218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713296-b86e-4411-95a2-c13ac6d83e5e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:58.488085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07713296-b86e-4411-95a2-c13ac6d83e5e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:58.500282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:58.501070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:58.501521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:58.517745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:58.538956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:58.564405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:58.610757 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3883/7766] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:42:59.060227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:42:59.062601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:59.097201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c1251e-1da4-49a1-a50c-b79680562d26 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:42:59.119035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:42:59.121378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:42:59.122305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:42:59.123297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:42:59.128304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:42:59.172763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:42:59.175903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:42:59.195655 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3884/7767] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:42:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:05.746848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:05.748324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:05.906765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fcf44f-f85a-4e53-86e1-f18ed3ed33fe service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:05.922762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:05.923603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:05.925095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:05.926050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] PATH_INFO: `/v3/users/be83cb3486a94a249e3281b1fbad3142` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:05.929113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be83cb3486a94a249e3281b1fbad3142)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:05.934810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:06.026876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:06.028455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:06.045161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be83cb3486a94a249e3281b1fbad3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.046292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be83cb3486a94a249e3281b1fbad3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.066316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be83cb3486a94a249e3281b1fbad3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.067024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be83cb3486a94a249e3281b1fbad3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.076994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d33ec74a-9b42-4147-a63a-aaf166d7094b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be83cb3486a94a249e3281b1fbad3142'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.082575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d7d15e-1b8a-4812-973d-9e9fd6f32d7c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:06.102034 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3884/7768] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:05 2022] DELETE /identity/v3/users/be83cb3486a94a249e3281b1fbad3142 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:06.109735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:06.110652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:06.110971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:06.111247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] PATH_INFO: `/v3/users/0bb8e7e9ce4b4df0808120246c0ea085` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:06.112543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb8e7e9ce4b4df0808120246c0ea085)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:06.114512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:06.229648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb8e7e9ce4b4df0808120246c0ea085'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.245665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb8e7e9ce4b4df0808120246c0ea085'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.264551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb8e7e9ce4b4df0808120246c0ea085'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.265494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb8e7e9ce4b4df0808120246c0ea085'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.276118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb8e7e9ce4b4df0808120246c0ea085'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.286278 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3885/7769] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:06 2022] DELETE /identity/v3/users/0bb8e7e9ce4b4df0808120246c0ea085 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:06.291061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:06.291372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:06.291654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:06.326556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:06.327840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:06.342401 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:06.460336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3885/7770] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:43:06.481505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:06.483120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:06.658823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631125d1-c503-473a-ac7b-c87af23883f1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:06.671421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad3df7f-3ca8-4347-a422-3ca63e61f236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:06.671786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3df7f-3ca8-4347-a422-3ca63e61f236 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:06.672081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3df7f-3ca8-4347-a422-3ca63e61f236 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:06.674136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad3df7f-3ca8-4347-a422-3ca63e61f236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:06.714317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3df7f-3ca8-4347-a422-3ca63e61f236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:06.717012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad3df7f-3ca8-4347-a422-3ca63e61f236 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:06.722814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:06.724778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:06.756424 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3886/7771] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:06.765682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6105328f-29a9-4980-a326-91ad7a0e11c5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:06.778432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:06.780108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:06.780511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:06.780859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] PATH_INFO: `/v3/projects/b754e9c2edf54a7f8aa736500f2de2dc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:06.782272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b754e9c2edf54a7f8aa736500f2de2dc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:06.784788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:06.867722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b754e9c2edf54a7f8aa736500f2de2dc', 'request_id': 'req-dde53905-632c-4623-92f7-b0c30cc78d01'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.878658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b754e9c2edf54a7f8aa736500f2de2dc', 'request_id': 'req-dde53905-632c-4623-92f7-b0c30cc78d01'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.887069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b754e9c2edf54a7f8aa736500f2de2dc', 'request_id': 'req-dde53905-632c-4623-92f7-b0c30cc78d01'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.915261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] The token cache is being invalidate because project b754e9c2edf54a7f8aa736500f2de2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:06.915587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.916490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dde53905-632c-4623-92f7-b0c30cc78d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:06.923049 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3886/7772] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:06 2022] DELETE /identity/v3/projects/b754e9c2edf54a7f8aa736500f2de2dc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:06.924696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:06.925000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:06.925279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:06.949248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:06.950974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:06.957199 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:07.067248 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3887/7773] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:43:07.077226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.078377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.086278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.119270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:07.121056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:07.163774 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3887/7774] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:07.168584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.181214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57106b29-f25f-43dd-92ee-08cff21d146f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.181516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.183095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:07.187556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.188565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.189110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.189533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.191005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:07.191335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.193038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.218174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3888/7775] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:07.224382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.228899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc7e1a-6175-4d86-9906-b414d591aed2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.250559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.251514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.251806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.252084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] PATH_INFO: `/v3/projects/a5049d1f8e3d4e068a1690245fd7261b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.252622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833bb382-255d-46a7-a784-ebf804606140 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.253571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5049d1f8e3d4e068a1690245fd7261b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.256166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.259527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.260990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.261344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.261686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.262460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.265012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.309692 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3889/7776] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:07.315760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.352560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5049d1f8e3d4e068a1690245fd7261b', 'request_id': 'req-3be175b8-3a6c-43a1-bf9e-8196f901b73b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:07.365897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5049d1f8e3d4e068a1690245fd7261b', 'request_id': 'req-3be175b8-3a6c-43a1-bf9e-8196f901b73b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:07.385980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5049d1f8e3d4e068a1690245fd7261b', 'request_id': 'req-3be175b8-3a6c-43a1-bf9e-8196f901b73b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:07.413119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] The token cache is being invalidate because project a5049d1f8e3d4e068a1690245fd7261b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:07.413683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:07.414769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-3be175b8-3a6c-43a1-bf9e-8196f901b73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:07.417216 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3888/7777] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:07 2022] DELETE /identity/v3/projects/a5049d1f8e3d4e068a1690245fd7261b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:43:07.422203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f2bdf-1aed-4a9d-83d2-4689d1887cfd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.422698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f2bdf-1aed-4a9d-83d2-4689d1887cfd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.423130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8f2bdf-1aed-4a9d-83d2-4689d1887cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.449497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a516449-4abc-469d-8f11-54c08a861b9b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.453076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb8f2bdf-1aed-4a9d-83d2-4689d1887cfd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:07.454687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb8f2bdf-1aed-4a9d-83d2-4689d1887cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:07.460812 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:07.543697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.544723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.548746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.548746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.548746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.548746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.568688 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3889/7778] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:43:07.577881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.581962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.581962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.625538 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3890/7779] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/users => generated 286 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:07.629395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.631372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:07.637178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:07.638406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:07.646240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a15c24-9203-49e7-addd-6c93028724d6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.653180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.654144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.654611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.655151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.656302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.657866 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3890/7780] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:07.662368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.663314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.669178 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:07.678662 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3891/7781] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:43:07.683298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.700106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde5032-4282-44a2-9f44-4a96d8e92fda None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.712804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22676abb-8c63-4f34-863d-8fce265e5e89 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.721519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.722219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.722507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.722785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.723691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:07.724315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.725896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.737786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.738648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.739172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.739464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.740219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.742790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.759116 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3891/7782] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:07.763076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.777507 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3892/7783] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:43:07.782960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.799078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad447a2-778a-4eba-946f-437e7038463f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.803965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca989dc-1b30-4944-956a-e40f2efeb080 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:07.814137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.815400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.815709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.816020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] PATH_INFO: `/v3/projects/4113febee1994410a8b45a4097bd7bd7/users/d48c53bdca214973a1f1bcabd8709b92/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.818848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60aa4-5109-4a75-8ea3-80c098bbb807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:07.819541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60aa4-5109-4a75-8ea3-80c098bbb807 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.819835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60aa4-5109-4a75-8ea3-80c098bbb807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.820241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60aa4-5109-4a75-8ea3-80c098bbb807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.821635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60aa4-5109-4a75-8ea3-80c098bbb807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.823606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60aa4-5109-4a75-8ea3-80c098bbb807 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.843742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4113febee1994410a8b45a4097bd7bd7, user_id=d48c53bdca214973a1f1bcabd8709b92, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:07.848103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:07.890124 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3892/7785] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:43:07.891078 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3893/7785] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:07 2022] PUT /identity/v3/projects/4113febee1994410a8b45a4097bd7bd7/users/d48c53bdca214973a1f1bcabd8709b92/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:07.894397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:07.894397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:07.896451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:07.904234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:07.980159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] MFA Rules not processed for user `d48c53bdca214973a1f1bcabd8709b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:07.981544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:08.050051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34d4dd-8b9b-4c5f-8907-164dc539e2d2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:08.143580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:08.145104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.145663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.146024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.146870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:08.149738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:08.161538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3893/7786] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:08.170643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:08.177170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:08.185060 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3894/7787] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:07 2022] POST /identity/v3/users => generated 291 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:08.189716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:08.211139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81620418-3493-4749-ac6a-ed5e087b63f5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:08.225783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:08.228666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.230584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.231663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.234210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:08.240079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:08.266391 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3895/7788] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:43:08.268185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:08.291961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3169cff-4726-45ec-b9f2-ddec08dcf949 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:08.292818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3d669-71b9-4e13-a6e0-3312306d24cb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:08.297881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:08.298796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.299162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.299530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.306385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ab9f1-724f-407b-a00c-9b7ad5b69edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:08.307100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ab9f1-724f-407b-a00c-9b7ad5b69edb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.307396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ab9f1-724f-407b-a00c-9b7ad5b69edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.307661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ab9f1-724f-407b-a00c-9b7ad5b69edb admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.308552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ab9f1-724f-407b-a00c-9b7ad5b69edb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:08.310494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ab9f1-724f-407b-a00c-9b7ad5b69edb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:08.315727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:08.318097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:08.326062 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:08.334705 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3894/7789] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:43:08.352400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3896/7790] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:08.358579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:08.377706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6fb32d-5593-4970-a957-3d2a0627b90e service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:08.391588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:08.396308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.396658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.396930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] PATH_INFO: `/v3/projects/9da51d65e2b746178900d380dc21280a/users/4790439330224385a2bfb304b64f8b0f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.426510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da51d65e2b746178900d380dc21280a, user_id=4790439330224385a2bfb304b64f8b0f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:08.430359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:08.454652 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3895/7791] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:08 2022] PUT /identity/v3/projects/9da51d65e2b746178900d380dc21280a/users/4790439330224385a2bfb304b64f8b0f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:43:08.466801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f18f9d-f071-4c23-ab84-24c4e97c4373 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.467192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f18f9d-f071-4c23-ab84-24c4e97c4373 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.467424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f18f9d-f071-4c23-ab84-24c4e97c4373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.526840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-44f18f9d-f071-4c23-ab84-24c4e97c4373 None None] MFA Rules not processed for user `4790439330224385a2bfb304b64f8b0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:08.528601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-44f18f9d-f071-4c23-ab84-24c4e97c4373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:08.597867 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:08.682945 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3897/7792] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:08.694237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:08.696026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:08.822157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badae485-cfda-432b-abb3-ac320180461f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:08.833917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072359b6-f192-4320-9572-8308165be744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:08.834662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072359b6-f192-4320-9572-8308165be744 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:08.834957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072359b6-f192-4320-9572-8308165be744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:08.835445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072359b6-f192-4320-9572-8308165be744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:08.849974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072359b6-f192-4320-9572-8308165be744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:08.851613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072359b6-f192-4320-9572-8308165be744 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:08.896862 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3896/7793] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:11.209293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:11.209892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:11.209892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:11.237731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] MFA Rules not processed for user `d48c53bdca214973a1f1bcabd8709b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:11.239601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:11.321117 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3898/7794] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:43:18.877332 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:21.307833 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=39 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:35.383513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072359b6-f192-4320-9572-8308165be744 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:35.386792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-072359b6-f192-4320-9572-8308165be744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.404105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:35.406415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.507252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9c8047-9123-4818-9d4f-09b4eaff0e23 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:35.513418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:35.515401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:35.516225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:35.518095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] PATH_INFO: `/v3/users/5f712df6419249dcab69d9843e24a258` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:35.521044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f712df6419249dcab69d9843e24a258)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:35.526022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:35.563428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072359b6-f192-4320-9572-8308165be744 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:35.570724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:35.571446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:35.571961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:35.572253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:35.574916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.606084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:35.609774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b0be0-17ee-44fd-b2db-d916cc29d109 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:35.623296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f712df6419249dcab69d9843e24a258'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:35.631691 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3897/7795] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:35.635859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f712df6419249dcab69d9843e24a258'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:35.652780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f712df6419249dcab69d9843e24a258'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:35.653541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f712df6419249dcab69d9843e24a258'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:35.662769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f712df6419249dcab69d9843e24a258'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:35.672380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3899/7796] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:35 2022] DELETE /identity/v3/users/5f712df6419249dcab69d9843e24a258 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:43:35.675569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:35.675860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:35.676138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:35.700970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:35.702186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.702546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:35.705914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.783044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3898/7797] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:35.802367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:35.804081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.840557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bdc5aa-8b9b-4fbc-8516-56cffa2cbfc0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:35.849151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:35.850146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:35.850623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:35.851089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:35.854369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:35.882475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0fc117-e28d-4bea-aa0d-e3d3772ad3d1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:35.883071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:35.885689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:35.889224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff5e05f-4b7a-4206-9ed8-7320c9cd88d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:35.890847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e05f-4b7a-4206-9ed8-7320c9cd88d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:35.891303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e05f-4b7a-4206-9ed8-7320c9cd88d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:35.891732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff5e05f-4b7a-4206-9ed8-7320c9cd88d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:35.904126 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3900/7798] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:43:35.909734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e05f-4b7a-4206-9ed8-7320c9cd88d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:35.911381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff5e05f-4b7a-4206-9ed8-7320c9cd88d5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:35.942190 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3899/7799] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:36.279489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:36.281173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:36.305423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108b96d-01a1-4144-9f0b-6779ae2a9eec service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:36.320443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:36.321449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.321890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.322150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] PATH_INFO: `/v3/projects/7bde7fb864064938bd67aff91f496ad8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.323691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bde7fb864064938bd67aff91f496ad8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:36.325972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:36.330261 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:36.402476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bde7fb864064938bd67aff91f496ad8', 'request_id': 'req-c12d0571-91d7-483b-9585-809f6b21fb8f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:36.415590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bde7fb864064938bd67aff91f496ad8', 'request_id': 'req-c12d0571-91d7-483b-9585-809f6b21fb8f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:36.428105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bde7fb864064938bd67aff91f496ad8', 'request_id': 'req-c12d0571-91d7-483b-9585-809f6b21fb8f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:36.451731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] The token cache is being invalidate because project 7bde7fb864064938bd67aff91f496ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:36.452092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:36.455031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c12d0571-91d7-483b-9585-809f6b21fb8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:36.460029 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3901/7800] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:36 2022] DELETE /identity/v3/projects/7bde7fb864064938bd67aff91f496ad8 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:36.462020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.462532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.462637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.482757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:36.484279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:36.521298 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:36.569445 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3900/7801] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:36.577411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.578066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.578447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.627501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:36.631925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:36.645782 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3902/7802] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:36.649708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:36.662641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222194-6991-4d1a-9bb7-580be08ded8b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:36.668362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:36.669786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.670085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.670377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.672465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:36.672800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:36.674556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:36.691376 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3901/7803] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:36.695482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:36.707693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fd329-61bf-406e-ba88-a37a8e1754d0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:36.722727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:36.724379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.724379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.724379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.724996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:36.727060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:36.788797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3903/7804] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:36 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:36.797769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:36.810091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282204af-36ba-486a-9bcd-42b7448572f4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:36.895669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:36.896704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.897789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.898827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.899990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:36.903080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:36.947002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:36.947278 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3902/7805] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:36 2022] POST /identity/v3/users => generated 289 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:36.959186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3a220b-4a6f-444b-a7a6-a1443d9ba2ca admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:36.967793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:36.981327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:36.981997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:36.983363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:36.984465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:36.986257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:37.006771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:37.007571 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3904/7806] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:37.028572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cb860-1b79-4466-b2a4-dc2c139f82b5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:37.037517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da65947-41a0-4ec2-9fe5-ac38328eee95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:37.038406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65947-41a0-4ec2-9fe5-ac38328eee95 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:37.038828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65947-41a0-4ec2-9fe5-ac38328eee95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:37.039298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da65947-41a0-4ec2-9fe5-ac38328eee95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:37.040169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da65947-41a0-4ec2-9fe5-ac38328eee95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:37.062949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da65947-41a0-4ec2-9fe5-ac38328eee95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:37.096798 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3903/7807] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:37.098013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:37.110829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c364c73a-c3d4-4307-92e5-a5b19f3b2b72 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:37.125077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:37.125997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:37.126280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:37.126555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] PATH_INFO: `/v3/projects/739fedb3e1ee43a18444dd98ab76d8c7/users/7cdaeac04fdb413eabf5174102707d07/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:37.189853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=739fedb3e1ee43a18444dd98ab76d8c7, user_id=7cdaeac04fdb413eabf5174102707d07, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:37.197766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:37.246609 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3905/7808] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:37 2022] PUT /identity/v3/projects/739fedb3e1ee43a18444dd98ab76d8c7/users/7cdaeac04fdb413eabf5174102707d07/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:37.255452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:37.255993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:37.256469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:37.316636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] MFA Rules not processed for user `7cdaeac04fdb413eabf5174102707d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:37.318433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:37.434382 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3904/7809] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:37.443163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:37.445845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:37.576183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae09e71-f6d0-4dbe-a5d6-00e5be9a5819 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:37.581489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbf550d-4463-4983-9878-83fb5910ff9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:37.582198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf550d-4463-4983-9878-83fb5910ff9a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:37.582523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf550d-4463-4983-9878-83fb5910ff9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:37.582840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbf550d-4463-4983-9878-83fb5910ff9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:37.594364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf550d-4463-4983-9878-83fb5910ff9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:37.595876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbf550d-4463-4983-9878-83fb5910ff9a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:37.610505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3906/7810] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:40.644824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:40.648090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:40.757259 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:40.881309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e08ce0-2692-4a2b-81ff-712c77fb9e6e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:40.895492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:40.896598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:40.896971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:40.897188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] PATH_INFO: `/v3/users/4790439330224385a2bfb304b64f8b0f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:40.899102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4790439330224385a2bfb304b64f8b0f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:40.901753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:41.033595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4790439330224385a2bfb304b64f8b0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.034850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4790439330224385a2bfb304b64f8b0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.066313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4790439330224385a2bfb304b64f8b0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.067438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4790439330224385a2bfb304b64f8b0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.080097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4790439330224385a2bfb304b64f8b0f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.118267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:41.118946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:41.119549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:41.123771 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3905/7811] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:40 2022] DELETE /identity/v3/users/4790439330224385a2bfb304b64f8b0f => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:41.197614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:41.205105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:41.282261 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:41.335726 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3907/7812] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:41.343623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:41.345426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:41.455181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b8502-39fa-4a6e-9864-3b3fa8e042a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:41.465611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9d712a-d679-49b1-8fce-2d846f2c2950 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:41.466761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d712a-d679-49b1-8fce-2d846f2c2950 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:41.468127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d712a-d679-49b1-8fce-2d846f2c2950 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:41.468650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9d712a-d679-49b1-8fce-2d846f2c2950 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:41.484118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d712a-d679-49b1-8fce-2d846f2c2950 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:41.485910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9d712a-d679-49b1-8fce-2d846f2c2950 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:41.501740 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3906/7813] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:41.777648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:41.780588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:41.803971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75f08c-0685-424d-9c62-b1b2b645dfbb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:41.810130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:41.810841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:41.811184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:41.811671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] PATH_INFO: `/v3/projects/9da51d65e2b746178900d380dc21280a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:41.813816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da51d65e2b746178900d380dc21280a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:41.817468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:41.891763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da51d65e2b746178900d380dc21280a', 'request_id': 'req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.910776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da51d65e2b746178900d380dc21280a', 'request_id': 'req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.923144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da51d65e2b746178900d380dc21280a', 'request_id': 'req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.951119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] The token cache is being invalidate because project 9da51d65e2b746178900d380dc21280a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:41.954795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.954795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-082ff0b7-e1f7-454f-8eb3-0b4d97363bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:41.960138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3908/7814] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:41 2022] DELETE /identity/v3/projects/9da51d65e2b746178900d380dc21280a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:41.966462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:41.966929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:41.967057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.021604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:42.023602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:42.141969 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:42.169397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3907/7815] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:42.177705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.179102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.179581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.229846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:42.231530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:42.253865 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3909/7816] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:42.257292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.272088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d9afb-34b6-4248-89f3-14c3356f305c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:42.278502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:42.279547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.279834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.280110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.282294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:42.282753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:42.284849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:42.305377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3908/7817] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:42.309459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.324881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f521511-2b0c-488e-b7e3-5560227825ee None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:42.348444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:42.350086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.350367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.350637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.351347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:42.353368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:42.402196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.402613 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3910/7818] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:42 2022] POST /identity/v3/projects => generated 361 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:42.413876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdebca1-41a0-474f-bdc8-a50f01aef0d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:42.507001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:42.507692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.507967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.508438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.509318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:42.511557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:42.542294 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3909/7819] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:42 2022] POST /identity/v3/users => generated 281 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:42.547182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.561247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63dd17-9489-41f2-aa5e-2777202a43b4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:42.567162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:42.567974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.568326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.568694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.569707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:42.571765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:42.592284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3911/7820] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:42.596175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.612527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc9465-6c78-4c53-a917-2c7f588072a2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:42.626549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f028e8d-c5a6-4396-9904-9c69688e91d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:42.636530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028e8d-c5a6-4396-9904-9c69688e91d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.636952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028e8d-c5a6-4396-9904-9c69688e91d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.637229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f028e8d-c5a6-4396-9904-9c69688e91d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.637999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028e8d-c5a6-4396-9904-9c69688e91d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:42.639803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f028e8d-c5a6-4396-9904-9c69688e91d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:42.658842 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3910/7821] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:42.661287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.672834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ecbdba-8d48-4818-9b51-c1f80e674e1e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:42.683709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:42.684774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.685486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.686428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] PATH_INFO: `/v3/projects/843dd98b991342648becf056d3f04c23/users/e678582ca85a4323a802b6a02a31c517/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.711784 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=843dd98b991342648becf056d3f04c23, user_id=e678582ca85a4323a802b6a02a31c517, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:42.715200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:42.735236 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3912/7822] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:42 2022] PUT /identity/v3/projects/843dd98b991342648becf056d3f04c23/users/e678582ca85a4323a802b6a02a31c517/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:42.745698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:42.746125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:42.746533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:42.799515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] MFA Rules not processed for user `e678582ca85a4323a802b6a02a31c517`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:42.801843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:42.905021 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3911/7823] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:42.919083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:42.921940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:43.068720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1bb598-5088-43d1-b88c-f94ae66aa1a1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:43.073687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f086aba-de75-45ff-b732-c1eeee3cd509 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:43.074718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f086aba-de75-45ff-b732-c1eeee3cd509 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:43.075014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f086aba-de75-45ff-b732-c1eeee3cd509 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:43.075337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f086aba-de75-45ff-b732-c1eeee3cd509 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:43.082013 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:43.091838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f086aba-de75-45ff-b732-c1eeee3cd509 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:43.094290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f086aba-de75-45ff-b732-c1eeee3cd509 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:43.109161 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3913/7824] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:44.597835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:44.599599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:44.705134 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:44.731938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e01d71-840a-464c-82fc-76062d1fc24f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:44.742368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:44.743640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:44.743966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:44.744253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] PATH_INFO: `/v3/users/7cdaeac04fdb413eabf5174102707d07` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:44.746505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cdaeac04fdb413eabf5174102707d07)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:44.749725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:44.864084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cdaeac04fdb413eabf5174102707d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:44.865473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cdaeac04fdb413eabf5174102707d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:44.885275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cdaeac04fdb413eabf5174102707d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:44.887394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cdaeac04fdb413eabf5174102707d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:44.908147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cdaeac04fdb413eabf5174102707d07'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:44.939442 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3912/7825] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:44 2022] DELETE /identity/v3/users/7cdaeac04fdb413eabf5174102707d07 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:44.944316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:44.944930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:44.944930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:44.965778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:44.967974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:45.056486 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3914/7826] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:45.079338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:45.081408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:45.169439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85339d88-18fc-4248-8d27-b242dd3204c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:45.174807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eda62b-4f0f-4ee3-a43d-1fbc00bfa9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:45.175535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda62b-4f0f-4ee3-a43d-1fbc00bfa9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:45.175850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda62b-4f0f-4ee3-a43d-1fbc00bfa9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:45.176359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eda62b-4f0f-4ee3-a43d-1fbc00bfa9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:45.190641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda62b-4f0f-4ee3-a43d-1fbc00bfa9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:45.192438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7eda62b-4f0f-4ee3-a43d-1fbc00bfa9c2 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:45.229963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3913/7827] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:45.484299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:45.486544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:45.504868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d8077-1078-4e3b-a3ca-9f4364ca80d8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:45.511776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:45.513427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:45.513777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:45.514115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] PATH_INFO: `/v3/projects/739fedb3e1ee43a18444dd98ab76d8c7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:45.527170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=739fedb3e1ee43a18444dd98ab76d8c7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:45.531372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:45.618313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '739fedb3e1ee43a18444dd98ab76d8c7', 'request_id': 'req-cd20c305-c530-4b25-b67e-deb01a44d0ec'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:45.634759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '739fedb3e1ee43a18444dd98ab76d8c7', 'request_id': 'req-cd20c305-c530-4b25-b67e-deb01a44d0ec'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:45.652517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '739fedb3e1ee43a18444dd98ab76d8c7', 'request_id': 'req-cd20c305-c530-4b25-b67e-deb01a44d0ec'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:45.679872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] The token cache is being invalidate because project 739fedb3e1ee43a18444dd98ab76d8c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:45.680010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:45.681295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cd20c305-c530-4b25-b67e-deb01a44d0ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:45.690411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3915/7828] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:45 2022] DELETE /identity/v3/projects/739fedb3e1ee43a18444dd98ab76d8c7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:45.692269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:45.692774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:45.692877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:45.720994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:45.723054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:45.830209 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3914/7829] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:45.832854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:45.833144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:45.833420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:45.861234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:45.862980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:45.873345 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3916/7830] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:45.877577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:45.891565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192285b8-e8b3-4129-bb7f-f58fbd942d2f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:45.898017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:45.899311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:45.899879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:45.900506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:45.901533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:45.902771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:45.905692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:45.909415 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:45.925513 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3915/7831] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:45.929939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:45.965163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7712dd4c-60c6-42dd-b429-5f7c01dea56a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:45.986908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:45.989113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:45.990178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:45.990941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:45.992575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:45.997881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.049908 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3917/7832] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:45 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:46.054502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.065786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa067d7-79dd-4e47-a8bd-7d93a2c5fd5c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.164554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012377de-9b13-4956-824f-29be28457572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.165833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012377de-9b13-4956-824f-29be28457572 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.166121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012377de-9b13-4956-824f-29be28457572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.166384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012377de-9b13-4956-824f-29be28457572 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.167296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012377de-9b13-4956-824f-29be28457572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.174188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012377de-9b13-4956-824f-29be28457572 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.205167 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3916/7833] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:46 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:46.209116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.220187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e4584-9ffb-469f-adc4-3195957294c1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.226820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.228002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.228296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.228704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.229468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.232038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.248407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3918/7834] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:46.251712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012377de-9b13-4956-824f-29be28457572 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.265593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012377de-9b13-4956-824f-29be28457572 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.273428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab8620-cb2e-43dd-b625-6914cdef2477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.274141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8620-cb2e-43dd-b625-6914cdef2477 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.274429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8620-cb2e-43dd-b625-6914cdef2477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.274983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab8620-cb2e-43dd-b625-6914cdef2477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.275515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab8620-cb2e-43dd-b625-6914cdef2477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.277805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab8620-cb2e-43dd-b625-6914cdef2477 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.293426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3917/7835] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:43:46.298348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.324439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d62f0c-16fe-439b-a9cc-0897cb9c6fe8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.338761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.339741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.340051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.340304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] PATH_INFO: `/v3/projects/efcd40592bb4429b9477f9dce32cd30e/users/78088a39215b4acf8c7a823455b6cd37/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.361490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efcd40592bb4429b9477f9dce32cd30e, user_id=78088a39215b4acf8c7a823455b6cd37, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.364331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.392699 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3919/7836] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:46 2022] PUT /identity/v3/projects/efcd40592bb4429b9477f9dce32cd30e/users/78088a39215b4acf8c7a823455b6cd37/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:46.406358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.406890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.407362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.454689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] MFA Rules not processed for user `78088a39215b4acf8c7a823455b6cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:46.456382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:46.551893 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3918/7837] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:46.556373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.582734 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:46.657407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9cbbc-ed2b-41a4-ad70-e3024cfc8165 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.664464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.665227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.665573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.666005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.666943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.670781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.718139 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3920/7838] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:46 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:46.722185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.738380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6568a0-8f62-409f-a8a7-59ecf9bef644 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.866606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.867841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.868099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.868518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.869135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.871287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.885901 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:46.912109 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3919/7839] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:46 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:46.913280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.924657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b30075-8352-446a-a38a-11df99b92cd3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.930183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.931145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.931145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.931448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:46.932160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:46.933842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:46.948720 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3921/7840] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:46.953570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:46.965809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de085c7-4462-4182-aa43-974b64a8082b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:46.971607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:46.972755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:46.973065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:46.973338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] PATH_INFO: `/v3/projects/93da0a9daefb430cbfc9d6b818987a5b/users/2aba50465e994cabaedc7218d6799c6d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.008022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93da0a9daefb430cbfc9d6b818987a5b, user_id=2aba50465e994cabaedc7218d6799c6d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:47.011030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:47.032803 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3920/7841] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:46 2022] PUT /identity/v3/projects/93da0a9daefb430cbfc9d6b818987a5b/users/2aba50465e994cabaedc7218d6799c6d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:47.036011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:47.063028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b28206-352d-4f0e-b9d5-6c1d4c726568 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:47.200820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38025a47-4124-4d0b-ad37-550a9d00a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:47.201634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025a47-4124-4d0b-ad37-550a9d00a822 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:47.202027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025a47-4124-4d0b-ad37-550a9d00a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:47.202363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38025a47-4124-4d0b-ad37-550a9d00a822 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.203195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38025a47-4124-4d0b-ad37-550a9d00a822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:47.205802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38025a47-4124-4d0b-ad37-550a9d00a822 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:47.218831 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3922/7842] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:47.223522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:47.235503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450a3322-ce26-4ded-b08e-92815f49e1a0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:47.245568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:47.246512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:47.246913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:47.247264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] PATH_INFO: `/v3/projects/93da0a9daefb430cbfc9d6b818987a5b/users/2aba50465e994cabaedc7218d6799c6d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.250266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93da0a9daefb430cbfc9d6b818987a5b, user_id=2aba50465e994cabaedc7218d6799c6d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:47.254267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:47.281890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:47.282894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:47.283370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.285014 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3921/7843] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:47 2022] PUT /identity/v3/projects/93da0a9daefb430cbfc9d6b818987a5b/users/2aba50465e994cabaedc7218d6799c6d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:47.318252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] MFA Rules not processed for user `2aba50465e994cabaedc7218d6799c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:47.319854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:47.369182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:47.371799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:47.487311 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3923/7844] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:47 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:47.499327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:47.501215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:47.524556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d35cfc4-2a9b-44a1-b9b1-e40ca2f861f0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:47.530429 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:47.532911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:47.534382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:47.535029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:47.535537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] PATH_INFO: `/v3/users/2f1df85cdc5747a18c413f5a111e876d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.537629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f1df85cdc5747a18c413f5a111e876d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:47.540031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:47.685529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f1df85cdc5747a18c413f5a111e876d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:47.686371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f1df85cdc5747a18c413f5a111e876d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:47.704564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f1df85cdc5747a18c413f5a111e876d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:47.705693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f1df85cdc5747a18c413f5a111e876d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:47.707140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792bec18-670c-4e06-ae8e-4f0d2342599c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:47.718439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8248f9da-1082-424f-9e86-edc0b2eb6b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f1df85cdc5747a18c413f5a111e876d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:47.719555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:47.720485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:47.721127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:47.721449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.724380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:47.755388 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3922/7845] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:47 2022] DELETE /identity/v3/users/2f1df85cdc5747a18c413f5a111e876d => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:43:47.759716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:47.760263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:47.760776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:47.773843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:47.775459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:47.788167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:47.789770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:47.800114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3924/7846] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:47 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:47.864628 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:47.918633 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3923/7847] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:43:47.928622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:47.930259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:48.065264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b93349-ddff-4600-921e-192be8d7ee39 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:48.096596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:48.098485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:48.156123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:48.157139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:48.157639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:48.158063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:48.173086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:48.175424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:48.185558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d17633-eb92-4785-b2fe-62a478308a44 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:48.188071 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3925/7848] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:48.189721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:48.190431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:48.190914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:48.191262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:48.194006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:48.297659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:48.300415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9c3e4-fe1f-491e-baee-e266359a87ef service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:48.325011 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3924/7849] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:43:48.781366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:48.783706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:48.808572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b261f50-8f71-4408-816c-f4d9c681ae14 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:48.816204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:48.817556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:48.817965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:48.818394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] PATH_INFO: `/v3/projects/39edaa4447ec412eb0d82bbc309615b0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:48.819840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39edaa4447ec412eb0d82bbc309615b0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:48.822139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:48.900204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39edaa4447ec412eb0d82bbc309615b0', 'request_id': 'req-c464f65b-e072-480e-904c-6cdb7a3119a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:48.910118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39edaa4447ec412eb0d82bbc309615b0', 'request_id': 'req-c464f65b-e072-480e-904c-6cdb7a3119a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:48.917787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39edaa4447ec412eb0d82bbc309615b0', 'request_id': 'req-c464f65b-e072-480e-904c-6cdb7a3119a5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:48.923324 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:48.934494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] The token cache is being invalidate because project 39edaa4447ec412eb0d82bbc309615b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:48.935069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:48.935886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c464f65b-e072-480e-904c-6cdb7a3119a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:48.943762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:48.947393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:48.947393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:48.947835 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3926/7850] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:48 2022] DELETE /identity/v3/projects/39edaa4447ec412eb0d82bbc309615b0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:48.967528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:48.968916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:49.068385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.068385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.069510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.071024 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3925/7851] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:49.091487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:49.093339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:49.106910 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3927/7852] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:43:49.111836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.127666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5b926-512e-4fec-8707-43b1d3ad8ea3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.136088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.137297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.137872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.138736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.140115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:49.140889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:49.143285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:49.163713 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3926/7853] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:49.166412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.179829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299348e9-29aa-4611-b0df-db2eef9c6260 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.185879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.186815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.187121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.187383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.188293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:49.190763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:49.245926 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3928/7854] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:49 2022] POST /identity/v3/projects => generated 371 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:49.250344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.271564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bb599c-ae72-4bae-a39b-d369bf86a680 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.304981 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:49.390660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.392254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.392575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.392853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.393848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:49.396986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:49.435231 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3927/7855] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:49 2022] POST /identity/v3/users => generated 286 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:49.436405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.452170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf10a02b-b60f-42ca-a614-9b9d7c96485a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.461445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.462436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.462892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.463495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.464618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:49.467823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:49.488720 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3929/7856] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:43:49.493484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.506677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d62ce9-fe80-4eb2-82e4-231842ecb61f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.531991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504adbd8-5ab8-428e-8ec9-028eeabf652f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.532694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504adbd8-5ab8-428e-8ec9-028eeabf652f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.533022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504adbd8-5ab8-428e-8ec9-028eeabf652f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.533355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504adbd8-5ab8-428e-8ec9-028eeabf652f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.534103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504adbd8-5ab8-428e-8ec9-028eeabf652f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:49.535748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504adbd8-5ab8-428e-8ec9-028eeabf652f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:49.547596 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3928/7857] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:49.551813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.566690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82c960-8ea7-43f0-9496-2bbc3079a5fb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.573691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.575356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.575791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.576246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] PATH_INFO: `/v3/projects/347f245cee94444e97b68974519829bd/users/423981c1b40d4039bc854f637775c6ec/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.607243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347f245cee94444e97b68974519829bd, user_id=423981c1b40d4039bc854f637775c6ec, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:49.610127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:49.630066 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3930/7858] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:49 2022] PUT /identity/v3/projects/347f245cee94444e97b68974519829bd/users/423981c1b40d4039bc854f637775c6ec/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:49.642155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.642637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.643078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:49.679544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] MFA Rules not processed for user `423981c1b40d4039bc854f637775c6ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:49.680887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:49.818719 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3929/7859] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:49.832576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:49.837799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:49.981859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f35b532-a23d-487b-8cdb-e19de35860a6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:49.986564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daccc734-2eb6-44f8-8179-d91eb8f64a36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:49.987242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc734-2eb6-44f8-8179-d91eb8f64a36 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:49.987522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc734-2eb6-44f8-8179-d91eb8f64a36 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:49.987796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daccc734-2eb6-44f8-8179-d91eb8f64a36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:50.010481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccc734-2eb6-44f8-8179-d91eb8f64a36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:50.012136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daccc734-2eb6-44f8-8179-d91eb8f64a36 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:50.033029 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3931/7860] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:54.091465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:54.093453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:54.184055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced2de53-24f9-4d6b-9306-e50599d568eb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:54.193903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:54.194903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:54.195932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:54.197195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] PATH_INFO: `/v3/users/e678582ca85a4323a802b6a02a31c517` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:54.199349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e678582ca85a4323a802b6a02a31c517)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:54.202095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:54.263818 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:54.298257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e678582ca85a4323a802b6a02a31c517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:54.299397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e678582ca85a4323a802b6a02a31c517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:54.309697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e678582ca85a4323a802b6a02a31c517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:54.310363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e678582ca85a4323a802b6a02a31c517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:54.320861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e678582ca85a4323a802b6a02a31c517'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:54.357834 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3930/7861] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:43:54 2022] DELETE /identity/v3/users/e678582ca85a4323a802b6a02a31c517 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:54.359711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:54.360437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:54.360437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:54.389078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:54.392160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:54.495813 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3932/7862] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:54.503382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:54.505578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:54.608738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d6f5a-4607-4ca5-bff2-0d2abbb9f183 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:54.613739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8148d-6a67-416d-955d-434f4751513e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:54.615157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8148d-6a67-416d-955d-434f4751513e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:54.615628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8148d-6a67-416d-955d-434f4751513e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:54.616227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8148d-6a67-416d-955d-434f4751513e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:54.630446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8148d-6a67-416d-955d-434f4751513e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:54.632710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8148d-6a67-416d-955d-434f4751513e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:54.648279 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3931/7863] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:55.014043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.015756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:55.073184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4043813-45a2-4a4d-9195-3fa885bdcb92 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.081211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.082585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.082874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.083161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] PATH_INFO: `/v3/projects/843dd98b991342648becf056d3f04c23` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.084754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] RBAC: Authorizing `identity:delete_project(project_id=843dd98b991342648becf056d3f04c23)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:55.087000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:55.109660 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:55.193453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '843dd98b991342648becf056d3f04c23', 'request_id': 'req-479a7ed1-2c1d-4cd6-84f8-423738a8898d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:55.214565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '843dd98b991342648becf056d3f04c23', 'request_id': 'req-479a7ed1-2c1d-4cd6-84f8-423738a8898d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:55.233218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '843dd98b991342648becf056d3f04c23', 'request_id': 'req-479a7ed1-2c1d-4cd6-84f8-423738a8898d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:55.265233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] The token cache is being invalidate because project 843dd98b991342648becf056d3f04c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:43:55.265538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:55.272059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-479a7ed1-2c1d-4cd6-84f8-423738a8898d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:43:55.272784 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3933/7864] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:43:55 2022] DELETE /identity/v3/projects/843dd98b991342648becf056d3f04c23 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:55.274290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.274760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.274861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.303290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:55.304619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:55.458748 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3932/7865] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:55.465465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.466031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.466031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.488922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:55.490545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:55.500882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3934/7866] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:55.505638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.517467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ade1b1-f35f-4ea8-95ea-1176c0e443b7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.522922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.525048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.525048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.525048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.525048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:43:55.525801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:55.527760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:55.546892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3933/7867] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:43:55.548041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.559855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd40e3a-ab5b-4548-bb70-1e7d67c80715 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.566300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.567248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.567669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.570894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.570894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:55.572382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:55.608943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.614802 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3935/7868] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:55 2022] POST /identity/v3/projects => generated 363 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:55.622016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733ec75-7409-4938-88e1-c3582745f949 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.693057 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:55.741167 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.743655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.743933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.744215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.746040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:55.748221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:55.775582 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3934/7869] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:55 2022] POST /identity/v3/users => generated 282 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:55.780572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.804139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2427df02-433f-44f5-8bad-a883012a0afe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.827130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.827843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.829210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.829402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.830139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:55.831786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:55.855493 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3936/7870] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:55.859797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.876390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbf9753-acdc-4360-890e-c1bb10153535 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.903859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b6a47-ba95-4df4-8f15-68e7de6da9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.904939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6a47-ba95-4df4-8f15-68e7de6da9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.905335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6a47-ba95-4df4-8f15-68e7de6da9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.905752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b6a47-ba95-4df4-8f15-68e7de6da9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.907868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6a47-ba95-4df4-8f15-68e7de6da9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:55.912145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b6a47-ba95-4df4-8f15-68e7de6da9ab admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:55.937700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3935/7871] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:55.939331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:55.954798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dd6b6d-054a-4300-9027-ca1a1fc08933 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:55.969769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:55.970872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:55.971327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:55.971791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] PATH_INFO: `/v3/projects/78b535c13ade43698f6f9f7ca8e5424a/users/630cc241e9994aaba22f925c5e820a12/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:55.996791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78b535c13ade43698f6f9f7ca8e5424a, user_id=630cc241e9994aaba22f925c5e820a12, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:56.005590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:56.047811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3937/7872] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:55 2022] PUT /identity/v3/projects/78b535c13ade43698f6f9f7ca8e5424a/users/630cc241e9994aaba22f925c5e820a12/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:56.084426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:56.084735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:56.084991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:56.166418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] MFA Rules not processed for user `630cc241e9994aaba22f925c5e820a12`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:56.166993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:56.360883 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3936/7873] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:56 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:56.365641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:56.458306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef415d73-5eb7-4a1f-97b8-bec2a173d31d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:56.466887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:56.467634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:56.467759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:56.468014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:56.468767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:56.471189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:56.545921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:56.548994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:56.597580 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3938/7874] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:43:56 2022] POST /identity/v3/projects => generated 365 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:43:56.600533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:56.709958 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:56.793946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6342d04-662f-475e-a6d1-01cad096fde9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:56.836068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d69e24-04c9-4ab7-a8a3-bb9ccefb2bc1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:56.855944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:56.860989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:56.861512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:56.862201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:56.862842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:56.865490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:56.902524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:56.903206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:56.903488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:56.903768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:56.905720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:56.917320 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3939/7875] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:43:56 2022] POST /identity/v3/users => generated 289 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:43:56.920299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:56.931246 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:56.966262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f271-126c-4943-99a3-5767693c5410 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:56.986953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:56.995439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:56.995439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:56.995439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:56.997021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:56.998800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:57.072963 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3940/7876] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:57.084705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:57.117580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:57.119326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:57.124494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fde347-aa19-40de-a11d-0afd37b65eec admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:57.166415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:57.169481 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3937/7877] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:57.170862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:57.171157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:57.171451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] PATH_INFO: `/v3/projects/b5f2b749bcbe438a8f9ab12e0bb5462a/users/dc64a617a9554effa29b521f6ad5ed24/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:57.252996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f2b749bcbe438a8f9ab12e0bb5462a, user_id=dc64a617a9554effa29b521f6ad5ed24, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:57.264774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:57.318845 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3941/7878] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:57 2022] PUT /identity/v3/projects/b5f2b749bcbe438a8f9ab12e0bb5462a/users/dc64a617a9554effa29b521f6ad5ed24/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:57.320060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:57.344906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b0d00-0bb8-4403-a92e-732ec2a93793 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:57.624163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0803fa8-7175-4c46-89d6-2333f610006a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:57.625211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0803fa8-7175-4c46-89d6-2333f610006a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:57.626001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0803fa8-7175-4c46-89d6-2333f610006a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:57.626001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0803fa8-7175-4c46-89d6-2333f610006a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:57.626791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0803fa8-7175-4c46-89d6-2333f610006a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:57.628863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0803fa8-7175-4c46-89d6-2333f610006a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:57.668934 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3938/7879] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:43:57.673905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:57.707543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb8f0f-6258-4594-bccc-7296758d4678 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:57.725040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:57.726117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:57.727171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:57.728439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] PATH_INFO: `/v3/projects/b5f2b749bcbe438a8f9ab12e0bb5462a/users/dc64a617a9554effa29b521f6ad5ed24/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:57.730237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5f2b749bcbe438a8f9ab12e0bb5462a, user_id=dc64a617a9554effa29b521f6ad5ed24, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:57.733170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:57.752932 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3942/7880] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:43:57 2022] PUT /identity/v3/projects/b5f2b749bcbe438a8f9ab12e0bb5462a/users/dc64a617a9554effa29b521f6ad5ed24/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:43:57.777528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:57.778261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:57.778776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:57.832683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] MFA Rules not processed for user `dc64a617a9554effa29b521f6ad5ed24`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:43:57.836293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:58.061224 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3939/7881] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:43:57 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:43:58.075332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:58.078166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:43:58.211944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d1cc7-1b81-4a91-9b73-c713ea14e0e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:58.217837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:58.218627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:58.219098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:58.219965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:58.246584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:58.248495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:58.264395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3943/7882] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:58 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:43:58.602952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:43:58.647309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bde6e-b598-4922-919b-e9bb094f6bd9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:43:58.655282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875de92-fc9a-43ee-ab48-2b5809eaf324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:43:58.656048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875de92-fc9a-43ee-ab48-2b5809eaf324 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:43:58.656611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875de92-fc9a-43ee-ab48-2b5809eaf324 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:43:58.657166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875de92-fc9a-43ee-ab48-2b5809eaf324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:43:58.730126 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:43:58.797545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875de92-fc9a-43ee-ab48-2b5809eaf324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:43:58.799414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8875de92-fc9a-43ee-ab48-2b5809eaf324 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:43:58.814379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3940/7883] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:43:58 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:02.485882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:02.702937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed1efab-550c-4555-bc44-067d2ae946d8 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:02.717413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:02.721719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:02.722394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:02.723347 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] PATH_INFO: `/v3/users/630cc241e9994aaba22f925c5e820a12` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:02.725439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630cc241e9994aaba22f925c5e820a12)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:02.729254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:02.765116 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:02.860302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630cc241e9994aaba22f925c5e820a12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:02.888933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630cc241e9994aaba22f925c5e820a12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:02.953352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630cc241e9994aaba22f925c5e820a12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:02.954247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630cc241e9994aaba22f925c5e820a12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:02.981414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630cc241e9994aaba22f925c5e820a12'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:03.001853 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3944/7884] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:02 2022] DELETE /identity/v3/users/630cc241e9994aaba22f925c5e820a12 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:03.004262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:03.004872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:03.004872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:03.039988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:03.042330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:03.234695 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3941/7885] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:03.246144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:03.249100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:03.439645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c86a5-11f9-47ce-bc93-3aa4292a8b68 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:03.445012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:03.445834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:03.446162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:03.446453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:03.465046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:03.466719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:03.480866 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3945/7886] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:03.985970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:03.987900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:04.005475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fab226-c928-4c04-87b9-7330be4b1be9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:04.016783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:04.018045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:04.018991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:04.019547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] PATH_INFO: `/v3/projects/78b535c13ade43698f6f9f7ca8e5424a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:04.021177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=78b535c13ade43698f6f9f7ca8e5424a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:04.024062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:04.150995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78b535c13ade43698f6f9f7ca8e5424a', 'request_id': 'req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.168835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78b535c13ade43698f6f9f7ca8e5424a', 'request_id': 'req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.180376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78b535c13ade43698f6f9f7ca8e5424a', 'request_id': 'req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.213653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] The token cache is being invalidate because project 78b535c13ade43698f6f9f7ca8e5424a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:04.213946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.214691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.217198 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3942/7887] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:03 2022] DELETE /identity/v3/projects/78b535c13ade43698f6f9f7ca8e5424a => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:04.221679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:04.243444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850a734-1ff3-4553-9709-83eeae43bce9 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:04.467574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:04.469186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:04.469670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:04.470149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] PATH_INFO: `/v3/users/dc64a617a9554effa29b521f6ad5ed24` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:04.478116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc64a617a9554effa29b521f6ad5ed24)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:04.481870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:04.578615 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:04.593024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc64a617a9554effa29b521f6ad5ed24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.619147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc64a617a9554effa29b521f6ad5ed24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.650019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc64a617a9554effa29b521f6ad5ed24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.651870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc64a617a9554effa29b521f6ad5ed24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.670830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96f6e548-bec9-4f61-ad95-84b45c2569df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc64a617a9554effa29b521f6ad5ed24'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:04.693604 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3946/7888] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:04 2022] DELETE /identity/v3/users/dc64a617a9554effa29b521f6ad5ed24 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:04.807808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:04.809633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:04.842808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba4ea96-5bc3-4756-af40-6781a4fc8d4a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:04.958829 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:04.994313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:04.995839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:04.995999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:04.996289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] PATH_INFO: `/v3/users/78088a39215b4acf8c7a823455b6cd37` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:04.998655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] RBAC: Authorizing `identity:delete_user(user_id=78088a39215b4acf8c7a823455b6cd37)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:05.000669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:05.126118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78088a39215b4acf8c7a823455b6cd37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.126852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78088a39215b4acf8c7a823455b6cd37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.145988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78088a39215b4acf8c7a823455b6cd37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.146710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78088a39215b4acf8c7a823455b6cd37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.166403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78088a39215b4acf8c7a823455b6cd37'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.242604 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3943/7889] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:04 2022] DELETE /identity/v3/users/78088a39215b4acf8c7a823455b6cd37 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:05.244622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:05.245144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:05.245258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:05.280126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:05.281821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:05.302672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:05.303930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:05.431520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668f413e-dbc3-4d18-8a76-1a732e1e208d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:05.449049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:05.449830 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3947/7890] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:05.453859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:05.454166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:05.454451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] PATH_INFO: `/v3/projects/b5f2b749bcbe438a8f9ab12e0bb5462a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:05.455842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5f2b749bcbe438a8f9ab12e0bb5462a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:05.458300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:05.467190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:05.475421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:05.565266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5f2b749bcbe438a8f9ab12e0bb5462a', 'request_id': 'req-80909ccf-074d-45d5-8995-191696b88f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.583565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5f2b749bcbe438a8f9ab12e0bb5462a', 'request_id': 'req-80909ccf-074d-45d5-8995-191696b88f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.597339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5f2b749bcbe438a8f9ab12e0bb5462a', 'request_id': 'req-80909ccf-074d-45d5-8995-191696b88f40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.601846 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:05.621748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9714abfd-df12-4eb6-a2fa-75e4e76d68c5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:05.622008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] The token cache is being invalidate because project b5f2b749bcbe438a8f9ab12e0bb5462a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:05.622307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.623350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-80909ccf-074d-45d5-8995-191696b88f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:05.628829 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3944/7891] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:05 2022] DELETE /identity/v3/projects/b5f2b749bcbe438a8f9ab12e0bb5462a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:05.630592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:05.630889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:05.631173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:05.680556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:05.682442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:05.755747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:05.756757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:05.757227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:05.768839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:05.782434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:05.860161 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:05.980061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:05.981937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957a7041-8694-4733-8cc9-d6dde4461b4d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:06.013236 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3948/7892] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:06.144009 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3945/7893] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:06.152170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:06.153064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:06.153558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:06.185813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:06.188231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:06.205207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3949/7894] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:06.209119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.225624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f4dfd-9f83-47f8-b473-f4593c34531d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:06.233444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:06.234349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:06.234349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:06.234689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:06.236264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:06.239047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:06.241633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:06.274130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3946/7895] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:06.279174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.309190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc076f4-fb4a-4778-90db-ade5fe98c399 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:06.327957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:06.330121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:06.330471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:06.330829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:06.332277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:06.348300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:06.449467 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3950/7896] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:06 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:06.455868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.494599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5b4764-98d1-49c6-8efb-60014b424a3f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:06.611142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.613217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:06.670987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:06.671952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:06.677114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:06.677454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:06.678565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:06.680768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:06.755732 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3947/7897] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:06 2022] POST /identity/v3/users => generated 284 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:06.768738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.772427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cb6d52-0526-4b05-8101-513aba303f25 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:06.780681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:06.782068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:06.782509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:06.783000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] PATH_INFO: `/v3/projects/efcd40592bb4429b9477f9dce32cd30e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:06.784585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=efcd40592bb4429b9477f9dce32cd30e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:06.786737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:06.856576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd9322-6160-47e5-838b-e0be2c61ebce admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:06.872725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efcd40592bb4429b9477f9dce32cd30e', 'request_id': 'req-afbed1d7-89a3-4fa8-af81-d9916358e21e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:06.898703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efcd40592bb4429b9477f9dce32cd30e', 'request_id': 'req-afbed1d7-89a3-4fa8-af81-d9916358e21e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:06.929748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efcd40592bb4429b9477f9dce32cd30e', 'request_id': 'req-afbed1d7-89a3-4fa8-af81-d9916358e21e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:06.970621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] The token cache is being invalidate because project efcd40592bb4429b9477f9dce32cd30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:06.971090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:06.972296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:06.976887 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3951/7898] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:06 2022] DELETE /identity/v3/projects/efcd40592bb4429b9477f9dce32cd30e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:06.982842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:06.987451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:07.029889 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:07.049663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.050705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.051217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.051647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.052605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.054850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:07.068412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3948/7899] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:07.072557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:07.077565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:07.104093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f88a2b-df6c-4dc9-acd4-a391b2dde5cf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:07.111178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.112577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.113448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.113897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.115109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.117579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:07.119290 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:07.130104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbed1d7-89a3-4fa8-af81-d9916358e21e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:07.135723 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3949/7900] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:07.140122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.140651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:07.141690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.142098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.142556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] PATH_INFO: `/v3/users/2aba50465e994cabaedc7218d6799c6d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.144713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aba50465e994cabaedc7218d6799c6d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.146817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:07.166224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d420d532-fc6d-4882-be62-e247c372d58a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:07.173460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a210c2b3-a63e-4975-9f76-96cba501494b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.174721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c2b3-a63e-4975-9f76-96cba501494b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.174998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c2b3-a63e-4975-9f76-96cba501494b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.175865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a210c2b3-a63e-4975-9f76-96cba501494b admin admin] PATH_INFO: `/v3/projects/2d1acd5c8b164296b8e9a6a8b19e4471/users/e60edd5c802d45799247019dd747c691/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.197223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c2b3-a63e-4975-9f76-96cba501494b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1acd5c8b164296b8e9a6a8b19e4471, user_id=e60edd5c802d45799247019dd747c691, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.200260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a210c2b3-a63e-4975-9f76-96cba501494b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:07.236987 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3950/7901] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:07 2022] PUT /identity/v3/projects/2d1acd5c8b164296b8e9a6a8b19e4471/users/e60edd5c802d45799247019dd747c691/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:07.240523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.243352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.243740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.286568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aba50465e994cabaedc7218d6799c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:07.302584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aba50465e994cabaedc7218d6799c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:07.306255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] MFA Rules not processed for user `e60edd5c802d45799247019dd747c691`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:07.307548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:07.331642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aba50465e994cabaedc7218d6799c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:07.334364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aba50465e994cabaedc7218d6799c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:07.366511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aba50465e994cabaedc7218d6799c6d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:07.386280 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3952/7902] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:06 2022] DELETE /identity/v3/users/2aba50465e994cabaedc7218d6799c6d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:07.421886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:07.422806 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3951/7903] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:07 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:07.424395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:07.565223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af44af41-ebe6-4ed1-a913-db7b38cab196 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:07.576885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.578868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.579590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.581963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.583668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.590833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:07.657089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3953/7904] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:07 2022] POST /identity/v3/projects => generated 367 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:07.659650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:07.812707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d776ff2e-d1bf-43b4-b819-cb3130fe9f42 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:07.978784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:07.981851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:07.981851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:07.981851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:07.985749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:07.989152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:08.023226 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:08.041108 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3952/7905] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:07 2022] POST /identity/v3/users => generated 290 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:08.048866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:08.074635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9c667-632b-410f-acc4-3ed827b65a86 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:08.096396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:08.097246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:08.097712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:08.097985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:08.098739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:08.100418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:08.134186 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3954/7906] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:08.137622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:08.166205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b165134-05e4-4bd5-b67d-bc9f1844cd06 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:08.176519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:08.177458 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:08.178086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:08.178370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] PATH_INFO: `/v3/projects/256735e63a374ba3bfb1a75b139a8f17/users/dbcb522ebf7e4984b018f721a50546ba/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:08.219473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256735e63a374ba3bfb1a75b139a8f17, user_id=dbcb522ebf7e4984b018f721a50546ba, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:08.225573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:08.255883 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3953/7907] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:08 2022] PUT /identity/v3/projects/256735e63a374ba3bfb1a75b139a8f17/users/dbcb522ebf7e4984b018f721a50546ba/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:08.260119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:08.271361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cd5ab-e157-44db-9f14-b3807387400d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:08.322508 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:08.405841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:08.410330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:08.473313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:08.474180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:08.474304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:08.475067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:08.475492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:08.477403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:08.499387 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3955/7908] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:08 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:08.504761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:08.526772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a0b6e-7a57-421f-ad1a-d5d7776ccf37 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:08.535362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219b203-dcc5-4c4c-b839-95507a9450b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:08.536667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219b203-dcc5-4c4c-b839-95507a9450b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:08.537339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219b203-dcc5-4c4c-b839-95507a9450b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:08.537630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219b203-dcc5-4c4c-b839-95507a9450b1 admin admin] PATH_INFO: `/v3/projects/256735e63a374ba3bfb1a75b139a8f17/users/dbcb522ebf7e4984b018f721a50546ba/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:08.544529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219b203-dcc5-4c4c-b839-95507a9450b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=256735e63a374ba3bfb1a75b139a8f17, user_id=dbcb522ebf7e4984b018f721a50546ba, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:08.547332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219b203-dcc5-4c4c-b839-95507a9450b1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:08.585299 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3956/7909] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:08 2022] PUT /identity/v3/projects/256735e63a374ba3bfb1a75b139a8f17/users/dbcb522ebf7e4984b018f721a50546ba/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:08.603762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:08.606970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:08.607516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:08.737392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] MFA Rules not processed for user `dbcb522ebf7e4984b018f721a50546ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:08.742414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:08.752324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9926b9a9-58fe-4912-ba8f-7afa77c6f7d3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:08.959514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:08.961580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:08.963104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:08.964713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] PATH_INFO: `/v3/projects/93da0a9daefb430cbfc9d6b818987a5b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:08.967031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93da0a9daefb430cbfc9d6b818987a5b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:08.971988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:09.007688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3957/7910] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 412 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:09.022707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:09.025878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:09.126094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93da0a9daefb430cbfc9d6b818987a5b', 'request_id': 'req-a39544b8-1dfb-462a-9011-21de28fb3245'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:09.151329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93da0a9daefb430cbfc9d6b818987a5b', 'request_id': 'req-a39544b8-1dfb-462a-9011-21de28fb3245'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:09.183697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93da0a9daefb430cbfc9d6b818987a5b', 'request_id': 'req-a39544b8-1dfb-462a-9011-21de28fb3245'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:09.242320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] The token cache is being invalidate because project 93da0a9daefb430cbfc9d6b818987a5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:09.246080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:09.247814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a39544b8-1dfb-462a-9011-21de28fb3245 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:09.252165 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3954/7911] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:08 2022] DELETE /identity/v3/projects/93da0a9daefb430cbfc9d6b818987a5b => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:09.257091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4bde-c24c-40b7-a3ed-24df29953a27 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.257455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4bde-c24c-40b7-a3ed-24df29953a27 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.257792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d4bde-c24c-40b7-a3ed-24df29953a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.272732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609fd973-cba9-4cfd-bae6-348376b53bd5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:09.304877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-574d4bde-c24c-40b7-a3ed-24df29953a27 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:09.306308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-574d4bde-c24c-40b7-a3ed-24df29953a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:09.326090 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:09.396321 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:09.455918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:09.459381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.459688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.462053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.466419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:09.494813 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3955/7912] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:09.503486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.503856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.504043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.564795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:09.566053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:09.580966 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3956/7913] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:09.582235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:09.596995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce3383c-d2d7-4fa6-87e5-fe0adfddfda0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:09.608788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:09.609490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.609777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.610056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.610796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:09.613083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:09.615360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:09.656734 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3957/7914] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:09.661171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:09.669534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:09.671174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:09.681615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7739564-e82f-48ec-b4c7-b9f0a1f618e8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:09.690388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3958/7915] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:44:09.701093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:09.702185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.702685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.703582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.704563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:09.707488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:09.741432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3958/7916] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:09 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:09.745723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:09.768154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f31059-e99f-44e2-91e8-36e093933ce5 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:09.920701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:09.921505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.921864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.922217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.923001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:09.925117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:09.965800 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3959/7917] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:09 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:09.966235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:09.978484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb29c5b-600c-4b2c-b51c-8951bc3408b9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:09.984662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:09.985477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:09.985962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:09.986592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:09.987695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:09.992769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:10.010703 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3959/7918] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:09 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:10.012042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:10.035198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d9e19-85d1-43de-ba29-7abee196b67f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:10.054638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c970b0-142d-45d3-b9b2-a464c5c105b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:10.056843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c970b0-142d-45d3-b9b2-a464c5c105b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:10.066524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c970b0-142d-45d3-b9b2-a464c5c105b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:10.066818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c970b0-142d-45d3-b9b2-a464c5c105b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:10.071988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c970b0-142d-45d3-b9b2-a464c5c105b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:10.089081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c970b0-142d-45d3-b9b2-a464c5c105b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:10.120896 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3960/7919] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:10.125823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:10.147083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921def-d354-454d-8b16-3fce30831b1f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:10.174718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:10.176025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:10.177271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:10.179409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] PATH_INFO: `/v3/projects/4c98207ddf9c4b8ea85af88d92fcb89d/users/d1f87b26cf8f4ced931b7c2e91b7f180/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:10.224085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c98207ddf9c4b8ea85af88d92fcb89d, user_id=d1f87b26cf8f4ced931b7c2e91b7f180, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:10.229290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:10.267900 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3960/7920] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:10 2022] PUT /identity/v3/projects/4c98207ddf9c4b8ea85af88d92fcb89d/users/d1f87b26cf8f4ced931b7c2e91b7f180/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:10.282775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:10.282775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:10.282775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:10.379956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] MFA Rules not processed for user `d1f87b26cf8f4ced931b7c2e91b7f180`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:10.381589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:10.588496 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:10.624407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3961/7921] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:10.630045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:10.826796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba3a3f-bae5-4d71-a65b-baec62f85dc7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:10.841029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:10.842159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:10.842452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:10.842730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:10.843846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:10.846471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:10.938568 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3961/7922] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:10 2022] POST /identity/v3/projects => generated 373 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:10.942632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:10.963993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d3fda-0fe0-4405-b8e8-a6fd464251ba None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:11.131236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:11.132449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:11.133038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:11.133622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:11.134610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:11.149576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:11.191428 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3962/7923] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:10 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:11.195338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:11.211158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0461f0d-9e6e-4235-87a2-c77e8f9e34c8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:11.217095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:11.217800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:11.218078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:11.218355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:11.219098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:11.222692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:11.241950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:11.250690 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3962/7924] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:11.260624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41887f4-0731-40d2-96bf-88c2a94142c8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:11.276256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:11.277047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:11.277385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:11.277677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] PATH_INFO: `/v3/projects/67abbe24d0c74a7bba80016c7f6ee20a/users/3cb6690dd54b4aad8e62b21196582115/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:11.307948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67abbe24d0c74a7bba80016c7f6ee20a, user_id=3cb6690dd54b4aad8e62b21196582115, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:11.315933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:11.340411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3963/7925] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:11 2022] PUT /identity/v3/projects/67abbe24d0c74a7bba80016c7f6ee20a/users/3cb6690dd54b4aad8e62b21196582115/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:11.342741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:11.356740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de44b3-3fde-48d3-88f8-97e0095b6fc3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:11.380642 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:11.572625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b0eda0-c306-46be-bf25-273963ca217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:11.582725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0eda0-c306-46be-bf25-273963ca217b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:11.582725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0eda0-c306-46be-bf25-273963ca217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:11.582725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b0eda0-c306-46be-bf25-273963ca217b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:11.582725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0eda0-c306-46be-bf25-273963ca217b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:11.583270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b0eda0-c306-46be-bf25-273963ca217b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:11.624240 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3963/7926] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:11 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:11.625943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:11.643747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5bf2c-377d-4ff2-b90f-f7f2ca2c7a15 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:11.662676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:11.663674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:11.663973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:11.664242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] PATH_INFO: `/v3/projects/67abbe24d0c74a7bba80016c7f6ee20a/users/3cb6690dd54b4aad8e62b21196582115/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:11.671582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=67abbe24d0c74a7bba80016c7f6ee20a, user_id=3cb6690dd54b4aad8e62b21196582115, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:11.674851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:11.699127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3964/7927] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:11 2022] PUT /identity/v3/projects/67abbe24d0c74a7bba80016c7f6ee20a/users/3cb6690dd54b4aad8e62b21196582115/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:11.706365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:11.706992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:11.707475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:11.783522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] MFA Rules not processed for user `3cb6690dd54b4aad8e62b21196582115`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:11.793737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:11.994095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3964/7928] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:12.009396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:12.011258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:12.169196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37adb4a2-bc4e-4c9d-a4e3-995992145fcd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:12.177374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:12.178471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:12.179047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:12.179556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:12.198046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:12.200628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:12.256138 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3965/7929] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:12 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:13.091436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:13.093019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:13.216175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:13.270632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ad01a4-74dc-4aa8-8605-2e765e88983c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:13.289169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:13.291337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:13.291696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:13.292818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] PATH_INFO: `/v3/users/e60edd5c802d45799247019dd747c691` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:13.295343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e60edd5c802d45799247019dd747c691)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:13.304196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:13.365692 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:13.376252 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:13.406219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b066f8-6452-431e-9bcb-0f45f49f3f98 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:13.416316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e60edd5c802d45799247019dd747c691'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.418426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e60edd5c802d45799247019dd747c691'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.422560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:13.423584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:13.423937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:13.424596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] PATH_INFO: `/v3/users/d1f87b26cf8f4ced931b7c2e91b7f180` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:13.428437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f87b26cf8f4ced931b7c2e91b7f180)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:13.433277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:13.440914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e60edd5c802d45799247019dd747c691'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.445303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e60edd5c802d45799247019dd747c691'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.468713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1da3776e-eb82-4c78-abf5-5c025cf3b779 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e60edd5c802d45799247019dd747c691'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.547457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3965/7930] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:13 2022] DELETE /identity/v3/users/e60edd5c802d45799247019dd747c691 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:13.551762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:13.552372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:13.553279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:13.553883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f87b26cf8f4ced931b7c2e91b7f180'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.577319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f87b26cf8f4ced931b7c2e91b7f180'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.609422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f87b26cf8f4ced931b7c2e91b7f180'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.611351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f87b26cf8f4ced931b7c2e91b7f180'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.613358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:13.616446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:13.628231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-87719744-9ca5-4d27-8c3c-199aa596bb31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f87b26cf8f4ced931b7c2e91b7f180'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:13.642714 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3966/7931] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:13 2022] DELETE /identity/v3/users/d1f87b26cf8f4ced931b7c2e91b7f180 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:13.647789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:13.648074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:13.648384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:13.674887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:13.676559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:13.750020 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3966/7932] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:13.757621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:13.759327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:13.833623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3967/7933] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:13.851437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:13.853167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:13.877005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b82d4-68f0-407d-afd6-ef2aa4f396d7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:13.962694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9444727e-782f-44c8-87ab-9cf49f31080c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:13.968339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:13.969170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:13.969513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:13.969859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:13.984599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:13.986451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:13.986626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:13.989624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:13.992247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:13.993097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:14.001499 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3968/7934] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:14.034390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:14.035987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:14.063816 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3967/7935] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:15.913579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:15.918808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:15.919584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:15.921975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:15.939696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c9ba3-bd42-4616-b8ba-ae633429561f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:15.946333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:15.946491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e051103-aa24-4bcb-a398-26da11cc4ada service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:15.949223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:15.952075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:15.952590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] PATH_INFO: `/v3/projects/4c98207ddf9c4b8ea85af88d92fcb89d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:15.959288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:15.960276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:15.960652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:15.961005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] PATH_INFO: `/v3/projects/2d1acd5c8b164296b8e9a6a8b19e4471` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:15.962501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1acd5c8b164296b8e9a6a8b19e4471)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:15.964551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:15.970325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c98207ddf9c4b8ea85af88d92fcb89d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:15.974864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:15.983133 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:15.988625 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:16.075137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1acd5c8b164296b8e9a6a8b19e4471', 'request_id': 'req-0f9697c8-037b-4667-8758-4edfcede341e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.085243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1acd5c8b164296b8e9a6a8b19e4471', 'request_id': 'req-0f9697c8-037b-4667-8758-4edfcede341e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.095630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c98207ddf9c4b8ea85af88d92fcb89d', 'request_id': 'req-1b4364ed-d679-429a-811c-7831692061b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.095886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1acd5c8b164296b8e9a6a8b19e4471', 'request_id': 'req-0f9697c8-037b-4667-8758-4edfcede341e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.109420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] The token cache is being invalidate because project 2d1acd5c8b164296b8e9a6a8b19e4471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:16.109710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.110634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c98207ddf9c4b8ea85af88d92fcb89d', 'request_id': 'req-1b4364ed-d679-429a-811c-7831692061b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.110757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.115952 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3969/7936] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:15 2022] DELETE /identity/v3/projects/2d1acd5c8b164296b8e9a6a8b19e4471 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:16.117781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:16.119622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:16.134937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c98207ddf9c4b8ea85af88d92fcb89d', 'request_id': 'req-1b4364ed-d679-429a-811c-7831692061b0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.154412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] The token cache is being invalidate because project 4c98207ddf9c4b8ea85af88d92fcb89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:16.154757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.155947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.161766 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3968/7937] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:15 2022] DELETE /identity/v3/projects/4c98207ddf9c4b8ea85af88d92fcb89d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:16.165078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:16.169227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:16.229439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9697c8-037b-4667-8758-4edfcede341e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:16.305585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4364ed-d679-429a-811c-7831692061b0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:16.319284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:16.320197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:16.320502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:16.320772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] PATH_INFO: `/v3/users/3cb6690dd54b4aad8e62b21196582115` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:16.323104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cb6690dd54b4aad8e62b21196582115)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:16.325772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:16.333071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:16.333973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:16.334251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:16.334572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] PATH_INFO: `/v3/users/dbcb522ebf7e4984b018f721a50546ba` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:16.335890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbcb522ebf7e4984b018f721a50546ba)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:16.343851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:16.444425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cb6690dd54b4aad8e62b21196582115'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.446295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cb6690dd54b4aad8e62b21196582115'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.461308 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:16.464663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbcb522ebf7e4984b018f721a50546ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.466896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cb6690dd54b4aad8e62b21196582115'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.468766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cb6690dd54b4aad8e62b21196582115'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.482546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cb6690dd54b4aad8e62b21196582115'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.486159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbcb522ebf7e4984b018f721a50546ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.530976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbcb522ebf7e4984b018f721a50546ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.531349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbcb522ebf7e4984b018f721a50546ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.550318 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3969/7938] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:16 2022] DELETE /identity/v3/users/3cb6690dd54b4aad8e62b21196582115 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:16.567955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbcb522ebf7e4984b018f721a50546ba'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:16.597384 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3970/7939] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:16 2022] DELETE /identity/v3/users/dbcb522ebf7e4984b018f721a50546ba => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:17.662890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:17.664986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:17.684610 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:17.737605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:17.739119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:17.783046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a41013-b326-42d6-a73f-9875f24019f7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:17.864095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c359e2b9-5cd7-4d12-ae62-a671f7457d43 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:17.870107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:17.871307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:17.871963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:17.872486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] PATH_INFO: `/v3/projects/67abbe24d0c74a7bba80016c7f6ee20a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:17.873997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67abbe24d0c74a7bba80016c7f6ee20a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:17.876123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:17.876841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:17.877103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:17.877373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:17.879214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:17.881140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:17.982422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67abbe24d0c74a7bba80016c7f6ee20a', 'request_id': 'req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:17.997502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67abbe24d0c74a7bba80016c7f6ee20a', 'request_id': 'req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.015999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:18.016853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67abbe24d0c74a7bba80016c7f6ee20a', 'request_id': 'req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.019827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b69919-2a64-45c2-b281-ee58fe766d7f service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:18.031061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] The token cache is being invalidate because project 67abbe24d0c74a7bba80016c7f6ee20a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:18.031419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.033501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.047066 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3971/7940] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:17 2022] DELETE /identity/v3/projects/67abbe24d0c74a7bba80016c7f6ee20a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:18.047066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:18.047066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:18.077102 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3970/7941] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:44:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:44:18.081281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4bb7-8357-4331-a08c-723de5839dda None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.081784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4bb7-8357-4331-a08c-723de5839dda None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.082240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eb4bb7-8357-4331-a08c-723de5839dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.118834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79eb4bb7-8357-4331-a08c-723de5839dda None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:18.120412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79eb4bb7-8357-4331-a08c-723de5839dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:18.132539 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:18.153060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be734f6f-9110-4d7e-b5ca-dfe9ce5f76a8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:18.162063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:18.163738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.164031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.164603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] PATH_INFO: `/v3/projects/256735e63a374ba3bfb1a75b139a8f17` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.166780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=256735e63a374ba3bfb1a75b139a8f17)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:18.172145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:18.259569 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:18.293956 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3971/7942] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:18.301817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.302442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.302913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.334088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '256735e63a374ba3bfb1a75b139a8f17', 'request_id': 'req-dca00eed-331b-43f1-87c0-21b8cd4f6d16'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.341072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:18.344714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:18.353839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '256735e63a374ba3bfb1a75b139a8f17', 'request_id': 'req-dca00eed-331b-43f1-87c0-21b8cd4f6d16'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.365250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '256735e63a374ba3bfb1a75b139a8f17', 'request_id': 'req-dca00eed-331b-43f1-87c0-21b8cd4f6d16'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.387248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] The token cache is being invalidate because project 256735e63a374ba3bfb1a75b139a8f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:18.387505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.388724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-dca00eed-331b-43f1-87c0-21b8cd4f6d16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:18.394172 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3972/7943] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:18 2022] DELETE /identity/v3/projects/256735e63a374ba3bfb1a75b139a8f17 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:18.396759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c846b-af49-4481-bd7c-a53303675c79 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.397045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c846b-af49-4481-bd7c-a53303675c79 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.397327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c846b-af49-4481-bd7c-a53303675c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.432619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1c9c846b-af49-4481-bd7c-a53303675c79 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:18.439256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1c9c846b-af49-4481-bd7c-a53303675c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:18.486170 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3972/7944] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:18.490677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:18.501931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75472400-3d9c-4860-af68-4e7dba24ee3c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:18.507769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:18.508493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.508782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.509059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.509796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:18.510101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:18.511753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:18.539193 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3973/7945] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:18.542847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:18.576380 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3973/7946] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:18.577304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3acfcce-0132-45bf-9d8b-eadf6e08999e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:18.584789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.585082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.585357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.594382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:18.597723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.598045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.598317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.606781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:18.610330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:18.639970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:18.641845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:18.671306 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3974/7947] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:18.674961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:18.696216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e028ea35-7d74-41a1-8480-67f9f1866c3c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:18.713586 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3974/7948] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/projects => generated 387 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:18.715730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:18.918301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8b48b-def2-492d-a786-2e02546e43bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:18.924108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:18.925156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.925657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.926139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.927388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:18.929798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:18.955042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:18.955741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:18.956036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:18.956294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:18.957083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:18.957398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:18.959048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:18.968983 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3975/7949] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:18.970326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:18.989089 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3975/7950] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:18.997695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.021508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d11981-b446-4cf0-8e07-f2ee4995ab04 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.026611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.027229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.027513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.027840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.028073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc12e6d-7f36-4a21-a367-2daffc589390 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.028959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.030521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.052425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.053508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.055325 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:19.056629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.056990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.063249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.073864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.085542 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3976/7951] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:18 2022] POST /identity/v3/projects => generated 381 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:19.089908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.127175 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3976/7952] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:18 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:19.131409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.157887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce70411-d652-43b5-80b2-031065b355eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.227913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb9228-0112-40b1-8938-12386fbd2d32 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.241646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.242359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.242645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.242925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.243636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.245643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.260523 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:19.304715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.306839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.306839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.306839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.306839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.309561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.338149 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3977/7953] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:19.338377 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3977/7954] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:19 2022] POST /identity/v3/users => generated 291 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:19.339390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.343245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.368242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f991e-507d-4a7f-b32d-1658bd446dda admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.378884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0bdea-5c65-4d01-9ae1-108a8ddc420a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.390339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03674b-8a98-44bd-ad49-dd0c72a3460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.393860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.394558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.394842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.395115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.397864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03674b-8a98-44bd-ad49-dd0c72a3460f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.398172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03674b-8a98-44bd-ad49-dd0c72a3460f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.398453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03674b-8a98-44bd-ad49-dd0c72a3460f admin admin] PATH_INFO: `/v3/projects/47d1f825841e4e4ab7c2949fa9ab42c7/users/46872471535f437f86be31dda9afd585/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.400542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.402173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.445390 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3978/7955] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:19.451557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.453738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03674b-8a98-44bd-ad49-dd0c72a3460f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47d1f825841e4e4ab7c2949fa9ab42c7, user_id=46872471535f437f86be31dda9afd585, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.459040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03674b-8a98-44bd-ad49-dd0c72a3460f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.478947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525b4d4-2ec9-4737-9ff7-8b2b55936976 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.501963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.502658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.502946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.503226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.503664 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3978/7956] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:19 2022] PUT /identity/v3/projects/47d1f825841e4e4ab7c2949fa9ab42c7/users/46872471535f437f86be31dda9afd585/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:19.513798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.513798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.515146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7827850-2c03-419d-9795-dca58447f561 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.515799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7827850-2c03-419d-9795-dca58447f561 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.516070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7827850-2c03-419d-9795-dca58447f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.545300 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3979/7957] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:19.556781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.597109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c7827850-2c03-419d-9795-dca58447f561 None None] MFA Rules not processed for user `46872471535f437f86be31dda9afd585`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:19.597791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e629813-fb4b-461f-b829-756151d6c922 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.598786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c7827850-2c03-419d-9795-dca58447f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:19.767382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3979/7958] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:19.772152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7827850-2c03-419d-9795-dca58447f561 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.775654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e2fb2-405f-4a6c-8b33-a8b04dbc246d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.776602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2fb2-405f-4a6c-8b33-a8b04dbc246d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.776885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2fb2-405f-4a6c-8b33-a8b04dbc246d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.777156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e2fb2-405f-4a6c-8b33-a8b04dbc246d admin admin] PATH_INFO: `/v3/projects/cef6be20996345b28d287602b46ef0c6/users/ef3c00e963c948bb967331560b4fe8fe/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.820050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7827850-2c03-419d-9795-dca58447f561 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:19.838769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e2fb2-405f-4a6c-8b33-a8b04dbc246d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cef6be20996345b28d287602b46ef0c6, user_id=ef3c00e963c948bb967331560b4fe8fe, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.842110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e2fb2-405f-4a6c-8b33-a8b04dbc246d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.852028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:19.852624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.852908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.853188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.853903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:19.856205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:19.866836 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3980/7959] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:19 2022] PUT /identity/v3/projects/cef6be20996345b28d287602b46ef0c6/users/ef3c00e963c948bb967331560b4fe8fe/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:19.881378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:19.881756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:19.882111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:19.940993 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3980/7960] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:19 2022] POST /identity/v3/projects => generated 387 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:19.942981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:19.954012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] MFA Rules not processed for user `ef3c00e963c948bb967331560b4fe8fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:19.959295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:20.023346 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:20.177050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488acee9-a6d3-48af-8a33-823d5ee97a12 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.204585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.205329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.205886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.205886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.206762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.209335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.216401 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3981/7961] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:20.219896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.234486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92ea1e-d558-4ce0-b5f3-992e4bbfdf25 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.242203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.243298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.243677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.244104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.245625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.249652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.287936 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3981/7962] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:19 2022] POST /identity/v3/users => generated 300 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:20.293208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.318643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaeff21-0a9e-440b-90a5-93d5aa3ea604 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.325996 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3982/7963] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:20 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:20.328096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.342286 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:20.439031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.439730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.440015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.440293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.441128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.443276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.473263 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3982/7964] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:44:20.474391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.490960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcd65a-0a86-4f39-9f8f-276c9a519e39 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.501077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.501984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.502265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.502539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] PATH_INFO: `/v3/projects/bdf32e8eedaa48ed89443b07d175cedd/users/858a75f6e24943b19ebcd2b331d34052/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.526452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d24df-df6a-46af-96ab-31c334cfe543 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.538556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf32e8eedaa48ed89443b07d175cedd, user_id=858a75f6e24943b19ebcd2b331d34052, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.541245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.542119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.544542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.544948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.546560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.547401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.552514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.575973 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3983/7965] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:20 2022] PUT /identity/v3/projects/bdf32e8eedaa48ed89443b07d175cedd/users/858a75f6e24943b19ebcd2b331d34052/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:20.577149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.611878 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3983/7966] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:20 2022] POST /identity/v3/users => generated 297 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:20.615534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.652777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f247e-8835-48f1-85b9-802c6436ea42 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.707069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768c3d-f80d-42c5-85e8-463384b95b9a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.712542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.713232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.713508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.713779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.714515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.716220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.742244 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3984/7967] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:44:20.749417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:20.759876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003676f-bb07-4569-a067-b64efa8fab49 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:20.781181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821af5b-3aaa-494f-adb6-58c4e36515eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.782111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821af5b-3aaa-494f-adb6-58c4e36515eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.782387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821af5b-3aaa-494f-adb6-58c4e36515eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.782655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821af5b-3aaa-494f-adb6-58c4e36515eb admin admin] PATH_INFO: `/v3/projects/bdf32e8eedaa48ed89443b07d175cedd/users/858a75f6e24943b19ebcd2b331d34052/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.784856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821af5b-3aaa-494f-adb6-58c4e36515eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf32e8eedaa48ed89443b07d175cedd, user_id=858a75f6e24943b19ebcd2b331d34052, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.787567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2821af5b-3aaa-494f-adb6-58c4e36515eb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.831695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3985/7968] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:20 2022] PUT /identity/v3/projects/bdf32e8eedaa48ed89443b07d175cedd/users/858a75f6e24943b19ebcd2b331d34052/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:20.843286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.843574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.843822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.870366 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:20.919762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:20.929195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:20.929482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:20.929757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:20.937308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] MFA Rules not processed for user `858a75f6e24943b19ebcd2b331d34052`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:20.937719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:20.938550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:20.940477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:20.983008 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3984/7969] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:44:20.989424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:21.011558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b833c-bb5a-4c7c-8f3b-56df1ec43cc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:21.181085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3986/7970] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:21.195389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:21.198294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:21.198763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:21.200273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:21.200820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:21.201321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] PATH_INFO: `/v3/projects/07f1ab2e2a16462293ed29cb284a8815/users/13c8fae82fc547e0becd9b052dbfc651/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:21.241162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f1ab2e2a16462293ed29cb284a8815, user_id=13c8fae82fc547e0becd9b052dbfc651, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:21.245910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:21.283641 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3985/7971] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:20 2022] PUT /identity/v3/projects/07f1ab2e2a16462293ed29cb284a8815/users/13c8fae82fc547e0becd9b052dbfc651/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:21.288365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:21.349668 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:21.440639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c32e7-0654-4bff-90f6-05f1ee66a59c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:21.548587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ea73f-a3bc-4cf1-9245-c9f86a1248fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:21.595711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:21.596463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:21.596756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:21.597040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:21.597798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:21.599487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:21.645884 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3986/7972] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:21.647387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:21.650794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:21.651512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:21.651797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:21.652079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:21.656869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:21.824111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:21.828430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:21.840200 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:21.869825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad61ee-c171-4dcb-bfc5-df23f607ad9a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:21.871595 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3987/7973] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:21 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:21.876111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:21.900665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:21.902923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ccf0b2-194c-4afc-a76e-2c96450bb500 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:21.906276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:21.908791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:21.909660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:21.913447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b9b64-03ff-448b-bf1b-cb37e52e668a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:21.914959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9b64-03ff-448b-bf1b-cb37e52e668a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:21.915351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9b64-03ff-448b-bf1b-cb37e52e668a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:21.916028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b9b64-03ff-448b-bf1b-cb37e52e668a admin admin] PATH_INFO: `/v3/projects/07f1ab2e2a16462293ed29cb284a8815/users/13c8fae82fc547e0becd9b052dbfc651/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:21.920792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9b64-03ff-448b-bf1b-cb37e52e668a admin admin] RBAC: Authorizing `identity:create_grant(project_id=07f1ab2e2a16462293ed29cb284a8815, user_id=13c8fae82fc547e0becd9b052dbfc651, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:21.922330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:21.929493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b9b64-03ff-448b-bf1b-cb37e52e668a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:21.958948 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3988/7974] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:21 2022] PUT /identity/v3/projects/07f1ab2e2a16462293ed29cb284a8815/users/13c8fae82fc547e0becd9b052dbfc651/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:21.974297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:21.974702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:21.975081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:21.995707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:22.005901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:22.035376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] MFA Rules not processed for user `13c8fae82fc547e0becd9b052dbfc651`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:22.038067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:22.077464 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3987/7975] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:21 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:22.322564 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3989/7976] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:22.334043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:22.356505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29507b5d-662e-40ee-8a9b-a920e32475f9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:22.627489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:22.628866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:22.629377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:22.629890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:22.688742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:22.690248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:22.738027 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3988/7977] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:22 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:22.992554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:23.017941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdb9cca-c82e-4f66-970e-4a30fc5e1ba6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:23.078541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5613f15-5faf-4000-9498-b3c27333f1fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:23.083236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613f15-5faf-4000-9498-b3c27333f1fc service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:23.084494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613f15-5faf-4000-9498-b3c27333f1fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:23.086010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5613f15-5faf-4000-9498-b3c27333f1fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:23.343887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613f15-5faf-4000-9498-b3c27333f1fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:23.345607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5613f15-5faf-4000-9498-b3c27333f1fc service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:23.380083 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3990/7978] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:24.141486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:24.478912 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:24.506398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22742b-866f-4df5-9b24-5ecd57d9745a service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:24.552196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:24.553755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:24.554220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:24.554651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] PATH_INFO: `/v3/users/46872471535f437f86be31dda9afd585` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:24.561871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46872471535f437f86be31dda9afd585)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:24.584466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:24.729460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46872471535f437f86be31dda9afd585'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:24.734470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46872471535f437f86be31dda9afd585'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:24.757374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46872471535f437f86be31dda9afd585'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:24.759096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46872471535f437f86be31dda9afd585'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:24.783480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46872471535f437f86be31dda9afd585'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:24.843322 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3989/7979] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:24 2022] DELETE /identity/v3/users/46872471535f437f86be31dda9afd585 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:24.849105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:24.850249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:24.850705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:24.889414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:24.893929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:25.186448 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3991/7980] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:25.196890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:25.198438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:25.354892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42f83cc-09dd-4b48-ae21-3b7d386a13b7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:25.358943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:25.359622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:25.359906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:25.360386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:25.378581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:25.382631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:25.406761 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3990/7981] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:26.210538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:26.212459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:26.244885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1e0eed-2409-4e50-a026-f54ec69a15bc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:26.273269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:26.280771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:26.281838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:26.282732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] PATH_INFO: `/v3/projects/47d1f825841e4e4ab7c2949fa9ab42c7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:26.289670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] RBAC: Authorizing `identity:delete_project(project_id=47d1f825841e4e4ab7c2949fa9ab42c7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:26.292038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:26.313978 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:26.468181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47d1f825841e4e4ab7c2949fa9ab42c7', 'request_id': 'req-cdce736b-8544-4dfc-ae78-d388ecabfefa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.492927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47d1f825841e4e4ab7c2949fa9ab42c7', 'request_id': 'req-cdce736b-8544-4dfc-ae78-d388ecabfefa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.504673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47d1f825841e4e4ab7c2949fa9ab42c7', 'request_id': 'req-cdce736b-8544-4dfc-ae78-d388ecabfefa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.530356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] The token cache is being invalidate because project 47d1f825841e4e4ab7c2949fa9ab42c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:26.530647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.532252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-cdce736b-8544-4dfc-ae78-d388ecabfefa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.542035 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3992/7982] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:26 2022] DELETE /identity/v3/projects/47d1f825841e4e4ab7c2949fa9ab42c7 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:26.543477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:26.557378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646b5f-238b-4f15-bae3-fd99733ca90f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:26.622524 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:26.622854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:26.623332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:26.661939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] MFA Rules not processed for user `c6d16c41cc3d4368b18961ded33d267d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:26.663179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:26.770758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:26.771733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:26.772015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:26.772294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] PATH_INFO: `/v3/users/858a75f6e24943b19ebcd2b331d34052` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:26.775078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=858a75f6e24943b19ebcd2b331d34052)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:26.777087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:26.804710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3993/7983] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:26.860296 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:26.899580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:26.901030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:26.915389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '858a75f6e24943b19ebcd2b331d34052'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.920581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '858a75f6e24943b19ebcd2b331d34052'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.945688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '858a75f6e24943b19ebcd2b331d34052'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.946764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '858a75f6e24943b19ebcd2b331d34052'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:26.961198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '858a75f6e24943b19ebcd2b331d34052'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:27.023310 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3991/7984] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:26 2022] DELETE /identity/v3/users/858a75f6e24943b19ebcd2b331d34052 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:27.062604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe87fff-8748-4b38-981e-963f1b74f2b5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:27.186440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:27.187126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:27.187406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:27.187679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:27.190293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:27.198458 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:27.299999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:27.302120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2464caa-6be0-489c-a37a-6bf514daeff4 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:27.320298 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3994/7985] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:44:28.557449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:28.559197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:28.796934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9661a2-b480-4acc-8309-77b857c9df36 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:28.817401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:28.818782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:28.819306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:28.819819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] PATH_INFO: `/v3/projects/bdf32e8eedaa48ed89443b07d175cedd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:28.831598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf32e8eedaa48ed89443b07d175cedd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:28.844582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:28.972105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf32e8eedaa48ed89443b07d175cedd', 'request_id': 'req-7743cc70-5bb8-4771-a7b0-698b9301ac58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:28.991743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf32e8eedaa48ed89443b07d175cedd', 'request_id': 'req-7743cc70-5bb8-4771-a7b0-698b9301ac58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:29.000964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf32e8eedaa48ed89443b07d175cedd', 'request_id': 'req-7743cc70-5bb8-4771-a7b0-698b9301ac58'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:29.030481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] The token cache is being invalidate because project bdf32e8eedaa48ed89443b07d175cedd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:29.030951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:29.032563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7743cc70-5bb8-4771-a7b0-698b9301ac58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:29.040126 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3992/7986] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:28 2022] DELETE /identity/v3/projects/bdf32e8eedaa48ed89443b07d175cedd => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:29.048311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:29.048877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:29.048877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:29.099330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:29.101136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:29.350330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:29.353727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:29.354177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:29.365389 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3995/7987] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:29.443652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:29.446489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:29.486368 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3993/7988] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:29.493603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:29.518878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e35e7c-7903-43a3-a752-218ab0dd0cce None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:29.546189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:29.547634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:29.549922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:29.550228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:29.551058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:29.551374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:29.562180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:29.632378 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3996/7989] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:29.639370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:29.667389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81320b-eca2-4d2d-b30e-339d20180b16 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:29.706433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:29.707156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:29.707441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:29.716070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:29.716961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:29.727779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:29.798018 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:29.826348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:29.826545 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3994/7990] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:29 2022] POST /identity/v3/projects => generated 369 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:29.846117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3776bd-c08c-4ae9-b191-8dbe46b7e094 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:30.110307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:30.112723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:30.113519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:30.114225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:30.119469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:30.123533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:30.208801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3997/7991] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:29 2022] POST /identity/v3/users => generated 285 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:30.211952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:30.228299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcdca3-69b6-4cfb-9fec-42a7e5bdf040 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:30.242127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:30.243353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:30.244284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:30.244785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:30.245745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:30.248129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:30.274391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:30.279635 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3995/7992] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:30.297958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbdf5-5ada-48bb-a112-f16a3d0c21a9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:30.311163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a64751-33d2-44da-8a17-75a89d2ad1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:30.313748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a64751-33d2-44da-8a17-75a89d2ad1af admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:30.315541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a64751-33d2-44da-8a17-75a89d2ad1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:30.315947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a64751-33d2-44da-8a17-75a89d2ad1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:30.318209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a64751-33d2-44da-8a17-75a89d2ad1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:30.328262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a64751-33d2-44da-8a17-75a89d2ad1af admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:30.353061 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:30.374554 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3998/7993] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:44:30.375466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:30.391441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24cf717-25c6-4844-a8e2-7a6bb344f01f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:30.407405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:30.411462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:30.411771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:30.412227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] PATH_INFO: `/v3/projects/1caa140cdc024f7c86381e2b0cb40763/users/5dee1a9b473a46f2a036747772214f0b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:30.448553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1caa140cdc024f7c86381e2b0cb40763, user_id=5dee1a9b473a46f2a036747772214f0b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:30.456386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:30.483183 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3996/7994] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:30 2022] PUT /identity/v3/projects/1caa140cdc024f7c86381e2b0cb40763/users/5dee1a9b473a46f2a036747772214f0b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:30.494354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:30.494701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:30.494951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:30.576315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] MFA Rules not processed for user `5dee1a9b473a46f2a036747772214f0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:30.582279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:30.837233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 3999/7995] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:30.848709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:30.855372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:31.020601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e81e4-4827-4e5f-b8eb-2b2648c1d521 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:31.033350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:31.034069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:31.034342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:31.034796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:31.086512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:31.089033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:31.102660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3997/7996] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:30 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:34.232297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:34.245397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:34.362973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6712c3b-da2f-41bb-963b-324161a79d3a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:34.371410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:34.373096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:34.373294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:34.373879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:34.376297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:34.392308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:34.406045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b932f7-75bd-4c24-934d-ed4643a4f969 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:34.450406 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4000/7997] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:35.059122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:35.061358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:35.293854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240309bc-6efe-4f6e-bc9e-6ed5b80f439c service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:35.301314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:35.303475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:35.304072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:35.304688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] PATH_INFO: `/v3/users/ef3c00e963c948bb967331560b4fe8fe` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:35.306671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3c00e963c948bb967331560b4fe8fe)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:35.310141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:35.420591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3c00e963c948bb967331560b4fe8fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:35.421739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3c00e963c948bb967331560b4fe8fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:35.443649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3c00e963c948bb967331560b4fe8fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:35.444502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3c00e963c948bb967331560b4fe8fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:35.467074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3c00e963c948bb967331560b4fe8fe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:35.485048 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:35.540261 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3998/7998] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:35 2022] DELETE /identity/v3/users/ef3c00e963c948bb967331560b4fe8fe => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:35.543035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:35.543583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:35.543583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:35.579151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:35.580735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:35.754986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4001/7999] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:35.761630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:35.763217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:35.942898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89267a-b43e-4d4b-826c-fafce2eaf9e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:35.947911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:35.947911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:35.947911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:35.957133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:35.983951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:35.986022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:36.046944 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 3999/8000] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:37.378639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:37.380786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:37.432783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7f6f0-cfc8-44a9-9ac8-8a9d8bde0ee7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:37.439899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:37.441167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:37.442108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:37.442627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] PATH_INFO: `/v3/projects/cef6be20996345b28d287602b46ef0c6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:37.444142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cef6be20996345b28d287602b46ef0c6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:37.447395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:37.508613 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:37.545317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cef6be20996345b28d287602b46ef0c6', 'request_id': 'req-d0ef89ab-3b75-45d4-9bee-8869ebf01885'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.556654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cef6be20996345b28d287602b46ef0c6', 'request_id': 'req-d0ef89ab-3b75-45d4-9bee-8869ebf01885'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.570449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cef6be20996345b28d287602b46ef0c6', 'request_id': 'req-d0ef89ab-3b75-45d4-9bee-8869ebf01885'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.601340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] The token cache is being invalidate because project cef6be20996345b28d287602b46ef0c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:37.603198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.608086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.610828 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4002/8001] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:37 2022] DELETE /identity/v3/projects/cef6be20996345b28d287602b46ef0c6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:37.615524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:37.633767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48547bf6-eb1c-48b8-a599-fe17b1a7c515 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:37.752122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:37.753351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:37.753636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:37.753912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] PATH_INFO: `/v3/users/13c8fae82fc547e0becd9b052dbfc651` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:37.756193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13c8fae82fc547e0becd9b052dbfc651)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:37.758547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:37.834300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13c8fae82fc547e0becd9b052dbfc651'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.834975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13c8fae82fc547e0becd9b052dbfc651'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.849076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13c8fae82fc547e0becd9b052dbfc651'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.849961 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13c8fae82fc547e0becd9b052dbfc651'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.863190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13c8fae82fc547e0becd9b052dbfc651'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:37.888875 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4000/8002] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:37 2022] DELETE /identity/v3/users/13c8fae82fc547e0becd9b052dbfc651 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:38.396734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:38.402435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:38.463383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef89ab-3b75-45d4-9bee-8869ebf01885 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:38.529984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:38.531809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:38.548700 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:38.673649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:38.674531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:38.674814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:38.675126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] PATH_INFO: `/v3/projects/07f1ab2e2a16462293ed29cb284a8815` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:38.680607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07f1ab2e2a16462293ed29cb284a8815)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:38.680822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439c8b4-25d1-4eff-863a-75f0f0d8a7e7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:38.682630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:38.691447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:38.694851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:38.699796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:38.700814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:38.703837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:38.757944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:38.759751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8217c67-b4a8-4c82-9492-c883b54951bb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:38.775537 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4001/8003] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:38.852730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07f1ab2e2a16462293ed29cb284a8815', 'request_id': 'req-2f8735fc-502b-4530-8570-cbd5a4f9b478'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:38.874981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07f1ab2e2a16462293ed29cb284a8815', 'request_id': 'req-2f8735fc-502b-4530-8570-cbd5a4f9b478'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:38.887758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07f1ab2e2a16462293ed29cb284a8815', 'request_id': 'req-2f8735fc-502b-4530-8570-cbd5a4f9b478'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:38.935629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] The token cache is being invalidate because project 07f1ab2e2a16462293ed29cb284a8815 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:38.936195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:38.937381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2f8735fc-502b-4530-8570-cbd5a4f9b478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:38.940962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4003/8004] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:38 2022] DELETE /identity/v3/projects/07f1ab2e2a16462293ed29cb284a8815 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:38.947042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:38.948076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:38.948841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:39.003701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:39.005097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:39.279572 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4002/8005] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:39.287667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:39.288440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:39.289033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:39.337674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:39.340001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:39.371741 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4004/8006] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:39.380416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:39.434333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e86cc3c-9167-4bfe-b5cc-160cac4eab5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:39.448949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:39.449847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:39.450240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:39.450641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:39.452821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:39.454074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:39.457865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:39.482276 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4003/8007] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:39.486246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:39.510139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3482d2-214e-43ca-aa87-faa16c2ab8d6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:39.526045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:39.529503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:39.531500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:39.531841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:39.535776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:39.547171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:39.605879 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4005/8008] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:39 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:39.609949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:39.629332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bead42b-77f1-43d0-81ea-96996c1798c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:39.789395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:39.790609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:39.792732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:39.793034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:39.793773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:39.800202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:39.873064 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4004/8009] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:39 2022] POST /identity/v3/users => generated 291 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:39.878564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:39.894519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd86684c-4f16-4629-a57a-ccf739c0ea47 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:39.913407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:39.914314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:39.914728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:39.915012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:39.915777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:39.917573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:39.947457 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4006/8010] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:39.948893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:39.980097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e1578-702c-4cab-889b-292f0496f5b8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:39.998769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa5ff50-6c63-4925-bc8f-7d9e8b0f9303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:39.999476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5ff50-6c63-4925-bc8f-7d9e8b0f9303 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:39.999776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5ff50-6c63-4925-bc8f-7d9e8b0f9303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.000045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa5ff50-6c63-4925-bc8f-7d9e8b0f9303 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.000863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5ff50-6c63-4925-bc8f-7d9e8b0f9303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:40.002491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa5ff50-6c63-4925-bc8f-7d9e8b0f9303 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:40.033282 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4005/8011] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:40.037132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:40.066192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677e2c7-50f9-4b41-a20d-c87b50305122 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:40.082509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:40.083471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.083755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.084034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] PATH_INFO: `/v3/projects/9601502fab514af1a07bdc09fc55bd26/users/56cc0414228e40da8d983d807361b438/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.089147 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:40.135327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9601502fab514af1a07bdc09fc55bd26, user_id=56cc0414228e40da8d983d807361b438, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:40.138972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:40.181549 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4007/8012] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:40 2022] PUT /identity/v3/projects/9601502fab514af1a07bdc09fc55bd26/users/56cc0414228e40da8d983d807361b438/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:40.193016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.193321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.193591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.294886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] MFA Rules not processed for user `56cc0414228e40da8d983d807361b438`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:40.296525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:40.304763 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:40.495347 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4006/8013] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:40.497464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:40.624941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91e837b-7bb7-4489-969d-e5a7ac475513 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:40.632655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:40.635699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.635699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.635699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.635699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:40.637960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:40.676395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4008/8014] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:40 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:40.678844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:40.693545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20624b2-2212-4271-aa9d-eec10e37eb2c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:40.801145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:40.801863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.802266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.802564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.803287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:40.807616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:40.852014 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4007/8015] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:40 2022] POST /identity/v3/users => generated 297 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:44:40.856033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:40.881497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a4948-51a3-408e-9f61-5c13afcb8742 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:40.893837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:40.894776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.895117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.895405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:40.896207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:40.898181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:40.914166 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4009/8016] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:40 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:40.917788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:40.945844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e420cc-ea11-4dc2-9c0d-1594c6e33691 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:40.965629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:40.970960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:40.971400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:40.971856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] PATH_INFO: `/v3/projects/80c0e93129b44612a4f01ee9ce95119a/users/a129c8fdc1b74794adf72542e3b24eff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:41.021507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c0e93129b44612a4f01ee9ce95119a, user_id=a129c8fdc1b74794adf72542e3b24eff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:41.024404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:41.099597 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4008/8017] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:40 2022] PUT /identity/v3/projects/80c0e93129b44612a4f01ee9ce95119a/users/a129c8fdc1b74794adf72542e3b24eff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:41.104519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:41.120617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947e434-0693-42c5-94ef-55a89a15f4d7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:41.298829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d4b4d-1f4b-49d4-9046-8fae84256d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:41.299548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4b4d-1f4b-49d4-9046-8fae84256d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:41.299850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4b4d-1f4b-49d4-9046-8fae84256d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:41.300102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d4b4d-1f4b-49d4-9046-8fae84256d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:41.300976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d4b4d-1f4b-49d4-9046-8fae84256d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:41.307631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005d4b4d-1f4b-49d4-9046-8fae84256d7f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:41.336236 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4010/8018] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:41.337285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:41.367772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4647ba5-2295-475a-acb1-d9f86c60cc7f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:41.378974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:41.379922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:41.380210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:41.381410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] PATH_INFO: `/v3/projects/80c0e93129b44612a4f01ee9ce95119a/users/a129c8fdc1b74794adf72542e3b24eff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:41.404684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c0e93129b44612a4f01ee9ce95119a, user_id=a129c8fdc1b74794adf72542e3b24eff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:41.430130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:41.464339 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4009/8019] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:41 2022] PUT /identity/v3/projects/80c0e93129b44612a4f01ee9ce95119a/users/a129c8fdc1b74794adf72542e3b24eff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:41.475468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:41.475816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:41.476261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:41.572442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] MFA Rules not processed for user `a129c8fdc1b74794adf72542e3b24eff`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:41.574724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:41.705152 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:41.776619 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4011/8020] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:41.787333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:41.789447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:41.955269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6672b9-4a8f-4333-8add-11f7c5598300 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:41.962819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:41.963684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:41.963936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:41.964223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:41.995468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:41.997497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:42.005149 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:42.016577 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4010/8021] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:42.183241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:42.186061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:42.246813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f774f026-965e-4f8c-ae28-3ce9f550a37a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:42.258123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f658f-350f-459e-aabd-8880486738c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:42.259474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f658f-350f-459e-aabd-8880486738c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:42.259767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f658f-350f-459e-aabd-8880486738c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:42.261956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f658f-350f-459e-aabd-8880486738c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:42.437442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f658f-350f-459e-aabd-8880486738c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:42.444984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f658f-350f-459e-aabd-8880486738c5 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:42.467332 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4012/8022] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:42 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:43.162149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:43.398491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d18e0-e957-4fcf-b279-8474affde0f7 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:43.419841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:43.425632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:43.426062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:43.428066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] PATH_INFO: `/v3/users/56cc0414228e40da8d983d807361b438` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:43.432708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=56cc0414228e40da8d983d807361b438)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:43.437540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:43.662176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56cc0414228e40da8d983d807361b438'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:43.663261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56cc0414228e40da8d983d807361b438'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:43.679656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56cc0414228e40da8d983d807361b438'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:43.682050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56cc0414228e40da8d983d807361b438'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:43.696704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56cc0414228e40da8d983d807361b438'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:43.766760 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4011/8023] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:43 2022] DELETE /identity/v3/users/56cc0414228e40da8d983d807361b438 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:43.769737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:43.770260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:43.770735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:43.830181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:43.832227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:44.034954 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4013/8024] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:44.047972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:44.049719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:44.213397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5826-10af-4cd2-8d73-991992edfaeb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:44.246420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:44.249565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:44.250405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:44.250405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:44.282420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:44.285055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:44.333327 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4012/8025] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:45.006319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.008259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:45.041391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdaaf1-fa67-4e7f-884b-d1fa98c792e1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.068311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.069774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.070302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.070814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] PATH_INFO: `/v3/projects/9601502fab514af1a07bdc09fc55bd26` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.075817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9601502fab514af1a07bdc09fc55bd26)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.093701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.209015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9601502fab514af1a07bdc09fc55bd26', 'request_id': 'req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.236190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9601502fab514af1a07bdc09fc55bd26', 'request_id': 'req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.253054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9601502fab514af1a07bdc09fc55bd26', 'request_id': 'req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.280038 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:45.285565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] The token cache is being invalidate because project 9601502fab514af1a07bdc09fc55bd26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:45.286808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.290141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.293242 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4014/8026] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:45 2022] DELETE /identity/v3/projects/9601502fab514af1a07bdc09fc55bd26 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:45.300209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:45.324796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68d5c40-7de2-4e8b-8647-9e1a004fd2e0 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:45.360315 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:45.485237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:45.488715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:45.489270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:45.489833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] PATH_INFO: `/v3/users/a129c8fdc1b74794adf72542e3b24eff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:45.494197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a129c8fdc1b74794adf72542e3b24eff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:45.498561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:45.605868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a129c8fdc1b74794adf72542e3b24eff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.606681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a129c8fdc1b74794adf72542e3b24eff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.638804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a129c8fdc1b74794adf72542e3b24eff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.641021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a129c8fdc1b74794adf72542e3b24eff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.671649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a129c8fdc1b74794adf72542e3b24eff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:45.759507 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4013/8027] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:45 2022] DELETE /identity/v3/users/a129c8fdc1b74794adf72542e3b24eff => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:46.409903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:46.412462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:46.493539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:46.495701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:46.530363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9830fc1-5bf1-48b3-bb9a-d7d6cce1afa1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:46.712265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfe0e53-fdea-4122-bf3b-6725588be971 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:46.722821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:46.726512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:46.726808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:46.727085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:46.727216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] PATH_INFO: `/v3/users/f047ddb9fbfd4b6f8fd66d02e0dbca20` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:46.728161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:46.729245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f047ddb9fbfd4b6f8fd66d02e0dbca20)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:46.729722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:46.730030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] PATH_INFO: `/v3/projects/80c0e93129b44612a4f01ee9ce95119a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:46.731247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:46.731394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c0e93129b44612a4f01ee9ce95119a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:46.734250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:46.844909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c0e93129b44612a4f01ee9ce95119a', 'request_id': 'req-2c13c61a-9450-432c-850b-84007a76d33c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.861739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c0e93129b44612a4f01ee9ce95119a', 'request_id': 'req-2c13c61a-9450-432c-850b-84007a76d33c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.872160 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:46.876540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c0e93129b44612a4f01ee9ce95119a', 'request_id': 'req-2c13c61a-9450-432c-850b-84007a76d33c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.879724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f047ddb9fbfd4b6f8fd66d02e0dbca20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.883625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f047ddb9fbfd4b6f8fd66d02e0dbca20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.905847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] The token cache is being invalidate because project 80c0e93129b44612a4f01ee9ce95119a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:46.906453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.907412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c13c61a-9450-432c-850b-84007a76d33c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.911911 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4015/8028] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:46 2022] DELETE /identity/v3/projects/80c0e93129b44612a4f01ee9ce95119a => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:46.919708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:46.921567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f047ddb9fbfd4b6f8fd66d02e0dbca20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.921920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:46.922646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:46.922791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f047ddb9fbfd4b6f8fd66d02e0dbca20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.946872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-268e5251-e8de-4fa6-b25e-af3493e42cd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f047ddb9fbfd4b6f8fd66d02e0dbca20'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:46.950406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:46.952473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:46.988569 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4014/8029] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:44:46 2022] DELETE /identity/v3/users/f047ddb9fbfd4b6f8fd66d02e0dbca20 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:47.085927 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4016/8030] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:47.088096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.088643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.089025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.140816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:47.142201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:47.296882 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4015/8031] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:47.298254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.310085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143d63f-5a19-4dce-85df-42d6cf4fb8f0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.318621 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.319337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.319706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.319908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.320821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:47.321082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.325632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.353264 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4017/8032] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:47.357140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.367122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.371518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf2466-6d30-4430-baa8-3982938ff11d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.383235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.384128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.384576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.384948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.385816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.386638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:47.390677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.423782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257cff0-a88a-4d93-8350-611a67f5b2d9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.440677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.441922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.442391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.442855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] PATH_INFO: `/v3/projects/44b748e137e44837a2b4314092a2c57b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.444607 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4016/8033] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:47 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:47.448690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44b748e137e44837a2b4314092a2c57b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.448920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.453544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.500627 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:47.603607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778064e6-bcb8-4f0a-9a09-8c3661465387 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.609288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44b748e137e44837a2b4314092a2c57b', 'request_id': 'req-b2706277-28bf-49bf-96bd-f3ef1bae8767'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:47.629729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44b748e137e44837a2b4314092a2c57b', 'request_id': 'req-b2706277-28bf-49bf-96bd-f3ef1bae8767'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:47.654996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44b748e137e44837a2b4314092a2c57b', 'request_id': 'req-b2706277-28bf-49bf-96bd-f3ef1bae8767'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:47.676150 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:47.682501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] The token cache is being invalidate because project 44b748e137e44837a2b4314092a2c57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:44:47.682773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:47.684999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b2706277-28bf-49bf-96bd-f3ef1bae8767 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:44:47.688632 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4018/8034] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:44:47 2022] DELETE /identity/v3/projects/44b748e137e44837a2b4314092a2c57b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:47.696534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdedbd7-91ca-421d-8b73-2c94c9c16f59 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.696922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdedbd7-91ca-421d-8b73-2c94c9c16f59 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.697269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdedbd7-91ca-421d-8b73-2c94c9c16f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.711630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.712478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.712764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.713240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.713962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.716064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.737827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1bdedbd7-91ca-421d-8b73-2c94c9c16f59 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:47.741768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1bdedbd7-91ca-421d-8b73-2c94c9c16f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:47.746698 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4017/8035] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:47 2022] POST /identity/v3/users => generated 289 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:44:47.747887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.750730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:47.758926 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4019/8036] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:47.767202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.767995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.768299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.777248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0b4db-5bfc-443c-8f20-bc90b2becef3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.792663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.794380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.795472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.795913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.799476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.803035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.810151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:47.813276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:47.827190 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4018/8037] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:47.828264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.841005 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4020/8038] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:47.844918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.858829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220e4e0b-50d3-4009-aea2-c70dd40e9cdf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.880532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f82750-fc9c-4b79-a8ed-63a38053cf51 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.891690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.892429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.892666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.892781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.892964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.893179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.893463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.893701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.893825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.894482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:44:47.895348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.895557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.899595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.924275 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4019/8039] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:47.928578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.955230 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4021/8040] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:44:47.956452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393f665-fa0c-4087-b238-56136660f940 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.956759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:47.963081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69591318-cfe4-4255-8c53-31c6c71c173b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:47.969931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.970576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.970861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.971142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:47.971872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:47.973941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:47.995169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3b164-002a-4e5e-b52b-6306f664a6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:47.999076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b164-002a-4e5e-b52b-6306f664a6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:47.999395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b164-002a-4e5e-b52b-6306f664a6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:47.999920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3b164-002a-4e5e-b52b-6306f664a6db admin admin] PATH_INFO: `/v3/projects/a19c8f6c3d3d498fb6b600b7c6b41b89/users/40a1a27186484277be3d5d9a8f899d5c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.030369 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4022/8041] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:44:47 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:44:48.034655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:48.067540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b164-002a-4e5e-b52b-6306f664a6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=a19c8f6c3d3d498fb6b600b7c6b41b89, user_id=40a1a27186484277be3d5d9a8f899d5c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:48.071774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf3b164-002a-4e5e-b52b-6306f664a6db admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:48.222310 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4020/8042] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:47 2022] PUT /identity/v3/projects/a19c8f6c3d3d498fb6b600b7c6b41b89/users/40a1a27186484277be3d5d9a8f899d5c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:44:48.235305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.235870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.236942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.273115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50288c-5432-4c07-8522-30b024a7838d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:48.335342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] MFA Rules not processed for user `40a1a27186484277be3d5d9a8f899d5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:48.336946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:48.474154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:48.475038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.475381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.475719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.476656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:48.478757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:48.487188 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:48.519497 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4021/8043] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:44:48.542797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:48.542797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:48.565018 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4023/8044] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:44:48 2022] POST /identity/v3/users => generated 284 bytes in 531 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:44:48.568423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:48.589047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd4057-a568-415c-8272-8f5e21bd8dd0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:48.603728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:48.604512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.604797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.605074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.605838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:48.607539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:48.644080 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4024/8045] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:48.645478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:48.669751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ece83e-ba9f-43ca-b281-e5693e9d4412 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:48.682001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:48.682631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.682916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.683191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.685962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:48.687705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:48.698385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49599d-363a-421b-92d1-c2a63f264892 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:48.710001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d661fee-162b-4d6d-99b5-00d7f6eb528a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:48.710705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d661fee-162b-4d6d-99b5-00d7f6eb528a service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.710993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d661fee-162b-4d6d-99b5-00d7f6eb528a service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.711272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d661fee-162b-4d6d-99b5-00d7f6eb528a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.724243 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4025/8046] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:44:48.725411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:48.734072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d661fee-162b-4d6d-99b5-00d7f6eb528a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:48.735585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d661fee-162b-4d6d-99b5-00d7f6eb528a service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:48.746482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044922b5-0f5c-4f5a-9778-ca12be221a11 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:48.753221 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4022/8047] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:48.757169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:48.758278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.758562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.758835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] PATH_INFO: `/v3/projects/068fa5f11fc344c6913ce2d912b8255f/users/fb4deacbce344b5caf9f416d2680ecd5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.779001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=068fa5f11fc344c6913ce2d912b8255f, user_id=fb4deacbce344b5caf9f416d2680ecd5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:48.782133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:48.802498 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4026/8048] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:44:48 2022] PUT /identity/v3/projects/068fa5f11fc344c6913ce2d912b8255f/users/fb4deacbce344b5caf9f416d2680ecd5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:44:48.816318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:48.816318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:48.816318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:48.872616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] MFA Rules not processed for user `fb4deacbce344b5caf9f416d2680ecd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:44:48.875018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:48.894601 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:49.009260 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4023/8049] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:44:48 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:44:49.034614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:44:49.038225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:44:49.233601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef52f4bd-b4dc-4cdf-bea9-62299b4ccca7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:44:49.244996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a0fa7-c30b-4bfb-943c-63584b11a2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:44:49.246029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a0fa7-c30b-4bfb-943c-63584b11a2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:44:49.247212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a0fa7-c30b-4bfb-943c-63584b11a2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:44:49.248506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a0fa7-c30b-4bfb-943c-63584b11a2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:44:49.283911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a0fa7-c30b-4bfb-943c-63584b11a2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:44:49.285533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a0fa7-c30b-4bfb-943c-63584b11a2c4 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:44:49.308035 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4027/8050] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:44:49 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:44:59.000329 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=22 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:44:59.300904 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=4,keystone:SELECT=48 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:00.134693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:00.136430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:00.271990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35051afa-087c-4bc2-b826-f58dad4f5dbd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:00.287524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:00.288497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:00.288789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:00.289072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] PATH_INFO: `/v3/users/423981c1b40d4039bc854f637775c6ec` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:00.291245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423981c1b40d4039bc854f637775c6ec)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:00.295559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:00.436818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423981c1b40d4039bc854f637775c6ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:00.437539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423981c1b40d4039bc854f637775c6ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:00.449176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423981c1b40d4039bc854f637775c6ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:00.449950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423981c1b40d4039bc854f637775c6ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:00.463388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423981c1b40d4039bc854f637775c6ec'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:00.491022 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4024/8051] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:00 2022] DELETE /identity/v3/users/423981c1b40d4039bc854f637775c6ec => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:00.491925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:00.492518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:00.492518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:00.521493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:00.523064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:00.632444 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4028/8052] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:00.643914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:00.646072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:00.739192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff14653-68c5-4715-9588-924de9834251 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:00.745243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fdf33-36a3-4590-aa4b-426c5b50e807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:00.746434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fdf33-36a3-4590-aa4b-426c5b50e807 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:00.746950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fdf33-36a3-4590-aa4b-426c5b50e807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:00.747829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fdf33-36a3-4590-aa4b-426c5b50e807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:00.764590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fdf33-36a3-4590-aa4b-426c5b50e807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:00.766502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fdf33-36a3-4590-aa4b-426c5b50e807 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:00.793963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4025/8053] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:01.365637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:01.367293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:01.397993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9add0cc2-688f-4fea-a0da-342bf2d063c6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:01.407778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:01.408744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:01.409033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:01.409522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] PATH_INFO: `/v3/projects/347f245cee94444e97b68974519829bd` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:01.411947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] RBAC: Authorizing `identity:delete_project(project_id=347f245cee94444e97b68974519829bd)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:01.414076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:01.519114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347f245cee94444e97b68974519829bd', 'request_id': 'req-fbddc161-2a3e-4fef-83f9-010c4168564e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:01.534254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347f245cee94444e97b68974519829bd', 'request_id': 'req-fbddc161-2a3e-4fef-83f9-010c4168564e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:01.543530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347f245cee94444e97b68974519829bd', 'request_id': 'req-fbddc161-2a3e-4fef-83f9-010c4168564e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:01.575398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] The token cache is being invalidate because project 347f245cee94444e97b68974519829bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:01.577394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:01.578564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fbddc161-2a3e-4fef-83f9-010c4168564e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:01.582497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4029/8054] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:01 2022] DELETE /identity/v3/projects/347f245cee94444e97b68974519829bd => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:01.587805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:01.588251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:01.588543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:01.622295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:01.624077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:01.658849 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:01.762554 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4026/8055] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:01.765870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:01.765870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:01.765870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:01.797908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:01.799401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:01.812373 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4030/8056] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:01.814044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:01.845980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47abfef-4c96-4772-9e42-b240952fca06 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:01.860630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:01.861981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:01.862553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:01.866015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:01.867163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:01.867690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:01.874048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:01.922493 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4027/8057] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:45:01.924402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:01.940022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d96603-5c74-4f03-a250-814f7a2ceb14 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:01.952817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:01.953615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:01.953994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:01.954389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:01.956915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:01.962557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:02.031118 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4031/8058] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:01 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:02.044753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:02.060471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20289c-7ea5-44cb-983d-e653bd2d4ae3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:02.172490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:02.177368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:02.177668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:02.178077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:02.178888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:02.181190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:02.208850 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4028/8059] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:02 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:02.210480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:02.233204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a02059-7f83-4a43-b367-9a473a9f5558 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:02.240580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:02.241585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:02.242074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:02.242601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:02.243735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:02.245945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:02.272338 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4032/8060] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:45:02.277732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:02.296506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c991e4a-8e08-4ce9-be41-d59e12b74e5d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:02.310337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36327ca9-1fd2-4e90-88fd-e0b9fb14ac3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:02.311593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36327ca9-1fd2-4e90-88fd-e0b9fb14ac3c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:02.313424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36327ca9-1fd2-4e90-88fd-e0b9fb14ac3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:02.313947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36327ca9-1fd2-4e90-88fd-e0b9fb14ac3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:02.315148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36327ca9-1fd2-4e90-88fd-e0b9fb14ac3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:02.317017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36327ca9-1fd2-4e90-88fd-e0b9fb14ac3c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:02.337266 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4029/8061] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:02.341728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:02.361564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4315b9-1c27-4abd-b553-299fc84564de admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:02.370105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:02.371354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:02.371648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:02.371908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] PATH_INFO: `/v3/projects/ff4a4be1a81f4103a618a534bea51c9b/users/209429f600ed4541b4f53ff85a4c4f0c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:02.392473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff4a4be1a81f4103a618a534bea51c9b, user_id=209429f600ed4541b4f53ff85a4c4f0c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:02.396691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:02.426285 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4033/8062] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:02 2022] PUT /identity/v3/projects/ff4a4be1a81f4103a618a534bea51c9b/users/209429f600ed4541b4f53ff85a4c4f0c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:02.442782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428d960-b03d-49ef-a208-01af348838c2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:02.443359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428d960-b03d-49ef-a208-01af348838c2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:02.443816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428d960-b03d-49ef-a208-01af348838c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:02.487718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f428d960-b03d-49ef-a208-01af348838c2 None None] MFA Rules not processed for user `209429f600ed4541b4f53ff85a4c4f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:02.489074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f428d960-b03d-49ef-a208-01af348838c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:02.588687 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4030/8063] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:02.600548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:02.603115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:02.636685 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:02.693773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3a5e65-b2f7-4a65-b516-11fcea81627a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:02.703163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:02.703952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:02.704305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:02.704676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:02.716863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:02.719146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:02.738151 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4034/8064] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:05.491965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893ba3b-d0f8-4982-969c-4a15295f0a7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:05.493121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893ba3b-d0f8-4982-969c-4a15295f0a7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:05.493641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893ba3b-d0f8-4982-969c-4a15295f0a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:05.533565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1893ba3b-d0f8-4982-969c-4a15295f0a7a None None] MFA Rules not processed for user `209429f600ed4541b4f53ff85a4c4f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:05.537594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1893ba3b-d0f8-4982-969c-4a15295f0a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:05.554206 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4031/8065] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:05 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:12.732850 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=17 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:13.287374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:13.288042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:13.525088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8fb8-7719-4fdc-bc5e-9b1b62714319 service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:13.532012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:13.533226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:13.533646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:13.534063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] PATH_INFO: `/v3/users/fb4deacbce344b5caf9f416d2680ecd5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:13.535481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4deacbce344b5caf9f416d2680ecd5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:13.539127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:13.621943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4deacbce344b5caf9f416d2680ecd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:13.661504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4deacbce344b5caf9f416d2680ecd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:13.684573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4deacbce344b5caf9f416d2680ecd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:13.687499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4deacbce344b5caf9f416d2680ecd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:13.699436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4deacbce344b5caf9f416d2680ecd5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:13.716945 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4035/8066] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:13 2022] DELETE /identity/v3/users/fb4deacbce344b5caf9f416d2680ecd5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:13.721354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:13.721942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:13.721942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:13.777662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:13.781308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:13.793341 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:13.928530 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4032/8067] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:13.940971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:13.943155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:14.087823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182dae-2581-4732-bda5-1a4c31cff127 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:14.092210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c316bc4-e979-4bca-9645-31ede926aa06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:14.093165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316bc4-e979-4bca-9645-31ede926aa06 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:14.093451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316bc4-e979-4bca-9645-31ede926aa06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:14.093739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c316bc4-e979-4bca-9645-31ede926aa06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:14.107547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316bc4-e979-4bca-9645-31ede926aa06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:14.109557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c316bc4-e979-4bca-9645-31ede926aa06 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:14.125637 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4036/8068] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:14.667369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:14.668946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:14.688115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd580cb5-3559-4c80-b0e7-65bfa7e1c24c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:14.703901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:14.707193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:14.708713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:14.709582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] PATH_INFO: `/v3/projects/068fa5f11fc344c6913ce2d912b8255f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:14.713137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=068fa5f11fc344c6913ce2d912b8255f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:14.715146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:14.778634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '068fa5f11fc344c6913ce2d912b8255f', 'request_id': 'req-70a2c4c4-c9ca-4996-9e17-5690338ae664'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:14.798722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '068fa5f11fc344c6913ce2d912b8255f', 'request_id': 'req-70a2c4c4-c9ca-4996-9e17-5690338ae664'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:14.814481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '068fa5f11fc344c6913ce2d912b8255f', 'request_id': 'req-70a2c4c4-c9ca-4996-9e17-5690338ae664'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:14.838372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] The token cache is being invalidate because project 068fa5f11fc344c6913ce2d912b8255f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:14.838659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:14.839691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-70a2c4c4-c9ca-4996-9e17-5690338ae664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:14.842058 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4033/8069] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:14 2022] DELETE /identity/v3/projects/068fa5f11fc344c6913ce2d912b8255f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:14.849862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:14.850773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:14.851210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:14.880581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:14.883272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:14.933181 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:14.989368 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4037/8070] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:14.998193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:14.998629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:14.998916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.037717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:15.064301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:15.074225 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4034/8071] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:15.078378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.090975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9341a5-4e14-4f99-a2e2-c3d2028326b0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.097982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.098917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.099622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.100055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.103656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:15.103656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.105165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.122495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4038/8072] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:15.126572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.140254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb9e717-abde-4d9d-a8c2-a5e51c83aa1e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.153576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.154282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.154573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.154854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.156121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.159041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.201655 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4035/8073] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:15 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:15.202697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.220175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae26647-9c44-4a7f-83f5-f8330c98b825 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.410997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.411617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.411903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.412607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.413496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.415584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.459650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.480603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4039/8074] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:15 2022] POST /identity/v3/users => generated 293 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:15.499929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203ff12-5e64-4d87-9476-d97aeea827cb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.513991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.516602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.517063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.517956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.518872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.520769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.542172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4036/8075] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:15.543857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.565135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea979676-8f18-488e-a52b-84a73f482940 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.578241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a10a5a-3a88-489c-be1b-cbf2f645eaea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.579585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10a5a-3a88-489c-be1b-cbf2f645eaea admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.580285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10a5a-3a88-489c-be1b-cbf2f645eaea admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.580954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a10a5a-3a88-489c-be1b-cbf2f645eaea admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.582860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a10a5a-3a88-489c-be1b-cbf2f645eaea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.585683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a10a5a-3a88-489c-be1b-cbf2f645eaea admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.607303 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4040/8076] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:15.608951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.622765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74253281-6ef8-4faa-a41c-0dad74a93a96 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.630120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.631946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.633463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.637061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] PATH_INFO: `/v3/projects/610ef3d76e6a4dfa9200a82ece0dbb00/users/a8a55f25af2c4819b5e85c7527f83951/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.658172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] RBAC: Authorizing `identity:create_grant(project_id=610ef3d76e6a4dfa9200a82ece0dbb00, user_id=a8a55f25af2c4819b5e85c7527f83951, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.661331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.680975 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4037/8077] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:15 2022] PUT /identity/v3/projects/610ef3d76e6a4dfa9200a82ece0dbb00/users/a8a55f25af2c4819b5e85c7527f83951/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:15.691344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.691782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.692187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.725320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] MFA Rules not processed for user `a8a55f25af2c4819b5e85c7527f83951`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:15.727181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:15.823739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4041/8078] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:15.828899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.871562 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:15.912616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70292c6-194c-4f6b-a909-b5db4f04c90b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.919383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:15.920302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:15.920880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:15.921176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:15.923717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:15.926186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:15.956945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4038/8079] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:15 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:15.961316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:15.975698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4ef2c-32a5-449e-8217-5fa6f68549ae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:15.990977 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:16.047690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.049127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.049127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.049127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.050277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.051637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.092241 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4042/8080] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:15 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:16.098146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.119805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95a2800-f47e-4b5a-84c6-04815d0c2f71 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.142591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.143595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.143881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.144155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.145011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.147356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.160837 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4039/8081] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:16.165471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.178446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26187d4-1a95-4882-bb2c-64d0869ca414 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.186293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.187693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.188146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.188617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] PATH_INFO: `/v3/projects/f946b00bc222487db09a9f49b6021d9b/users/8fdf9f2c211942b397e0800768262113/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.208333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f946b00bc222487db09a9f49b6021d9b, user_id=8fdf9f2c211942b397e0800768262113, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.211415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.240335 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4043/8082] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:16 2022] PUT /identity/v3/projects/f946b00bc222487db09a9f49b6021d9b/users/8fdf9f2c211942b397e0800768262113/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:16.240908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.252168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7cb57-8f2b-4358-8961-ec94a420fb8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.365015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5f16-c13a-4c23-8dcc-a637eed0f762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.366141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5f16-c13a-4c23-8dcc-a637eed0f762 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.366665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5f16-c13a-4c23-8dcc-a637eed0f762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.369086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5f16-c13a-4c23-8dcc-a637eed0f762 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.370093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc5f16-c13a-4c23-8dcc-a637eed0f762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.372377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc5f16-c13a-4c23-8dcc-a637eed0f762 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.388967 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4040/8083] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:16 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:16.390140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.406413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860d096d-ee88-4a0b-93f6-ada36eeee8ce admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.441023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.442359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.443336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.443933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] PATH_INFO: `/v3/projects/f946b00bc222487db09a9f49b6021d9b/users/8fdf9f2c211942b397e0800768262113/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.446411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f946b00bc222487db09a9f49b6021d9b, user_id=8fdf9f2c211942b397e0800768262113, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.449969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.467429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4044/8084] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:16 2022] PUT /identity/v3/projects/f946b00bc222487db09a9f49b6021d9b/users/8fdf9f2c211942b397e0800768262113/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:16.478239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.478587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.478873 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.521199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] MFA Rules not processed for user `8fdf9f2c211942b397e0800768262113`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:16.524815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:16.638931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4041/8085] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:16.640181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.656203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71598b50-08d9-4aee-abbb-cce7fb446af8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.662037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.663678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.664218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.665183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.667358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.669377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.721855 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4045/8086] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:16 2022] POST /identity/v3/services => generated 288 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:45:16.722925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.736016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684494-c07c-41ed-9a3b-2704f2a5bb5d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.787678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.793747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.794185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.804646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.806155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.817402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: On instance['enabled']: Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: On instance['enabled']: Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: 'False' Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.833042 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:45:16.835491 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:16.837623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4042/8087] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:45:16 2022] POST /identity/v3/endpoints => generated 283 bytes in 114 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:45:16.842853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:16.896829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc7dee-8731-49a4-97a3-7f3771b113bd tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:16.937458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:16.939374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:16.939603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:16.939809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:16.942411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:16.944009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: On instance['enabled']: Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: On instance['enabled']: Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: 'True' Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise error Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'True' Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.980336 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:45:16.982318 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'True' Jul 19 11:45:16.983662 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:16.984909 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4046/8088] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:45:16 2022] POST /identity/v3/endpoints => generated 281 bytes in 142 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:45:16.991723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.003840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3424e87f-e979-4d21-aed1-cf31219a24ee tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.009111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.009792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.010237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.010511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.012049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.014993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.028357 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:17.067465 n-d-master-1 devstack@keystone.service[80581]: WARNING py.warnings [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1963484047. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:45:17.067465 n-d-master-1 devstack@keystone.service[80581]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:45:17.067465 n-d-master-1 devstack@keystone.service[80581]: Jul 19 11:45:17.132999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.134123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4043/8089] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:45:16 2022] POST /identity/v3/endpoints => generated 361 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:17.148909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724de663-73c7-4905-88c5-efac8ee23d93 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.190014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.190907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.191264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.191654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/regions/tempest-region-1963484047` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.192479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1963484047)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.193864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.202876 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4047/8090] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:45:17 2022] GET /identity/v3/regions/tempest-region-1963484047 => generated 180 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:17.207316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.224779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1d104e-16c3-489d-aed7-6575a98ba74b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.243496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.244758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.245232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.245620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints/7efbd2aa0d6042a0bc47753a5b56fe5d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.254942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=7efbd2aa0d6042a0bc47753a5b56fe5d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.256799 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: On instance['enabled']: Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: On instance['enabled']: Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: 'False' Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise error Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.291807 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:45:17.294286 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application 'False' Jul 19 11:45:17.295517 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:17.300847 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4044/8091] 10.222.0.15 () {60 vars in 1254 bytes} [Tue Jul 19 11:45:17 2022] PATCH /identity/v3/endpoints/7efbd2aa0d6042a0bc47753a5b56fe5d => generated 283 bytes in 94 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:45:17.305213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.327395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96f48c-fb46-467a-8fc6-233ba66b86bf tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.346942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.348083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.348580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.349032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints/7efbd2aa0d6042a0bc47753a5b56fe5d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.351280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=7efbd2aa0d6042a0bc47753a5b56fe5d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.353228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.373759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '7efbd2aa0d6042a0bc47753a5b56fe5d', 'request_id': 'req-80e4e269-8f2b-4a1c-880f-bca880db10f1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:17.397495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4048/8092] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:45:17 2022] DELETE /identity/v3/endpoints/7efbd2aa0d6042a0bc47753a5b56fe5d => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:17.401789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.419675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c054e9-9b69-4cf0-a12b-a7ca3c7ead97 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.469221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.475083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.475611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.477191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/regions/tempest-region-1963484047` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.479286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1963484047)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.482646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.541148 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4045/8093] 10.222.0.15 () {58 vars in 1208 bytes} [Tue Jul 19 11:45:17 2022] DELETE /identity/v3/regions/tempest-region-1963484047 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:17.546132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.563046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4e269-8f2b-4a1c-880f-bca880db10f1 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.624421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.626004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.626297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.628161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.629691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.631364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.672193 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1126471104. To ensure interoperability, identifiers should be a valid uuid. Jul 19 11:45:17.672193 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Jul 19 11:45:17.672193 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:45:17.752177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4049/8094] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Jul 19 11:45:17 2022] POST /identity/v3/endpoints => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:17.755769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.775470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5baa2c-0a34-483d-8370-8a2ecb20225a tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.816652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.817810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.818293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.818762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/regions/tempest-region-1126471104` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.819754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1126471104)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.823270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.831336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4046/8095] 10.222.0.15 () {58 vars in 1205 bytes} [Tue Jul 19 11:45:17 2022] GET /identity/v3/regions/tempest-region-1126471104 => generated 180 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:45:17.835872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.849738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ddbbe-7fde-4851-b02c-61ece69f2a55 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.856888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.858060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `PATCH` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.858585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.859101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints/86efb8cac6c34166a654ca5647c3a848` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.886672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=86efb8cac6c34166a654ca5647c3a848)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.888311 n-d-master-1 devstack@keystone.service[80580]: WARNING py.warnings [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 11:45:17.888311 n-d-master-1 devstack@keystone.service[80580]: warnings.warn(msg) Jul 19 11:45:17.888311 n-d-master-1 devstack@keystone.service[80580]: Jul 19 11:45:17.889507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: On instance['enabled']: Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: On instance['enabled']: Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: 'True' Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise error Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'True' Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.911473 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Jul 19 11:45:17.914709 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application On instance['enabled']: Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application 'True' Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: ERROR keystone.server.flask.application Jul 19 11:45:17.917093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4050/8096] 10.222.0.15 () {60 vars in 1254 bytes} [Tue Jul 19 11:45:17 2022] PATCH /identity/v3/endpoints/86efb8cac6c34166a654ca5647c3a848 => generated 281 bytes in 78 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Jul 19 11:45:17.918570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:17.937265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d2b98-6ce9-4660-80f4-d596bebe5aeb tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:17.945030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:17.945997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:17.946277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:17.946552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/endpoints/86efb8cac6c34166a654ca5647c3a848` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:17.948833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=86efb8cac6c34166a654ca5647c3a848)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:17.950589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:17.978259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '86efb8cac6c34166a654ca5647c3a848', 'request_id': 'req-b42e37b4-41a4-4b2a-9031-8590e1cc697c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:17.998810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4047/8097] 10.222.0.15 () {58 vars in 1235 bytes} [Tue Jul 19 11:45:17 2022] DELETE /identity/v3/endpoints/86efb8cac6c34166a654ca5647c3a848 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:18.003644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:18.019645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389fafa6-379a-43d1-a8be-fd5838e8963c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:18.040978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:18.042154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:18.043626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:18.044110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/regions/tempest-region-1126471104` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:18.045205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1126471104)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:18.047466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:18.068492 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=8,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:18.085501 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4051/8098] 10.222.0.15 () {58 vars in 1208 bytes} [Tue Jul 19 11:45:18 2022] DELETE /identity/v3/regions/tempest-region-1126471104 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:18.091594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:18.104973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42e37b4-41a4-4b2a-9031-8590e1cc697c tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:18.124789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf9fee6-d458-4204-8528-207cf1ecbb4b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8fdf9f2c211942b397e0800768262113', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f946b00bc222487db09a9f49b6021d9b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:18.126578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9fee6-d458-4204-8528-207cf1ecbb4b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:18.127535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9fee6-d458-4204-8528-207cf1ecbb4b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:18.128043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf9fee6-d458-4204-8528-207cf1ecbb4b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] PATH_INFO: `/v3/services/62003fbabb304277b4db7f4e8025cdf2` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:18.129194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9fee6-d458-4204-8528-207cf1ecbb4b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorizing `identity:delete_service(service_id=62003fbabb304277b4db7f4e8025cdf2)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:18.131138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf9fee6-d458-4204-8528-207cf1ecbb4b tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:18.170396 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4048/8099] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:18 2022] DELETE /identity/v3/services/62003fbabb304277b4db7f4e8025cdf2 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:18.172091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:18.278245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805e225-8e87-46ef-ab1c-aefdd7208bd7 tempest-EndpointsNegativeTestJSON-1935746981 tempest-EndpointsNegativeTestJSON-1935746981-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:18.325299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:18.326530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:18.326988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:18.327113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] PATH_INFO: `/v3/users/a8a55f25af2c4819b5e85c7527f83951` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:18.329126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a55f25af2c4819b5e85c7527f83951)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:18.336986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:18.449200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a55f25af2c4819b5e85c7527f83951'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:18.469371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a55f25af2c4819b5e85c7527f83951'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:18.492880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a55f25af2c4819b5e85c7527f83951'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:18.494164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a55f25af2c4819b5e85c7527f83951'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:18.515631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a55f25af2c4819b5e85c7527f83951'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:18.533544 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4052/8100] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:18 2022] DELETE /identity/v3/users/a8a55f25af2c4819b5e85c7527f83951 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:18.539364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:18.542396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:18.543123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:18.592030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:18.593744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:18.855560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4049/8101] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:18.856434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:18.858153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:19.167427 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:19.174057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b4ee8-523d-4093-a618-a12b32256893 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:19.203484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:19.208364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:19.208859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:19.209341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:19.263923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:19.274365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:19.310795 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4053/8102] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:20.181194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:20.183502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:20.224067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b42756-9319-4d57-8afa-1a14a4d21b4d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:20.246851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:20.255820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:20.256995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:20.257620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] PATH_INFO: `/v3/projects/610ef3d76e6a4dfa9200a82ece0dbb00` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:20.262469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=610ef3d76e6a4dfa9200a82ece0dbb00)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:20.266824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:20.358624 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:20.443308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610ef3d76e6a4dfa9200a82ece0dbb00', 'request_id': 'req-645c44c5-4de8-41c6-8d4c-2df53764db9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:20.482085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610ef3d76e6a4dfa9200a82ece0dbb00', 'request_id': 'req-645c44c5-4de8-41c6-8d4c-2df53764db9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:20.534887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610ef3d76e6a4dfa9200a82ece0dbb00', 'request_id': 'req-645c44c5-4de8-41c6-8d4c-2df53764db9d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:20.585168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] The token cache is being invalidate because project 610ef3d76e6a4dfa9200a82ece0dbb00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:20.585693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:20.586868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:20.590132 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4050/8103] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:20 2022] DELETE /identity/v3/projects/610ef3d76e6a4dfa9200a82ece0dbb00 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:20.601314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:20.624286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf6bfa-fc2b-41c9-bdf7-7c1787e1ffb4 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:20.873844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:20.877361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:20.877905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:20.879317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] PATH_INFO: `/v3/users/8fdf9f2c211942b397e0800768262113` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:20.895494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdf9f2c211942b397e0800768262113)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:20.897920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:21.188280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdf9f2c211942b397e0800768262113'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:21.217243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdf9f2c211942b397e0800768262113'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:21.291724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdf9f2c211942b397e0800768262113'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:21.293708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdf9f2c211942b397e0800768262113'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:21.330467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4cee8c1e-95e5-4e47-8af7-c8041b49e615 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdf9f2c211942b397e0800768262113'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:21.356689 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4054/8104] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:20 2022] DELETE /identity/v3/users/8fdf9f2c211942b397e0800768262113 => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:22.751066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:22.752810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:22.799630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c44c5-4de8-41c6-8d4c-2df53764db9d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:23.165028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:23.168380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.168911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.169528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] PATH_INFO: `/v3/projects/f946b00bc222487db09a9f49b6021d9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.172030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f946b00bc222487db09a9f49b6021d9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:23.178786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:23.413733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e49264-19cf-46cf-9dc9-3a546141c7ed None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.415888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e49264-19cf-46cf-9dc9-3a546141c7ed None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.415888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e49264-19cf-46cf-9dc9-3a546141c7ed None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.415888 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4055/8105] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 11:45:23.425685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.426879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.428104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.430576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f946b00bc222487db09a9f49b6021d9b', 'request_id': 'req-af81ffa1-8a95-4a22-950e-60d98b629f2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:23.464509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f946b00bc222487db09a9f49b6021d9b', 'request_id': 'req-af81ffa1-8a95-4a22-950e-60d98b629f2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:23.476642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:23.491780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:23.495739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f946b00bc222487db09a9f49b6021d9b', 'request_id': 'req-af81ffa1-8a95-4a22-950e-60d98b629f2d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:23.528872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] The token cache is being invalidate because project f946b00bc222487db09a9f49b6021d9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:23.529216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:23.532985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-af81ffa1-8a95-4a22-950e-60d98b629f2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:23.535081 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4051/8106] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:22 2022] DELETE /identity/v3/projects/f946b00bc222487db09a9f49b6021d9b => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:23.540991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.541340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.541618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.612278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:23.615746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:23.622474 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:23.635157 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4056/8107] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:23.660732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:23.662750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:23.705673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eb73d7-86e1-4cf8-898e-b55782c4b2eb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:23.712637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea14f186-c325-4bcc-82c7-4a0ccf77f52e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:23.713690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f186-c325-4bcc-82c7-4a0ccf77f52e service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.714275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f186-c325-4bcc-82c7-4a0ccf77f52e service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.714793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14f186-c325-4bcc-82c7-4a0ccf77f52e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.726684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f186-c325-4bcc-82c7-4a0ccf77f52e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:23.728995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea14f186-c325-4bcc-82c7-4a0ccf77f52e service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:23.744557 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4057/8108] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:23.749603 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:23.842522 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4052/8109] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:23.851810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.852058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.852320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.899667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:23.901218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:23.921397 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4058/8110] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:23.925721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:23.945528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fae3ba-a161-4255-b377-8fe0844e94af None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:23.977077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:23.978715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:23.979855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:23.980202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:23.980858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:23.984764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:23.986447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.037395 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4053/8111] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:24.042104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:24.059192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1770e539-b5af-4353-85b8-31d6e3c10412 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:24.065625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:24.067529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.070148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.070636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.072094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:24.081418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.186932 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4059/8112] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:24 2022] POST /identity/v3/projects => generated 359 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:24.194844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:24.232290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef882cef-e3ae-44d3-9890-ab0e901c8c95 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:24.350443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:24.351741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.352107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.354740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.355400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:24.358848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.421394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4054/8113] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:24 2022] POST /identity/v3/users => generated 280 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:24.425636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:24.446074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:24.460142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97ddb09-23dd-4aeb-9298-b03518b6f5f2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:24.506885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:24.511794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.514146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.515010 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.516464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:24.524971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.557905 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4060/8114] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:24.568074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:24.626324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c70757-5b62-424a-8b1f-dda096b29998 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:24.641444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0ab3c1-55d8-4f6e-b763-220ee6244dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:24.643528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ab3c1-55d8-4f6e-b763-220ee6244dee admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.644399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ab3c1-55d8-4f6e-b763-220ee6244dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.646662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0ab3c1-55d8-4f6e-b763-220ee6244dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.648333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ab3c1-55d8-4f6e-b763-220ee6244dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:24.651532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0ab3c1-55d8-4f6e-b763-220ee6244dee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.676802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d913cea-10c3-47c3-8065-6392797ea19a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:24.686567 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4061/8115] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:24 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:45:24.690323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.692892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.693447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.710867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:24.712313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.712995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.713609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.723515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:24.770869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:24.773462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.810480 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4055/8116] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:45:24.811618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:24.823416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:24.832280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:24.837152 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5a13ea-ad2b-4233-be50-846d268af0cd service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:24.850269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4e942a-5089-4cb4-8e0d-afcb12a60fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:24.851242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e942a-5089-4cb4-8e0d-afcb12a60fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.851565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e942a-5089-4cb4-8e0d-afcb12a60fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.851841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4e942a-5089-4cb4-8e0d-afcb12a60fe5 admin admin] PATH_INFO: `/v3/projects/c98b372a89354d86b885064d856f686d/users/1f1def0a933843988de066f725ea0068/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:24.914987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e942a-5089-4cb4-8e0d-afcb12a60fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c98b372a89354d86b885064d856f686d, user_id=1f1def0a933843988de066f725ea0068, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:24.918582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4e942a-5089-4cb4-8e0d-afcb12a60fe5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:24.959062 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4056/8117] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:24 2022] PUT /identity/v3/projects/c98b372a89354d86b885064d856f686d/users/1f1def0a933843988de066f725ea0068/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:24.962573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0203-c967-49e7-bb72-84ce0e630260 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:24.963151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0203-c967-49e7-bb72-84ce0e630260 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:24.963673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e0203-c967-49e7-bb72-84ce0e630260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.033880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-539e0203-c967-49e7-bb72-84ce0e630260 None None] MFA Rules not processed for user `1f1def0a933843988de066f725ea0068`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:25.037018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-539e0203-c967-49e7-bb72-84ce0e630260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:25.060517 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:25.069723 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4062/8118] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:45:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:25.171553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.174320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:25.244640 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4057/8119] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:24 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:25.251436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37450594-bc53-47f9-b1e6-6cff61f4a67a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.251745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37450594-bc53-47f9-b1e6-6cff61f4a67a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.251976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37450594-bc53-47f9-b1e6-6cff61f4a67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.278501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37450594-bc53-47f9-b1e6-6cff61f4a67a None None] MFA Rules not processed for user `1f1def0a933843988de066f725ea0068`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:25.279794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37450594-bc53-47f9-b1e6-6cff61f4a67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:25.285228 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4058/8120] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:25 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:45:25.293793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.295036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.296172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.324523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] MFA Rules not processed for user `1f1def0a933843988de066f725ea0068`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:25.326165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:25.331174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4059/8121] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:25 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:45:25.336170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.358268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130fc69-b277-4648-9888-89f268e66eb0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.373701 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.374878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.375334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.375882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.385251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorizing `identity:check_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:25.387999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:25.396556 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4060/8122] 10.222.0.15 () {56 vars in 1263 bytes} [Tue Jul 19 11:45:25 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Jul 19 11:45:25.402785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.420027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd94e4e7-d5b6-4098-b24e-219356b19484 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.420995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f2d79-87bb-4cb9-8fa9-619334056af1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.427095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.428471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.429286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.429841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.441404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:25.443730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:25.458479 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4061/8123] 10.222.0.15 () {56 vars in 1262 bytes} [Tue Jul 19 11:45:25 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 19 11:45:25.466243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.470916 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:25.504269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad181eb-53ea-4f81-9e84-43bdba8af563 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.514243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.516495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.517848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.518789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.538459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:25.540593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:25.570121 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4062/8124] 10.222.0.15 () {56 vars in 1265 bytes} [Tue Jul 19 11:45:25 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:25.575228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.585653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.586815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.587312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.587917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.648475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5438b8-4373-411f-98c9-682f8d47ddb0 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.664105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d9093-68d2-41de-9bfc-a5c7b79a1223 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.664829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9093-68d2-41de-9bfc-a5c7b79a1223 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `HEAD` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.665120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9093-68d2-41de-9bfc-a5c7b79a1223 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.665412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d9093-68d2-41de-9bfc-a5c7b79a1223 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.668016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cc5d9093-68d2-41de-9bfc-a5c7b79a1223 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cc5d9093-68d2-41de-9bfc-a5c7b79a1223 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Jul 19 11:45:25.685893 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 19 11:45:25.687740 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 19 11:45:25.689155 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:25.689155 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:25.689155 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 19 11:45:25.689155 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 19 11:45:25.689155 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 19 11:45:25.689155 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:25.691959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4063/8125] 10.222.0.15 () {56 vars in 1263 bytes} [Tue Jul 19 11:45:25 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:45:25.703022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.703751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.705859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.730695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] MFA Rules not processed for user `1f1def0a933843988de066f725ea0068`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:25.732433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:25.737175 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4064/8126] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:25 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 19 11:45:25.741577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.753322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:25.756818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:25.788256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa63072-1ef5-4685-a349-d766188bc908 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.801181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.802181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.802608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.803665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.812590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:25.815302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:25.821985 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4063/8127] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:45:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:45:25.830497 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4065/8128] 10.222.0.15 () {56 vars in 1262 bytes} [Tue Jul 19 11:45:25 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 19 11:45:25.840767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:25.872991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa89371-9b47-4275-b0b5-d79385c72dbb service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:25.888062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:25.892494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:25.892702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:25.893004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:25.918881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:25.924668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:25.964022 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4064/8129] 10.222.0.15 () {56 vars in 1265 bytes} [Tue Jul 19 11:45:25 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:25.970478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:26.014614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2596667-01f6-48a4-9026-dbbbb976e228 tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:26.025093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5bd7f-dc50-4cdf-9e4a-f2b410fc8b2f tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1f1def0a933843988de066f725ea0068', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c98b372a89354d86b885064d856f686d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:26.025779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bd7f-dc50-4cdf-9e4a-f2b410fc8b2f tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:26.026063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bd7f-dc50-4cdf-9e4a-f2b410fc8b2f tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:26.026687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5bd7f-dc50-4cdf-9e4a-f2b410fc8b2f tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:26.031146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0ca5bd7f-dc50-4cdf-9e4a-f2b410fc8b2f tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-0ca5bd7f-dc50-4cdf-9e4a-f2b410fc8b2f tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Jul 19 11:45:26.053183 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application self.check_revocation(token) Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Jul 19 11:45:26.054450 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Jul 19 11:45:26.055592 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:45:26.055592 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:45:26.055592 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Jul 19 11:45:26.055592 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Jul 19 11:45:26.055592 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Jul 19 11:45:26.055592 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:45:26.058904 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4066/8130] 10.222.0.15 () {56 vars in 1262 bytes} [Tue Jul 19 11:45:25 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 90 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:45:26.063883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:26.216239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084d37f-98cc-4455-bb60-481761ef27ce tempest-TokensV3Test-683601772 tempest-TokensV3Test-683601772-project] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:26.230800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:26.233844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:26.235340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:26.236110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] PATH_INFO: `/v3/users/1f1def0a933843988de066f725ea0068` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:26.238154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1def0a933843988de066f725ea0068)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:26.253315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:26.417714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1def0a933843988de066f725ea0068'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:26.420189 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:26.459997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1def0a933843988de066f725ea0068'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:26.521902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1def0a933843988de066f725ea0068'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:26.523117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1def0a933843988de066f725ea0068'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:26.575494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1def0a933843988de066f725ea0068'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:26.594877 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4065/8131] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:26 2022] DELETE /identity/v3/users/1f1def0a933843988de066f725ea0068 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:26.600475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0524b59-3a16-4344-b049-0b498beb2487 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:26.605908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0524b59-3a16-4344-b049-0b498beb2487 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:26.607808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0524b59-3a16-4344-b049-0b498beb2487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:26.659656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f0524b59-3a16-4344-b049-0b498beb2487 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:26.665549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0524b59-3a16-4344-b049-0b498beb2487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:26.809905 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4067/8132] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:26.829862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:26.843500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:26.948057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41368f-6f9c-4966-b95b-73a3f5f6c7ce None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:26.950367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41368f-6f9c-4966-b95b-73a3f5f6c7ce None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:26.950902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af41368f-6f9c-4966-b95b-73a3f5f6c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:26.982933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-af41368f-6f9c-4966-b95b-73a3f5f6c7ce None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:26.988792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-af41368f-6f9c-4966-b95b-73a3f5f6c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:27.026374 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:27.105472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538cbf54-6b48-423c-a289-6ff109631a12 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:27.111390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:27.111918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:27.112208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:27.117481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:27.176100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:27.184011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:27.208251 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4066/8133] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:27.224367 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4068/8134] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:45:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:27.246315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:27.250594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:27.433202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4fe26a-4be4-43fb-ad95-f48fe8a604f0 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:27.452397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:27.455658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:27.456506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:27.457136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:27.494322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:27.497325 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:27.521180 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4067/8135] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:45:27.871252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:27.871541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:27.874523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:27.941655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:27.943315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:27.962028 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4069/8136] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:45:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:27.978402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:27.994704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178218fe-2500-4037-b23c-52507ab0f067 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:28.010443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62780f0-8fac-4434-9177-a9b72e24c675 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:28.015551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62780f0-8fac-4434-9177-a9b72e24c675 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.016047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62780f0-8fac-4434-9177-a9b72e24c675 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.016525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62780f0-8fac-4434-9177-a9b72e24c675 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.028243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62780f0-8fac-4434-9177-a9b72e24c675 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:28.030175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62780f0-8fac-4434-9177-a9b72e24c675 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:28.096635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4068/8137] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:45:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:45:28.248028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:28.255344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:28.310619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d83b41-7e8f-4df7-8d2c-9fe6dd101173 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:28.328843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:28.331392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.331778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.332160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] PATH_INFO: `/v3/projects/c98b372a89354d86b885064d856f686d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.336379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c98b372a89354d86b885064d856f686d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:28.347686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:28.474082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c98b372a89354d86b885064d856f686d', 'request_id': 'req-b412db82-429a-4e67-8bd0-4a464da80e0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:28.488746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c98b372a89354d86b885064d856f686d', 'request_id': 'req-b412db82-429a-4e67-8bd0-4a464da80e0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:28.500888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c98b372a89354d86b885064d856f686d', 'request_id': 'req-b412db82-429a-4e67-8bd0-4a464da80e0e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:28.552556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] The token cache is being invalidate because project c98b372a89354d86b885064d856f686d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:28.553230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:28.554550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b412db82-429a-4e67-8bd0-4a464da80e0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:28.559222 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4070/8138] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:28 2022] DELETE /identity/v3/projects/c98b372a89354d86b885064d856f686d => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:28.564135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.564948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.565444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.601247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:28.603144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:28.696475 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:28.738831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad5ec-099b-4c0b-b1dc-7e64f910055b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.740180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad5ec-099b-4c0b-b1dc-7e64f910055b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.740583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ad5ec-099b-4c0b-b1dc-7e64f910055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.744975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4069/8139] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:28.768338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-972ad5ec-099b-4c0b-b1dc-7e64f910055b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:28.769930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-972ad5ec-099b-4c0b-b1dc-7e64f910055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:28.790336 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4071/8140] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:28.794825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:28.820050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df4de84-09ff-42e7-9120-ac3f20b5945e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:28.829009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.829303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.829580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.843126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:28.846441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.846962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.847428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.848381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:28.850709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:28.859363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:28.873102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:28.875938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:28.890244 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4070/8141] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:28.897832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:28.911517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb629d0-415f-45dd-9e81-3045573c038d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:28.920525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:28.921434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:28.921817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:28.922224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:28.923291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:28.926995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:28.977390 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4071/8142] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:28 2022] POST /identity/v3/projects => generated 393 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:28.982294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.021567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4072/8143] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:45:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:29.023146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.024989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:29.101576 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:29.159134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e4ab5-3180-4dfe-9404-c32ea37b6ed4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.176993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.176993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.176993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.179477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.180730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.183211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e6ab4-7c82-4f35-8c54-4e17cb62fa8d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.186567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.246181 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4072/8144] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:28 2022] POST /identity/v3/users => generated 303 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:29.255056 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.273980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32fbde4-167b-4798-ad7b-c119ff62a66b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.288098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.289703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.293213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.293213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.294371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.299962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.331725 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4073/8145] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:29.334909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.372428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.373327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.373680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.373855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.381702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f039fb1-6cfc-4b80-a2bf-4e5010832570 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.421919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.428134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.428820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.429554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] PATH_INFO: `/v3/projects/5efddbf1075f4e3db497f38f4c6d847e/users/37826aa4f7ff43a8ba43bf65b013e125/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.477787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efddbf1075f4e3db497f38f4c6d847e, user_id=37826aa4f7ff43a8ba43bf65b013e125, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.481694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.513729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.515085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4074/8146] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:29 2022] PUT /identity/v3/projects/5efddbf1075f4e3db497f38f4c6d847e/users/37826aa4f7ff43a8ba43bf65b013e125/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:29.515581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.519151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.535092 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4073/8147] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:45:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:45:29.699120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b0bf0-51f6-4902-8b28-7e3827134507 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.713208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf0f8b-7998-4669-a42b-f4f88f716153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.713924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0f8b-7998-4669-a42b-f4f88f716153 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.714390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0f8b-7998-4669-a42b-f4f88f716153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.714704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf0f8b-7998-4669-a42b-f4f88f716153 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.715419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0f8b-7998-4669-a42b-f4f88f716153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.717179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf0f8b-7998-4669-a42b-f4f88f716153 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.723629 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:29.742324 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4075/8148] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:29.743190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:29.764117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670727da-d960-482c-9d02-d4eb07a5ffee service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:29.775898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:29.776900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.777293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.777456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] PATH_INFO: `/v3/projects/5efddbf1075f4e3db497f38f4c6d847e/users/37826aa4f7ff43a8ba43bf65b013e125/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.781300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efddbf1075f4e3db497f38f4c6d847e, user_id=37826aa4f7ff43a8ba43bf65b013e125, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:29.784023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:29.816146 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4074/8149] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:29 2022] PUT /identity/v3/projects/5efddbf1075f4e3db497f38f4c6d847e/users/37826aa4f7ff43a8ba43bf65b013e125/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:29.939589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:29.940532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:29.940979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:29.974449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] MFA Rules not processed for user `37826aa4f7ff43a8ba43bf65b013e125`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:29.976488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:30.157162 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4076/8150] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:30.161431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.260669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14bc1d8-9766-497d-ace5-bbc352ef9b80 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.295591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.296663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.297691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.300889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.314864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.327481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.348578 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:30.371698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.372288 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4075/8151] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:30 2022] POST /identity/v3/projects => generated 393 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:30.389464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f490ee59-f261-49d6-a78f-5fd1ab8030eb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.534397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.535113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.535400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.535680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.536594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.538653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.605701 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4077/8152] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:30 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:30.609990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.625533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36088bf1-7eae-46f0-b45e-f9f407d4ad27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.645964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.649276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.650658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.651273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.653452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.658542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.684945 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4076/8153] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:45:30.688775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.709155 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb753f-ab4c-4c2a-81cc-03e2247dbb24 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.719949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaee96-c9d9-45a1-8c9d-06d53ed27378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.720725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaee96-c9d9-45a1-8c9d-06d53ed27378 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.721016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaee96-c9d9-45a1-8c9d-06d53ed27378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.721319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaee96-c9d9-45a1-8c9d-06d53ed27378 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.722108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaee96-c9d9-45a1-8c9d-06d53ed27378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.723928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdaee96-c9d9-45a1-8c9d-06d53ed27378 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.763824 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4078/8154] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:30.768693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:30.783644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53695e1e-96fb-43d4-b1f9-0256a92af535 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:30.791841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:30.792991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.793607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.794072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] PATH_INFO: `/v3/projects/3769baf0485442a9ab308ba824193277/users/5221b06b8310493e91cf70f027feda92/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.839854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3769baf0485442a9ab308ba824193277, user_id=5221b06b8310493e91cf70f027feda92, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:30.842643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:30.872995 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4077/8155] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:30 2022] PUT /identity/v3/projects/3769baf0485442a9ab308ba824193277/users/5221b06b8310493e91cf70f027feda92/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:30.874105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:30.874497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:30.874885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:30.912152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] MFA Rules not processed for user `5221b06b8310493e91cf70f027feda92`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:30.913795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:31.030699 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:31.056474 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4079/8156] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:31.065599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:31.067711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:31.171222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6aa424-3ade-4268-ba0a-93565ed679d5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:31.175166 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63bc073-0ef1-418c-8b49-93a43f66aa22 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:31.175848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc073-0ef1-418c-8b49-93a43f66aa22 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:31.176137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc073-0ef1-418c-8b49-93a43f66aa22 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:31.176466 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63bc073-0ef1-418c-8b49-93a43f66aa22 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:31.259659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc073-0ef1-418c-8b49-93a43f66aa22 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:31.261237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63bc073-0ef1-418c-8b49-93a43f66aa22 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:31.276963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4078/8157] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:32.227933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:32.335556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263e9f1e-72c5-4019-b1de-efe653b51d06 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:32.340880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:32.342021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:32.342406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:32.342815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] PATH_INFO: `/v3/users/37826aa4f7ff43a8ba43bf65b013e125` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:32.345154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37826aa4f7ff43a8ba43bf65b013e125)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:32.347585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:32.417160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37826aa4f7ff43a8ba43bf65b013e125'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:32.429923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37826aa4f7ff43a8ba43bf65b013e125'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:32.449014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37826aa4f7ff43a8ba43bf65b013e125'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:32.450105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37826aa4f7ff43a8ba43bf65b013e125'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:32.474015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37826aa4f7ff43a8ba43bf65b013e125'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:32.492398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4080/8158] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:32 2022] DELETE /identity/v3/users/37826aa4f7ff43a8ba43bf65b013e125 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:32.495315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:32.495809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:32.495931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:32.549540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:32.550774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:32.634159 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:32.650389 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4079/8159] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:32.658668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:32.660234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:32.778200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c2a2-5a86-4262-a1a4-c297998ed4c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:32.789357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:32.790138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:32.790494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:32.790841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:32.812848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:32.818889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:32.848289 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4081/8160] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:33.436687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:33.439539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:33.461785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb721a7-186d-4eac-b4c5-c9aaff7b7796 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:33.477221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:33.478178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:33.478462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:33.478948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] PATH_INFO: `/v3/projects/5efddbf1075f4e3db497f38f4c6d847e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:33.483921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efddbf1075f4e3db497f38f4c6d847e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:33.487075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:33.565407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:33.566883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:33.606906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a833b8d7-3429-4097-824a-be4bfb55cb6a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:33.629182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efddbf1075f4e3db497f38f4c6d847e', 'request_id': 'req-5d0a0010-e36f-4292-85c4-2a1698a5b16a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.642744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efddbf1075f4e3db497f38f4c6d847e', 'request_id': 'req-5d0a0010-e36f-4292-85c4-2a1698a5b16a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.652605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efddbf1075f4e3db497f38f4c6d847e', 'request_id': 'req-5d0a0010-e36f-4292-85c4-2a1698a5b16a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.656901 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:33.677649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] The token cache is being invalidate because project 5efddbf1075f4e3db497f38f4c6d847e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:33.678080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.680619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.684333 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4080/8161] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:33 2022] DELETE /identity/v3/projects/5efddbf1075f4e3db497f38f4c6d847e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:33.688678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:33.692593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:33.738673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:33.739989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:33.740460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:33.740892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] PATH_INFO: `/v3/users/40a1a27186484277be3d5d9a8f899d5c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:33.742539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a1a27186484277be3d5d9a8f899d5c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:33.744893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:33.782386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0a0010-e36f-4292-85c4-2a1698a5b16a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:33.788589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:33.790026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:33.790485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:33.790947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] PATH_INFO: `/v3/users/5221b06b8310493e91cf70f027feda92` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:33.792588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5221b06b8310493e91cf70f027feda92)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:33.794745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:33.819952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a1a27186484277be3d5d9a8f899d5c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.831007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a1a27186484277be3d5d9a8f899d5c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.849358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a1a27186484277be3d5d9a8f899d5c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.850974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a1a27186484277be3d5d9a8f899d5c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.860689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67e68b2b-ab6e-4a4a-b2be-2d130f4d5be6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a1a27186484277be3d5d9a8f899d5c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.871891 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4082/8162] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:33 2022] DELETE /identity/v3/users/40a1a27186484277be3d5d9a8f899d5c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:33.873714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:33.874374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:33.874976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:33.880889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5221b06b8310493e91cf70f027feda92'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.882586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5221b06b8310493e91cf70f027feda92'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.898009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:33.899415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:33.902497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5221b06b8310493e91cf70f027feda92'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.904337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5221b06b8310493e91cf70f027feda92'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.925566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5221b06b8310493e91cf70f027feda92'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:33.970012 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4081/8163] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:33 2022] DELETE /identity/v3/users/5221b06b8310493e91cf70f027feda92 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:33.993140 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4083/8164] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:34.000895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:34.002726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:34.008938 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:34.085668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8817cb-6fce-440c-ae9d-5dd824be2229 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:34.091512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:34.091800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:34.091897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:34.092130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:34.201011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:34.202604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:34.214833 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4082/8165] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:34.588313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:34.591274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:34.640526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae042627-c1c0-46c1-a7d4-d12add6af592 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:34.665071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:34.666332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:34.666606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:34.666875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] PATH_INFO: `/v3/projects/3769baf0485442a9ab308ba824193277` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:34.669521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3769baf0485442a9ab308ba824193277)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:34.671564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:34.737395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:34.739812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:34.759510 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:34.763131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf90e3d-ea90-4497-90a0-5ed68165367a service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:34.793026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3769baf0485442a9ab308ba824193277', 'request_id': 'req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:34.809457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3769baf0485442a9ab308ba824193277', 'request_id': 'req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:34.825661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3769baf0485442a9ab308ba824193277', 'request_id': 'req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:34.853037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] The token cache is being invalidate because project 3769baf0485442a9ab308ba824193277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:34.853420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:34.854235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-2c0cfa5b-c80e-4621-8d05-41d8d8861f31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:34.859609 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4084/8166] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:34 2022] DELETE /identity/v3/projects/3769baf0485442a9ab308ba824193277 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:34.863644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309103b-8e71-4d05-ad38-a40928ef42bb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:34.863950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309103b-8e71-4d05-ad38-a40928ef42bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:34.864231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309103b-8e71-4d05-ad38-a40928ef42bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:34.900035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:34.904924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:34.905180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:34.905375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] PATH_INFO: `/v3/users/209429f600ed4541b4f53ff85a4c4f0c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:34.911821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=209429f600ed4541b4f53ff85a4c4f0c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:34.916414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:34.919572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5309103b-8e71-4d05-ad38-a40928ef42bb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:34.920917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5309103b-8e71-4d05-ad38-a40928ef42bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:34.952869 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4085/8167] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:34.962716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:34.963166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:34.963550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.021672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:35.028894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.034745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '209429f600ed4541b4f53ff85a4c4f0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.036003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '209429f600ed4541b4f53ff85a4c4f0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.052782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '209429f600ed4541b4f53ff85a4c4f0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.054024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '209429f600ed4541b4f53ff85a4c4f0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.064380 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:35.069627 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4086/8168] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:35.070401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '209429f600ed4541b4f53ff85a4c4f0c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.071107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.099104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7142729-2536-4e3f-a647-ae7648b68253 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.113725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.120081 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4083/8169] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:34 2022] DELETE /identity/v3/users/209429f600ed4541b4f53ff85a4c4f0c => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:35.120081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.125608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.128092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.128938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.129532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.130695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:35.131356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.134809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a63390f-b2a0-4eb3-8e11-136289ce766a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.173815 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4087/8170] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:35.176030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.176465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.176878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.208106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:35.210360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.310865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59801e03-8cfc-4131-a3ab-01dc4a676f64 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.326494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.327777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.328323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.329500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] PATH_INFO: `/v3/projects/a19c8f6c3d3d498fb6b600b7c6b41b89` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.331386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a19c8f6c3d3d498fb6b600b7c6b41b89)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.333775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.335940 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4088/8171] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:35.336849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.347990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03950317-cd1c-4b2e-a560-e1838d79cd50 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.354664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.355600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.355949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.356294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.357252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.359365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.413555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a19c8f6c3d3d498fb6b600b7c6b41b89', 'request_id': 'req-55de6167-4994-4bc2-8bef-f6abd8bfaed3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.416405 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4089/8172] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/projects => generated 379 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:35.418279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.420594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.423342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a19c8f6c3d3d498fb6b600b7c6b41b89', 'request_id': 'req-55de6167-4994-4bc2-8bef-f6abd8bfaed3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.432664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a19c8f6c3d3d498fb6b600b7c6b41b89', 'request_id': 'req-55de6167-4994-4bc2-8bef-f6abd8bfaed3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.456503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] The token cache is being invalidate because project a19c8f6c3d3d498fb6b600b7c6b41b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:35.457136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.458891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:35.462448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4084/8173] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:35 2022] DELETE /identity/v3/projects/a19c8f6c3d3d498fb6b600b7c6b41b89 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:35.463611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.465805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.518769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce28535-659d-4dfe-918f-64c8b68170c8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.520930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.521623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.521902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.522179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.524210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.555580 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:35.579185 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de6167-4994-4bc2-8bef-f6abd8bfaed3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.585797 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:35.615160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.619140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4b097-7d10-49d3-afef-4cd8a7dd01de service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.634242 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4090/8174] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:35.642413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9cb2-9a8f-499f-941c-61e2d239c7c8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.642720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9cb2-9a8f-499f-941c-61e2d239c7c8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.643636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb9cb2-9a8f-499f-941c-61e2d239c7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.666837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f7fb9cb2-9a8f-499f-941c-61e2d239c7c8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:35.668139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f7fb9cb2-9a8f-499f-941c-61e2d239c7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.674028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.675063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.675546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.676035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.676984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.679847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.684519 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4091/8175] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:35.686372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.686664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.686938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.708889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:35.710509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:35.720938 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4092/8176] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:35.729412 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4085/8177] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/users => generated 290 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:35.730111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.733449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.749529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3309caa0-4fc9-4eec-bd16-8569932c5ccd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.754468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e7df21-c271-48b1-b475-5929b7b7a921 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.763866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.764609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.764894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.765165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.766320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.767283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.767572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.767847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.768657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.770911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:35.771282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.772980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.775346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.797150 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4086/8178] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:35.805406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.817401 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4093/8179] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:35.824543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.842038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8538a641-de8a-4e18-ab07-9697b1840109 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.855428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4edb7-1e8e-4c3c-8b38-5f35aa1e4d96 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.862516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.863859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.865338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.866592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.869033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.872963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.877288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.878610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.881362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.882112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.883611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:35.888013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:35.917466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4087/8180] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:35 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:35.919446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:35.945859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad086b84-93c4-4232-8625-00e9ce2e91a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:35.958380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:35.960201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:35.960201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:35.960201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] PATH_INFO: `/v3/projects/e08a57d70e2842b5b96814c564a17391/users/98d0d95926554afe955aded1e00ce5f5/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:35.980170 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4094/8181] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:35.984744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.004399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08a57d70e2842b5b96814c564a17391, user_id=98d0d95926554afe955aded1e00ce5f5, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.008503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.056405 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4088/8182] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:35 2022] PUT /identity/v3/projects/e08a57d70e2842b5b96814c564a17391/users/98d0d95926554afe955aded1e00ce5f5/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:36.057607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.060096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.088837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd29f8c2-26af-40bb-8390-8200b68b11a0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.189119 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5230998-3bdd-48ed-a0c6-49126eca458b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.194471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.195483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.195769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.196907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] PATH_INFO: `/v3/projects/ff4a4be1a81f4103a618a534bea51c9b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.198596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff4a4be1a81f4103a618a534bea51c9b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.200687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.202910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964717e-126a-4158-9996-5f016282300c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.204100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964717e-126a-4158-9996-5f016282300c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.209244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964717e-126a-4158-9996-5f016282300c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.209777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964717e-126a-4158-9996-5f016282300c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.210812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964717e-126a-4158-9996-5f016282300c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.216165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964717e-126a-4158-9996-5f016282300c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.264456 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4095/8183] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:35 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:45:36.264456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35cfdf-0a1c-470b-a2f9-a43aaf34c1e9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.264456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35cfdf-0a1c-470b-a2f9-a43aaf34c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.264456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35cfdf-0a1c-470b-a2f9-a43aaf34c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.279768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff4a4be1a81f4103a618a534bea51c9b', 'request_id': 'req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:36.287894 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:36.301151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff4a4be1a81f4103a618a534bea51c9b', 'request_id': 'req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:36.302842 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:36.313769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4c35cfdf-0a1c-470b-a2f9-a43aaf34c1e9 None None] MFA Rules not processed for user `98d0d95926554afe955aded1e00ce5f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:36.316515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4c35cfdf-0a1c-470b-a2f9-a43aaf34c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.316727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff4a4be1a81f4103a618a534bea51c9b', 'request_id': 'req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:36.350754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] The token cache is being invalidate because project ff4a4be1a81f4103a618a534bea51c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:36.351664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:36.354337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:36.359208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4089/8184] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:36 2022] DELETE /identity/v3/projects/ff4a4be1a81f4103a618a534bea51c9b => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:36.362913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.367101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.485601 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4096/8185] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:36.494797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.495796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.496516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.519655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:36.521113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.532218 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4097/8186] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:36.533296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.534937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.546255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7e323-1f07-4f9e-ad89-8e1390c601c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.560509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.561236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.561608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.561985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.562836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.568385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.596743 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4090/8187] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:36.600558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.632981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd0ebb8-84b4-498d-a9fd-5670ebd17e25 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.646340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf8710-758c-4610-beaa-666b3482a04a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.650197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76909853-d4f5-4d0e-8373-224a8f112709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.651995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909853-d4f5-4d0e-8373-224a8f112709 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.652956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909853-d4f5-4d0e-8373-224a8f112709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.653940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909853-d4f5-4d0e-8373-224a8f112709 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.657072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909853-d4f5-4d0e-8373-224a8f112709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.661291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909853-d4f5-4d0e-8373-224a8f112709 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.662921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.663797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.664140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.667605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.679505 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4091/8188] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:36.682090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.683419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.683916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.689156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.690780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.711242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:36.713136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.719004 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4098/8189] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:36 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:36.719921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.741793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69ff4bb-2c08-4ab8-a49f-e1dc4f017eee service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.744928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4092/8190] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:36.748876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.751662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f8cd2-4a2d-42c6-b8fd-aa62a39f4f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.752917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f8cd2-4a2d-42c6-b8fd-aa62a39f4f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.753310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f8cd2-4a2d-42c6-b8fd-aa62a39f4f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.753661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f8cd2-4a2d-42c6-b8fd-aa62a39f4f3e admin admin] PATH_INFO: `/v3/projects/c96ba35fbf4e4a54bd15c1c138c21add/users/e39a2885414745d689e1a0f2b8d9b7a4/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.786126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3654293-8cf2-4124-ab5b-620f4c4b04b8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.803786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f8cd2-4a2d-42c6-b8fd-aa62a39f4f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c96ba35fbf4e4a54bd15c1c138c21add, user_id=e39a2885414745d689e1a0f2b8d9b7a4, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.806481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.807876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.808718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.808958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.810118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:36.810516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.812428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.813539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064f8cd2-4a2d-42c6-b8fd-aa62a39f4f3e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:36.832191 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4093/8191] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:36.840665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:36.850032 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4099/8192] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:36 2022] PUT /identity/v3/projects/c96ba35fbf4e4a54bd15c1c138c21add/users/e39a2885414745d689e1a0f2b8d9b7a4/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:36.863122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.863505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.863698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.865221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb2528a-f643-41e8-94a8-dc1427a5e03c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:36.914538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] MFA Rules not processed for user `e39a2885414745d689e1a0f2b8d9b7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:36.920801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:36.957702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:36.958839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:36.959189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:36.959578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:36.960553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:36.963781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.020447 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:37.045015 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4100/8193] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:37.055788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.057912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:37.101258 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4094/8194] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:36 2022] POST /identity/v3/projects => generated 383 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:37.102629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.169345 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:37.195550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90844d00-c1c3-45ab-af21-840f175803b3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:37.230922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89a1909-b650-4315-8f5f-84f2e1872097 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:37.240426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:37.242215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.242956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.243949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.245872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:37.249802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.281476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:37.282236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.283129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.283129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.325828 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4095/8195] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:37 2022] POST /identity/v3/users => generated 292 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:37.326983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.329589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:37.368133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a91c0e-36c2-4492-8ed9-03a8eb38dccf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:37.382582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:37.383525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.383810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.384570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] PATH_INFO: `/v3/users/98d0d95926554afe955aded1e00ce5f5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.389696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d0d95926554afe955aded1e00ce5f5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:37.392303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.438857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:37.441973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.474504 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4101/8196] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:37.478281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.515900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739aaf7-637d-40e4-b7e2-df5ddfdf29cf service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:37.519556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d0d95926554afe955aded1e00ce5f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:37.521092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d0d95926554afe955aded1e00ce5f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:37.528938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:37.529654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.529953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.530236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.531051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:37.533795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.535613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d0d95926554afe955aded1e00ce5f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:37.538055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d0d95926554afe955aded1e00ce5f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:37.553749 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4102/8197] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:37.561665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-92b1db02-33ab-496e-96fa-a7f422f67d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d0d95926554afe955aded1e00ce5f5'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:37.571856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.578582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:37.593590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42bdcb7-3e21-44f0-b934-78b6c9f0d6d4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:37.600957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:37.601820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.602170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.603174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.603332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:37.605187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.618648 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4103/8198] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:37 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:37.623055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.635673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89ba7-9910-4024-8e2b-f3c936f0c1ee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:37.641063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6e7184-1c9f-4aac-9681-439abf16d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:37.642397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e7184-1c9f-4aac-9681-439abf16d8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.642693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e7184-1c9f-4aac-9681-439abf16d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.643090 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6e7184-1c9f-4aac-9681-439abf16d8f4 admin admin] PATH_INFO: `/v3/projects/19222bc9dc0b42d896fdb963f625e722/users/22e26c46a62a417aacfbafb054eb8752/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.647694 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4096/8199] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:37 2022] DELETE /identity/v3/users/98d0d95926554afe955aded1e00ce5f5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:37.653798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.654122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.654716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.665288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e7184-1c9f-4aac-9681-439abf16d8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19222bc9dc0b42d896fdb963f625e722, user_id=22e26c46a62a417aacfbafb054eb8752, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:37.672456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6e7184-1c9f-4aac-9681-439abf16d8f4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:37.690401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:37.692949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:37.704904 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4104/8200] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:37 2022] PUT /identity/v3/projects/19222bc9dc0b42d896fdb963f625e722/users/22e26c46a62a417aacfbafb054eb8752/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:37.718657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:37.721937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:37.725338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:37.757272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:37.759798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:37.790734 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:37.913526 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4097/8201] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:37.914598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.916461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:37.937458 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4105/8202] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:37.954138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:37.956299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:38.027135 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:38.074952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f88213d-f742-409d-89af-1862b1c6fdb6 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:38.080076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:38.080907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:38.081269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:38.081718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:38.100969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:38.102608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:38.146716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e87775-95d2-43ae-987a-f3c6cc96bbbf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:38.160278 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4098/8203] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:38.179793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b931b-9412-4013-b140-51f10c7ff813 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:38.180861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b931b-9412-4013-b140-51f10c7ff813 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:38.181479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b931b-9412-4013-b140-51f10c7ff813 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:38.181790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b931b-9412-4013-b140-51f10c7ff813 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:38.229219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b931b-9412-4013-b140-51f10c7ff813 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:38.236470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3b931b-9412-4013-b140-51f10c7ff813 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:38.269530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4106/8204] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:38.797831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:38.799655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:38.846224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957aeb3d-ae86-4ec8-b583-deb912557f7b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:38.861385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:38.862312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:38.862874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:38.863232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] PATH_INFO: `/v3/projects/e08a57d70e2842b5b96814c564a17391` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:38.864900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08a57d70e2842b5b96814c564a17391)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:38.867222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:38.997026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08a57d70e2842b5b96814c564a17391', 'request_id': 'req-8d835180-7575-407a-88b7-39ea86962682'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:39.005835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08a57d70e2842b5b96814c564a17391', 'request_id': 'req-8d835180-7575-407a-88b7-39ea86962682'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:39.014896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08a57d70e2842b5b96814c564a17391', 'request_id': 'req-8d835180-7575-407a-88b7-39ea86962682'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:39.045995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] The token cache is being invalidate because project e08a57d70e2842b5b96814c564a17391 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:39.046117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:39.046967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8d835180-7575-407a-88b7-39ea86962682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:39.050538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4099/8205] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:38 2022] DELETE /identity/v3/projects/e08a57d70e2842b5b96814c564a17391 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:39.057981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.059202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.062226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.104106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:39.107076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:39.361010 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4107/8206] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:39.368711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.369779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.370260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.416654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:39.416654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:39.446312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4100/8207] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:39.448290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:39.469355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc215f72-ab00-4a54-9f1b-bf47918df1f1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:39.489071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:39.490564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.491323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.491837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.492888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:39.493626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:39.497917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:39.536847 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4108/8208] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:45:39.542178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:39.557895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17688797-16fd-4e77-84bc-1a679290e91f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:39.561041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04063007-625d-4025-94a1-a44d6a0836d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:39.568829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063007-625d-4025-94a1-a44d6a0836d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.569672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063007-625d-4025-94a1-a44d6a0836d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.569672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04063007-625d-4025-94a1-a44d6a0836d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.570177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063007-625d-4025-94a1-a44d6a0836d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:39.573049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04063007-625d-4025-94a1-a44d6a0836d9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:39.615172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4101/8209] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:39 2022] POST /identity/v3/projects => generated 391 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:39.619607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:39.634409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7190bd-0304-4488-b44a-2d39e3c31bf1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:39.762753 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:39.805564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:39.807071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.807677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.808383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.809937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:39.818148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:39.843695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.843981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.844528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.867508 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4109/8210] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:39 2022] POST /identity/v3/users => generated 296 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:39.868794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:39.889723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ac68d-473a-4bcb-b7f8-509139cb7a77 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:39.904856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:39.905743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.906095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.906435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.907261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:39.909045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:39.914478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] MFA Rules not processed for user `22e26c46a62a417aacfbafb054eb8752`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:39.919282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:39.939623 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4110/8211] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:39.941647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:39.954047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ffe87-0568-44a5-88a3-f569b57a3892 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:39.969437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:39.970253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:39.971132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:39.971132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:39.972834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:39.974617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:39.992397 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4111/8212] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:39.994962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:40.015087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca2b8-1851-430b-ae7f-41ea307f4ac8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:40.027417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704ecdd6-a564-44ac-9370-4716c82b9b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:40.028447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ecdd6-a564-44ac-9370-4716c82b9b6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:40.028690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ecdd6-a564-44ac-9370-4716c82b9b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:40.028971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ecdd6-a564-44ac-9370-4716c82b9b6f admin admin] PATH_INFO: `/v3/projects/fc32044a64c540cbafe77062752a6b34/users/ffafe496f4d64579ba54c5e20e16572b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:40.064570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ecdd6-a564-44ac-9370-4716c82b9b6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc32044a64c540cbafe77062752a6b34, user_id=ffafe496f4d64579ba54c5e20e16572b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:40.084268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704ecdd6-a564-44ac-9370-4716c82b9b6f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:40.095270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4102/8213] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:40.120044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:40.122428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:40.130906 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4112/8214] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:39 2022] PUT /identity/v3/projects/fc32044a64c540cbafe77062752a6b34/users/ffafe496f4d64579ba54c5e20e16572b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:40.143221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:40.143555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:40.143789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:40.178392 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:40.200190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] MFA Rules not processed for user `ffafe496f4d64579ba54c5e20e16572b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:40.201538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:40.244562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b601e-4eb5-46cf-adb5-e74e7fef1ef8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:40.339334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:40.340480 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4113/8215] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:40.341083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:40.341378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:40.341710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:40.345091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:40.468793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:40.470385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:40.502676 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4103/8216] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:45:40.546710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c028b0-4a37-4ab1-ae65-9c8eb611f15e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:40.557775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:40.558612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:40.558999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:40.559376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:40.560206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:40.565451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:40.628406 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4114/8217] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:40 2022] POST /identity/v3/projects => generated 391 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:45:40.632897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:40.654459 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb6959-d1bf-41e9-96e7-f42f1e262d0b service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:40.815437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:40.820856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:40.821512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:40.824507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:40.831367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:40.837091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:40.900039 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4104/8218] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:40 2022] POST /identity/v3/users => generated 302 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:40.904295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:40.924490 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:40.938331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fd0db-c4dd-4f21-89df-e3a2a81dcffe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:40.951384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:40.952915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:40.953740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:40.954183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:40.955842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:40.960003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:40.994011 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4115/8219] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:40 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:40.999565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:41.033901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362f2f6-8caf-442b-94c6-7367b5207c99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:41.053040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:41.054057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:41.054343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:41.054622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] PATH_INFO: `/v3/projects/f37f6d66370b40d78e45e01d7721f243/users/8e461145c4b8400f8d661aacfbdc2809/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:41.096156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37f6d66370b40d78e45e01d7721f243, user_id=8e461145c4b8400f8d661aacfbdc2809, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:41.100995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:41.126651 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:41.134160 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4105/8220] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:40 2022] PUT /identity/v3/projects/f37f6d66370b40d78e45e01d7721f243/users/8e461145c4b8400f8d661aacfbdc2809/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:41.141272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:41.177569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5822f15-d084-4358-83f9-4b559485cec8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:41.348340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f0d323-b78e-4460-a032-b4e353df33cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:41.349285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d323-b78e-4460-a032-b4e353df33cc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:41.349683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d323-b78e-4460-a032-b4e353df33cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:41.350019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f0d323-b78e-4460-a032-b4e353df33cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:41.350961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0d323-b78e-4460-a032-b4e353df33cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:41.353152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f0d323-b78e-4460-a032-b4e353df33cc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:41.373434 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4116/8221] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:45:41 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:45:41.378079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:41.395353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291cd3a7-aca3-49bb-99bd-2f7f8b5f9efc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:41.405250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:41.407092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:41.407589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:41.408090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] PATH_INFO: `/v3/projects/f37f6d66370b40d78e45e01d7721f243/users/8e461145c4b8400f8d661aacfbdc2809/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:41.413859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f37f6d66370b40d78e45e01d7721f243, user_id=8e461145c4b8400f8d661aacfbdc2809, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:41.421699 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:41.447366 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4106/8222] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:45:41 2022] PUT /identity/v3/projects/f37f6d66370b40d78e45e01d7721f243/users/8e461145c4b8400f8d661aacfbdc2809/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:41.464842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:41.465343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:41.465822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:41.507258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] MFA Rules not processed for user `8e461145c4b8400f8d661aacfbdc2809`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:41.509068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:41.713050 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4117/8223] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:41.720205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:41.722483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:41.861156 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5052ae-c82a-4012-8bfd-8149e0d15800 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:41.872011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:41.872737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:41.873022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:41.873310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:41.987863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:41.989566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:42.004053 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4107/8224] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:41 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:48.495549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:48.497122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:48.521678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b661cda9-ec71-4b26-ae0f-8ee5729e802c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:48.527009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:48.527763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:48.531362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:48.539436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:48.567885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:48.571974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:48.616737 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4118/8225] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:51.998061 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=54,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:53.655902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:53.658363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:54.076739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5d039-4223-4190-82af-196fecaeede7 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:54.100451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:54.101310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:54.103814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:54.104523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:54.110866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:54.161703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:54.168625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:54.187735 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4108/8226] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:54.802057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:54.804188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:54.982596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:55.032427 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:55.152924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eac274-a093-4f0a-8a31-368271f085b8 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:55.154657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dc9ce3-113d-4ad7-aa9c-572a87c1fee6 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:55.162364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:55.163368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:55.169951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:55.170557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:55.171009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] PATH_INFO: `/v3/users/ffafe496f4d64579ba54c5e20e16572b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:55.171681 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:55.172156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:55.172623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ffafe496f4d64579ba54c5e20e16572b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:55.173423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] PATH_INFO: `/v3/users/e39a2885414745d689e1a0f2b8d9b7a4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:55.174796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:55.178270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39a2885414745d689e1a0f2b8d9b7a4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:55.185042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:55.293911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ffafe496f4d64579ba54c5e20e16572b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.294643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ffafe496f4d64579ba54c5e20e16572b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.318625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ffafe496f4d64579ba54c5e20e16572b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.319692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ffafe496f4d64579ba54c5e20e16572b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.408853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39a2885414745d689e1a0f2b8d9b7a4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.413637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c186c7f2-a8df-47b3-b091-195311cf4e18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ffafe496f4d64579ba54c5e20e16572b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.445734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39a2885414745d689e1a0f2b8d9b7a4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.447177 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:55.484929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4109/8227] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:54 2022] DELETE /identity/v3/users/ffafe496f4d64579ba54c5e20e16572b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:55.490921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:55.491484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:55.491926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:55.518726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39a2885414745d689e1a0f2b8d9b7a4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.521773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39a2885414745d689e1a0f2b8d9b7a4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.534366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:55.535947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:55.564934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0f547803-19f7-4ad2-8c52-c44ca8c73d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39a2885414745d689e1a0f2b8d9b7a4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:55.606342 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4119/8228] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:54 2022] DELETE /identity/v3/users/e39a2885414745d689e1a0f2b8d9b7a4 => generated 0 bytes in 804 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:55.612596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:55.614375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:55.615408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:55.678973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:55.689257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:55.846909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4110/8229] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:55.858881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:55.865817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:55.928569 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4120/8230] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:45:55.951845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:55.954280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:56.098369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e643b5-d42e-4c6e-8f31-2436c6ecc070 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:56.198648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c3341-6cd1-43bb-bf19-692704add75e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:56.207729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:56.209259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:56.211548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:56.211548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:56.247137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:56.276229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:56.336455 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4121/8231] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:56.404441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:56.405564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:56.406027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:56.406506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:56.459433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:56.463745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:56.531774 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4111/8232] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:45:58.237077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:58.238714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:58.278873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d9712-e12a-4d93-a15a-81fcfb97b40d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:58.298590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:58.299657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:58.300058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:58.300486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] PATH_INFO: `/v3/projects/fc32044a64c540cbafe77062752a6b34` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:58.303257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc32044a64c540cbafe77062752a6b34)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:58.309282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:58.375364 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:58.495231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:58.497939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:58.531656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c96885-cfa0-4fa4-a8a1-1fd5542f2781 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:58.571024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc32044a64c540cbafe77062752a6b34', 'request_id': 'req-f06e81be-6090-4765-a378-4f678234cac7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.589833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc32044a64c540cbafe77062752a6b34', 'request_id': 'req-f06e81be-6090-4765-a378-4f678234cac7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.602704 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc32044a64c540cbafe77062752a6b34', 'request_id': 'req-f06e81be-6090-4765-a378-4f678234cac7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.623857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] The token cache is being invalidate because project fc32044a64c540cbafe77062752a6b34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:58.623857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.630721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.638651 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4122/8233] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:58 2022] DELETE /identity/v3/projects/fc32044a64c540cbafe77062752a6b34 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:58.640631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:58.642321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:58.830941 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:58.847650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:58.848599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:58.848889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:58.849380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] PATH_INFO: `/v3/projects/c96ba35fbf4e4a54bd15c1c138c21add` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:58.850755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c96ba35fbf4e4a54bd15c1c138c21add)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:58.853801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:58.944311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06e81be-6090-4765-a378-4f678234cac7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:58.976531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c96ba35fbf4e4a54bd15c1c138c21add', 'request_id': 'req-aac7b393-dc08-439b-b10c-6a8f08f78050'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.990870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c96ba35fbf4e4a54bd15c1c138c21add', 'request_id': 'req-aac7b393-dc08-439b-b10c-6a8f08f78050'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:58.999436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c96ba35fbf4e4a54bd15c1c138c21add', 'request_id': 'req-aac7b393-dc08-439b-b10c-6a8f08f78050'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.026332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] The token cache is being invalidate because project c96ba35fbf4e4a54bd15c1c138c21add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:45:59.031142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.033255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aac7b393-dc08-439b-b10c-6a8f08f78050 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.039348 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4112/8234] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:45:58 2022] DELETE /identity/v3/projects/c96ba35fbf4e4a54bd15c1c138c21add => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:45:59.049715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d8d3f-1ffe-47a1-8b4c-dc260eb21834 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:59.051876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d8d3f-1ffe-47a1-8b4c-dc260eb21834 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:59.054435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d8d3f-1ffe-47a1-8b4c-dc260eb21834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:59.133750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-530d8d3f-1ffe-47a1-8b4c-dc260eb21834 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:59.137959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-530d8d3f-1ffe-47a1-8b4c-dc260eb21834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:59.171329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:59.172295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:59.172684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:59.172971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] PATH_INFO: `/v3/users/8e461145c4b8400f8d661aacfbdc2809` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:59.175774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e461145c4b8400f8d661aacfbdc2809)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:59.178897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:59.291815 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4113/8235] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:59.297907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:59.298957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:59.299602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:59.375259 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:59.392991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e461145c4b8400f8d661aacfbdc2809'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.404719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:45:59.408694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:59.433560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e461145c4b8400f8d661aacfbdc2809'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.437259 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4114/8236] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:45:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:45:59.438863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:59.461500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d85bc-850e-476d-a6d3-8939c25e0d8f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:59.472733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:59.474210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:59.474531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:59.476108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:59.476848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:45:59.478099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:59.484934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:59.487906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e461145c4b8400f8d661aacfbdc2809'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.490972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e461145c4b8400f8d661aacfbdc2809'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.517948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e461145c4b8400f8d661aacfbdc2809'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:45:59.535600 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4115/8237] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:45:59.544681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:59.545957 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4123/8238] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:45:58 2022] DELETE /identity/v3/users/8e461145c4b8400f8d661aacfbdc2809 => generated 0 bytes in 906 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:45:59.556426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:45:59.608105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e082913-8d54-46fc-b49e-136f33331da9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:45:59.735835 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:45:59.765294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:45:59.767953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:45:59.769275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:45:59.770012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:45:59.771665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:45:59.775834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:45:59.894863 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4116/8239] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:45:59 2022] POST /identity/v3/projects => generated 371 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:45:59.901368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:45:59.935270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c530678d-fd5d-4266-b268-97aa74793239 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:00.375807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:00.384826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:00.386783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:00.387727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:00.388764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:00.392649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:00.442402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4124/8240] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:45:59 2022] POST /identity/v3/users => generated 286 bytes in 542 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:00.449658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:00.576123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20dc33-7ae7-4e43-bee3-39f608c396a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:00.643096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:00.644529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:00.645144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:00.646198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:00.647678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:00.653428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:00.718030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:00.724188 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4117/8241] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:00.777598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96599dfe-00c6-4548-99fc-d534497aa6d1 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:00.824114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73aa34-e6e6-431e-b815-63e8fd68390b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:00.827964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73aa34-e6e6-431e-b815-63e8fd68390b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:00.828486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73aa34-e6e6-431e-b815-63e8fd68390b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:00.829002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73aa34-e6e6-431e-b815-63e8fd68390b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:00.831009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73aa34-e6e6-431e-b815-63e8fd68390b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:00.840620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73aa34-e6e6-431e-b815-63e8fd68390b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:00.939688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4125/8242] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:46:00.946175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:00.986391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199a1399-4ed0-42d8-99bf-22d08bf40ba0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:01.019416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:01.021116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:01.021662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:01.022101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] PATH_INFO: `/v3/projects/50fb0efb83624683b308b7a2306baa38/users/ce7c35f99ce1456cb462f49e36b1c78b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:01.065352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50fb0efb83624683b308b7a2306baa38, user_id=ce7c35f99ce1456cb462f49e36b1c78b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:01.068312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:01.127174 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4118/8243] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:00 2022] PUT /identity/v3/projects/50fb0efb83624683b308b7a2306baa38/users/ce7c35f99ce1456cb462f49e36b1c78b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:46:01.149365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:01.149929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:01.150413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:01.257501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:01.262153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:01.311779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] MFA Rules not processed for user `ce7c35f99ce1456cb462f49e36b1c78b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:01.313133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:01.562513 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4126/8244] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:01.578658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:01.621348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:01.750129 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:01.820115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1011b-ddcf-4f2d-b45c-f9ece13be5c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:01.866129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:01.868838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:01.869157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:01.869399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] PATH_INFO: `/v3/projects/f37f6d66370b40d78e45e01d7721f243` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:01.881925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f37f6d66370b40d78e45e01d7721f243)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:01.892332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:01.941080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fcc873-5f52-4ebd-ae05-403972643a32 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:01.994776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:01.998152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:01.998661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:01.999129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:02.090739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:02.093351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:02.123245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f37f6d66370b40d78e45e01d7721f243', 'request_id': 'req-1328da77-44b8-4b99-8736-8efb95b23976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.152985 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4127/8245] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:02.180449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f37f6d66370b40d78e45e01d7721f243', 'request_id': 'req-1328da77-44b8-4b99-8736-8efb95b23976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.205255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:02.232528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f37f6d66370b40d78e45e01d7721f243', 'request_id': 'req-1328da77-44b8-4b99-8736-8efb95b23976'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.256005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b140cc-c2d3-49c8-9eae-b7b5618934bb service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:02.284739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] The token cache is being invalidate because project f37f6d66370b40d78e45e01d7721f243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:46:02.286608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.298228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1328da77-44b8-4b99-8736-8efb95b23976 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.308753 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4119/8246] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:46:01 2022] DELETE /identity/v3/projects/f37f6d66370b40d78e45e01d7721f243 => generated 0 bytes in 1053 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:02.320547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caebbf6-1e46-497e-9129-0c0556135a79 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:02.321004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caebbf6-1e46-497e-9129-0c0556135a79 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:02.321497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caebbf6-1e46-497e-9129-0c0556135a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:02.403709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1caebbf6-1e46-497e-9129-0c0556135a79 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:02.405788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1caebbf6-1e46-497e-9129-0c0556135a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:02.495136 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:02.517241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:02.519146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:02.521215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:02.521894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] PATH_INFO: `/v3/users/ce7c35f99ce1456cb462f49e36b1c78b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:02.524288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7c35f99ce1456cb462f49e36b1c78b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:02.531285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:02.668384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7c35f99ce1456cb462f49e36b1c78b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.691142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7c35f99ce1456cb462f49e36b1c78b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.728456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7c35f99ce1456cb462f49e36b1c78b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.729692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7c35f99ce1456cb462f49e36b1c78b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.743756 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4120/8247] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:02.758297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f622dac4-619b-4d63-9ab5-b8030eae72f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7c35f99ce1456cb462f49e36b1c78b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:02.765265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:02.772047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:02.773207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:02.776300 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4128/8248] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:46:02 2022] DELETE /identity/v3/users/ce7c35f99ce1456cb462f49e36b1c78b => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:02.783256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:02.783705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:02.784073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:02.850201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:02.853183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:02.853912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:02.858157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:02.955375 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:03.118995 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4129/8249] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:03.129600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:03.134342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:03.156546 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4121/8250] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:46:03.158462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:03.178453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9184a9d-8436-4e4c-afef-7f30dfdacd91 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:03.196281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:03.202101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:03.202101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:03.202101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:03.223140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:46:03.223486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:03.228600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:03.266342 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4122/8251] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:46:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:46:03.267803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:03.294653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207a5f0-7ad1-47be-ad51-284c51e99903 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:03.331427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:03.332135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:03.332465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:03.332753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:03.333642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:03.339852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:03.342094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdf1db-92ee-4abe-b811-89e669cc9d97 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:03.360813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:03.370252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:03.370641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:03.370926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:03.399297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:03.403351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:03.442421 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4123/8252] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:46:03 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:03.448491 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4130/8253] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:03.448676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:03.734702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aa5ce7-f774-40fa-bd33-0dfb2d9c11a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:03.748193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:03.748854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:03.749145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:03.749410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:03.750128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:03.752131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:03.796405 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4124/8254] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:03 2022] POST /identity/v3/users => generated 286 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:46:03.807193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:03.822892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91212494-c808-4aed-aa82-d574b5203c68 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:03.840029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:03.842283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:03.842283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:03.842283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:03.842283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:03.843702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:03.883281 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4131/8255] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:03.892069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:03.947251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dbe1d0-4061-4d52-852a-5dfafcb035b4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:03.962383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349b5a2-8106-4e6a-9a50-5d4c49f24874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:03.963350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b5a2-8106-4e6a-9a50-5d4c49f24874 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:03.963636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b5a2-8106-4e6a-9a50-5d4c49f24874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:03.963915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349b5a2-8106-4e6a-9a50-5d4c49f24874 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:03.964964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349b5a2-8106-4e6a-9a50-5d4c49f24874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:03.969083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349b5a2-8106-4e6a-9a50-5d4c49f24874 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:04.003350 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4125/8256] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:03 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:04.007111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:04.026819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82116b-a6a5-4838-a456-de38983d98e8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:04.051438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:04.055167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.055823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.056277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] PATH_INFO: `/v3/projects/4d649c3c84d1415fbb18fdee0175ef34/users/05ca9fb2bf494cc28b593e20d5e27fe3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.087189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d649c3c84d1415fbb18fdee0175ef34, user_id=05ca9fb2bf494cc28b593e20d5e27fe3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:04.090565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:04.132399 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4132/8257] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:04 2022] PUT /identity/v3/projects/4d649c3c84d1415fbb18fdee0175ef34/users/05ca9fb2bf494cc28b593e20d5e27fe3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:04.134417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.134834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.135204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.147193 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:04.176440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] MFA Rules not processed for user `05ca9fb2bf494cc28b593e20d5e27fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:04.180641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.217052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:04.219138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.306448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4126/8258] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:04.322807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:04.427636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8587fc-3754-49c3-bcfe-bd7ccc9ea2e6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:04.433514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01442-a40d-4744-af16-78dd9e42944a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:04.437854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acfbefc-0be6-4c8e-8c8e-f7382ca6de42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:04.438664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbefc-0be6-4c8e-8c8e-f7382ca6de42 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.439048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:04.439211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbefc-0be6-4c8e-8c8e-f7382ca6de42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.439513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acfbefc-0be6-4c8e-8c8e-f7382ca6de42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.439951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.440236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.440547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] PATH_INFO: `/v3/projects/50fb0efb83624683b308b7a2306baa38` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.442725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50fb0efb83624683b308b7a2306baa38)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:04.446359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:04.459314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbefc-0be6-4c8e-8c8e-f7382ca6de42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:04.462153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acfbefc-0be6-4c8e-8c8e-f7382ca6de42 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:04.483671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4127/8259] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:04.508775 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:04.540913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50fb0efb83624683b308b7a2306baa38', 'request_id': 'req-268762d9-abd8-4f8c-8092-e7207fc924e0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:04.556403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50fb0efb83624683b308b7a2306baa38', 'request_id': 'req-268762d9-abd8-4f8c-8092-e7207fc924e0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:04.567075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50fb0efb83624683b308b7a2306baa38', 'request_id': 'req-268762d9-abd8-4f8c-8092-e7207fc924e0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:04.585170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] The token cache is being invalidate because project 50fb0efb83624683b308b7a2306baa38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:46:04.588504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:04.589627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-268762d9-abd8-4f8c-8092-e7207fc924e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:04.593970 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4133/8260] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:46:04 2022] DELETE /identity/v3/projects/50fb0efb83624683b308b7a2306baa38 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:04.598858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.599208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.600106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.634096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:04.643334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.799475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4128/8261] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:46:04.809201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.809905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.810128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.882138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:04.883434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:04.938247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:04.941592 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4134/8262] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:04.952925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18da48c-945f-4e14-b4a5-6fd433215f09 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:04.971177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:04.972164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:04.972486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:04.972776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:04.973654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:46:04.974075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:04.978829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:05.013079 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4129/8263] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:46:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:46:05.017579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:05.030298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9419d3f-af42-4f4a-90ca-103c25e3175a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:05.059223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:05.059971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:05.060259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:05.060638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:05.061401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:05.067906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:05.152724 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4135/8264] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:46:05 2022] POST /identity/v3/projects => generated 365 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:05.153736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:05.172136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78618b-5548-4f6f-b3e1-c70830886e54 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:05.291187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:05.293054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:05.317249 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:05.494133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:05.495385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:05.495806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:05.496191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:05.497096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:05.504148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:05.555519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb7ba31-cf29-49ed-9b18-f8c0f32656f8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:05.577789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:05.578399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:05.578683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:05.578959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:05.581039 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4130/8265] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:05 2022] POST /identity/v3/users => generated 283 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:05.586340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:05.595419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:05.627023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:05.628734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:05.654169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac2224-9b64-45d3-878e-6109c1b03514 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:05.667167 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4136/8266] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:46:05.685325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:05.686038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:05.686318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:05.686798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:05.687724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:05.690337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:05.747185 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4131/8267] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:05.747777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:05.785521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5be8740-97e9-4954-854f-2d949c3cdf95 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:05.818982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2ac6f-8e1e-4ab4-9136-124a5ab98eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:05.820397 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2ac6f-8e1e-4ab4-9136-124a5ab98eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:05.821018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2ac6f-8e1e-4ab4-9136-124a5ab98eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:05.821776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2ac6f-8e1e-4ab4-9136-124a5ab98eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:05.823253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2ac6f-8e1e-4ab4-9136-124a5ab98eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:05.831371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2ac6f-8e1e-4ab4-9136-124a5ab98eb9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:05.857502 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4137/8268] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:05 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:46:05.862736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:05.918767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdfe5c3-b955-4509-ac1d-9a6d914c4372 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:05.945247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:05.946764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:05.947303 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:05.953648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] PATH_INFO: `/v3/projects/eecef58893ca420db454178649f4d64e/users/9d7e342279c74c28946873bea2d74aae/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:06.012043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eecef58893ca420db454178649f4d64e, user_id=9d7e342279c74c28946873bea2d74aae, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:06.027181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:06.084868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4132/8269] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:05 2022] PUT /identity/v3/projects/eecef58893ca420db454178649f4d64e/users/9d7e342279c74c28946873bea2d74aae/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:46:06.090027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28600996-9b58-4967-b632-044611420fb3 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:06.091268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28600996-9b58-4967-b632-044611420fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:06.091760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28600996-9b58-4967-b632-044611420fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:06.127185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-28600996-9b58-4967-b632-044611420fb3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:06.130190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-28600996-9b58-4967-b632-044611420fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:06.221884 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:06.252286 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4138/8270] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:06.253118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:06.255269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:06.387471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010d13e-ffc6-411b-8872-a8f37542e833 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:06.404127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:06.404941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:06.405262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:06.405547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:06.425960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:06.427504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:06.459147 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4133/8271] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:46:08.471881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28600996-9b58-4967-b632-044611420fb3 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:08.917311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28600996-9b58-4967-b632-044611420fb3 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:08.932554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:08.933709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:08.942628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:08.944021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:08.952685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:08.988157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:08.990357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76648ea-a33a-43ba-abe5-dd19ada93852 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:09.024681 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4139/8272] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:46:15.880924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:15.883205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:15.915539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31143233-3ff6-426a-821b-20e86a996ade service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:15.939564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:15.940982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:15.941578 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:15.942104 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] PATH_INFO: `/v3/users/5dee1a9b473a46f2a036747772214f0b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:15.945874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dee1a9b473a46f2a036747772214f0b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:15.952315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:16.062788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dee1a9b473a46f2a036747772214f0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:16.072959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dee1a9b473a46f2a036747772214f0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:16.090869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dee1a9b473a46f2a036747772214f0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:16.091656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dee1a9b473a46f2a036747772214f0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:16.102685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dee1a9b473a46f2a036747772214f0b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:16.133643 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:INSERT=5,keystone:DELETE=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:16.154007 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4134/8273] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:46:15 2022] DELETE /identity/v3/users/5dee1a9b473a46f2a036747772214f0b => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:16.159008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:16.159604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:16.159842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:16.203640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:16.206854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:16.368144 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4140/8274] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:16.460500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:16.462709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:16.629215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699170dd-dfb6-4a8c-8c7f-0015e5739a84 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:16.646564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa399a7-979e-4f36-a601-e5bbdabcb427 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:16.647434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa399a7-979e-4f36-a601-e5bbdabcb427 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:16.647823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa399a7-979e-4f36-a601-e5bbdabcb427 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:16.648207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa399a7-979e-4f36-a601-e5bbdabcb427 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:16.671155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa399a7-979e-4f36-a601-e5bbdabcb427 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:16.672829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa399a7-979e-4f36-a601-e5bbdabcb427 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:16.694255 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4135/8275] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:17.587724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:17.589222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:17.615551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9c0ac-6df7-4d9f-9c5f-6f6503b36443 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:17.641267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:17.642291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:17.642548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:17.642920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] PATH_INFO: `/v3/projects/1caa140cdc024f7c86381e2b0cb40763` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:17.649851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1caa140cdc024f7c86381e2b0cb40763)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:17.654575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:17.768733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1caa140cdc024f7c86381e2b0cb40763', 'request_id': 'req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:17.785844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1caa140cdc024f7c86381e2b0cb40763', 'request_id': 'req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:17.793448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1caa140cdc024f7c86381e2b0cb40763', 'request_id': 'req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:17.822367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] The token cache is being invalidate because project 1caa140cdc024f7c86381e2b0cb40763 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:46:17.822688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:17.823415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d6f64918-6a8a-44c0-8b8b-2b14b9610e87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:17.825408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4141/8276] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:46:17 2022] DELETE /identity/v3/projects/1caa140cdc024f7c86381e2b0cb40763 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:17.830433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:17.830986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:17.831436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:17.893968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:17.902953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:18.110916 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4136/8277] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:18.127168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.127530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.127714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.165396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:18.166826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:18.189271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4142/8278] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:18.190022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:18.201559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5872ffd-3bf3-48d0-b86c-cffec292930e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:18.219605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:18.220293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.220604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.220882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.221676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:46:18.221946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:18.225188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:18.226106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:18.227492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:18.232953 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:18.256828 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4137/8279] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:46:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:46:18.261139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:18.290485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf8596d-a710-4894-9c4d-78894996694f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:18.304283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:18.304996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.305285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.305564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.306323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:18.311791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:18.384233 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4138/8280] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:46:18 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:18.386573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:18.410330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50d294-4c46-48ce-b0c6-2f78bac98225 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:18.581590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:18.582974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.583692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.585190 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.587827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:18.697902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:18.699446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe768ae-0266-46ea-84b0-eef51cb1bb39 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:18.700021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:18.740810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4143/8281] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:46:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 11:46:18.761853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:18.763030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.763795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.764590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.766522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:18.771169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:18.812603 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:18.961301 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4139/8282] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:18 2022] POST /identity/v3/users => generated 296 bytes in 577 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:46:18.961964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:18.975108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff554f70-de0f-4927-bc27-84ec9a31b8a9 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:18.981178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:18.982035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:18.982418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:18.982801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:18.983654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:18.985481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.002465 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4144/8283] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:18 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:46:19.006832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:19.019499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b688e-8c40-4dc9-8af3-a51b10d4b809 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:19.026991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa66402-816b-45e6-bd05-e40304da8fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:19.028066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa66402-816b-45e6-bd05-e40304da8fac admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.028468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa66402-816b-45e6-bd05-e40304da8fac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.028755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa66402-816b-45e6-bd05-e40304da8fac admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.030983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa66402-816b-45e6-bd05-e40304da8fac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:19.033537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa66402-816b-45e6-bd05-e40304da8fac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.069417 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4140/8284] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:19.073798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:19.086030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f20b0fe-3463-43be-b974-c15fe8febcb8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:19.093145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a9506-3f94-4253-a016-cd7d6b39c877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:19.093967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9506-3f94-4253-a016-cd7d6b39c877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.094296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9506-3f94-4253-a016-cd7d6b39c877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.094565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9506-3f94-4253-a016-cd7d6b39c877 admin admin] PATH_INFO: `/v3/projects/7cd9c014043344dc9034ed88f572f25a/users/025e82ba128a461f960237bc46a0270b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.119747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a9506-3f94-4253-a016-cd7d6b39c877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cd9c014043344dc9034ed88f572f25a, user_id=025e82ba128a461f960237bc46a0270b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:19.122628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a9506-3f94-4253-a016-cd7d6b39c877 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.177026 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4145/8285] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:19 2022] PUT /identity/v3/projects/7cd9c014043344dc9034ed88f572f25a/users/025e82ba128a461f960237bc46a0270b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:19.180256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.180582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.180869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.216159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.216656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.216948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.246703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] MFA Rules not processed for user `025e82ba128a461f960237bc46a0270b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:19.248948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:19.258958 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:19.279270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] MFA Rules not processed for user `9d7e342279c74c28946873bea2d74aae`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:19.291387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:19.445123 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4141/8286] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:19.468040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:19.470519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:19.528471 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4146/8287] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:19.529555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:19.532178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:19.658905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d9cee8-6e04-4684-aba2-142d71eabfe7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:19.671388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ae9ad5-099b-4048-b26b-f9a70bda4660 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:19.673141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:19.674192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.674582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.675062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.679608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:19.684654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.685039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.685415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.686533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:19.692271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.694027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:19.696737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.724948 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4142/8288] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:46:19.748896 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4147/8289] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:19 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:19.750154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:19.773638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba393b8-247e-4f24-a154-78bdb3e4be9d service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:19.779641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55e973-df67-4ea1-b154-15d19c597c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:19.780429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55e973-df67-4ea1-b154-15d19c597c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.780828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55e973-df67-4ea1-b154-15d19c597c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.781372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55e973-df67-4ea1-b154-15d19c597c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.782341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55e973-df67-4ea1-b154-15d19c597c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:19.784597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55e973-df67-4ea1-b154-15d19c597c9f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.806165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:19.807175 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4143/8290] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:19 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:19.828703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df0269-b7b5-4156-b29e-c2e6d13fe508 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:19.834086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:19.835072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.835361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.835642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] PATH_INFO: `/v3/system/users/9a4668973c7f4ee2aab7b19847b5d76e/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.871260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9a4668973c7f4ee2aab7b19847b5d76e, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:19.872943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:19.886063 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4148/8291] 10.222.0.15 () {60 vars in 1377 bytes} [Tue Jul 19 11:46:19 2022] PUT /identity/v3/system/users/9a4668973c7f4ee2aab7b19847b5d76e/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:19.900988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:19.901599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:19.902046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:19.971704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] MFA Rules not processed for user `9a4668973c7f4ee2aab7b19847b5d76e`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:19.989133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:20.157739 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:20.233177 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4144/8292] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:19 2022] POST /identity/v3/auth/tokens => generated 2405 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 19 11:46:20.234605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:20.372732 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:20.458204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0f4839-d5da-4133-99ef-ec9e5a84e66e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:20.532875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4668973c7f4ee2aab7b19847b5d76e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:20.533683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:20.534070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:20.534467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] PATH_INFO: `/v3/services` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:20.535419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:20.538268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:20.563614 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4149/8293] 10.222.0.15 () {58 vars in 1109 bytes} [Tue Jul 19 11:46:20 2022] GET /identity/v3/services => generated 2191 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:20.565226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:20.895258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d1e5fa-27b1-4e84-a63c-4700f164c6cf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:20.963725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4668973c7f4ee2aab7b19847b5d76e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:20.964755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:20.965095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:20.965390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] PATH_INFO: `/v3/limits` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:20.966159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:20.967532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Jul 19 11:46:21.026717 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.NoLimitReference Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Jul 19 11:46:21.028654 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:46:21.030711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4145/8294] 10.222.0.15 () {60 vars in 1125 bytes} [Tue Jul 19 11:46:20 2022] POST /identity/v3/limits => generated 124 bytes in 466 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Jul 19 11:46:21.036520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:21.306053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c422b667-4606-44a8-89f2-39376785fa30 None tempest-ImageQuotaTest-1012704917-system-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:21.418746 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:21.453754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4668973c7f4ee2aab7b19847b5d76e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:21.454465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:21.454744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:21.455032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:21.455998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:21.457205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:21.478550 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4150/8295] 10.222.0.15 () {58 vars in 1136 bytes} [Tue Jul 19 11:46:21 2022] GET /identity/v3/registered_limits => generated 129 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:46:21.487792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:21.631423 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:21.750473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca571c8-fee3-42c3-82d2-e8267f5fc85e None tempest-ImageQuotaTest-1012704917-system-admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:21.847347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff608951-3ab3-4d3e-ab5b-0a4f8fd4c176 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9a4668973c7f4ee2aab7b19847b5d76e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:21.848511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608951-3ab3-4d3e-ab5b-0a4f8fd4c176 None tempest-ImageQuotaTest-1012704917-system-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:21.849020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608951-3ab3-4d3e-ab5b-0a4f8fd4c176 None tempest-ImageQuotaTest-1012704917-system-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:21.850411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff608951-3ab3-4d3e-ab5b-0a4f8fd4c176 None tempest-ImageQuotaTest-1012704917-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:21.851698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff608951-3ab3-4d3e-ab5b-0a4f8fd4c176 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:21.854442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff608951-3ab3-4d3e-ab5b-0a4f8fd4c176 None tempest-ImageQuotaTest-1012704917-system-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:21.890050 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4146/8296] 10.222.0.15 () {58 vars in 1136 bytes} [Tue Jul 19 11:46:21 2022] GET /identity/v3/registered_limits => generated 129 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:46:28.097840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:28.099683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:28.120490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfd3ff5-bb07-4ce4-bb74-366e1709b787 None tempest-ImageQuotaTest-1012704917-system-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:28.126367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:28.127339 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:28.127629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:28.127904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] PATH_INFO: `/v3/users/05ca9fb2bf494cc28b593e20d5e27fe3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:28.129468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05ca9fb2bf494cc28b593e20d5e27fe3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:28.132141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:28.208333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05ca9fb2bf494cc28b593e20d5e27fe3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:28.219145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05ca9fb2bf494cc28b593e20d5e27fe3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:28.236642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05ca9fb2bf494cc28b593e20d5e27fe3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:28.238144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05ca9fb2bf494cc28b593e20d5e27fe3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:28.257589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05ca9fb2bf494cc28b593e20d5e27fe3'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:28.271736 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4151/8297] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:46:28 2022] DELETE /identity/v3/users/05ca9fb2bf494cc28b593e20d5e27fe3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:28.276855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:28.277619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:28.277712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:28.318149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:28.324637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:28.496119 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4147/8298] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:28.518495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:28.520491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:28.714936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74305b1c-ab12-4b33-b30b-f08188d4c9c2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:28.722248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bf625-61cc-46e1-a93f-3491d880fd3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:28.722934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf625-61cc-46e1-a93f-3491d880fd3b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:28.723221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf625-61cc-46e1-a93f-3491d880fd3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:28.723500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bf625-61cc-46e1-a93f-3491d880fd3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:28.745637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bf625-61cc-46e1-a93f-3491d880fd3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:28.747418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bf625-61cc-46e1-a93f-3491d880fd3b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:28.773208 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4152/8299] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:29.520002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:29.530142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:29.595732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea7f329-3142-466b-94b4-0324407cd7a3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:29.608213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:29.609347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:29.609813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:29.610258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] PATH_INFO: `/v3/projects/4d649c3c84d1415fbb18fdee0175ef34` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:29.612055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d649c3c84d1415fbb18fdee0175ef34)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:29.614324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:29.742206 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:29.761643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d649c3c84d1415fbb18fdee0175ef34', 'request_id': 'req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:29.772199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d649c3c84d1415fbb18fdee0175ef34', 'request_id': 'req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:29.785824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d649c3c84d1415fbb18fdee0175ef34', 'request_id': 'req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:29.814377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] The token cache is being invalidate because project 4d649c3c84d1415fbb18fdee0175ef34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:46:29.814669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:29.816056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-f09950b8-81a1-46f5-a200-9c4b7c34a9f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:29.818419 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4148/8300] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:46:29 2022] DELETE /identity/v3/projects/4d649c3c84d1415fbb18fdee0175ef34 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:29.823994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:29.824532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:29.824645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:29.868162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:29.869968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:29.985530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4153/8301] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:29.988102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:29.988387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:29.988683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.022411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:30.023844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:30.037742 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4149/8302] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:30.038654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.063504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501a1bf4-ca1d-4ba0-b03b-8e5eb5f9c81c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.077639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.078327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.078782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.079053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.079981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:46:30.080475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.082605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.084764 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:30.101174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4154/8303] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:46:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:46:30.105210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.115609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353ac08-5688-4dd7-97ce-bd6d6acd481c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.121838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.122557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.122818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.123247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.123956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.126143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.174494 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4150/8304] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:46:30 2022] POST /identity/v3/projects => generated 359 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:30.178854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.199563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4511be7c-0ecd-4a27-a613-746ebc9c1283 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.317437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.320277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.320810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.321561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.323503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.332783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.345161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.347043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:30.368160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e98668e-92ec-4d36-a0ad-cfcd52dda943 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.370074 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4155/8305] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:30 2022] POST /identity/v3/users => generated 280 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:30.376612 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.387236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.388192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.388507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.388792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] PATH_INFO: `/v3/users/9d7e342279c74c28946873bea2d74aae` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.391995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535dfd76-6534-422a-9c20-3b2972af8eea admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.394811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7e342279c74c28946873bea2d74aae)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.396928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.398525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.411893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.412207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.413250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.415203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.417163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.444764 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4156/8306] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:30.449239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.469161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c77bce-24e9-419c-9912-a70037067441 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.483509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.488291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.489085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.489383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.490188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.491842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.504109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4157/8307] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:30 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:30.506047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7e342279c74c28946873bea2d74aae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:30.506792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7e342279c74c28946873bea2d74aae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:30.508292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.512122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:30.521127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7e342279c74c28946873bea2d74aae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:30.522442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7e342279c74c28946873bea2d74aae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:30.525910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7787b-2ebc-4921-bae9-b9ba44e8f0b9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.531671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.532282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-c899cc89-19f5-4769-b7be-adca33f20cd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7e342279c74c28946873bea2d74aae'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:30.532898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.533308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.533683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] PATH_INFO: `/v3/projects/b2fc946c6dd1461eb4519baa6abb961b/users/6670d25aa400433288465e0d4e71f9af/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.552395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2fc946c6dd1461eb4519baa6abb961b, user_id=6670d25aa400433288465e0d4e71f9af, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.555452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.562522 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4151/8308] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:46:30 2022] DELETE /identity/v3/users/9d7e342279c74c28946873bea2d74aae => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:30.573153 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4158/8309] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:30 2022] PUT /identity/v3/projects/b2fc946c6dd1461eb4519baa6abb961b/users/6670d25aa400433288465e0d4e71f9af/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:30.584844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.585400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.585876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.617501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] MFA Rules not processed for user `6670d25aa400433288465e0d4e71f9af`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:30.619269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:30.726626 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4152/8310] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:30 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:30.766550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.769245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:30.885928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d81c3e-ce91-4bf1-86c1-e58ae73c9b90 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:30.889814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:30.893262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:30.896227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:30.900071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:30.900670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:30.901124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:30.913483 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:30.927284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:30.929257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:30.957120 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4159/8311] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:30 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:31.108729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f811a8-9183-43b7-b934-1051a846ac60 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:31.116320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:31.117464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:31.117993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:31.118428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] PATH_INFO: `/v3/projects/eecef58893ca420db454178649f4d64e` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:31.119862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=eecef58893ca420db454178649f4d64e)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:31.122768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:31.201457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eecef58893ca420db454178649f4d64e', 'request_id': 'req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.218707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eecef58893ca420db454178649f4d64e', 'request_id': 'req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.232806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eecef58893ca420db454178649f4d64e', 'request_id': 'req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.257856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] The token cache is being invalidate because project eecef58893ca420db454178649f4d64e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:46:31.258137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.262353 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.264382 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4153/8312] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:46:30 2022] DELETE /identity/v3/projects/eecef58893ca420db454178649f4d64e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:31.268488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:31.282537 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc700bd-6384-4ea0-8d21-688372eef0fc service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:31.371267 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:31.450253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:31.451746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:31.452554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:31.453028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] PATH_INFO: `/v3/users/9a4668973c7f4ee2aab7b19847b5d76e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:31.454634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a4668973c7f4ee2aab7b19847b5d76e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:31.457894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:31.561799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a4668973c7f4ee2aab7b19847b5d76e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.580743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a4668973c7f4ee2aab7b19847b5d76e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.610393 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a4668973c7f4ee2aab7b19847b5d76e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.613183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a4668973c7f4ee2aab7b19847b5d76e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.629805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a4668973c7f4ee2aab7b19847b5d76e'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:31.650659 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4160/8313] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:46:31 2022] DELETE /identity/v3/users/9a4668973c7f4ee2aab7b19847b5d76e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:32.261505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:32.263488 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:32.295159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ea037-1fbd-45ee-a6b0-1dfaf9a54dac admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:32.414794 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:32.415919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:32.416579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:32.416945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] PATH_INFO: `/v3/projects/None` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:32.433878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=None)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:32.437109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] Could not find project: None.: keystone.exception.ProjectNotFound: Could not find project: None. Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 19 11:46:32.460667 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: None. Jul 19 11:46:32.462177 n-d-master-1 devstack@keystone.service[80581]: ERROR keystone.server.flask.application Jul 19 11:46:32.465456 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4154/8314] 10.222.0.15 () {58 vars in 1148 bytes} [Tue Jul 19 11:46:32 2022] DELETE /identity/v3/projects/None => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 19 11:46:38.258396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:38.265572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:38.503124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e482040-6289-451f-9315-55f73df87acb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:38.510296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:38.511500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:38.511881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:38.512459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:38.514765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:38.576361 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:38.642099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:38.646992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:38.723060 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4161/8315] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:42.442329 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:45.106892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:45.119123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:45.140894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60841f40-ccdf-4ff6-b878-326dc1b162f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:45.168826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:45.179181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:45.179487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:45.183307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:45.193362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:45.377854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:45.380067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403a5a00-0e81-410f-9ec7-033b8072f4a7 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:45.410273 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4155/8316] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:48.698985 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=11 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:49.166650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:49.168244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:49.203456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecee83f-7f86-48d4-99ef-6f5566f5d54b service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:49.215093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:49.217128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:49.219148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:49.219596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] PATH_INFO: `/v3/users/025e82ba128a461f960237bc46a0270b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:49.223833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=025e82ba128a461f960237bc46a0270b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:49.228950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:49.364199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025e82ba128a461f960237bc46a0270b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:49.378384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025e82ba128a461f960237bc46a0270b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:49.446564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025e82ba128a461f960237bc46a0270b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:49.447806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025e82ba128a461f960237bc46a0270b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:49.467980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025e82ba128a461f960237bc46a0270b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:49.481439 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4162/8317] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:46:49 2022] DELETE /identity/v3/users/025e82ba128a461f960237bc46a0270b => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:49.486184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:49.487110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:49.487557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:49.527205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:49.528907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:49.618379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4156/8318] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:46:49.779112 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:49.781106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:50.011631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa4d1e-af2f-4923-abc4-d88e72ba6796 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:50.027583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a1b09-44d8-4861-bf12-f5002291e504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:50.028608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1b09-44d8-4861-bf12-f5002291e504 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:50.028608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1b09-44d8-4861-bf12-f5002291e504 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:50.028866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a1b09-44d8-4861-bf12-f5002291e504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:50.065772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1b09-44d8-4861-bf12-f5002291e504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:50.067247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a1b09-44d8-4861-bf12-f5002291e504 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:50.108051 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4163/8319] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:51.459754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:51.461428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:51.493361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d5ff9-8a72-475b-92dc-907e253a8a9a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:51.498992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:51.501133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:51.502037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:51.502569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] PATH_INFO: `/v3/projects/7cd9c014043344dc9034ed88f572f25a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:51.508050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cd9c014043344dc9034ed88f572f25a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:51.510930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:51.611598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cd9c014043344dc9034ed88f572f25a', 'request_id': 'req-46d5e76a-bdc9-407f-8924-439a663b1ed7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:51.621518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cd9c014043344dc9034ed88f572f25a', 'request_id': 'req-46d5e76a-bdc9-407f-8924-439a663b1ed7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:51.630918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cd9c014043344dc9034ed88f572f25a', 'request_id': 'req-46d5e76a-bdc9-407f-8924-439a663b1ed7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:51.656414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] The token cache is being invalidate because project 7cd9c014043344dc9034ed88f572f25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:46:51.657474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:51.660558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46d5e76a-bdc9-407f-8924-439a663b1ed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:46:51.664870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4157/8320] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:46:51 2022] DELETE /identity/v3/projects/7cd9c014043344dc9034ed88f572f25a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:51.671219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:51.671948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:51.671948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:51.720284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:51.765929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:51.910989 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4164/8321] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:51.915255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:51.916594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:51.917038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:51.954132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:51.956224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:51.980918 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4158/8322] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:51.981395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:51.997662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b35c26d-0630-42be-9576-d68c8f0183bb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.010984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.011997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.012408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.012797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.016930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:46:52.017530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:52.019578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:52.051788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:52.059895 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:52.062195 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4165/8323] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:46:52.068312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6e178d-f0a9-4781-aa44-1008a9dae0da None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.083115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.083805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.084088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.084377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.085288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:52.087536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:52.140696 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:52.147900 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:52.148511 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4159/8324] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:46:52 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:52.158374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b04777-40bd-4e51-a7f9-afb58358f326 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.325103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.325891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.326230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.327053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.327567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:52.330570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:52.389375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:52.399662 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4166/8325] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:52 2022] POST /identity/v3/users => generated 287 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:52.402259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636672e2-c54d-47dc-818a-4379954d171e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.417305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.418007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.418406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.418740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.419496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:52.421175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:52.451351 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4160/8326] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:52.460261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:52.483035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449995d-e530-426c-93ad-414a49a2ad0a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.498833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280e65c-23e0-4a4a-88b4-3666933014cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.500754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e65c-23e0-4a4a-88b4-3666933014cf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.502157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e65c-23e0-4a4a-88b4-3666933014cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.503453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280e65c-23e0-4a4a-88b4-3666933014cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.508221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e65c-23e0-4a4a-88b4-3666933014cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:52.510299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280e65c-23e0-4a4a-88b4-3666933014cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:52.539543 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4167/8327] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:52.540748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:52.560788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8f4f1f-f00a-4239-af3d-a7d94369e39f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.572000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.573111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.573503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.573897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] PATH_INFO: `/v3/projects/b60b917a7bcc4fc4ad0299a05630937a/users/dd4c7b18771f48479940ad67779109b9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.604972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60b917a7bcc4fc4ad0299a05630937a, user_id=dd4c7b18771f48479940ad67779109b9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:52.608086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:52.632404 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4161/8328] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:52 2022] PUT /identity/v3/projects/b60b917a7bcc4fc4ad0299a05630937a/users/dd4c7b18771f48479940ad67779109b9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:52.644238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.644706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.645094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.689248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] MFA Rules not processed for user `dd4c7b18771f48479940ad67779109b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:52.692044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:52.809441 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4168/8329] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:52 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:46:52.813413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:52.978951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195740d6-b11c-47f6-bdcc-8def3c919b2d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:52.997679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:52.998369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:52.998654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:52.998932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:52.999635 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:53.001705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:53.073992 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4162/8330] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:46:52 2022] POST /identity/v3/projects => generated 373 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:53.075250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:53.092848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd5872-b674-46bc-abd3-883b68be1755 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:53.182208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:53.182909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:53.183187 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:53.183456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:53.184465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:53.188099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:53.236804 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:53.247931 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4169/8331] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:46:53 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:46:53.248180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:53.265864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5a018-62aa-4b3e-a855-7206aec5a69d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:53.281653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:53.282861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:53.283399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:53.283924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:53.284931 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:53.286911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:53.321292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4163/8332] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:53.324398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:53.350761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c708272-5385-4a88-98a4-e88225d8fcd0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:53.362379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:53.363358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:53.363645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:53.363924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] PATH_INFO: `/v3/projects/5a0e0d91bba1413f84d4aaa46ae3f5f7/users/3d887acd1b414730ab4fb3eb1a9c99ff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:53.418228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0e0d91bba1413f84d4aaa46ae3f5f7, user_id=3d887acd1b414730ab4fb3eb1a9c99ff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:53.423357 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:53.463751 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4170/8333] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:53 2022] PUT /identity/v3/projects/5a0e0d91bba1413f84d4aaa46ae3f5f7/users/3d887acd1b414730ab4fb3eb1a9c99ff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:53.468089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:53.489337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820bdfc-f0ea-4732-a783-4ec55cd2e010 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:53.627387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c769a18-abf4-472f-a4e4-1a4db263e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:53.628184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769a18-abf4-472f-a4e4-1a4db263e852 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:53.628585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769a18-abf4-472f-a4e4-1a4db263e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:53.628936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c769a18-abf4-472f-a4e4-1a4db263e852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:53.629758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c769a18-abf4-472f-a4e4-1a4db263e852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:53.631477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c769a18-abf4-472f-a4e4-1a4db263e852 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:53.644217 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4164/8334] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:46:53 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:46:53.648239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:53.665584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d69d058-5911-437f-8f9c-49018a169049 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:53.677176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:53.678412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:53.679756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:53.680979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] PATH_INFO: `/v3/projects/5a0e0d91bba1413f84d4aaa46ae3f5f7/users/3d887acd1b414730ab4fb3eb1a9c99ff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:53.689026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0e0d91bba1413f84d4aaa46ae3f5f7, user_id=3d887acd1b414730ab4fb3eb1a9c99ff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:53.692242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:53.718977 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4171/8335] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:46:53 2022] PUT /identity/v3/projects/5a0e0d91bba1413f84d4aaa46ae3f5f7/users/3d887acd1b414730ab4fb3eb1a9c99ff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:46:53.730050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:53.730992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:53.731390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:53.803983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] MFA Rules not processed for user `3d887acd1b414730ab4fb3eb1a9c99ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:46:53.805580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:53.816797 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:46:53.954140 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4165/8336] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:46:53 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:46:53.966095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:53.967859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:46:54.065417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68f59c9-ccde-4005-a11a-1aa9954588e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:54.069919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdbf6a8-ac74-45fd-9b57-177fc20f4820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:54.071095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf6a8-ac74-45fd-9b57-177fc20f4820 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:54.071553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf6a8-ac74-45fd-9b57-177fc20f4820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:54.071995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdbf6a8-ac74-45fd-9b57-177fc20f4820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:54.159005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf6a8-ac74-45fd-9b57-177fc20f4820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:54.161335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdbf6a8-ac74-45fd-9b57-177fc20f4820 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:54.177066 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4172/8337] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:46:57.763654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:46:57.781249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce679ce-1431-4225-a9a8-725da50cb902 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:46:57.786234 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:46:57.787463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:46:57.787921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:46:57.788453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:46:57.802707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:46:57.804847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:46:57.818783 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4166/8338] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:46:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:04.185363 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=63,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:07.813060 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=33 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:10.127596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75928314-7c8b-45ad-b0e6-47ee38911047 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:10.127596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75928314-7c8b-45ad-b0e6-47ee38911047 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:10.127596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75928314-7c8b-45ad-b0e6-47ee38911047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:10.154984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-75928314-7c8b-45ad-b0e6-47ee38911047 None None] MFA Rules not processed for user `dd4c7b18771f48479940ad67779109b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:10.156181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-75928314-7c8b-45ad-b0e6-47ee38911047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:10.182794 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4173/8339] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:47:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:11.166783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:11.169972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:11.215589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6399867-28fe-43b6-979a-a4742cd632d9 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:11.220944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:11.221882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:11.222897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:11.223320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:11.229410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:11.268809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:11.271929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:11.291578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4167/8340] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:20.128936 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:20.354462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:20.354659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:20.354939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:20.423398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] MFA Rules not processed for user `c6d16c41cc3d4368b18961ded33d267d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:20.427154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:20.526577 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4174/8341] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:47:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:21.283698 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:23.582214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:23.584308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:23.785662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:23.787158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:23.879424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e5bbf-c108-4994-9057-1158b10c488e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:23.895159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:23.896128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:23.896697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:23.897537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:23.902646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:23.936413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:23.938443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971be43-ac36-4d9e-a32f-8c8226ffdc91 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:23.966486 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4168/8342] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:24.041195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb903b4-40e8-41e9-b0ec-5a379bc6e305 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:24.073115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:24.073811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:24.074100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:24.074384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:24.104206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:24.106186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:24.137735 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4175/8343] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:25.433103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:25.433634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:25.433634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:25.486670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] MFA Rules not processed for user `22e26c46a62a417aacfbafb054eb8752`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:47:25.489165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:25.629552 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4169/8344] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:47:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:47:26.002235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:26.017462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08915abc-083e-48ad-9b80-93cd59ba982c service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:26.021659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:26.022552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:26.022930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:26.023300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:26.025360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:26.041129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:26.042705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:26.056850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4176/8345] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:27.360650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:47:27.388693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2ded5-b8c6-43ed-8718-ed1a2d83be7d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:47:27.400112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:47:27.402291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:47:27.403007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:47:27.403708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:47:27.406987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:47:27.430144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:47:27.454321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e688363-71a3-437d-8160-94750228edb3 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:47:27.484489 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4170/8346] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:47:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:47:36.051043 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=63 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:47:37.466574 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=68 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:09.227388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:09.230182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:09.515693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f71c5a-7f76-4baf-9c43-696a426d8758 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:09.530398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:09.531164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:09.531448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:09.531723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:09.551550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:09.718468 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:09.732895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167b016f-9772-4f1c-9b19-1a3954d9667e service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:09.797440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4177/8347] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:12.769401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a0ad-8e58-4aff-8aeb-76a023753fd1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:12.770030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a0ad-8e58-4aff-8aeb-76a023753fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:12.770030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e49a0ad-8e58-4aff-8aeb-76a023753fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:12.804298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3e49a0ad-8e58-4aff-8aeb-76a023753fd1 None None] MFA Rules not processed for user `dd4c7b18771f48479940ad67779109b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:12.808624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3e49a0ad-8e58-4aff-8aeb-76a023753fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:12.832202 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4171/8348] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:13.103717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45062e-d152-4d03-973b-e16d75620a3c None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:13.104279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45062e-d152-4d03-973b-e16d75620a3c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:13.104405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45062e-d152-4d03-973b-e16d75620a3c None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:13.106082 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4178/8349] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 11:48:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 11:48:13.117801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:13.118390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:13.118874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:13.162039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:13.170511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:13.196247 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4172/8350] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:48:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:13.222423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45062e-d152-4d03-973b-e16d75620a3c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:13.253465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc45062e-d152-4d03-973b-e16d75620a3c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:13.268161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:13.270869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:13.272228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:13.272968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:13.285335 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:13.288452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:13.312408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4179/8351] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:13.634992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:13.659562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36f36f-db02-490f-8c7c-c99a8decc1cf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:13.670247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:13.671065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:13.673049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:13.673049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:13.685090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:13.746063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:13.750773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:13.773679 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4173/8352] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:13.966519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:13.985196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43093060-d6b3-446d-a67a-8b6667c7ccb8 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:13.995879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:13.997023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:13.997574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:13.998255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:14.000640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:14.295423 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:14.337882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:14.339508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479ca3e8-236f-4168-aaf3-0cb3ff577e74 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:14.391891 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4180/8353] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:23.762556 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=17 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:24.361957 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:29.246001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:29.248200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:29.369585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678877f-914f-46c4-9304-7c1afed8ba4f service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:29.374599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:29.375697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:29.375979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:29.376251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] PATH_INFO: `/v3/users/6670d25aa400433288465e0d4e71f9af` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:29.377566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6670d25aa400433288465e0d4e71f9af)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:29.380006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:29.463813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6670d25aa400433288465e0d4e71f9af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:29.464780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6670d25aa400433288465e0d4e71f9af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:29.478394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6670d25aa400433288465e0d4e71f9af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:29.479054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6670d25aa400433288465e0d4e71f9af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:29.489628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6670d25aa400433288465e0d4e71f9af'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:29.525316 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4174/8354] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:48:29 2022] DELETE /identity/v3/users/6670d25aa400433288465e0d4e71f9af => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:48:29.530382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:29.530382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:29.530962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:29.601259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:29.602731 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:29.723920 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4181/8355] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:29.734767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:29.737206 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:29.842327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1c9235-7a1d-4402-a96f-5d84df010c16 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:29.846760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cd56f-d247-4e31-981c-b3d252c307a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:29.847452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd56f-d247-4e31-981c-b3d252c307a9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:29.847735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd56f-d247-4e31-981c-b3d252c307a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:29.848010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cd56f-d247-4e31-981c-b3d252c307a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:29.868473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd56f-d247-4e31-981c-b3d252c307a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:29.868473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754cd56f-d247-4e31-981c-b3d252c307a9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:29.874044 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4175/8356] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:30.547948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:30.550887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:30.563334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5bdb26-be80-4443-86ee-cd635ed661fa None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:30.568920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:30.570096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:30.570450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:30.570793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] PATH_INFO: `/v3/projects/b2fc946c6dd1461eb4519baa6abb961b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:30.572407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2fc946c6dd1461eb4519baa6abb961b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:30.574564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:30.652438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2fc946c6dd1461eb4519baa6abb961b', 'request_id': 'req-96902e55-8cc3-4673-983a-3a1349c0bf07'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:30.662208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2fc946c6dd1461eb4519baa6abb961b', 'request_id': 'req-96902e55-8cc3-4673-983a-3a1349c0bf07'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:30.683198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2fc946c6dd1461eb4519baa6abb961b', 'request_id': 'req-96902e55-8cc3-4673-983a-3a1349c0bf07'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:30.712890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] The token cache is being invalidate because project b2fc946c6dd1461eb4519baa6abb961b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:48:30.713277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:30.715568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-96902e55-8cc3-4673-983a-3a1349c0bf07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:30.717776 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4182/8357] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:48:30 2022] DELETE /identity/v3/projects/b2fc946c6dd1461eb4519baa6abb961b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:48:30.724842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:30.726356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:30.726847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:30.735680 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:30.801778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:30.803300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:30.910795 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4176/8358] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:30.916226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:30.916642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:30.916932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:30.944006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:30.946161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:30.968321 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4183/8359] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:48:30.973050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:30.985269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528217f-4e20-4dd7-b877-d0bf474d7881 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:30.991392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:30.992377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:30.992754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:30.993107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:30.994097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:48:30.994563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:30.996309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.013834 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4177/8360] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:48:31.018017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:31.029020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0dfcce-d7c5-48ed-98f1-3c2628c37b3f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:31.034495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:31.035289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.035672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.036053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.036896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:31.038981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.084538 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4184/8361] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:48:31 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:48:31.086923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:31.099424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c90e2f-cf42-465b-add1-e9c94133a012 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:31.203277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:31.203964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.204245 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.204567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.205535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:31.207508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.235165 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4178/8362] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:48:31 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:48:31.239561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:31.257227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36975e25-f1f3-42b5-9b8d-b0c309cb52fd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:31.264094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:31.264996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.265373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.265783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.266966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:31.268870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.286592 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4185/8363] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:48:31.287273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:31.300830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270aaf0-5f40-4fcd-83e3-f6ce609c717d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:31.308251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a971a3df-b43d-4fb8-9f7f-fa563877f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:31.308985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971a3df-b43d-4fb8-9f7f-fa563877f7ea admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.309266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971a3df-b43d-4fb8-9f7f-fa563877f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.309537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971a3df-b43d-4fb8-9f7f-fa563877f7ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.310280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971a3df-b43d-4fb8-9f7f-fa563877f7ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:31.312405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a971a3df-b43d-4fb8-9f7f-fa563877f7ea admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.324068 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4179/8364] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:48:31.329486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:31.340606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa616cc-f1fa-4603-9f87-12a69109db0f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:31.346184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:31.347096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.347380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.347658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] PATH_INFO: `/v3/projects/c01d232244834ce3be46df0b37842ea1/users/b155e377ed984299b30e5fa44f92dd74/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.375606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01d232244834ce3be46df0b37842ea1, user_id=b155e377ed984299b30e5fa44f92dd74, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:31.379102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.395674 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4186/8365] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:48:31 2022] PUT /identity/v3/projects/c01d232244834ce3be46df0b37842ea1/users/b155e377ed984299b30e5fa44f92dd74/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:48:31.407663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.408045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.408380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.439271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] MFA Rules not processed for user `b155e377ed984299b30e5fa44f92dd74`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:31.440565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:31.485634 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:31.511789 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4180/8366] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:31.522101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:31.523920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:31.534718 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:31.593402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40441b46-8698-4f18-83f0-c6c094ab3312 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:31.597287 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:31.598162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:31.598513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:31.598861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:31.608276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:31.609851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:31.620059 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4187/8367] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:41.508523 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:41.615859 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=24 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:48.632134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:48.634475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:48.731423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43e004-bade-4313-8aeb-ff0752cfcfa1 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:48.750110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:48.751659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:48.752153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:48.753603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:48.757279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:48.796124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:48.797798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:48.824548 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4181/8368] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:58.025037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:58.073301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c3c00-4022-48c8-99ba-1adf6f614b4c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:58.106345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:58.107378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:58.107807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:58.108225 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:58.110666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:58.146768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:58.150213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98081af1-4d7c-4250-b905-5713e7f292a4 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:58.173102 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4188/8369] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:48:58.808037 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=32 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:48:59.052518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:59.199895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6a7a1-e875-43a9-9c34-fb3125315ec1 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:59.215798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:59.221700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:59.224228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:59.224809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] PATH_INFO: `/v3/users/b155e377ed984299b30e5fa44f92dd74` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:59.227921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b155e377ed984299b30e5fa44f92dd74)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:59.234879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:59.331184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b155e377ed984299b30e5fa44f92dd74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:59.332467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b155e377ed984299b30e5fa44f92dd74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:59.351535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b155e377ed984299b30e5fa44f92dd74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:59.353117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b155e377ed984299b30e5fa44f92dd74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:59.390682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-788233ff-0cf8-4d9e-b92e-ca91113cb14b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b155e377ed984299b30e5fa44f92dd74'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:48:59.418803 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4182/8370] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:48:59 2022] DELETE /identity/v3/users/b155e377ed984299b30e5fa44f92dd74 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:48:59.423280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:59.424111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:59.424563 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:59.461089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:59.462538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:59.497201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:59.497768 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:59.499180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:59.526115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] MFA Rules not processed for user `c6d16c41cc3d4368b18961ded33d267d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:48:59.527711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:59.611397 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4189/8371] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:59.616194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:48:59.618199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:48:59.655273 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4183/8372] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:48:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:48:59.739092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8ab71-20f5-4263-acbf-cf2567c11f56 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:48:59.767327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0369d447-8825-47d3-8a8e-35c8914b4b58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:48:59.768482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d447-8825-47d3-8a8e-35c8914b4b58 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:48:59.769615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d447-8825-47d3-8a8e-35c8914b4b58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:48:59.769615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0369d447-8825-47d3-8a8e-35c8914b4b58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:48:59.805624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369d447-8825-47d3-8a8e-35c8914b4b58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:48:59.815208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0369d447-8825-47d3-8a8e-35c8914b4b58 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:48:59.855379 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4190/8373] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:48:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:00.266224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:00.268379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:00.289115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ff384a-3533-477d-bca7-9d0a862efe8e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:00.294900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:00.296493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:00.297501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:00.298861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] PATH_INFO: `/v3/projects/c01d232244834ce3be46df0b37842ea1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:00.300814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01d232244834ce3be46df0b37842ea1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:00.304553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:00.334825 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:00.402756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01d232244834ce3be46df0b37842ea1', 'request_id': 'req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:00.416809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01d232244834ce3be46df0b37842ea1', 'request_id': 'req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:00.436812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01d232244834ce3be46df0b37842ea1', 'request_id': 'req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:00.461600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] The token cache is being invalidate because project c01d232244834ce3be46df0b37842ea1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:00.461982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:00.463030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bc4b1ade-f78c-4708-b280-436a2ba6a2e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:00.465826 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4184/8374] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:00 2022] DELETE /identity/v3/projects/c01d232244834ce3be46df0b37842ea1 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:00.471552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:00.472074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:00.472146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:00.501120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:00.502948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:00.587149 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4191/8375] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:00.594695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:00.595018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:00.595269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:00.633400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:00.638665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:00.664591 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4185/8376] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:00.668910 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:00.683383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b6630-a184-43a9-941b-0e47ad32af3a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:00.701219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:00.701219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:00.701219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:00.701762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:00.704837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:49:00.708765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:00.708765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:00.726635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4192/8377] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:49:00.731107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:00.752159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf2049-d635-4fe1-b2c9-4b69521ff905 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:00.766983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:00.767720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:00.768005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:00.768281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:00.769051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:00.771018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:00.846670 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4186/8378] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:00 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:00.847376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:00.864769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d2959-380d-419c-a6bf-9493667b0216 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:00.916711 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:01.046142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:01.052235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.052751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.053332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.055288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:01.061690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:01.113471 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4193/8379] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:00 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:49:01.114956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:01.131238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af08540-d50a-4f87-aaa9-6302adea1adc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:01.146776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:01.147860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.148329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.148987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.149771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:01.151435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:01.174119 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4187/8380] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:01.178272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:01.194497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d373c2-e40c-460b-8d8c-8d8751025284 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:01.200180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:01.201365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.201990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.201990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.202822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:01.204554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:01.214008 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:01.216395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:01.219116 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4194/8381] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:49:01.225672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:01.253173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3392ad-4754-4a1a-94e8-a11a05459aba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:01.268012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac1f60a-9bcc-4669-87de-980e783c0620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:01.268994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f60a-9bcc-4669-87de-980e783c0620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.269281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f60a-9bcc-4669-87de-980e783c0620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.269562 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac1f60a-9bcc-4669-87de-980e783c0620 admin admin] PATH_INFO: `/v3/projects/381da39d9b4842b0b1a58deecd3eecf5/users/a8e958e21f2b4411bd73f6865b518224/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.297439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1f60a-9bcc-4669-87de-980e783c0620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=381da39d9b4842b0b1a58deecd3eecf5, user_id=a8e958e21f2b4411bd73f6865b518224, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:01.305237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac1f60a-9bcc-4669-87de-980e783c0620 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:01.318291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9815fec3-1b0e-4480-98d7-db71443534a3 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:01.329101 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4195/8382] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:01 2022] PUT /identity/v3/projects/381da39d9b4842b0b1a58deecd3eecf5/users/a8e958e21f2b4411bd73f6865b518224/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:01.338740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:01.339450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.339740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.339931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.340048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.340454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.341217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.342083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:01.402875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] MFA Rules not processed for user `a8e958e21f2b4411bd73f6865b518224`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:01.404319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:01.516294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:01.517955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:01.540614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4188/8383] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:49:01.590721 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4196/8384] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:01.591781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:01.593404 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:01.621515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0d5b4-3416-4a02-ab2e-0364eb2fb5f8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:01.634540 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:01.782777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef4c83-b876-4cda-94d7-8f56676ef30e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:01.783486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4c83-b876-4cda-94d7-8f56676ef30e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:01.783766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4c83-b876-4cda-94d7-8f56676ef30e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:01.784044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef4c83-b876-4cda-94d7-8f56676ef30e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:01.810702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef4c83-b876-4cda-94d7-8f56676ef30e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:01.812637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef4c83-b876-4cda-94d7-8f56676ef30e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:01.834363 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4189/8385] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:01 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:49:01.847421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:01.997691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b22ca92-107f-4033-9afb-523ee842f43c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:02.005343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:02.006350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:02.006631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:02.006902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] PATH_INFO: `/v3/users/a8e958e21f2b4411bd73f6865b518224` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:02.010400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8e958e21f2b4411bd73f6865b518224)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:02.014722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:02.017584 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:02.151726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8e958e21f2b4411bd73f6865b518224'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:02.168846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8e958e21f2b4411bd73f6865b518224'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:02.212016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8e958e21f2b4411bd73f6865b518224'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:02.212809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8e958e21f2b4411bd73f6865b518224'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:02.234656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8e958e21f2b4411bd73f6865b518224'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:02.252085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4197/8386] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:49:01 2022] DELETE /identity/v3/users/a8e958e21f2b4411bd73f6865b518224 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:02.257606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:02.257907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:02.258725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:02.301204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:02.302478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:02.431709 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4190/8387] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:02.445994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:02.447958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:02.530195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4a879-984c-4fd5-8cce-8cd32f2cbfbd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:02.535283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939a6b0-4a99-45c9-8d9e-b7cf918281c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:02.535962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a6b0-4a99-45c9-8d9e-b7cf918281c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:02.536247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a6b0-4a99-45c9-8d9e-b7cf918281c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:02.536555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939a6b0-4a99-45c9-8d9e-b7cf918281c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:02.549432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a6b0-4a99-45c9-8d9e-b7cf918281c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:02.551057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939a6b0-4a99-45c9-8d9e-b7cf918281c5 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:02.578790 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4198/8388] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:03.055473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.057047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:03.075987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e56ba-d986-4606-af0c-a1459d41cf5b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.100120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.102170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.102170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.102405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] PATH_INFO: `/v3/projects/381da39d9b4842b0b1a58deecd3eecf5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.103624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] RBAC: Authorizing `identity:delete_project(project_id=381da39d9b4842b0b1a58deecd3eecf5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:03.105968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:03.191150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '381da39d9b4842b0b1a58deecd3eecf5', 'request_id': 'req-0dad4ab5-f613-4b75-9fdc-9faceb37001b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:03.198360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '381da39d9b4842b0b1a58deecd3eecf5', 'request_id': 'req-0dad4ab5-f613-4b75-9fdc-9faceb37001b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:03.208002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '381da39d9b4842b0b1a58deecd3eecf5', 'request_id': 'req-0dad4ab5-f613-4b75-9fdc-9faceb37001b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:03.232413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] The token cache is being invalidate because project 381da39d9b4842b0b1a58deecd3eecf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:03.232774 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:03.233423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-0dad4ab5-f613-4b75-9fdc-9faceb37001b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:03.239815 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4191/8389] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:03 2022] DELETE /identity/v3/projects/381da39d9b4842b0b1a58deecd3eecf5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:03.242982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.246788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.246788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.272866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:03.278820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:03.425630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4199/8390] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:03.434191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.434710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.434816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.464945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:03.466681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:03.496810 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4192/8391] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:03.501334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.513561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983b532d-918f-458c-b9d9-477e49bd196a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.520790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.522027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.522550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.523103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.524133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:49:03.524734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:03.528429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:03.554619 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4200/8392] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:49:03.558866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.572735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c51ef0-e2bd-4942-824d-e99f7f1ae9f5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.579964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.581076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.581579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.582122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.584252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:03.587996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:03.624768 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4193/8393] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:03 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:49:03.629046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.640062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226cf8d9-fa83-43b1-ad1f-09560692018c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.655879 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:03.730306 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.731130 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.731479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.731872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.733752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:03.735711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:03.790603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4201/8394] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:03 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:03.795396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.808981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2f76f-b66b-438a-b1b2-3a5331749634 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.814164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.815126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.815504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.815872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.817046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:03.819210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:03.821127 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:03.862523 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4194/8395] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:03.862853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.884118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5293e-3123-4289-860e-a7ee1a5fe22a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.894687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8197f9-fe61-40ee-9a53-d1b60b1605ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.895803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8197f9-fe61-40ee-9a53-d1b60b1605ef admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.900601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8197f9-fe61-40ee-9a53-d1b60b1605ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.900961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8197f9-fe61-40ee-9a53-d1b60b1605ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.901771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8197f9-fe61-40ee-9a53-d1b60b1605ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:03.908808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8197f9-fe61-40ee-9a53-d1b60b1605ef admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:03.941980 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4202/8396] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:03 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:03.946999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:03.967325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5817c5-bd55-4216-9025-6f6d2bc6989b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:03.974951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:03.976333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:03.977038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:03.977546 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] PATH_INFO: `/v3/projects/435eb792f0a547688111c523a2e75f07/users/ed17c6ebcd644de79dd88d431ce93879/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:03.999201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435eb792f0a547688111c523a2e75f07, user_id=ed17c6ebcd644de79dd88d431ce93879, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:04.002958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:04.033684 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4195/8397] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:03 2022] PUT /identity/v3/projects/435eb792f0a547688111c523a2e75f07/users/ed17c6ebcd644de79dd88d431ce93879/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:04.035552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:04.036051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:04.036645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:04.116682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] MFA Rules not processed for user `ed17c6ebcd644de79dd88d431ce93879`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:04.118124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:04.272268 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4203/8398] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:49:04.291354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:04.293162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:04.391714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9c382-2dca-46cd-a824-fae098dae1f1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:04.395555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d23efc-80a7-4a5a-b794-2115a031f859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:04.396229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23efc-80a7-4a5a-b794-2115a031f859 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:04.396556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23efc-80a7-4a5a-b794-2115a031f859 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:04.396835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d23efc-80a7-4a5a-b794-2115a031f859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:04.417674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23efc-80a7-4a5a-b794-2115a031f859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:04.419276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d23efc-80a7-4a5a-b794-2115a031f859 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:04.432477 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4196/8399] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:04 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:04.451950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:04.556667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55e3e7a-1194-4c59-97ab-6c14e9c75c0e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:04.571869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:04.572846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:04.573239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:04.573505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] PATH_INFO: `/v3/users/ed17c6ebcd644de79dd88d431ce93879` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:04.575841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed17c6ebcd644de79dd88d431ce93879)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:04.579065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:04.616444 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:04.651353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed17c6ebcd644de79dd88d431ce93879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:04.662803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed17c6ebcd644de79dd88d431ce93879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:04.687480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed17c6ebcd644de79dd88d431ce93879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:04.688307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed17c6ebcd644de79dd88d431ce93879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:04.700522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed17c6ebcd644de79dd88d431ce93879'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:04.708497 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4204/8400] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:49:04 2022] DELETE /identity/v3/users/ed17c6ebcd644de79dd88d431ce93879 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:04.713512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:04.713983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:04.714155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:04.733374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:04.734652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:04.801700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4197/8401] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:49:04.810201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:04.811968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:04.881038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65ae888-ff98-41d4-b94c-d3fa748555da admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:04.884988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7a063d-c5a9-4c36-b3f7-7d577e62f7a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:04.885667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a063d-c5a9-4c36-b3f7-7d577e62f7a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:04.885952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a063d-c5a9-4c36-b3f7-7d577e62f7a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:04.886228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7a063d-c5a9-4c36-b3f7-7d577e62f7a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:04.899945 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a063d-c5a9-4c36-b3f7-7d577e62f7a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:04.901808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7a063d-c5a9-4c36-b3f7-7d577e62f7a4 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:04.913153 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4205/8402] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:05.343595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:05.344790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:05.369171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c429ded-e4de-47a3-8ace-8dbb3c3c7eaf None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:05.378894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:05.379742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:05.380027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:05.380307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] PATH_INFO: `/v3/projects/435eb792f0a547688111c523a2e75f07` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:05.382679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=435eb792f0a547688111c523a2e75f07)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:05.389739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:05.485943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435eb792f0a547688111c523a2e75f07', 'request_id': 'req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:05.493490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435eb792f0a547688111c523a2e75f07', 'request_id': 'req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:05.506126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435eb792f0a547688111c523a2e75f07', 'request_id': 'req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:05.525152 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:05.535204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] The token cache is being invalidate because project 435eb792f0a547688111c523a2e75f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:05.535861 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:05.539390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d7fbe077-ad48-44d8-b7de-ee45c4c9db7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:05.554095 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4198/8403] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:05 2022] DELETE /identity/v3/projects/435eb792f0a547688111c523a2e75f07 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:05.556202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:05.556717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:05.556805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:05.582729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:05.582729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:05.665076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4206/8404] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:05.673982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:05.674503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:05.674923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:05.702063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:05.703479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:05.724256 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4199/8405] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:05.729098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:05.743034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d32f48b-9814-43fc-84fd-7cc6bc22c424 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:05.753728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:05.754472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:05.755496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:05.755718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:05.757576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:49:05.757576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:05.758944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:05.783103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:05.783350 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4207/8406] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:49:05.797369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb62cc-d2ad-498d-aee5-01fd233f8060 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:05.805189 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:05.805858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:05.806254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:05.806418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:05.807126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:05.809645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:05.856419 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4200/8407] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:05 2022] POST /identity/v3/projects => generated 403 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:49:05.860962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:05.879700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5658cc-6291-41db-9852-21e0860c9dff admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:06.101038 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:06.182273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:06.182983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:06.183260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:06.183531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:06.184373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:06.186326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:06.227491 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4208/8408] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:05 2022] POST /identity/v3/users => generated 302 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:06.232333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:06.247054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038a88-b579-4c66-8077-35bc61ef0124 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:06.259121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:06.259834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:06.260123 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:06.260847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:06.262252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:06.265855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:06.326250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:06.333598 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4201/8409] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:06.337620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d1ea8-1789-4367-870a-aa635619677b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:06.352097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dca5a1-ec75-4058-895a-35cdfa64ee63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:06.353223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dca5a1-ec75-4058-895a-35cdfa64ee63 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:06.354819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dca5a1-ec75-4058-895a-35cdfa64ee63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:06.355462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dca5a1-ec75-4058-895a-35cdfa64ee63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:06.357284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dca5a1-ec75-4058-895a-35cdfa64ee63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:06.361016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dca5a1-ec75-4058-895a-35cdfa64ee63 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:06.409796 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4209/8410] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:06.416327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:06.431142 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec281c8-9869-467c-b3af-ed8cb2b570f9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:06.450318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:06.451364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:06.451820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:06.452097 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] PATH_INFO: `/v3/projects/c36d6171fc0c4c9594e21fb2cb0d287a/users/0ec0728129e5453286bec3fcf7266638/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:06.484154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c36d6171fc0c4c9594e21fb2cb0d287a, user_id=0ec0728129e5453286bec3fcf7266638, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:06.489042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:06.522554 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4202/8411] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:06 2022] PUT /identity/v3/projects/c36d6171fc0c4c9594e21fb2cb0d287a/users/0ec0728129e5453286bec3fcf7266638/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:06.534893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:06.535479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:06.535855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:06.593281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] MFA Rules not processed for user `0ec0728129e5453286bec3fcf7266638`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:06.595487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:06.719870 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4210/8412] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:06.720221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:06.875971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a8e8-10c7-4a51-b7fa-02dfb3c206d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:06.881870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:06.882677 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:06.883090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:06.883362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:06.884077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:06.886177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:06.971441 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4203/8413] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:06 2022] POST /identity/v3/projects => generated 405 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:49:06.975298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:06.992047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161ca54-3588-4dae-ae48-e5ddfc24dd8b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:07.145251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:07.145965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:07.146250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:07.146523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:07.147256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:07.149399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:07.196969 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4211/8414] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:06 2022] POST /identity/v3/users => generated 309 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:07.203162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:07.217130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c8d87-d93e-45b4-aefb-103e0de4712c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:07.227549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:07.227941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:07.228231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:07.228556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:07.229414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:07.231205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:07.248502 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4204/8415] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:07.253263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:07.277615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625f64d-92fd-4af3-924a-bd6c721cf3a0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:07.294127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:07.295966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:07.296326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:07.296803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] PATH_INFO: `/v3/projects/503c9c45f3764202b93dd9f6d58bc39d/users/265bbaaee020480ab00b4cc08ac25e1d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:07.353438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] RBAC: Authorizing `identity:create_grant(project_id=503c9c45f3764202b93dd9f6d58bc39d, user_id=265bbaaee020480ab00b4cc08ac25e1d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:07.356708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:07.376403 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4212/8416] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:07 2022] PUT /identity/v3/projects/503c9c45f3764202b93dd9f6d58bc39d/users/265bbaaee020480ab00b4cc08ac25e1d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:07.378998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:07.399262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd0034-3200-4e24-8e95-7925686f9b00 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:07.619444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9e299-6517-421a-8d7f-30a2be7894f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:07.620140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9e299-6517-421a-8d7f-30a2be7894f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:07.620827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9e299-6517-421a-8d7f-30a2be7894f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:07.621249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9e299-6517-421a-8d7f-30a2be7894f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:07.622007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9e299-6517-421a-8d7f-30a2be7894f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:07.623780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9e299-6517-421a-8d7f-30a2be7894f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:07.655564 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4205/8417] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:07.659866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:07.667317 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:07.680515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58754f94-826c-478b-90e4-dbb6c93bb84f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:07.687659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:07.688861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:07.689134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:07.689413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] PATH_INFO: `/v3/projects/503c9c45f3764202b93dd9f6d58bc39d/users/265bbaaee020480ab00b4cc08ac25e1d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:07.691821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] RBAC: Authorizing `identity:create_grant(project_id=503c9c45f3764202b93dd9f6d58bc39d, user_id=265bbaaee020480ab00b4cc08ac25e1d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:07.696865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:07.724742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:07.725031 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:07.725314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:07.728252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4213/8418] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:07 2022] PUT /identity/v3/projects/503c9c45f3764202b93dd9f6d58bc39d/users/265bbaaee020480ab00b4cc08ac25e1d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:07.733620 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:07.782281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] MFA Rules not processed for user `265bbaaee020480ab00b4cc08ac25e1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:07.784323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:08.001854 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4206/8419] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:07 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:08.015327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:08.017647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:08.175109 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0033c57-da59-4b08-a288-80753c19b58b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:08.187853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2cab45-4ac0-4068-ad99-9e5f0cebd0b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:08.188571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cab45-4ac0-4068-ad99-9e5f0cebd0b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:08.188858 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cab45-4ac0-4068-ad99-9e5f0cebd0b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:08.189146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2cab45-4ac0-4068-ad99-9e5f0cebd0b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:08.210652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cab45-4ac0-4068-ad99-9e5f0cebd0b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:08.213144 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2cab45-4ac0-4068-ad99-9e5f0cebd0b6 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:08.248882 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4214/8420] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:08 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:08.485617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:08.586884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f89f57-b094-47bc-9979-35f5a8d647ae None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:08.593398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:08.594589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:08.594891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:08.595312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] PATH_INFO: `/v3/users/0ec0728129e5453286bec3fcf7266638` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:08.596733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ec0728129e5453286bec3fcf7266638)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:08.599124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:08.662771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ec0728129e5453286bec3fcf7266638'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:08.663925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ec0728129e5453286bec3fcf7266638'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:08.674567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ec0728129e5453286bec3fcf7266638'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:08.675299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ec0728129e5453286bec3fcf7266638'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:08.684041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ec0728129e5453286bec3fcf7266638'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:08.708827 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4207/8421] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:49:08 2022] DELETE /identity/v3/users/0ec0728129e5453286bec3fcf7266638 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:08.713458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:08.713948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:08.714072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:08.734538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:08.735803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:08.811986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4215/8422] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:08.824771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:08.826309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:08.843631 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:08.907471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb89d8-c1d3-4f70-8525-b2ce217e5076 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:08.911375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:08.912046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:08.912848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:08.912848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:08.924244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:08.925952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:08.937142 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4208/8423] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:49:09.657701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:09.659695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:09.681230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c9bc5-8a8a-4e8f-ba75-c7acede0b33a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:09.701384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:09.705140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:09.706634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:09.707075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] PATH_INFO: `/v3/projects/c36d6171fc0c4c9594e21fb2cb0d287a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:09.709043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c36d6171fc0c4c9594e21fb2cb0d287a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:09.711560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:09.854025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c36d6171fc0c4c9594e21fb2cb0d287a', 'request_id': 'req-78a28e44-74c8-4fee-bb0e-93de16ead193'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:09.867844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c36d6171fc0c4c9594e21fb2cb0d287a', 'request_id': 'req-78a28e44-74c8-4fee-bb0e-93de16ead193'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:09.894049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c36d6171fc0c4c9594e21fb2cb0d287a', 'request_id': 'req-78a28e44-74c8-4fee-bb0e-93de16ead193'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:09.910258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] The token cache is being invalidate because project c36d6171fc0c4c9594e21fb2cb0d287a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:09.910552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:09.911998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:09.916587 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4216/8424] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:09 2022] DELETE /identity/v3/projects/c36d6171fc0c4c9594e21fb2cb0d287a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:09.918830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:09.933227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c7c8c-aa4a-488b-a8b6-e38ab623b9bf service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:10.081917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:10.083075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:10.083366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:10.083643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] PATH_INFO: `/v3/users/265bbaaee020480ab00b4cc08ac25e1d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:10.085223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265bbaaee020480ab00b4cc08ac25e1d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:10.087649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:10.190839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265bbaaee020480ab00b4cc08ac25e1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.191724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265bbaaee020480ab00b4cc08ac25e1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.217520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265bbaaee020480ab00b4cc08ac25e1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.218318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265bbaaee020480ab00b4cc08ac25e1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.232397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-1cf88450-cb6c-46e5-8666-654fa13c23d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265bbaaee020480ab00b4cc08ac25e1d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.276867 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4209/8425] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:49:09 2022] DELETE /identity/v3/users/265bbaaee020480ab00b4cc08ac25e1d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:10.645046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:10.646572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:10.660890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a28e44-74c8-4fee-bb0e-93de16ead193 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:10.673619 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:10.736857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:10.737632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:10.738032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:10.738544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] PATH_INFO: `/v3/projects/503c9c45f3764202b93dd9f6d58bc39d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:10.739974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503c9c45f3764202b93dd9f6d58bc39d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:10.742776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:10.809875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503c9c45f3764202b93dd9f6d58bc39d', 'request_id': 'req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.820607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503c9c45f3764202b93dd9f6d58bc39d', 'request_id': 'req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.829467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503c9c45f3764202b93dd9f6d58bc39d', 'request_id': 'req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.843307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] The token cache is being invalidate because project 503c9c45f3764202b93dd9f6d58bc39d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:10.843623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.844753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b320a5c0-f06c-4185-9351-eb3fdf4c9fc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:10.848390 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4217/8426] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:10 2022] DELETE /identity/v3/projects/503c9c45f3764202b93dd9f6d58bc39d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:10.855389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:10.855875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:10.856440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:10.924362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:10.926569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:10.999237 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:11.098963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4210/8427] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:11.119125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.119983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.120952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.166069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:11.171667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:11.191614 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4218/8428] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:11.197088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:11.214501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa8b52f-7e56-45ab-b64e-9aa0a8a5bc9a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:11.228030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:11.229064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.229755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.230208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.231669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:49:11.232169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:11.237780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:11.261386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:11.274105 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4211/8429] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:49:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:49:11.285778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6526fa6f-c5f2-4752-9a17-838e9a26f633 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:11.293033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:11.294011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.294464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.295054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.295935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:11.319064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:11.359746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4219/8430] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:11 2022] POST /identity/v3/projects => generated 357 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:11.364922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:11.376386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743ad12-a03a-40fe-9648-fc28acb4b5d1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:11.499243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:11.499970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.500275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.500584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.501308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:11.503674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:11.550588 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4212/8431] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:11 2022] POST /identity/v3/users => generated 279 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:11.555003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:11.578204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eacfc53-fd4c-45de-9fdf-60688977542c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:11.583349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:11.584119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.584448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.584853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.585470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:11.587314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:11.608251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:11.625408 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4220/8432] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:11.630275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91164c3b-c29b-48df-92ff-ac7841452a27 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:11.638461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450362fc-fc20-4cb5-bce9-93f750960069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:11.639487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450362fc-fc20-4cb5-bce9-93f750960069 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.639876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450362fc-fc20-4cb5-bce9-93f750960069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.640257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450362fc-fc20-4cb5-bce9-93f750960069 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.641180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450362fc-fc20-4cb5-bce9-93f750960069 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:11.642939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450362fc-fc20-4cb5-bce9-93f750960069 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:11.679512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:11.687381 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4213/8433] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:11 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:49:11.692209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835857c9-94cb-45ca-afe9-54adaa6fed26 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:11.709915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:11.711161 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.711642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.712018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] PATH_INFO: `/v3/projects/6b386750066a41b1bea9f513f4bb445e/users/96719e3f6a874c4ead5a225b8c4f78eb/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.748373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b386750066a41b1bea9f513f4bb445e, user_id=96719e3f6a874c4ead5a225b8c4f78eb, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:11.752389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:11.829058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:11.829650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:11.830147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:11.836219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4221/8434] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:11 2022] PUT /identity/v3/projects/6b386750066a41b1bea9f513f4bb445e/users/96719e3f6a874c4ead5a225b8c4f78eb/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:11.911667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] MFA Rules not processed for user `96719e3f6a874c4ead5a225b8c4f78eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:11.917445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:12.106279 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4214/8435] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:11 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:12.111265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.237545 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:12.292981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc53b4-49c7-4f53-92e7-c895963062af admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:12.302741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:12.303806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.304381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.304969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.306449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:12.320154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:12.358046 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4222/8436] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:12 2022] POST /identity/v3/projects => generated 357 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:12.361871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.375909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863c2473-b82e-4a7a-8388-7a457daf1796 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:12.409561 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:12.452009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:12.453028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.453601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.453985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.454802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:12.458182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:12.496454 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4215/8437] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:12 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:49:12.501098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.527265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd923e9e-9d29-406b-94d5-8164096a071a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:12.536503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:12.537512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.538004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.538542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.539624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:12.541848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:12.556038 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4223/8438] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:12.559901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.574323 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bdab8-5cb3-4c91-8842-b7d6e349169d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:12.580951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:12.582927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.583453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.583954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] PATH_INFO: `/v3/projects/2a41ce3d135a41f89e01c29937e177dc/users/4e145d635ee942d6a28d5058a9171b64/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.622560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a41ce3d135a41f89e01c29937e177dc, user_id=4e145d635ee942d6a28d5058a9171b64, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:12.626545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:12.673758 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4216/8439] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:12 2022] PUT /identity/v3/projects/2a41ce3d135a41f89e01c29937e177dc/users/4e145d635ee942d6a28d5058a9171b64/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:49:12.678365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.698085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568390e-64c7-443a-9ce0-4b18d5e0142d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:12.764711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba8a79-2c8b-4ca2-ba7b-c0396ee627c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:12.765747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8a79-2c8b-4ca2-ba7b-c0396ee627c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.766221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8a79-2c8b-4ca2-ba7b-c0396ee627c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.766712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba8a79-2c8b-4ca2-ba7b-c0396ee627c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.767536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8a79-2c8b-4ca2-ba7b-c0396ee627c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:12.769290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba8a79-2c8b-4ca2-ba7b-c0396ee627c8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:12.784297 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4224/8440] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:12 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:12.785618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.801930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72df1391-07d4-490e-bfe4-b5a0dfa3ddc2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:12.809128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:12.810258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.810922 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.811307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] PATH_INFO: `/v3/projects/2a41ce3d135a41f89e01c29937e177dc/users/4e145d635ee942d6a28d5058a9171b64/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.814024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a41ce3d135a41f89e01c29937e177dc, user_id=4e145d635ee942d6a28d5058a9171b64, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:12.817465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:12.832314 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4217/8441] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:12 2022] PUT /identity/v3/projects/2a41ce3d135a41f89e01c29937e177dc/users/4e145d635ee942d6a28d5058a9171b64/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:12.843706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:12.844296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:12.844717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:12.876449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] MFA Rules not processed for user `4e145d635ee942d6a28d5058a9171b64`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:12.878428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:12.969901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4225/8442] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:12 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:12.982761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:12.984705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:13.060757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dc9a0b-3f05-45b0-8cca-4c15dd3ff70c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:13.066288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:13.066901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:13.067182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:13.067454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:13.078761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:13.080656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:13.091377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4218/8443] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:12 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:13.169933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:13.183413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef81bb-ac46-4422-ba70-e9006d676a92 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:13.187271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79872b4a-fd6a-4555-8d43-8846ebaef220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:13.187933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79872b4a-fd6a-4555-8d43-8846ebaef220 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:13.188213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79872b4a-fd6a-4555-8d43-8846ebaef220 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:13.188512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79872b4a-fd6a-4555-8d43-8846ebaef220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:13.226214 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:13.254234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79872b4a-fd6a-4555-8d43-8846ebaef220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:13.255614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79872b4a-fd6a-4555-8d43-8846ebaef220 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:13.266085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4226/8444] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:13 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:17.516141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:17.538722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:17.717738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dccaf5-19e9-4362-8f3b-33d74825ae59 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:17.726596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:17.727443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:17.727803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:17.728090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:17.730150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:17.768762 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:17.837807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:17.839859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:17.872377 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4219/8445] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:49:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:49:18.521769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:18.522250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:18.522324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:18.542607 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] MFA Rules not processed for user `22e26c46a62a417aacfbafb054eb8752`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:18.544232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:18.674433 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4227/8446] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:23.373864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:23.377016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:23.458783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19b130a-8e6c-494f-8f74-f19e0b3b5ca0 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:23.463732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:23.464801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:23.465239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:23.465667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:23.467863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:23.482617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:23.484930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1096b8f4-ad6c-4529-8b55-060b27e42534 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:23.499437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4220/8447] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:26.933514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:26.935008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:26.967946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed694b2-714a-4dac-9a58-2b13628f0dce None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:26.976199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:26.976917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:26.977199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:26.977474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:26.986478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:27.147990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:27.150639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:27.172140 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4228/8448] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:31.129849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:31.130655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:31.131200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:31.152022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] MFA Rules not processed for user `dd4c7b18771f48479940ad67779109b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:31.155041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:31.237553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4221/8449] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:34.196972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:34.210996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b3823-1756-4ad7-9186-330970ad11ff service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:34.215097 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:34.216008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:34.216556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:34.216903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:34.219137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:34.232777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:34.234249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd11d4-3847-4aa9-9383-4957ef08b7d1 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:34.254723 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4229/8450] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:41.017233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:41.095386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb36eb4-f626-43a3-8a91-8bf1dde7915d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:41.100510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:41.101751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:41.102451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:41.102744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] PATH_INFO: `/v3/users/96719e3f6a874c4ead5a225b8c4f78eb` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:41.104053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96719e3f6a874c4ead5a225b8c4f78eb)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:41.106052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:41.123628 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:41.172669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96719e3f6a874c4ead5a225b8c4f78eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.173355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96719e3f6a874c4ead5a225b8c4f78eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.186040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96719e3f6a874c4ead5a225b8c4f78eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.186690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96719e3f6a874c4ead5a225b8c4f78eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.197864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96719e3f6a874c4ead5a225b8c4f78eb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.221558 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4222/8451] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:49:41 2022] DELETE /identity/v3/users/96719e3f6a874c4ead5a225b8c4f78eb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:41.225951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:41.226394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:41.227691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:41.257408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:41.258672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:41.324102 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:41.340371 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4230/8452] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:41.354080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:41.355860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:41.422227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef86e2-963e-45bd-9232-1dc2661ec632 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:41.425911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:41.426582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:41.426872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:41.427150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:41.437438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:41.438992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:41.451155 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4223/8453] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:49:41.794303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:41.801079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:41.818312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3f8dd-53e9-4a0e-8f43-f59d2ec49b28 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:41.826959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:41.828169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:41.828646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:41.829072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] PATH_INFO: `/v3/projects/6b386750066a41b1bea9f513f4bb445e` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:41.830886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b386750066a41b1bea9f513f4bb445e)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:41.833608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:41.897329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b386750066a41b1bea9f513f4bb445e', 'request_id': 'req-bf13e45f-2aff-47f5-92f8-28d3fc64487f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.914216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b386750066a41b1bea9f513f4bb445e', 'request_id': 'req-bf13e45f-2aff-47f5-92f8-28d3fc64487f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.922290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b386750066a41b1bea9f513f4bb445e', 'request_id': 'req-bf13e45f-2aff-47f5-92f8-28d3fc64487f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.935912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] The token cache is being invalidate because project 6b386750066a41b1bea9f513f4bb445e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:41.936283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.937365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:41.939483 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4231/8454] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:41 2022] DELETE /identity/v3/projects/6b386750066a41b1bea9f513f4bb445e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:41.943803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:41.954462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc804b73-28ae-4891-b28f-5775b8258af0 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:42.021549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:42.022455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:42.022776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:42.023001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] PATH_INFO: `/v3/users/4e145d635ee942d6a28d5058a9171b64` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:42.024215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e145d635ee942d6a28d5058a9171b64)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:42.026236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:42.085300 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:42.102377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e145d635ee942d6a28d5058a9171b64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.103220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e145d635ee942d6a28d5058a9171b64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.115704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e145d635ee942d6a28d5058a9171b64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.116611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e145d635ee942d6a28d5058a9171b64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.125340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-996de18a-d57c-4632-b39f-59eaf0a3f11b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e145d635ee942d6a28d5058a9171b64'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.150265 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4224/8455] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:49:41 2022] DELETE /identity/v3/users/4e145d635ee942d6a28d5058a9171b64 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:42.447740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:42.449909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:42.470200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13e45f-2aff-47f5-92f8-28d3fc64487f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:42.531667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:42.532591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:42.532869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:42.533138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] PATH_INFO: `/v3/projects/2a41ce3d135a41f89e01c29937e177dc` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:42.534341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a41ce3d135a41f89e01c29937e177dc)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:42.536332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:42.585254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a41ce3d135a41f89e01c29937e177dc', 'request_id': 'req-c9b97636-fe4e-4956-8368-adb427b87496'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.596555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a41ce3d135a41f89e01c29937e177dc', 'request_id': 'req-c9b97636-fe4e-4956-8368-adb427b87496'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.605534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a41ce3d135a41f89e01c29937e177dc', 'request_id': 'req-c9b97636-fe4e-4956-8368-adb427b87496'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.617123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] The token cache is being invalidate because project 2a41ce3d135a41f89e01c29937e177dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:49:42.617404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.618079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c9b97636-fe4e-4956-8368-adb427b87496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:49:42.619672 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4232/8456] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:49:42 2022] DELETE /identity/v3/projects/2a41ce3d135a41f89e01c29937e177dc => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:42.625099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:42.625396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:42.626042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:42.645934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:42.647204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:42.746023 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4225/8457] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:42.755741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:42.756411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:42.756866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:42.776025 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:42.789968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:42.792042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:42.806637 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4233/8458] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:42.810893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:42.830007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dae331-a0cd-4b2f-8cc8-4d968202b102 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:42.835591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:42.837025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:42.837382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:42.837757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:42.838570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:49:42.839261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:42.841215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:42.856527 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4226/8459] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:49:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:49:42.860863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:42.873851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc26d-0752-45d8-89f9-32b56711ae78 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:42.880748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:42.881737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:42.882131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:42.882626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:42.883667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:42.885787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:42.928405 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:42.928940 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4234/8460] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:42 2022] POST /identity/v3/projects => generated 383 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:42.939293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f47b-5117-4d50-a103-3e4d99eb94fb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.023721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.024471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.024761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.025036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.025796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.027763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.062730 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4227/8461] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:42 2022] POST /identity/v3/users => generated 292 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:43.066667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.078418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdda159-e6bb-4ad5-8592-da8dd700fa7e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.083477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.084242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.084654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.085028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.085864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.087583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.099717 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4235/8462] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:43.103556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.113951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a90d6b-924b-4fca-acc1-4101df84a3a1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.118805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cfd81-9fcb-477c-87df-bd137991190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.119481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cfd81-9fcb-477c-87df-bd137991190d admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.119764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cfd81-9fcb-477c-87df-bd137991190d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.120038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cfd81-9fcb-477c-87df-bd137991190d admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.120824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cfd81-9fcb-477c-87df-bd137991190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.122443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cfd81-9fcb-477c-87df-bd137991190d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.133528 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4228/8463] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:43.137842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.149503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ee993c-d7d6-4310-80f4-9738a5bcfb82 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.154620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.155752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.156104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.156589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] PATH_INFO: `/v3/projects/4de17636ff6f4833a2af15ab0bf2665f/users/abcc4c976e11403e80e8d785dcc6cbc0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.173403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de17636ff6f4833a2af15ab0bf2665f, user_id=abcc4c976e11403e80e8d785dcc6cbc0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.176605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.191082 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4236/8464] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:43 2022] PUT /identity/v3/projects/4de17636ff6f4833a2af15ab0bf2665f/users/abcc4c976e11403e80e8d785dcc6cbc0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:49:43.203215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.203505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.203703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.249369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] MFA Rules not processed for user `abcc4c976e11403e80e8d785dcc6cbc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:43.251033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:43.258999 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:43.329164 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4229/8465] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:43.333596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.407419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27827-2503-48f2-b410-b480b91d813a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.412641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.413760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.414158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.414504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.415293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.417744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.456656 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4237/8466] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:49:43 2022] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:43.457756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.473780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7d353-86da-4e6a-97f1-5b6c676d7bd3 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.567932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.568802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.569146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.569512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.570289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.572281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.599521 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4230/8467] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:49:43 2022] POST /identity/v3/users => generated 297 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:49:43.603750 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.619658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0480163f-0d3c-45f2-980e-a697d9126bfe admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.624401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.625089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.625367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.626003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.627156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.628483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.640090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4238/8468] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:49:43.644709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.656742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5bb82-7008-4c81-b0ed-22dc53d3555c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.662403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.663505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.663841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.664128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] PATH_INFO: `/v3/projects/151e336dd1e4462180effafb4d31f5e9/users/dd2044f8a13a4f73a002a74a796bebff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.684986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151e336dd1e4462180effafb4d31f5e9, user_id=dd2044f8a13a4f73a002a74a796bebff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.687713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.707296 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4231/8469] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:43 2022] PUT /identity/v3/projects/151e336dd1e4462180effafb4d31f5e9/users/dd2044f8a13a4f73a002a74a796bebff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:49:43.709620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.720971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f7ab5-1445-4bba-82ef-425257847961 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.792210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d439b8-17e5-4ff5-b73f-98b689ec2e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.793147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d439b8-17e5-4ff5-b73f-98b689ec2e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.793864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d439b8-17e5-4ff5-b73f-98b689ec2e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.794293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d439b8-17e5-4ff5-b73f-98b689ec2e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.795238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d439b8-17e5-4ff5-b73f-98b689ec2e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.797110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d439b8-17e5-4ff5-b73f-98b689ec2e85 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.814682 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4239/8470] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:49:43 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:49:43.814997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:43.825350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dc801-abde-4447-bbc4-7330634a0883 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:43.830973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:43.831738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.832107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.832487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] PATH_INFO: `/v3/projects/151e336dd1e4462180effafb4d31f5e9/users/dd2044f8a13a4f73a002a74a796bebff/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.835003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=151e336dd1e4462180effafb4d31f5e9, user_id=dd2044f8a13a4f73a002a74a796bebff, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:43.838708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:43.850117 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4232/8471] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:49:43 2022] PUT /identity/v3/projects/151e336dd1e4462180effafb4d31f5e9/users/dd2044f8a13a4f73a002a74a796bebff/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:49:43.865631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:43.867592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:43.868128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:43.918191 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:43.922711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] MFA Rules not processed for user `dd2044f8a13a4f73a002a74a796bebff`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:49:43.925219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:44.026780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4240/8472] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:49:43 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:49:44.036612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:44.038692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:44.150129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ebb8e-4a70-4d9c-bc3c-c9ab678311c1 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:44.154461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:44.155317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:44.155695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:44.156063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:44.171779 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:49:44.230679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:44.232186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:44.242498 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4233/8473] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:49:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:49:53.988258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:49:53.989799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:49:54.071658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f741097-b605-44dc-86f5-73589c516ad0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:49:54.076987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac59af71-e96a-4e8b-b9f9-2e247c87fc1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:49:54.077705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59af71-e96a-4e8b-b9f9-2e247c87fc1a service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:49:54.077991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59af71-e96a-4e8b-b9f9-2e247c87fc1a service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:49:54.078389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac59af71-e96a-4e8b-b9f9-2e247c87fc1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:49:54.089008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59af71-e96a-4e8b-b9f9-2e247c87fc1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:49:54.090631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac59af71-e96a-4e8b-b9f9-2e247c87fc1a service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:49:54.100120 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4241/8474] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:49:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:49:54.237662 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=21 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:04.096867 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=60 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:26.220127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:26.222448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:26.324144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23bd97-2346-47bc-98bb-f332a68b9317 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:26.329057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:26.329948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:26.330251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:26.330538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] PATH_INFO: `/v3/users/dd4c7b18771f48479940ad67779109b9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:26.332005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd4c7b18771f48479940ad67779109b9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:26.343444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:26.447379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd4c7b18771f48479940ad67779109b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:26.448065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd4c7b18771f48479940ad67779109b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:26.465354 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd4c7b18771f48479940ad67779109b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:26.465979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd4c7b18771f48479940ad67779109b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:26.478023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd4c7b18771f48479940ad67779109b9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:26.501468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4234/8475] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:50:26 2022] DELETE /identity/v3/users/dd4c7b18771f48479940ad67779109b9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:50:26.508616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:26.509551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:26.510012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:26.535185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:50:26.537138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:26.683995 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4242/8476] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:50:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:50:26.693929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:26.695775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:26.809797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e2ff6b-f272-4560-9bff-7334eaaa7d6b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:26.813460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:26.814129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:26.814419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:26.814698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:26.827973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:26.831390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:26.857369 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4235/8477] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:27.254172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:27.255650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:27.278148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab74532-9b75-4d93-99a0-f34162a183e9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:27.307014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:27.308819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:27.309851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:27.310790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] PATH_INFO: `/v3/projects/b60b917a7bcc4fc4ad0299a05630937a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:27.319249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60b917a7bcc4fc4ad0299a05630937a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:27.321933 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:27.459764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60b917a7bcc4fc4ad0299a05630937a', 'request_id': 'req-7bc8be36-07c7-46bb-8135-1f88ef4e570d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.474571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60b917a7bcc4fc4ad0299a05630937a', 'request_id': 'req-7bc8be36-07c7-46bb-8135-1f88ef4e570d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.482211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60b917a7bcc4fc4ad0299a05630937a', 'request_id': 'req-7bc8be36-07c7-46bb-8135-1f88ef4e570d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.511380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] The token cache is being invalidate because project b60b917a7bcc4fc4ad0299a05630937a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:50:27.512078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.514491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.516223 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4243/8478] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:50:27 2022] DELETE /identity/v3/projects/b60b917a7bcc4fc4ad0299a05630937a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:50:27.520681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:27.532106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d573fe-e8cf-4d81-88dd-a7594018e4d0 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:27.569917 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:27.641173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:27.642108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:27.642393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:27.642670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] PATH_INFO: `/v3/users/3d887acd1b414730ab4fb3eb1a9c99ff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:27.646991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d887acd1b414730ab4fb3eb1a9c99ff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:27.649040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:27.765281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d887acd1b414730ab4fb3eb1a9c99ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.766543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d887acd1b414730ab4fb3eb1a9c99ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.785045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d887acd1b414730ab4fb3eb1a9c99ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.788430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d887acd1b414730ab4fb3eb1a9c99ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.817543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-30ce9014-a510-4153-b0bd-f1b60c91371a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d887acd1b414730ab4fb3eb1a9c99ff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:27.886924 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4236/8479] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:50:27 2022] DELETE /identity/v3/users/3d887acd1b414730ab4fb3eb1a9c99ff => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:50:28.293514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:28.295133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:28.311918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8be36-07c7-46bb-8135-1f88ef4e570d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:28.399302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:28.400353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.400655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.400931 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] PATH_INFO: `/v3/projects/5a0e0d91bba1413f84d4aaa46ae3f5f7` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.402223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0e0d91bba1413f84d4aaa46ae3f5f7)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:28.404196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:28.439168 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:28.463771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0e0d91bba1413f84d4aaa46ae3f5f7', 'request_id': 'req-b672a566-90b2-495d-8402-4334b1f65fb1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:28.473840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0e0d91bba1413f84d4aaa46ae3f5f7', 'request_id': 'req-b672a566-90b2-495d-8402-4334b1f65fb1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:28.482476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0e0d91bba1413f84d4aaa46ae3f5f7', 'request_id': 'req-b672a566-90b2-495d-8402-4334b1f65fb1'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:28.497518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] The token cache is being invalidate because project 5a0e0d91bba1413f84d4aaa46ae3f5f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:50:28.498218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:28.499700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-b672a566-90b2-495d-8402-4334b1f65fb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:50:28.503077 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4244/8480] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:50:28 2022] DELETE /identity/v3/projects/5a0e0d91bba1413f84d4aaa46ae3f5f7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:50:28.508772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.509408 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.510766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.533695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:50:28.534923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:28.610818 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4237/8481] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:50:28.618867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.627487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.627768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.651043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:50:28.652489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:28.661695 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4245/8482] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:50:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:50:28.666162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:28.678935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae1c0a-bfb9-4122-aa7a-70b1deac3d54 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:28.684092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:28.685175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.685503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.685785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.686702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:50:28.687145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:28.689094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:28.712371 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4238/8483] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:50:28.718676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:28.730923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f706675-23e5-4744-a07b-591025dd93f6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:28.741100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:28.741501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.741781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.742054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.742904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:28.745255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:28.802312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:28.810906 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4246/8484] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:50:28 2022] POST /identity/v3/projects => generated 383 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:50:28.817543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe2553f-0165-417d-a5a1-6c8dfe507ea4 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:28.853153 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:28.895272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:28.895973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.896440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.896719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.897452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:28.901175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:28.933246 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4239/8485] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:50:28 2022] POST /identity/v3/users => generated 292 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:50:28.937876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:28.958030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa9e4c-7c0f-449f-9003-7f3d7c5eb3b6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:28.963727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:28.964620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:28.964831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:28.965108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:28.965850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:28.967546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:28.979887 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4247/8486] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:50:28.984006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:28.995159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cbabdc-57ff-4435-800a-ad0d63ef7516 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:29.002933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424ea317-3d71-45b8-acbb-335246ad8a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:29.003837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea317-3d71-45b8-acbb-335246ad8a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:29.004306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea317-3d71-45b8-acbb-335246ad8a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:29.005133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424ea317-3d71-45b8-acbb-335246ad8a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:29.005900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ea317-3d71-45b8-acbb-335246ad8a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:29.007601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424ea317-3d71-45b8-acbb-335246ad8a0f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:29.019971 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4240/8487] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:50:29.024456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:29.038236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e52df9-b080-453a-a6b7-1e8934124b0b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:29.045510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:29.046881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:29.047358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:29.047776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] PATH_INFO: `/v3/projects/396456a8ab89489ba74518c230d0854a/users/4298885ada06459e8a315d954bd8c1ed/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:29.084422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=396456a8ab89489ba74518c230d0854a, user_id=4298885ada06459e8a315d954bd8c1ed, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:29.087121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:29.120217 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4248/8488] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:50:29 2022] PUT /identity/v3/projects/396456a8ab89489ba74518c230d0854a/users/4298885ada06459e8a315d954bd8c1ed/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:50:29.121955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947122f-511d-4722-a99f-6917797e486e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:29.122251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947122f-511d-4722-a99f-6917797e486e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:29.122534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947122f-511d-4722-a99f-6917797e486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:29.145144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e947122f-511d-4722-a99f-6917797e486e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:50:29.146373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e947122f-511d-4722-a99f-6917797e486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:29.236472 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4241/8489] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:50:29.250057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:29.252419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:29.364647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b015c455-2464-495c-8a68-7f0b1f1a9a67 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:29.369438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:29.370199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:29.370560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:29.370815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:29.382062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:29.384232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:29.409174 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4249/8490] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:36.427149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:36.427614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:36.427614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:36.462054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] MFA Rules not processed for user `4298885ada06459e8a315d954bd8c1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:50:36.463283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:36.543164 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4242/8491] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:50:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:50:36.547641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:36.560092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bdee39-7244-4e34-933a-2cfed8adb312 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:36.565920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:36.567100 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:36.567240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:36.568295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:36.568295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:36.571706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:36.626295 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4250/8492] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:50:36 2022] POST /identity/v3/projects => generated 381 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:50:36.627502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:36.654536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24466d-7026-4163-8293-9c263c7886c8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:36.708837 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:36.742706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:36.743411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:36.743694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:36.743975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:36.744722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:36.747016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:36.779303 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4243/8493] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:50:36 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:50:36.783646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:36.799904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e338136-1ad8-430f-becc-4d85079edc73 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:36.820044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:36.821445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:36.822855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:36.823647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:36.825748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:36.830214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:36.849007 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4251/8494] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:50:36.853078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:36.868095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0088ad-9502-4757-8b38-ff3b1366d7a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:36.874441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:36.875664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:36.876043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:36.876451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] PATH_INFO: `/v3/projects/771b387fab924be28a3547253bdeaf8f/users/17c69e9abd18451a81e8b37d05406a40/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:36.901708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] RBAC: Authorizing `identity:create_grant(project_id=771b387fab924be28a3547253bdeaf8f, user_id=17c69e9abd18451a81e8b37d05406a40, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:36.904808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:36.927932 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4244/8495] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:50:36 2022] PUT /identity/v3/projects/771b387fab924be28a3547253bdeaf8f/users/17c69e9abd18451a81e8b37d05406a40/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:50:36.931186 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:36.955671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b272f7-4e8f-42de-ab7b-8e5836d72387 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:36.990732 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:37.117246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:37.117836 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:37.118117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:37.118392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:37.119142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:37.122473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:37.152146 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4252/8496] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:50:37.156601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:37.170453 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67220b3e-ebcf-43e2-81d0-88e3e4ae6bad admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:37.194666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:37.195340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:37.195598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:37.195966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:37.196154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] PATH_INFO: `/v3/projects/771b387fab924be28a3547253bdeaf8f/users/17c69e9abd18451a81e8b37d05406a40/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:37.203369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:37.207427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=771b387fab924be28a3547253bdeaf8f, user_id=17c69e9abd18451a81e8b37d05406a40, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:37.211067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:37.228192 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4245/8497] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:50:37 2022] PUT /identity/v3/projects/771b387fab924be28a3547253bdeaf8f/users/17c69e9abd18451a81e8b37d05406a40/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:50:37.337442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c4fab5-96cd-41ad-af7f-1eabd9e9662e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:37.449221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:37.453022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:37.453314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:37.453935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:37.457166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:37.558993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:37.561038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8782a311-c484-4079-9917-9ae314c10222 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:37.586877 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4253/8498] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:37 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:40.716221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:40.743911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354a8e8e-1afb-4665-82c2-54baf0a41397 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:40.753769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:40.755916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:40.756220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:40.756530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:40.762824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:40.910098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:40.912317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:40.938898 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4246/8499] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:45.914554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:45.915428 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:45.915867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:45.955160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] MFA Rules not processed for user `17c69e9abd18451a81e8b37d05406a40`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:50:45.956685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:45.979876 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:46.106928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4254/8500] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:50:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:50:46.130506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:50:46.133915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:50:46.233802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6764b8-94cb-4d07-b662-f25f07a870f3 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:50:46.237693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48eaa9f-ddeb-42af-b2d7-218563ad1d19 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:50:46.238379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48eaa9f-ddeb-42af-b2d7-218563ad1d19 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:50:46.238664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48eaa9f-ddeb-42af-b2d7-218563ad1d19 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:50:46.238940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48eaa9f-ddeb-42af-b2d7-218563ad1d19 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:50:46.303740 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:46.330674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48eaa9f-ddeb-42af-b2d7-218563ad1d19 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:50:46.332993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48eaa9f-ddeb-42af-b2d7-218563ad1d19 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:50:46.345976 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4247/8501] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:50:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:50:56.097215 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=24 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:50:56.339945 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:09.753409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:09.756192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:10.080476 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832c07c5-2377-44cd-a397-4c497edbdf0e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:10.089406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:10.090494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:10.092020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:10.092425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] PATH_INFO: `/v3/users/d48c53bdca214973a1f1bcabd8709b92` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:10.094245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48c53bdca214973a1f1bcabd8709b92)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:10.097099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:10.192367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48c53bdca214973a1f1bcabd8709b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:10.202624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48c53bdca214973a1f1bcabd8709b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:10.220378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48c53bdca214973a1f1bcabd8709b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:10.222017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48c53bdca214973a1f1bcabd8709b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:10.235297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48c53bdca214973a1f1bcabd8709b92'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:10.244103 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4255/8502] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:51:09 2022] DELETE /identity/v3/users/d48c53bdca214973a1f1bcabd8709b92 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:51:10.250899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:10.251654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:10.251654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:10.279685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:10.284120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:10.417867 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4248/8503] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:10.425318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:10.427373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:10.602443 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da921ef-e81a-4c82-bb1a-1a8410ab770d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:10.611322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d888c632-64c2-4ab1-bf31-17b962f33c82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:10.613052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c632-64c2-4ab1-bf31-17b962f33c82 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:10.613341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c632-64c2-4ab1-bf31-17b962f33c82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:10.613623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d888c632-64c2-4ab1-bf31-17b962f33c82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:10.630318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c632-64c2-4ab1-bf31-17b962f33c82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:10.634066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d888c632-64c2-4ab1-bf31-17b962f33c82 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:10.655282 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4256/8504] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:10.915512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:10.917407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:10.940539 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa49b-2bac-4e8a-a207-c857127f5aa9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:10.968818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:10.970470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:10.971482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:10.972063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] PATH_INFO: `/v3/projects/4113febee1994410a8b45a4097bd7bd7` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:10.974388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4113febee1994410a8b45a4097bd7bd7)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:10.991114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.075288 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4113febee1994410a8b45a4097bd7bd7', 'request_id': 'req-e8532b37-6715-47c0-9e4e-1964a9746f32'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:11.084078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4113febee1994410a8b45a4097bd7bd7', 'request_id': 'req-e8532b37-6715-47c0-9e4e-1964a9746f32'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:11.091215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4113febee1994410a8b45a4097bd7bd7', 'request_id': 'req-e8532b37-6715-47c0-9e4e-1964a9746f32'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:11.113581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] The token cache is being invalidate because project 4113febee1994410a8b45a4097bd7bd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:51:11.114784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:11.115764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e8532b37-6715-47c0-9e4e-1964a9746f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:11.117711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4249/8505] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:51:10 2022] DELETE /identity/v3/projects/4113febee1994410a8b45a4097bd7bd7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:11.123719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.124410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.124516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.167815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:11.169248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:11.211411 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:11.281797 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4257/8506] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:51:11.289877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.290335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.290612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.327521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:11.328805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:11.340812 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4250/8507] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:11.342378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.355168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ade7c-8952-4c45-9813-080831098cc9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:11.365737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:11.366442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.366730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.367009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.367765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:51:11.368081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:11.372033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.393939 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4258/8508] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:51:11.396180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.409864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883ea8f-3091-4e3c-8d92-4347c2ac3e29 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:11.414994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:11.415857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.416209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.416587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.417560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:11.420837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.463838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4251/8509] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:51:11 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:11.465099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.479115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b60fce-4b0e-4fda-be34-fd6b421e9516 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:11.555459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:11.556150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.556544 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.556828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.557531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:11.559478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.593180 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4259/8510] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:51:11 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:11.597197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.608450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4797b8c-96d3-4a88-8535-968268a54063 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:11.615710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:11.616523 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.617021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.617386 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.618204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:11.619918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.632490 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4252/8511] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:51:11.636495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.647857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b36ea-0729-4c4d-9e24-1bbb28c21ecd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:11.652815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa2c32-2cd4-4c91-ab9b-17791bfe0fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:11.653557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2c32-2cd4-4c91-ab9b-17791bfe0fa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.653869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2c32-2cd4-4c91-ab9b-17791bfe0fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.654147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa2c32-2cd4-4c91-ab9b-17791bfe0fa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.654888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2c32-2cd4-4c91-ab9b-17791bfe0fa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:11.656572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aa2c32-2cd4-4c91-ab9b-17791bfe0fa0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.668252 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4260/8512] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:51:11.672553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.683816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8caa80-913b-44aa-8ef1-7d4b7c162c7e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:11.688586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:11.689483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.689767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.690044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] PATH_INFO: `/v3/projects/c31d257aa74d4f87a1f2cca00ea910d1/users/65ccdedd4efe447c80548fa39b1b444b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.706242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31d257aa74d4f87a1f2cca00ea910d1, user_id=65ccdedd4efe447c80548fa39b1b444b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:11.708886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:11.736930 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4253/8513] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:51:11 2022] PUT /identity/v3/projects/c31d257aa74d4f87a1f2cca00ea910d1/users/65ccdedd4efe447c80548fa39b1b444b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:51:11.746129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:11.746838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:11.747127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:11.775264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:11.777394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:11.877374 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4261/8514] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:11.889295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:11.891540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:11.922025 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:12.010327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73d09c-9687-41c7-9068-1bd64fa8778f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:12.016851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:12.017980 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:12.018463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:12.018942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:12.035675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:12.038480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:12.076471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4254/8515] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:13.195016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:13.208433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:13.247985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119da2d-a43b-45a4-a71f-ac85d25a6eb0 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:13.254638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:13.255744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:13.256436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:13.257624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:13.264238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:13.294760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:13.296919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:13.325967 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4262/8516] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:14.110945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:14.112552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:14.135349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad500839-1e0a-4d32-907b-2d8a0f121b5b service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:14.155034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:14.156199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:14.156616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:14.157003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] PATH_INFO: `/v3/users/22e26c46a62a417aacfbafb054eb8752` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:14.158411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e26c46a62a417aacfbafb054eb8752)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:14.161347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:14.224515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e26c46a62a417aacfbafb054eb8752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.225780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e26c46a62a417aacfbafb054eb8752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.238586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e26c46a62a417aacfbafb054eb8752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.239591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e26c46a62a417aacfbafb054eb8752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.252095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9a02b310-dbac-4dcf-a67c-1f393bcd9a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e26c46a62a417aacfbafb054eb8752'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.289251 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4255/8517] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:51:14 2022] DELETE /identity/v3/users/22e26c46a62a417aacfbafb054eb8752 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:14.546439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:14.557698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4376e5a-c2c3-468a-a065-d644f232dd16 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:14.597458 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:14.678079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:14.679137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:14.679282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:14.679517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] PATH_INFO: `/v3/projects/19222bc9dc0b42d896fdb963f625e722` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:14.680991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19222bc9dc0b42d896fdb963f625e722)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:14.683237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:14.758045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19222bc9dc0b42d896fdb963f625e722', 'request_id': 'req-0c2048d3-5f28-4d04-90d2-937544266ab5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.774530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19222bc9dc0b42d896fdb963f625e722', 'request_id': 'req-0c2048d3-5f28-4d04-90d2-937544266ab5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.791320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19222bc9dc0b42d896fdb963f625e722', 'request_id': 'req-0c2048d3-5f28-4d04-90d2-937544266ab5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.807683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] The token cache is being invalidate because project 19222bc9dc0b42d896fdb963f625e722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:51:14.808051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.808793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-0c2048d3-5f28-4d04-90d2-937544266ab5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:14.818237 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4263/8518] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:51:14 2022] DELETE /identity/v3/projects/19222bc9dc0b42d896fdb963f625e722 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:14.819014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:14.819305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:14.819581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:14.847116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:14.848771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:14.951968 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4256/8519] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:14.960493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:14.960818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:14.961049 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:14.984992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:14.986285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:14.999872 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4264/8520] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:51:15.001316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.012112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b5ef9-47f0-4e0e-bc10-cbae14de001c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.017678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.018659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.019367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.019640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.020585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:51:15.020886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.022650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.038448 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4257/8521] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:51:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:51:15.044515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.059105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1578ab-924b-4aac-b54c-586028bf7f2c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.066762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.067459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.067739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.068013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.068911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.071093 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.121901 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4265/8522] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:51:15 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:51:15.123413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.135746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ac01d-d26d-4982-9929-35fa1f941b2e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.168989 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:15.239620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.240995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.241397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.241671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.242997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.245965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.291333 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4258/8523] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:51:15 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:15.297849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.315943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d87de3-52dc-4047-895f-f61a4cffd13e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.334480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.335351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.335726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.336101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.337044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.338829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.361255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.361780 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4266/8524] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:51:15.372717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4810830b-eca9-42b3-bdd5-a3e53c965f6a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.379806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aeab68-fb01-40d2-bb64-da4805dc468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.380542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeab68-fb01-40d2-bb64-da4805dc468b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.380829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeab68-fb01-40d2-bb64-da4805dc468b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.381105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aeab68-fb01-40d2-bb64-da4805dc468b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.381854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeab68-fb01-40d2-bb64-da4805dc468b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.383533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aeab68-fb01-40d2-bb64-da4805dc468b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.408376 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4259/8525] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:51:15.412388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.427663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d8f1e6-744a-433f-8355-c80cbdb9d856 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.432817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.433631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.433903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.434168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] PATH_INFO: `/v3/projects/4f7e04546b8149828b7502d87c4b07ac/users/dc2d7ad6c58e40d5a34f0a5330b3d84c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.453355 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7e04546b8149828b7502d87c4b07ac, user_id=dc2d7ad6c58e40d5a34f0a5330b3d84c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.456251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.476834 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4267/8526] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:51:15 2022] PUT /identity/v3/projects/4f7e04546b8149828b7502d87c4b07ac/users/dc2d7ad6c58e40d5a34f0a5330b3d84c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:15.479182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd84e4-17e4-435d-84eb-5d25b6b453f3 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.479471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd84e4-17e4-435d-84eb-5d25b6b453f3 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.479745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd84e4-17e4-435d-84eb-5d25b6b453f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.515514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08cd84e4-17e4-435d-84eb-5d25b6b453f3 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:15.516786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08cd84e4-17e4-435d-84eb-5d25b6b453f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:15.587158 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4260/8527] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:15.598454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:15.601077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:15.676649 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:15.701077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5004009-39b2-49d6-8bf2-9c73ae29a2d8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:15.715604 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:15.716583 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:15.717111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:15.717545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:15.735769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:15.739953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:15.755332 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4268/8528] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:18.654660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:18.655297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:18.655297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:18.717065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] MFA Rules not processed for user `65ccdedd4efe447c80548fa39b1b444b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:18.718376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:18.833592 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4261/8529] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:18.838678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:18.840036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:18.854233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbd9fb-20bf-4559-893d-b4865310602a service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:18.859091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:18.859772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:18.860054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:18.860332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:18.861089 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:18.863031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:18.906465 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4269/8530] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:51:18 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:18.907145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:18.925629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47678dcf-75d5-4e54-881e-d41435656b72 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:18.996407 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:19.064582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:19.065359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:19.065652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:19.065929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:19.066659 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:19.069608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:19.123909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4262/8531] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:51:18 2022] POST /identity/v3/users => generated 297 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:19.125799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:19.140124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666bfd6-e30d-46a2-b5dd-37f43154b034 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:19.153493 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:19.154208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:19.154494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:19.154774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:19.155602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:19.157307 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:19.174746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:19.175868 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4270/8532] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:51:19.187094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a161137-5e32-43cf-9f8d-b329d419231b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:19.194001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:19.194817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:19.195102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:19.195377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] PATH_INFO: `/v3/projects/7617217a9be5446a9278037aaa46bcf0/users/90f2c5e033f040be97f1f0f895109063/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:19.212613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7617217a9be5446a9278037aaa46bcf0, user_id=90f2c5e033f040be97f1f0f895109063, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:19.215432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:19.239777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4263/8533] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:51:19 2022] PUT /identity/v3/projects/7617217a9be5446a9278037aaa46bcf0/users/90f2c5e033f040be97f1f0f895109063/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:19.241179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:19.252806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a2b5a3-d359-4671-bdbb-9805874672e4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:19.413761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:19.414665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:19.414948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:19.415218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:19.415956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:19.417716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:19.432402 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4271/8534] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:51:19.436672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:19.479213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c63efc2-53cf-4805-a51f-76c25260b0e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:19.501585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab609f6-d068-4ce5-9e49-0190ebd372c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:19.502540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab609f6-d068-4ce5-9e49-0190ebd372c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:19.502826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab609f6-d068-4ce5-9e49-0190ebd372c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:19.503103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab609f6-d068-4ce5-9e49-0190ebd372c5 admin admin] PATH_INFO: `/v3/projects/7617217a9be5446a9278037aaa46bcf0/users/90f2c5e033f040be97f1f0f895109063/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:19.511144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab609f6-d068-4ce5-9e49-0190ebd372c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7617217a9be5446a9278037aaa46bcf0, user_id=90f2c5e033f040be97f1f0f895109063, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:19.513953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab609f6-d068-4ce5-9e49-0190ebd372c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:19.532609 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4264/8535] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:51:19 2022] PUT /identity/v3/projects/7617217a9be5446a9278037aaa46bcf0/users/90f2c5e033f040be97f1f0f895109063/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:22.177608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:22.181113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:22.409584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bcd5a-63e9-47dd-9075-33ac54f338e7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:22.517577 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:22.540464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:22.546744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:22.547071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:22.547299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:22.552116 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:22.660037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:22.662673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:22.696145 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4272/8536] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:51:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:51:23.061633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:23.064438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:23.064806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:23.126608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] MFA Rules not processed for user `dc2d7ad6c58e40d5a34f0a5330b3d84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:23.127862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:23.297966 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4265/8537] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:23.302329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:23.478820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd0ac9d-d17e-4218-aa34-584535b88bf2 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:23.503458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:23.504171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:23.504486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:23.504764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:23.505574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:23.507956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:23.548801 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4273/8538] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:51:23 2022] POST /identity/v3/projects => generated 375 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:23.552817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:23.590090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84961332-2b3a-46f2-8dab-ba4cf50ddf50 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:23.716898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:23.717663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:23.717918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:23.718197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:23.718963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:23.721215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:23.791201 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4266/8539] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:51:23 2022] POST /identity/v3/users => generated 294 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:51:23.796267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:23.828987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545bf2d-7fcf-4098-943e-c61e470b9285 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:23.835664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:23.851015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:23.851318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:23.851622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:23.852429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:23.855111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:23.887969 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4274/8540] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:23 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:51:23.892645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:23.903919 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:23.923252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffde582-11c4-4c62-a7ef-a217bcb539c2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:23.933841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:23.936553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:23.938116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:23.939022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] PATH_INFO: `/v3/projects/4206bf6cbf3749f784d01f113029a5c3/users/f3839088e699410a9fc603e71620ebb9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:23.999224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4206bf6cbf3749f784d01f113029a5c3, user_id=f3839088e699410a9fc603e71620ebb9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:24.011962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:24.051045 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4267/8541] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:51:23 2022] PUT /identity/v3/projects/4206bf6cbf3749f784d01f113029a5c3/users/f3839088e699410a9fc603e71620ebb9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:24.055550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:24.067814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee30e8-d9da-43d2-8216-43ffe71da8bc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:24.307373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:24.310215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:24.310697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:24.311162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:24.312094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:24.330715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:24.339309 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:24.361109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4275/8542] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:51:24 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:51:24.365141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:24.381792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f14e1c8-3108-47aa-a6dc-bab08f77edeb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:24.410094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64258552-d3ee-4f00-904e-066846b227c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:24.411209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64258552-d3ee-4f00-904e-066846b227c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:24.411560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64258552-d3ee-4f00-904e-066846b227c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:24.411844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64258552-d3ee-4f00-904e-066846b227c5 admin admin] PATH_INFO: `/v3/projects/4206bf6cbf3749f784d01f113029a5c3/users/f3839088e699410a9fc603e71620ebb9/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:24.415105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64258552-d3ee-4f00-904e-066846b227c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4206bf6cbf3749f784d01f113029a5c3, user_id=f3839088e699410a9fc603e71620ebb9, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:24.418744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64258552-d3ee-4f00-904e-066846b227c5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:24.445462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4268/8543] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:51:24 2022] PUT /identity/v3/projects/4206bf6cbf3749f784d01f113029a5c3/users/f3839088e699410a9fc603e71620ebb9/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:28.212018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:28.350518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2479abea-646e-4050-86e5-36fc5cf0e145 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:28.513877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:28.516237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:28.519004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:28.519313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:28.527031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:28.709449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:28.714646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:28.738537 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4276/8544] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:51:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:51:29.951971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:29.961020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:29.961712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:30.115866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] MFA Rules not processed for user `90f2c5e033f040be97f1f0f895109063`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:30.117126 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:30.326935 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4269/8545] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:30.337913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:30.340139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:30.475938 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:30.577779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79758db-3834-4ad9-82a2-bdd120275d5a service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:30.601149 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:30.602102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:30.602541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:30.602968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:30.632538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:30.654253 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:30.688755 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4277/8546] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:31.100947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:31.107563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:31.257810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a28276-8d3b-4cf0-8136-7bb6c805d88e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:31.264218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:31.265109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:31.265500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:31.265883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:31.269988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:31.287604 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:31.289673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ceb5f-1d22-40be-b884-9965eabe10f8 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:31.317426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4270/8547] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:31.798909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:31.800690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:31.829075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051daf5-391d-402f-867c-1e96ae31e03a service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:31.846492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:31.851880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:31.853384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:31.853964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:31.858129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:31.921560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:31.930240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:32.005268 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4278/8548] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:34.405033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39fb29-513f-4b88-b357-85b2b8aaf7e1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:34.406082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39fb29-513f-4b88-b357-85b2b8aaf7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:34.406533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39fb29-513f-4b88-b357-85b2b8aaf7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:34.576240 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-8c39fb29-513f-4b88-b357-85b2b8aaf7e1 None None] MFA Rules not processed for user `f3839088e699410a9fc603e71620ebb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:34.578892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8c39fb29-513f-4b88-b357-85b2b8aaf7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:34.690794 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:34.763542 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4271/8549] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:34.785660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:34.787852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:34.829243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad81c2f-7267-4fc0-a609-55a1acf58270 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:34.854630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:34.855594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:34.856048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:34.856587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:34.885920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:34.889814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:34.923271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4279/8550] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:35.053950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:35.054309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:35.054938 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:35.096224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] MFA Rules not processed for user `dc2d7ad6c58e40d5a34f0a5330b3d84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:35.103118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:35.250989 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4272/8551] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:37.104890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:37.165812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c03cf-bb8a-4912-b535-d5f23ea71961 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:37.193717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:37.194643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:37.200515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:37.201117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:37.209378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:37.261921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:37.264014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:37.310485 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4280/8552] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:44.686543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:44.749227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893500af-8964-4fc8-93fe-3f54c3a1e2a5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:44.780524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:44.781228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:44.781511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:44.781785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:44.797312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:44.835254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:44.837025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:44.886711 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4273/8553] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:47.296809 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=33 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:47.719349 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:47.918302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a0acf-36c4-4c12-9d4f-8c5de08f6938 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:47.928907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:47.929952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:47.930427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:47.930795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] PATH_INFO: `/v3/users/65ccdedd4efe447c80548fa39b1b444b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:47.932553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65ccdedd4efe447c80548fa39b1b444b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:47.935430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:48.059935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65ccdedd4efe447c80548fa39b1b444b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.088132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65ccdedd4efe447c80548fa39b1b444b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.124145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65ccdedd4efe447c80548fa39b1b444b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.125024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65ccdedd4efe447c80548fa39b1b444b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.148289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65ccdedd4efe447c80548fa39b1b444b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.157346 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4281/8554] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:51:47 2022] DELETE /identity/v3/users/65ccdedd4efe447c80548fa39b1b444b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:48.449746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:48.466680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535323e9-fd23-43c8-b391-f04fdff8e7dc service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:48.565475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:48.567689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:48.568081 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:48.568630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] PATH_INFO: `/v3/projects/c31d257aa74d4f87a1f2cca00ea910d1` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:48.570110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31d257aa74d4f87a1f2cca00ea910d1)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:48.572301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:48.660513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31d257aa74d4f87a1f2cca00ea910d1', 'request_id': 'req-8a414e0b-ec3f-4545-b231-39723f74e964'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.668812 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31d257aa74d4f87a1f2cca00ea910d1', 'request_id': 'req-8a414e0b-ec3f-4545-b231-39723f74e964'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.676746 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:48.682796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31d257aa74d4f87a1f2cca00ea910d1', 'request_id': 'req-8a414e0b-ec3f-4545-b231-39723f74e964'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.702946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] The token cache is being invalidate because project c31d257aa74d4f87a1f2cca00ea910d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:51:48.703731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.704954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.707876 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4274/8555] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:51:48 2022] DELETE /identity/v3/projects/c31d257aa74d4f87a1f2cca00ea910d1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:48.711642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:48.714598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:48.739286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9733a-91c4-4dde-b639-ff0aa05fa9e3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:48.809923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:48.811656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:48.812153 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:48.812686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] PATH_INFO: `/v3/users/90f2c5e033f040be97f1f0f895109063` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:48.814373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f2c5e033f040be97f1f0f895109063)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:48.816921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:48.847653 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:51:48.891383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f2c5e033f040be97f1f0f895109063'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.904736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f2c5e033f040be97f1f0f895109063'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.931575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f2c5e033f040be97f1f0f895109063'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.932841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f2c5e033f040be97f1f0f895109063'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.953171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f2c5e033f040be97f1f0f895109063'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:48.971277 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4282/8556] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:51:48 2022] DELETE /identity/v3/users/90f2c5e033f040be97f1f0f895109063 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:49.177676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:49.180673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:49.218382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a414e0b-ec3f-4545-b231-39723f74e964 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:49.410085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:49.411132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:49.411760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:49.412139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] PATH_INFO: `/v3/projects/7617217a9be5446a9278037aaa46bcf0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:49.414884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7617217a9be5446a9278037aaa46bcf0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:49.417785 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:49.497001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7617217a9be5446a9278037aaa46bcf0', 'request_id': 'req-dc647ee8-98d6-462d-8778-35081b4139e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:49.508191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7617217a9be5446a9278037aaa46bcf0', 'request_id': 'req-dc647ee8-98d6-462d-8778-35081b4139e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:49.516512 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7617217a9be5446a9278037aaa46bcf0', 'request_id': 'req-dc647ee8-98d6-462d-8778-35081b4139e7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:49.538982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] The token cache is being invalidate because project 7617217a9be5446a9278037aaa46bcf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:51:49.539471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:49.541214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc647ee8-98d6-462d-8778-35081b4139e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:51:49.544308 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4275/8557] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:51:49 2022] DELETE /identity/v3/projects/7617217a9be5446a9278037aaa46bcf0 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:51:50.762838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:50.766032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:50.862205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea244e-4879-424a-a101-0b1129aa3c30 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:50.934296 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:50.935168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:50.935286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:50.935511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:50.937949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:50.954728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:50.956451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:50.971922 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4283/8558] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:51:53.331631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:53.332165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:53.332249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:53.351063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] MFA Rules not processed for user `dc2d7ad6c58e40d5a34f0a5330b3d84c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:51:53.352300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:53.423461 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4276/8559] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:51:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:51:56.870424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:51:56.871912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:56.902552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956b789f-fa45-460e-b7ad-23a7fe2f852d service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:51:56.924822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:51:56.925479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:51:56.925947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:51:56.926360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:51:56.928450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:51:57.001480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:51:57.011707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:51:57.062107 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4284/8560] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:51:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:52:03.416379 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=9,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:07.033764 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:10.206731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:10.230538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a5d661-ad4a-412e-8944-3baaf5202323 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:10.236507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:10.238095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:10.238555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:10.239048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:10.242254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:10.401967 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:10.406270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fc5bd-a33e-46d1-9e2b-5f353a487041 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:10.437231 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4277/8561] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:20.413909 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=37 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:21.190512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:21.192302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:21.339618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9c336-cc28-4515-8286-9bb6123631e8 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:21.345043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:21.346241 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:21.346676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:21.347298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] PATH_INFO: `/v3/users/c6d16c41cc3d4368b18961ded33d267d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:21.348853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6d16c41cc3d4368b18961ded33d267d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:21.351906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:21.448899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6d16c41cc3d4368b18961ded33d267d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:21.465301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6d16c41cc3d4368b18961ded33d267d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:21.500118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6d16c41cc3d4368b18961ded33d267d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:21.501743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6d16c41cc3d4368b18961ded33d267d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:21.512221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6d16c41cc3d4368b18961ded33d267d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:21.524284 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4285/8562] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:52:21 2022] DELETE /identity/v3/users/c6d16c41cc3d4368b18961ded33d267d => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:21.525342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:21.525929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:21.526029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:21.564703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:21.568480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:21.674553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4278/8563] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:21.686706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:21.688270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:21.799154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cae691-a2a2-420e-a373-a167495c0264 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:21.804909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:21.805697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:21.806082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:21.806459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:21.817821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:21.819741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:21.833449 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4286/8564] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:22.219497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:22.221011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:22.253568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556f5fe-7d2d-4728-9790-d5196748c679 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:22.269465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:22.270693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:22.271136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:22.271556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] PATH_INFO: `/v3/projects/ba88502ff7534d2cacf1989bb4ba5b06` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:22.273846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba88502ff7534d2cacf1989bb4ba5b06)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:22.276146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:22.387248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba88502ff7534d2cacf1989bb4ba5b06', 'request_id': 'req-5d8d62b9-2835-4793-ba21-c41de9f75e8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.403006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba88502ff7534d2cacf1989bb4ba5b06', 'request_id': 'req-5d8d62b9-2835-4793-ba21-c41de9f75e8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.410819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba88502ff7534d2cacf1989bb4ba5b06', 'request_id': 'req-5d8d62b9-2835-4793-ba21-c41de9f75e8f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.434515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] The token cache is being invalidate because project ba88502ff7534d2cacf1989bb4ba5b06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:52:22.434840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.435555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.440643 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4279/8565] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:52:22 2022] DELETE /identity/v3/projects/ba88502ff7534d2cacf1989bb4ba5b06 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:22.442264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:22.456850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbf14a5-4f11-40ac-8bc4-11af17a51548 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:22.511194 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:22.591976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:22.593553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:22.594076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:22.594558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] PATH_INFO: `/v3/users/f5f3d69647aa4e6898f5e5f70f697aca` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:22.618552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5f3d69647aa4e6898f5e5f70f697aca)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:22.622666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:22.695943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5f3d69647aa4e6898f5e5f70f697aca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.708221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5f3d69647aa4e6898f5e5f70f697aca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.726830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5f3d69647aa4e6898f5e5f70f697aca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.730267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5f3d69647aa4e6898f5e5f70f697aca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.740736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-4fb3ee27-77c1-40b0-96eb-1d2fb19694e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5f3d69647aa4e6898f5e5f70f697aca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:22.752545 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4287/8566] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:52:22 2022] DELETE /identity/v3/users/f5f3d69647aa4e6898f5e5f70f697aca => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:23.054836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.058696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:23.079376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d62b9-2835-4793-ba21-c41de9f75e8f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.172608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.173758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.174342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.174693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] PATH_INFO: `/v3/projects/4e6b52bde8344250ba9a1c3993fef18b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.191693 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6b52bde8344250ba9a1c3993fef18b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.193950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:23.215791 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:23.259328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6b52bde8344250ba9a1c3993fef18b', 'request_id': 'req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.267441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6b52bde8344250ba9a1c3993fef18b', 'request_id': 'req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.274804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6b52bde8344250ba9a1c3993fef18b', 'request_id': 'req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.298278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] The token cache is being invalidate because project 4e6b52bde8344250ba9a1c3993fef18b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:52:23.299176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.299487 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.304414 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4280/8567] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:52:23 2022] DELETE /identity/v3/projects/4e6b52bde8344250ba9a1c3993fef18b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:23.308370 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef31c-4519-49a8-acb9-1d370f0f4b6f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.312570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef31c-4519-49a8-acb9-1d370f0f4b6f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.313379 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aef31c-4519-49a8-acb9-1d370f0f4b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.364877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54aef31c-4519-49a8-acb9-1d370f0f4b6f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:23.368803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54aef31c-4519-49a8-acb9-1d370f0f4b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:23.493579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.495860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:23.562460 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4288/8568] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:23.566321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.566808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.567265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.587790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:23.589462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:23.600642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7dd1c-9d33-4e18-9901-e2c37ae5f225 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.604298 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4289/8569] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:23.606166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.608934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.609899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.610192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.610470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] PATH_INFO: `/v3/users/dc2d7ad6c58e40d5a34f0a5330b3d84c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.612051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc2d7ad6c58e40d5a34f0a5330b3d84c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.614996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:23.617164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5e203-c0dd-49d0-8ba4-091f40b532a1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.624629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.625660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.626143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.627137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.628236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:52:23.629362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.631728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:23.646217 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4290/8570] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:52:23.650685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.662711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7520b4-3106-4d8a-88ee-9c8964ab7d0b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.668963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.669735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.670193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.670479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.671208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.673276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:23.684492 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:23.693052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc2d7ad6c58e40d5a34f0a5330b3d84c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.696012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc2d7ad6c58e40d5a34f0a5330b3d84c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.708335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc2d7ad6c58e40d5a34f0a5330b3d84c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.709468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc2d7ad6c58e40d5a34f0a5330b3d84c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.719302 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4291/8571] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:52:23 2022] POST /identity/v3/projects => generated 373 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:23.721118 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.722976 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:23.723364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc2d7ad6c58e40d5a34f0a5330b3d84c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:23.746302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4281/8572] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:52:23 2022] DELETE /identity/v3/users/dc2d7ad6c58e40d5a34f0a5330b3d84c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:23.805124 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649b6361-1ec6-411a-ade2-b4e2437837fa admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.875246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.877694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.878214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.878699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.879606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.881965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:23.916792 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4292/8573] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:52:23 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:23.921369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.938069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0adb8-082f-4412-a8b5-2010482d26ff admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.944757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.946100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.946595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.947877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.948867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.951182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:23.967302 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4282/8574] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:52:23.971170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:23.982233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9135a-ed93-4f99-9031-1672db51f44d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:23.987875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:23.988774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:23.988893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:23.989143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:23.990236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:23.991533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:24.013357 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4293/8575] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:52:24.017573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:24.032599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8ddb29-6ab6-40d0-8d52-0706b14ceb66 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:24.045152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:24.047295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:24.049311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1e8f-a143-46d5-8532-e8f3406c7114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:24.049991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1e8f-a143-46d5-8532-e8f3406c7114 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.050276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1e8f-a143-46d5-8532-e8f3406c7114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.050549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1e8f-a143-46d5-8532-e8f3406c7114 admin admin] PATH_INFO: `/v3/projects/e07bd423dec645e5880a1ad1b1a73c00/users/5f070a3e8dca4ed2921dcca7b93e21c0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.088885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023d14f-d1d8-4122-85f2-fdad07051bb3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:24.093940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:24.094952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.095332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.095706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] PATH_INFO: `/v3/projects/4f7e04546b8149828b7502d87c4b07ac` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.097643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7e04546b8149828b7502d87c4b07ac)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:24.100560 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:24.101047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:24.108742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1e8f-a143-46d5-8532-e8f3406c7114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07bd423dec645e5880a1ad1b1a73c00, user_id=5f070a3e8dca4ed2921dcca7b93e21c0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:24.113636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1e8f-a143-46d5-8532-e8f3406c7114 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:24.137738 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4283/8576] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:24 2022] PUT /identity/v3/projects/e07bd423dec645e5880a1ad1b1a73c00/users/5f070a3e8dca4ed2921dcca7b93e21c0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:24.144646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.144646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.145127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.172994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7e04546b8149828b7502d87c4b07ac', 'request_id': 'req-671b68e8-7679-4435-9bde-dfa9bc220a39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.174529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:24.176893 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:24.186227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7e04546b8149828b7502d87c4b07ac', 'request_id': 'req-671b68e8-7679-4435-9bde-dfa9bc220a39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.198754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7e04546b8149828b7502d87c4b07ac', 'request_id': 'req-671b68e8-7679-4435-9bde-dfa9bc220a39'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.209829 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:24.216255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] The token cache is being invalidate because project 4f7e04546b8149828b7502d87c4b07ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:52:24.217023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.218491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.221631 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4294/8577] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:52:24 2022] DELETE /identity/v3/projects/4f7e04546b8149828b7502d87c4b07ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:24.226012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:24.228222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:24.269648 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4284/8578] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:24.281004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:24.282771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:24.314268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671b68e8-7679-4435-9bde-dfa9bc220a39 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:24.320934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:24.322295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.322878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.323304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] PATH_INFO: `/v3/users/f3839088e699410a9fc603e71620ebb9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.325710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3839088e699410a9fc603e71620ebb9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:24.328165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:24.363033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c468708-5eaa-4cca-b78d-d155fa4c3445 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:24.368859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:24.369990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.370273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.370545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.385902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:24.388831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:24.397008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3839088e699410a9fc603e71620ebb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.403943 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4285/8579] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:52:24.407425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3839088e699410a9fc603e71620ebb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.424820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3839088e699410a9fc603e71620ebb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.427890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3839088e699410a9fc603e71620ebb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.438949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ddce794b-9403-4f26-853e-9bb865c190dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3839088e699410a9fc603e71620ebb9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.447013 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4295/8580] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:52:24 2022] DELETE /identity/v3/users/f3839088e699410a9fc603e71620ebb9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:24.677221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:24.695251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebdf13f-2159-499b-91e4-4c5cf6ffa260 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:24.790273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:24.791216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.791494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.791758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] PATH_INFO: `/v3/projects/4206bf6cbf3749f784d01f113029a5c3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.793054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4206bf6cbf3749f784d01f113029a5c3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:24.795042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:24.849202 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:24.867364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4206bf6cbf3749f784d01f113029a5c3', 'request_id': 'req-bb530673-0674-401a-89e5-bee9929fb7bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.875182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4206bf6cbf3749f784d01f113029a5c3', 'request_id': 'req-bb530673-0674-401a-89e5-bee9929fb7bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.881876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4206bf6cbf3749f784d01f113029a5c3', 'request_id': 'req-bb530673-0674-401a-89e5-bee9929fb7bd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.901308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] The token cache is being invalidate because project 4206bf6cbf3749f784d01f113029a5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:52:24.901614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.902416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb530673-0674-401a-89e5-bee9929fb7bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:24.907462 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4286/8581] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:52:24 2022] DELETE /identity/v3/projects/4206bf6cbf3749f784d01f113029a5c3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:24.909206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a69de-8666-4b77-882a-be28fced6afc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:24.909754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a69de-8666-4b77-882a-be28fced6afc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:24.909754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a69de-8666-4b77-882a-be28fced6afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:24.930730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-744a69de-8666-4b77-882a-be28fced6afc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:24.933073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-744a69de-8666-4b77-882a-be28fced6afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:25.028448 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4296/8582] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:25.030942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.031236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.031519 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.069395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:25.071248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:25.092457 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4287/8583] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:25.094793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a69de-8666-4b77-882a-be28fced6afc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.108201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a69de-8666-4b77-882a-be28fced6afc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.114676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.115472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.115826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.116172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.117019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:52:25.117394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.119670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.136382 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4297/8584] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:52:25.140878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.166972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f249d6-9e89-4bf4-ae10-f57833ba9554 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.171823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.172537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.172942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.173232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.173935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.175871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.217809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.225361 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:25.230892 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4288/8585] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:52:25 2022] POST /identity/v3/projects => generated 377 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:25.236658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7be0a-bcdb-41ab-8f0f-cd2da92dffbc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.317632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.318444 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.318730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.319209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.319962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.322510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.356202 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4298/8586] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:52:25 2022] POST /identity/v3/users => generated 289 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:25.357011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.374220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d61b55-5922-4bc4-b823-0f14e505ee24 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.381397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.382333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.383099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.383449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.384445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.386201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.400227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4289/8587] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:52:25.403535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.415921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8538e-c952-4786-9a1e-fb69659d86f2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.421267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dafde0-a364-4d9b-9586-256923a28e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.422085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafde0-a364-4d9b-9586-256923a28e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.422478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafde0-a364-4d9b-9586-256923a28e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.422824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dafde0-a364-4d9b-9586-256923a28e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.423638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafde0-a364-4d9b-9586-256923a28e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.425599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dafde0-a364-4d9b-9586-256923a28e10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.439067 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4299/8588] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:52:25.442892 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.458406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414a335-1283-4056-994c-a893eeda5ade admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.492290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.493613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.493895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.494241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] PATH_INFO: `/v3/projects/343d6a3561fa46fc9ca586b6661d78c8/users/7365119e3cc74e4fbfefd8d261fb3216/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.550761 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=343d6a3561fa46fc9ca586b6661d78c8, user_id=7365119e3cc74e4fbfefd8d261fb3216, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.559475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.586553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4290/8589] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:25 2022] PUT /identity/v3/projects/343d6a3561fa46fc9ca586b6661d78c8/users/7365119e3cc74e4fbfefd8d261fb3216/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:25.590305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142171b0-cd96-4089-a864-367439a245bc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.590600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142171b0-cd96-4089-a864-367439a245bc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.590885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142171b0-cd96-4089-a864-367439a245bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.622065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-142171b0-cd96-4089-a864-367439a245bc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:25.623322 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-142171b0-cd96-4089-a864-367439a245bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:25.748490 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4300/8590] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:25.758753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:25.760895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:25.916702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e771b-b5d4-4575-b4d9-e07eaae392fe admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:25.923492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:25.924674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:25.926015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:25.926600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:25.962588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:25.965747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:25.995196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4291/8591] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:30.523009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142171b0-cd96-4089-a864-367439a245bc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:30.525632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-142171b0-cd96-4089-a864-367439a245bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:30.753812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142171b0-cd96-4089-a864-367439a245bc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:30.772084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:30.772826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:30.773107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:30.773376 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:30.778050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:30.788766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:30.790341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:30.827899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e193640-2114-4c02-ba75-3f42c541daeb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:30.834386 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:30.837143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2e221-4835-4708-8f1e-0ba5a9671f58 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:30.859332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:30.860022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:30.860314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:30.860647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:30.863098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:30.872855 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4301/8592] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:30.912820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:30.914979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:30.940585 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4292/8593] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:52:30.969229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:30.969515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:30.969795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:31.044819 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:31.070075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] MFA Rules not processed for user `5f070a3e8dca4ed2921dcca7b93e21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:31.079995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:31.250500 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4302/8594] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:31.255199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:31.257090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:31.302543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760abe4-10ff-4b1d-aac0-2c0f1f5ec74a service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:31.321573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:31.322200 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:31.322614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:31.322760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:31.323469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:31.325714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:31.452109 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4293/8595] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:52:31 2022] POST /identity/v3/projects => generated 373 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:31.453423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:31.473584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a058fe9-c711-42e1-9617-a259f6a4a423 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:31.637778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:31.638635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:31.638923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:31.639199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:31.639913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:31.641914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:31.736878 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4303/8596] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:52:31 2022] POST /identity/v3/users => generated 293 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:31.741376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:31.764430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b1001-54bf-495d-8628-1733f006ec6e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:31.776254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:31.777028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:31.777318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:31.777610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:31.778366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:31.785285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:31.827319 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4294/8597] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:52:31.832587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:31.854000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ec075-ab2d-495b-a1a1-f6023503e94a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:31.880915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:31.881862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:31.882142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:31.882900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] PATH_INFO: `/v3/projects/9e4f3dc90fcc4571ba585ba2b880477d/users/d816ee1399d043839a9f73cbcf5f4de4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:31.940685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4f3dc90fcc4571ba585ba2b880477d, user_id=d816ee1399d043839a9f73cbcf5f4de4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:31.944596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:31.969327 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4304/8598] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:31 2022] PUT /identity/v3/projects/9e4f3dc90fcc4571ba585ba2b880477d/users/d816ee1399d043839a9f73cbcf5f4de4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:31.973006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:32.011511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21045e9-949b-4db3-8e35-7b33decbace6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:32.063102 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:32.166392 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00e6e5-1896-4317-ae72-bcf06e2b5f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:32.167202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00e6e5-1896-4317-ae72-bcf06e2b5f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:32.168661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00e6e5-1896-4317-ae72-bcf06e2b5f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:32.169040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00e6e5-1896-4317-ae72-bcf06e2b5f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:32.169970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00e6e5-1896-4317-ae72-bcf06e2b5f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:32.173657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00e6e5-1896-4317-ae72-bcf06e2b5f95 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:32.186114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4295/8599] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:52:32.189953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:32.209319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d99538-45c7-4ea4-b7c3-da49355c5310 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:32.228381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:32.229958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:32.230235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:32.230509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] PATH_INFO: `/v3/projects/9e4f3dc90fcc4571ba585ba2b880477d/users/d816ee1399d043839a9f73cbcf5f4de4/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:32.233839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e4f3dc90fcc4571ba585ba2b880477d, user_id=d816ee1399d043839a9f73cbcf5f4de4, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:32.245694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:32.269048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4305/8600] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:32 2022] PUT /identity/v3/projects/9e4f3dc90fcc4571ba585ba2b880477d/users/d816ee1399d043839a9f73cbcf5f4de4/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:36.217318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:36.219726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:36.220016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:36.283074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:36.286225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:36.541475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4296/8601] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:36.545141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:36.668540 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:36.684809 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ce860-9e07-43a3-a6ae-bfb628d6e403 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:36.704431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:36.705338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:36.713237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:36.713932 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:36.715032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:36.717811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:36.770974 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4306/8602] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:52:36 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:36.775406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:36.796477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36292e-b9fa-4ea0-831d-26f0009b3e9d None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:36.995414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:36.996132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:36.996518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:36.996797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:36.997526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:36.999520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:37.058071 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4297/8603] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:52:36 2022] POST /identity/v3/users => generated 294 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:37.059392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:37.077251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921cf33-6a70-44fd-accb-e086c5449c75 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:37.112075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:37.113006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:37.113463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:37.113887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:37.120283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:37.122870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:37.157037 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4307/8604] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:52:37.158057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:37.183052 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad709491-fd9f-45dc-abb0-a887aed7186b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:37.195684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:37.196709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:37.196996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:37.197280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] PATH_INFO: `/v3/projects/7f2f9dea02b64b7dbffe63954efcee5c/users/30953a926e3c42498f09a7a5892ee15c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:37.231146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2f9dea02b64b7dbffe63954efcee5c, user_id=30953a926e3c42498f09a7a5892ee15c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:37.234317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:37.261680 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4298/8605] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:37 2022] PUT /identity/v3/projects/7f2f9dea02b64b7dbffe63954efcee5c/users/30953a926e3c42498f09a7a5892ee15c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:37.265743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:37.280201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93994c44-8aba-4a67-9a64-b6460e152da5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:37.469804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:37.470518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:37.470805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:37.471081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:37.471829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:37.473522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:37.505170 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4308/8606] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:52:37.506486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:37.520567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab4dd2-71a9-4b63-9414-414273509611 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:37.535954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17e1e50-e09b-4721-9c52-1bb9d6cdac79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:37.537271 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e1e50-e09b-4721-9c52-1bb9d6cdac79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:37.537945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e1e50-e09b-4721-9c52-1bb9d6cdac79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:37.538503 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17e1e50-e09b-4721-9c52-1bb9d6cdac79 admin admin] PATH_INFO: `/v3/projects/7f2f9dea02b64b7dbffe63954efcee5c/users/30953a926e3c42498f09a7a5892ee15c/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:37.541381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e1e50-e09b-4721-9c52-1bb9d6cdac79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2f9dea02b64b7dbffe63954efcee5c, user_id=30953a926e3c42498f09a7a5892ee15c, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:37.544407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17e1e50-e09b-4721-9c52-1bb9d6cdac79 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:37.547369 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:37.579113 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4299/8607] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:37 2022] PUT /identity/v3/projects/7f2f9dea02b64b7dbffe63954efcee5c/users/30953a926e3c42498f09a7a5892ee15c/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:42.683518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:42.685633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:42.705485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb6613-7638-4ed9-beff-96502a5b2cd0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:42.841796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:42.843483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:42.843865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:42.844246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] PATH_INFO: `/v3/users/abcc4c976e11403e80e8d785dcc6cbc0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:42.845861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abcc4c976e11403e80e8d785dcc6cbc0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:42.852576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:43.038595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abcc4c976e11403e80e8d785dcc6cbc0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:43.068521 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abcc4c976e11403e80e8d785dcc6cbc0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:43.107085 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:43.118570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abcc4c976e11403e80e8d785dcc6cbc0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:43.120894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abcc4c976e11403e80e8d785dcc6cbc0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:43.154454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abcc4c976e11403e80e8d785dcc6cbc0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:43.183495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4309/8608] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:52:42 2022] DELETE /identity/v3/users/abcc4c976e11403e80e8d785dcc6cbc0 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:43.188911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:43.189565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:43.189565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:43.241747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:43.243461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:43.447047 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4300/8609] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:43.457665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:43.459343 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:43.707165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48229f07-f6e5-4f20-a36f-ea99e02300b5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:43.722136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b33e26d-3e22-460f-9025-f5d03ca28e2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:43.723526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33e26d-3e22-460f-9025-f5d03ca28e2d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:43.724193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33e26d-3e22-460f-9025-f5d03ca28e2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:43.724744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b33e26d-3e22-460f-9025-f5d03ca28e2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:43.739714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33e26d-3e22-460f-9025-f5d03ca28e2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:43.741889 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b33e26d-3e22-460f-9025-f5d03ca28e2d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:43.758346 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4310/8610] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:44.623241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:44.624901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:44.667856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d7d01-3c2d-4d5f-ae90-181b819b1bc5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:44.704141 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:44.705286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:44.705683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:44.706069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] PATH_INFO: `/v3/projects/4de17636ff6f4833a2af15ab0bf2665f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:44.713424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de17636ff6f4833a2af15ab0bf2665f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:44.715765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:44.961784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de17636ff6f4833a2af15ab0bf2665f', 'request_id': 'req-9e3dd7ab-07ac-478e-a47e-0e2522926f33'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.026865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de17636ff6f4833a2af15ab0bf2665f', 'request_id': 'req-9e3dd7ab-07ac-478e-a47e-0e2522926f33'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.066517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de17636ff6f4833a2af15ab0bf2665f', 'request_id': 'req-9e3dd7ab-07ac-478e-a47e-0e2522926f33'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.130965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] The token cache is being invalidate because project 4de17636ff6f4833a2af15ab0bf2665f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:52:45.131717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.131979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:45.133065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:45.133949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:45.144869 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.146616 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4301/8611] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:52:44 2022] DELETE /identity/v3/projects/4de17636ff6f4833a2af15ab0bf2665f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:45.151442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:45.160722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:45.271916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] MFA Rules not processed for user `d816ee1399d043839a9f73cbcf5f4de4`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:45.282106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:45.371357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3dd7ab-07ac-478e-a47e-0e2522926f33 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:45.385473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:45.386821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:45.387219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:45.387606 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] PATH_INFO: `/v3/users/dd2044f8a13a4f73a002a74a796bebff` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:45.391764 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2044f8a13a4f73a002a74a796bebff)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:45.394148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:45.458291 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:45.532698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2044f8a13a4f73a002a74a796bebff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.533394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2044f8a13a4f73a002a74a796bebff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.550082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2044f8a13a4f73a002a74a796bebff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.550704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2044f8a13a4f73a002a74a796bebff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.553427 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4311/8612] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 423 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:45.592225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2044f8a13a4f73a002a74a796bebff'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:45.637329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:45.640576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:45.697699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4302/8613] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:52:45 2022] DELETE /identity/v3/users/dd2044f8a13a4f73a002a74a796bebff => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:45.753395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19aa2db-1d61-47cf-816f-72647da6b1e4 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:45.785715 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:46.082466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:46.087819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:46.089265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:46.089973 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:46.105967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:46.328543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:46.332587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b172c-6ca0-4ba1-b7b2-c04d808b695c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:46.360189 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4312/8614] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 723 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:46.675204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:46.678465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:46.797727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8570ad0c-c372-44e6-8c77-01938d0a6d34 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:46.813096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:46.824068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:46.824651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:46.825088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] PATH_INFO: `/v3/projects/151e336dd1e4462180effafb4d31f5e9` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:46.826691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] RBAC: Authorizing `identity:delete_project(project_id=151e336dd1e4462180effafb4d31f5e9)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:46.849273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:46.987697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '151e336dd1e4462180effafb4d31f5e9', 'request_id': 'req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:47.005525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '151e336dd1e4462180effafb4d31f5e9', 'request_id': 'req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:47.034360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '151e336dd1e4462180effafb4d31f5e9', 'request_id': 'req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:47.118817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] The token cache is being invalidate because project 151e336dd1e4462180effafb4d31f5e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:52:47.119783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:47.120843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bd6b7a2a-8904-4aa6-b8ec-6f2a1bb5499b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:52:47.123096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4303/8615] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:52:46 2022] DELETE /identity/v3/projects/151e336dd1e4462180effafb4d31f5e9 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:47.128435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:47.128726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:47.129013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:47.173403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:47.174600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:47.410440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4313/8616] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:47.420078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:47.420897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:47.421437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:47.471788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:47.473191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:47.501199 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4304/8617] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:47.506061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:47.534888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b85f2a-acdc-4ba1-a2b4-c841a6c75767 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:47.553636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:47.554445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:47.554925 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:47.555427 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:47.558575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:52:47.559268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:47.562571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:47.594605 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4314/8618] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:52:47.599673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:47.613286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95dd3f4-ac4a-45d7-9599-78a41b22526b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:47.628369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:47.650966 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:47.652669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:47.653755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:47.655333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:47.657763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:47.698159 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:47.733651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:47.734401 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4305/8619] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:52:47 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:47.754801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8262c62e-951b-431e-b0a5-499f7fb6a69d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:47.871548 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:47.963324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:47.964438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:47.964875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:47.965974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:47.966862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:47.986156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:48.029968 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4315/8620] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:52:47 2022] POST /identity/v3/users => generated 293 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:48.033781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:48.052493 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c10ed1-d831-475a-80dd-95e80cf95b3b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:48.069829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:48.070940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.071455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.071927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.072936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:48.074790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:48.116484 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4306/8621] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:52:48.117737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:48.130644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c7724b-7141-45b4-87b4-cdfe7d0ad7ab admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:48.147848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1528bd9-7de5-46f9-91a8-fc780682d0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:48.149157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1528bd9-7de5-46f9-91a8-fc780682d0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.149596 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1528bd9-7de5-46f9-91a8-fc780682d0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.150024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1528bd9-7de5-46f9-91a8-fc780682d0d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.150953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1528bd9-7de5-46f9-91a8-fc780682d0d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:48.152808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1528bd9-7de5-46f9-91a8-fc780682d0d4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:48.172688 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4316/8622] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:52:48.176963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:48.196973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab1b3ee-32e6-4735-ae51-baa6dca78ecd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:48.211115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:48.213140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.213964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.215101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] PATH_INFO: `/v3/projects/25144f74d6e14436a5354750bc25745b/users/0ad270bb91c247c795a1d63442a011e0/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.241723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=25144f74d6e14436a5354750bc25745b, user_id=0ad270bb91c247c795a1d63442a011e0, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:48.249442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:48.283219 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4307/8623] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:48 2022] PUT /identity/v3/projects/25144f74d6e14436a5354750bc25745b/users/0ad270bb91c247c795a1d63442a011e0/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:48.294421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.294652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.294822 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.362234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] MFA Rules not processed for user `0ad270bb91c247c795a1d63442a011e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:48.369487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:48.523389 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4317/8624] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:48.528000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:48.743160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0f6aec-2be1-4931-a5e3-5b3117bdc153 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:48.755948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:48.757053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.757829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.758366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.760047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:48.762620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:48.830821 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4308/8625] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:52:48 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:52:48.834365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:48.856432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d5c8c7-0f50-4a06-8051-f157324c2b36 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:48.975953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:48.976711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:48.977080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:48.977362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:48.978085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:48.981291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:49.068551 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4318/8626] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:52:48 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:52:49.072887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:49.092169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cdebd6-2753-4f46-acad-033fd15cf85e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:49.099819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:49.102086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:49.102327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:49.102702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:49.103584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:49.105363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:49.138599 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:49.139045 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4309/8627] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:52:49.155992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2a8fb-cbb3-44fe-9ddd-cce274dd51a5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:49.169639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:49.170575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:49.170862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:49.171143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] PATH_INFO: `/v3/projects/cd02c372280f43acbdca56006e1b1361/users/b797463c91c041b7af4f818c9aed2abe/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:49.210887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd02c372280f43acbdca56006e1b1361, user_id=b797463c91c041b7af4f818c9aed2abe, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:49.215929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:49.244798 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4319/8628] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:49 2022] PUT /identity/v3/projects/cd02c372280f43acbdca56006e1b1361/users/b797463c91c041b7af4f818c9aed2abe/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:49.252000 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:49.286497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdbdd9-880b-447f-a156-a2178f46d24b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:49.476258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce58c0e-592e-46a9-a28f-92a6aed87ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:49.480090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58c0e-592e-46a9-a28f-92a6aed87ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:49.480682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58c0e-592e-46a9-a28f-92a6aed87ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:49.485452 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce58c0e-592e-46a9-a28f-92a6aed87ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:49.490835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce58c0e-592e-46a9-a28f-92a6aed87ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:49.500099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce58c0e-592e-46a9-a28f-92a6aed87ed6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:49.529109 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4310/8629] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:52:49.533441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:49.552728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382bb7d6-dc3b-495f-affb-4a000119d010 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:49.573592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9ebf79-a533-487b-9745-691d223fc2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:49.574971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ebf79-a533-487b-9745-691d223fc2f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:49.575259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ebf79-a533-487b-9745-691d223fc2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:49.575569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9ebf79-a533-487b-9745-691d223fc2f7 admin admin] PATH_INFO: `/v3/projects/cd02c372280f43acbdca56006e1b1361/users/b797463c91c041b7af4f818c9aed2abe/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:49.577839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ebf79-a533-487b-9745-691d223fc2f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd02c372280f43acbdca56006e1b1361, user_id=b797463c91c041b7af4f818c9aed2abe, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:49.581496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9ebf79-a533-487b-9745-691d223fc2f7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:49.590586 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:49.624800 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4320/8630] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:52:49 2022] PUT /identity/v3/projects/cd02c372280f43acbdca56006e1b1361/users/b797463c91c041b7af4f818c9aed2abe/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:52:49.635942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:49.636611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:49.637906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:49.676211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] MFA Rules not processed for user `b797463c91c041b7af4f818c9aed2abe`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:49.679277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:49.734499 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:52:49.860108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd350-b58e-45c3-8973-016e7592429d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:49.861019 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd350-b58e-45c3-8973-016e7592429d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:49.861854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfbd350-b58e-45c3-8973-016e7592429d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:49.880804 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4311/8631] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:49.897531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:49.906687 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:49.919429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3cfbd350-b58e-45c3-8973-016e7592429d None None] MFA Rules not processed for user `5f070a3e8dca4ed2921dcca7b93e21c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:49.920892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3cfbd350-b58e-45c3-8973-016e7592429d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:50.090302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb718a1e-bde9-4d76-ae81-2d57a9c58586 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:50.102766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:50.103449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:50.103733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:50.104009 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:50.134208 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4321/8632] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:52:50.138182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:50.138458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:50.142012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:50.214361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] MFA Rules not processed for user `30953a926e3c42498f09a7a5892ee15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:50.215797 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:50.279769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:50.281577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:50.300114 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4312/8633] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:50.494423 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4322/8634] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:52:50.502762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:50.525469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548d0974-0cc4-4cba-8d83-f2d268b7a378 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:50.532596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:50.533337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:50.533629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:50.533911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:50.556222 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:50.566554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:50.588120 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4313/8635] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:50.744216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:50.764929 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46df94-2294-4b6f-81ea-99efe8a2733e None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:50.779962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:50.780710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:50.780998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:50.781279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:50.793305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:50.948879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:50.950701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f95b37-217e-4e90-9a2c-9f8caf97fb00 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:50.972109 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4323/8636] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:51.008841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:52:51.010730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:51.231402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734d228-f649-46dd-abb0-025418b3c1af service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:52:51.257663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:52:51.258723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:51.259029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:51.259316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:51.288855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:51.362253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:52:51.369514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:52:51.419151 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4314/8637] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:52:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:52:55.073576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:52:55.074440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:52:55.075064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:52:55.101883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:52:55.103813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:52:55.117811 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4324/8638] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:52:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:53:00.432756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:00.434563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:00.464888 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:00.505876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627b980-8646-4a16-ad36-cae7b28d6de1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:00.516849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:00.517881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:00.518720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:00.519172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:00.547561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:00.549464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:00.590805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4315/8639] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:05.093790 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:06.377069 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:06.392014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e69b7-45cc-4d13-af48-fc0fcb37bf1b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:06.402441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:06.403327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:06.403766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:06.404217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:06.406329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:06.481452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:06.483059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6512498-ec3b-4f95-9ae5-be7f51812cbe service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:06.495945 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4325/8640] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:10.565987 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:15.353747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:15.478901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58fbc7-1101-4a21-917c-738e58154974 service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:15.483792 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:15.484745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:15.485011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:15.485469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] PATH_INFO: `/v3/users/0ad270bb91c247c795a1d63442a011e0` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:15.489114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ad270bb91c247c795a1d63442a011e0)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:15.493127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:15.582263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ad270bb91c247c795a1d63442a011e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:15.583253 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ad270bb91c247c795a1d63442a011e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:15.593977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ad270bb91c247c795a1d63442a011e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:15.595561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ad270bb91c247c795a1d63442a011e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:15.613016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ad270bb91c247c795a1d63442a011e0'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:15.661963 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4316/8641] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:53:15 2022] DELETE /identity/v3/users/0ad270bb91c247c795a1d63442a011e0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:15.666896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:15.667754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:15.667754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:15.730332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:15.731592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:15.829047 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4326/8642] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:53:15.848463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:15.850729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:15.940537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46490d35-e609-41a3-89a1-997479d86261 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:15.945561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:15.946328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:15.946581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:15.946804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:15.960780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:15.963439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:15.980910 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4317/8643] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:16.336268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:16.338842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:16.359198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b558d-f8bc-423d-b157-0255db3044b2 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:16.364609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:16.365879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:16.366525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:16.367319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] PATH_INFO: `/v3/projects/25144f74d6e14436a5354750bc25745b` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:16.368911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25144f74d6e14436a5354750bc25745b)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:16.371104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:16.454619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25144f74d6e14436a5354750bc25745b', 'request_id': 'req-d76e3477-abcc-4818-a0a3-a5fff34b1a30'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.465511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25144f74d6e14436a5354750bc25745b', 'request_id': 'req-d76e3477-abcc-4818-a0a3-a5fff34b1a30'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.478255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25144f74d6e14436a5354750bc25745b', 'request_id': 'req-d76e3477-abcc-4818-a0a3-a5fff34b1a30'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.508046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] The token cache is being invalidate because project 25144f74d6e14436a5354750bc25745b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:53:16.508483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.509189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.510987 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4327/8644] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:53:16 2022] DELETE /identity/v3/projects/25144f74d6e14436a5354750bc25745b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:16.517740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:16.529640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a846c-69ca-418d-84b1-93fe4bf21feb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:16.575328 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:16.641978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:16.642960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:16.643400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:16.643679 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] PATH_INFO: `/v3/users/b797463c91c041b7af4f818c9aed2abe` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:16.645209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b797463c91c041b7af4f818c9aed2abe)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:16.648490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:16.733668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b797463c91c041b7af4f818c9aed2abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.734349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b797463c91c041b7af4f818c9aed2abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.748639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b797463c91c041b7af4f818c9aed2abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.749297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b797463c91c041b7af4f818c9aed2abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.761297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bb9880c7-c591-4d7d-a8b4-f19507a8513c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b797463c91c041b7af4f818c9aed2abe'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:16.794043 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4318/8645] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:53:16 2022] DELETE /identity/v3/users/b797463c91c041b7af4f818c9aed2abe => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:53:17.280695 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:17.287454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:17.350987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e3477-abcc-4818-a0a3-a5fff34b1a30 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:17.369471 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:17.442365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:17.443375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:17.443663 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:17.443934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] PATH_INFO: `/v3/projects/cd02c372280f43acbdca56006e1b1361` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:17.445383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd02c372280f43acbdca56006e1b1361)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:17.447367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:17.527233 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd02c372280f43acbdca56006e1b1361', 'request_id': 'req-5979d82a-c53a-42bf-84bb-644cbebae01b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:17.537918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd02c372280f43acbdca56006e1b1361', 'request_id': 'req-5979d82a-c53a-42bf-84bb-644cbebae01b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:17.545852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd02c372280f43acbdca56006e1b1361', 'request_id': 'req-5979d82a-c53a-42bf-84bb-644cbebae01b'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:17.559632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] The token cache is being invalidate because project cd02c372280f43acbdca56006e1b1361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:53:17.559895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:17.560613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-5979d82a-c53a-42bf-84bb-644cbebae01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:17.562494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4328/8646] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:53:17 2022] DELETE /identity/v3/projects/cd02c372280f43acbdca56006e1b1361 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:17.569015 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:17.569829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:17.569829 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:17.600707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:17.602800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:17.677831 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4319/8647] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:53:17.786680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:17.786680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:17.786680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:17.806954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:17.808212 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:17.818093 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4329/8648] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:17.822882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:17.834317 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37853ee-8cc2-4140-88fa-c99c3596240c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:17.841805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:17.843370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:17.844018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:17.844678 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:17.845990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:53:17.846522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:17.849598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:17.869784 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4320/8649] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 19 11:53:17.874767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:17.885274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f335c0-3ee5-4d14-8305-2b5a65346fd6 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:17.891706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:17.892440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:17.892977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:17.893095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:17.894216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:17.896150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:17.937687 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4330/8650] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:53:17 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:53:17.938985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:17.950440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8595626-cad3-46e0-8c0e-6a8f74a4a04f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:17.981115 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:18.029121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.030127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.030605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.031070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.032302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.036014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.069928 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4321/8651] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:53:17 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:53:18.074553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.088719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1e561-8da4-49ad-9206-6344d6b3591f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.093293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.093944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.094228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.094506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.095252 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.096949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.110339 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4331/8652] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:53:18.114618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.125872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7b778-1c74-4b9d-b48e-db0bc69df56d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.131276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78202a2-ee65-444d-99fb-4f67c12395c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.131979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78202a2-ee65-444d-99fb-4f67c12395c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.132263 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78202a2-ee65-444d-99fb-4f67c12395c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.132613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78202a2-ee65-444d-99fb-4f67c12395c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.133367 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78202a2-ee65-444d-99fb-4f67c12395c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.135023 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78202a2-ee65-444d-99fb-4f67c12395c3 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.146656 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4322/8653] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:53:18.151188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.161821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd61d75-ea9c-45df-8e91-1bfbda37d5bf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.166865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.167776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.168086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.168456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] PATH_INFO: `/v3/projects/a345f52fa09d4105af1b83cb8814681c/users/a99f793a7a4142e4aea3524cc0769244/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.197982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a345f52fa09d4105af1b83cb8814681c, user_id=a99f793a7a4142e4aea3524cc0769244, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.213561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.233051 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4332/8654] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:53:18 2022] PUT /identity/v3/projects/a345f52fa09d4105af1b83cb8814681c/users/a99f793a7a4142e4aea3524cc0769244/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:53:18.246420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.246765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.246990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.283423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] MFA Rules not processed for user `a99f793a7a4142e4aea3524cc0769244`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:18.284605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:18.369098 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4323/8655] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:18.374184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.435601 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:18.456079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915da89-3285-46c1-99c9-00c3135c8c05 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.461285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.462078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.462432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.462802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.463768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.465697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.500678 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4333/8656] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:53:18 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:53:18.504094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.519623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c36fa-c411-407d-b22d-d74e98a27539 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.605321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.606506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.607054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.607515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.608448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.611538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.642581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4324/8657] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:53:18 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:53:18.643297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.655970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9932f-e9f3-424b-96bb-2928b88738b0 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.661466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.662188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.662518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.662802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.663569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.666219 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.687177 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4334/8658] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:53:18.692043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.708843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418e402-22ab-4be4-8b70-d5f96c4b112a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.728124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.729863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.730424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.731168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] PATH_INFO: `/v3/projects/7943c8855aab4552be159f22e4af2b5d/users/226e58197f624bb79a11448a36256afb/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.770900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7943c8855aab4552be159f22e4af2b5d, user_id=226e58197f624bb79a11448a36256afb, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.775320 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.803325 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4325/8659] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:53:18 2022] PUT /identity/v3/projects/7943c8855aab4552be159f22e4af2b5d/users/226e58197f624bb79a11448a36256afb/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:53:18.807417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.818730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2418ce-e437-448d-91c3-c2e7e6a1f6d7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.902529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012afe3b-34f7-41bc-a2bb-9596afd6402c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.903579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012afe3b-34f7-41bc-a2bb-9596afd6402c admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.903579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012afe3b-34f7-41bc-a2bb-9596afd6402c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.904003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012afe3b-34f7-41bc-a2bb-9596afd6402c admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.905385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012afe3b-34f7-41bc-a2bb-9596afd6402c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.907086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012afe3b-34f7-41bc-a2bb-9596afd6402c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.920553 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4335/8660] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:53:18 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:53:18.924276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:18.930684 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:18.938315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25c35c-d48f-4eb0-86ad-1208af3163a6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:18.944997 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:18.946038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.946396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.946730 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] PATH_INFO: `/v3/projects/7943c8855aab4552be159f22e4af2b5d/users/226e58197f624bb79a11448a36256afb/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:18.948949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7943c8855aab4552be159f22e4af2b5d, user_id=226e58197f624bb79a11448a36256afb, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:18.951823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:18.963795 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4326/8661] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:53:18 2022] PUT /identity/v3/projects/7943c8855aab4552be159f22e4af2b5d/users/226e58197f624bb79a11448a36256afb/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:18.975869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:18.976140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:18.976456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:19.011978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] MFA Rules not processed for user `226e58197f624bb79a11448a36256afb`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:19.013278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:19.126182 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4336/8662] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:19.137615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:19.141414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:19.256449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5003b504-7161-4e44-a57e-ff3061a5625b admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:19.260717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e543fed-12df-4ec7-bb27-89d5203a4749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:19.261427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e543fed-12df-4ec7-bb27-89d5203a4749 service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:19.261720 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e543fed-12df-4ec7-bb27-89d5203a4749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:19.261993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e543fed-12df-4ec7-bb27-89d5203a4749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:19.357429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e543fed-12df-4ec7-bb27-89d5203a4749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:19.358996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e543fed-12df-4ec7-bb27-89d5203a4749 service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:19.371172 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4327/8663] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:53:23.122898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:23.197599 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:23.231968 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b07894-74c3-4c10-ba6a-73f4f25a00af None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:23.238924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:23.240774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:23.241517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:23.241890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] PATH_INFO: `/v3/users/a99f793a7a4142e4aea3524cc0769244` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:23.244606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99f793a7a4142e4aea3524cc0769244)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:23.248167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:23.342203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99f793a7a4142e4aea3524cc0769244'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:23.356282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99f793a7a4142e4aea3524cc0769244'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:23.374354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99f793a7a4142e4aea3524cc0769244'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:23.375341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99f793a7a4142e4aea3524cc0769244'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:23.384746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99f793a7a4142e4aea3524cc0769244'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:23.393561 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4337/8664] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:53:23 2022] DELETE /identity/v3/users/a99f793a7a4142e4aea3524cc0769244 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:23.398430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:23.399502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:23.399962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:23.422842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:23.425028 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:23.506067 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4328/8665] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:53:23.512513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:23.514409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:23.595627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a915de-a176-4722-9e70-9985b0db7a4d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:23.601162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:23.602052 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:23.602497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:23.602956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:23.618693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:23.620304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:23.644661 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4338/8666] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:23.998182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:23.999911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:24.012810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e013a-646c-4d9e-97c4-398636c50f6b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:24.018100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:24.019116 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:24.020278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:24.020278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] PATH_INFO: `/v3/projects/a345f52fa09d4105af1b83cb8814681c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:24.022409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a345f52fa09d4105af1b83cb8814681c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:24.024842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:24.082713 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:24.101358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a345f52fa09d4105af1b83cb8814681c', 'request_id': 'req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.108497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a345f52fa09d4105af1b83cb8814681c', 'request_id': 'req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.118641 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a345f52fa09d4105af1b83cb8814681c', 'request_id': 'req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.135277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] The token cache is being invalidate because project a345f52fa09d4105af1b83cb8814681c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:53:24.135575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.136248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.138517 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4329/8667] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:53:23 2022] DELETE /identity/v3/projects/a345f52fa09d4105af1b83cb8814681c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:24.143104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:24.157315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba5001-89ac-4f51-b8ff-1a0965aceb1e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:24.256561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:24.257567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:24.257949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:24.258327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] PATH_INFO: `/v3/users/226e58197f624bb79a11448a36256afb` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:24.259828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=226e58197f624bb79a11448a36256afb)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:24.262282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:24.265772 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:24.378270 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '226e58197f624bb79a11448a36256afb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.400461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '226e58197f624bb79a11448a36256afb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.421988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '226e58197f624bb79a11448a36256afb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.422876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '226e58197f624bb79a11448a36256afb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.432281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-372431b1-45e7-44b6-8d66-092d7936bb03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '226e58197f624bb79a11448a36256afb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:24.439386 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4339/8668] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:53:24 2022] DELETE /identity/v3/users/226e58197f624bb79a11448a36256afb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:24.866520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:24.868108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:24.895511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4ef2f-cdf5-4234-b8a5-2094f0718d57 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:24.992663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:24.993492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:24.993775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:24.994051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] PATH_INFO: `/v3/projects/7943c8855aab4552be159f22e4af2b5d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:24.995311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7943c8855aab4552be159f22e4af2b5d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:24.997538 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.072491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7943c8855aab4552be159f22e4af2b5d', 'request_id': 'req-418071d0-4c91-4ea5-b466-c9839e121e97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:25.080106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7943c8855aab4552be159f22e4af2b5d', 'request_id': 'req-418071d0-4c91-4ea5-b466-c9839e121e97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:25.087521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7943c8855aab4552be159f22e4af2b5d', 'request_id': 'req-418071d0-4c91-4ea5-b466-c9839e121e97'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:25.104461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] The token cache is being invalidate because project 7943c8855aab4552be159f22e4af2b5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:53:25.104930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:25.105801 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-418071d0-4c91-4ea5-b466-c9839e121e97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:25.107641 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4330/8669] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:53:24 2022] DELETE /identity/v3/projects/7943c8855aab4552be159f22e4af2b5d => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:25.112605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.112888 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.113263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.142452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:25.143702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:25.221356 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4340/8670] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:25.223460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.223760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.224040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.250627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:25.252035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:25.266036 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4331/8671] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:25.267664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.278461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13353967-537c-4c59-b39d-d6c787b9ccfc None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.285899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.286651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.286972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.287328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.288274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:53:25.288618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.290392 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.307172 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4341/8672] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:53:25.311791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.322719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3584b-162d-485e-b9fb-cda08ec58bac None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.329177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.329975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.330365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.330738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.331790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.334277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.380251 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4332/8673] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:53:25 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:53:25.384722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.401450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07580b-d2c4-4649-92f1-2f41052dde97 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.475915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.476952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.477300 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.477694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.479502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.481651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.503922 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:25.510679 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4342/8674] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:53:25 2022] POST /identity/v3/users => generated 289 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:53:25.515330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.527529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3736e76b-594a-41e3-91d3-e7a2a6076873 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.532887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.533645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.533989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.534333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.535135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.536930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.552232 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4333/8675] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:53:25.553890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.564658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e91d46-887a-47f1-b8c0-a805c19471fc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.569678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67540aac-d884-4f0f-9e71-176b5cf5e444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.570435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67540aac-d884-4f0f-9e71-176b5cf5e444 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.570790 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67540aac-d884-4f0f-9e71-176b5cf5e444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.571133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67540aac-d884-4f0f-9e71-176b5cf5e444 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.571950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67540aac-d884-4f0f-9e71-176b5cf5e444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.573685 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67540aac-d884-4f0f-9e71-176b5cf5e444 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.585988 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4343/8676] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:53:25.590099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.603381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f667fdb1-4a1f-4ac0-a399-a9089234878a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.608164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.609093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.609377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.609643 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] PATH_INFO: `/v3/projects/bdb9b8b3445a43b3aa4d5bad64c6ca13/users/c23ac734ac5b49d88e763c743ab76d53/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.627192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb9b8b3445a43b3aa4d5bad64c6ca13, user_id=c23ac734ac5b49d88e763c743ab76d53, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.630040 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.633090 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:25.653855 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4334/8677] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:53:25 2022] PUT /identity/v3/projects/bdb9b8b3445a43b3aa4d5bad64c6ca13/users/c23ac734ac5b49d88e763c743ab76d53/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:25.665002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73be5e-e688-4723-b8ea-ae1eb85f971e None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.665292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73be5e-e688-4723-b8ea-ae1eb85f971e None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.665572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73be5e-e688-4723-b8ea-ae1eb85f971e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.712884 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2f73be5e-e688-4723-b8ea-ae1eb85f971e None None] MFA Rules not processed for user `c23ac734ac5b49d88e763c743ab76d53`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:25.714284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2f73be5e-e688-4723-b8ea-ae1eb85f971e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:25.809405 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4344/8678] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:25.822820 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:25.824663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:25.891004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd91b9-ee2d-4c50-a9eb-789a57c0ce92 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:25.894777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:25.895506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:25.895862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:25.896249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:25.906030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:25.907619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:25.920229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4335/8679] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:35.798814 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=38 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:35.914617 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=1,keystone:SELECT=28 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:36.831732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:36.832697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:36.833043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:36.857452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] MFA Rules not processed for user `4298885ada06459e8a315d954bd8c1ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:36.858879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:36.929440 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4345/8680] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:37.322339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:37.323821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:37.400448 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2b24-da23-4268-84d7-88e95886e22e service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:37.408753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:37.409916 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:37.410417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:37.410942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:37.414634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:37.435836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:37.437589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93de9bd-467f-47f1-a1bc-a6628ed4c1b9 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:37.451619 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4336/8681] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:43.508142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:43.523327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b65268d-08f3-4a7c-a859-a123d75dd0d8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:43.527706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:43.528631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:43.529229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:43.529679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:43.531994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:43.548318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:43.549833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:43.562435 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4346/8682] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:43 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:47.446976 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=26 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:53.555042 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=31 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:53:57.204012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:57.204696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:57.204696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:57.223775 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:53:57.225118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:57.294030 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4337/8683] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:53:58.334143 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:58.346295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38e581-ffcd-4963-8cda-0bf70f9485fc service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:58.350843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:58.351516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:58.351794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:58.352067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:58.354021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:53:58.457316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:58.458981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e549c5f-1b30-45cf-b817-b1eaaf8fe707 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:58.475975 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4347/8684] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:53:58 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:53:59.741256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:53:59.821562 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7931371d-3cad-4707-8a9d-48c0afc4b5b2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:53:59.828473 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:53:59.829490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:59.829849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:59.830202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] PATH_INFO: `/v3/users/c23ac734ac5b49d88e763c743ab76d53` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:53:59.831722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c23ac734ac5b49d88e763c743ab76d53)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:53:59.834099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:53:59.909380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c23ac734ac5b49d88e763c743ab76d53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:59.910818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c23ac734ac5b49d88e763c743ab76d53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:59.924984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c23ac734ac5b49d88e763c743ab76d53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:59.929361 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c23ac734ac5b49d88e763c743ab76d53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:59.946838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c23ac734ac5b49d88e763c743ab76d53'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:53:59.983162 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4338/8685] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:53:59 2022] DELETE /identity/v3/users/c23ac734ac5b49d88e763c743ab76d53 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:53:59.984693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:53:59.985237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:53:59.985564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:00.007793 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:00.009922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:00.087317 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4348/8686] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:54:00.097048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:00.098972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:00.164332 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:00.221489 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5187ccb0-6a98-4b64-9f51-82e78516e559 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:00.229069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812d315f-b221-4bcf-bca7-ffb1068b4edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:00.230036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d315f-b221-4bcf-bca7-ffb1068b4edc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:00.230518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d315f-b221-4bcf-bca7-ffb1068b4edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:00.231368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812d315f-b221-4bcf-bca7-ffb1068b4edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:00.244094 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d315f-b221-4bcf-bca7-ffb1068b4edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:00.246083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812d315f-b221-4bcf-bca7-ffb1068b4edc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:00.258125 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4339/8687] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:00.642837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:00.644449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:00.681423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb10ae-67b4-42aa-a6c7-0dcbc6699d6a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:00.695946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:00.697655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:00.698114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:00.699210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] PATH_INFO: `/v3/projects/bdb9b8b3445a43b3aa4d5bad64c6ca13` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:00.702168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb9b8b3445a43b3aa4d5bad64c6ca13)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:00.705808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:00.793275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb9b8b3445a43b3aa4d5bad64c6ca13', 'request_id': 'req-ba7273f0-4d3e-483f-9f3a-007587149ad6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:00.816299 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb9b8b3445a43b3aa4d5bad64c6ca13', 'request_id': 'req-ba7273f0-4d3e-483f-9f3a-007587149ad6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:00.829909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb9b8b3445a43b3aa4d5bad64c6ca13', 'request_id': 'req-ba7273f0-4d3e-483f-9f3a-007587149ad6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:00.845039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] The token cache is being invalidate because project bdb9b8b3445a43b3aa4d5bad64c6ca13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:54:00.845661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:00.846711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-ba7273f0-4d3e-483f-9f3a-007587149ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:00.849373 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4349/8688] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:54:00 2022] DELETE /identity/v3/projects/bdb9b8b3445a43b3aa4d5bad64c6ca13 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:00.854478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:00.855945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:00.855945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:00.884280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:00.887168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:00.980834 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4340/8689] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:00.988303 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:00.989246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:00.989482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.014597 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:01.016244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:01.034532 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4350/8690] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:01.042663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.066070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ee2dad-2c9f-4375-8ae0-aa19d20a7661 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.071791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.072622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.073078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.073634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.074576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:54:01.074986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.077351 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.094973 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4341/8691] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:54:01.099585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.110131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078dd259-9efe-45e9-b62c-05dcdf9a8e14 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.125004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.126574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.126981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.127652 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.131036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.134222 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.146465 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:01.197885 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4351/8692] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:54:01 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:01.202074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.218107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa682a-3f9c-44d0-9c3e-e0653285e2fc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.307266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.307965 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.308625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.308915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.310857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.315520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.350635 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4342/8693] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:54:01 2022] POST /identity/v3/users => generated 288 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:01.354519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.366556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9189d93-69b7-4ba9-8af6-cb8c12c97787 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.372430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.381891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.381891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.381891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.381891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.381891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.389479 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4352/8694] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:01.393259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.408057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311460c1-6fee-4193-b0d8-356c2d6d2a83 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.421431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246cec2-4574-4158-9c62-c12c27b94e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.422631 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cec2-4574-4158-9c62-c12c27b94e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.423218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cec2-4574-4158-9c62-c12c27b94e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.423781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246cec2-4574-4158-9c62-c12c27b94e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.424583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246cec2-4574-4158-9c62-c12c27b94e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.426403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246cec2-4574-4158-9c62-c12c27b94e91 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.446217 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4343/8695] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 11:54:01.450408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.461894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76274550-a9e5-4515-8b5a-839c6e587931 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.469142 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.470310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.470771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.471194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] PATH_INFO: `/v3/projects/0dbbbe0a9fc84a9fb55d54b26f0bf722/users/d1d3449f31614a33af14cdb11e5c42ca/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.491567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dbbbe0a9fc84a9fb55d54b26f0bf722, user_id=d1d3449f31614a33af14cdb11e5c42ca, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.494844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.516700 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4353/8696] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:54:01 2022] PUT /identity/v3/projects/0dbbbe0a9fc84a9fb55d54b26f0bf722/users/d1d3449f31614a33af14cdb11e5c42ca/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:01.527413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.528050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.528335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.583646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] MFA Rules not processed for user `d1d3449f31614a33af14cdb11e5c42ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:01.585293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:01.618907 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:01.677555 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4344/8697] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:01.689965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:01.692168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:01.789067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c8dd4c-e127-4eaf-ba8a-39c195ac7a53 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:01.801136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:01.802330 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:01.806668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:01.807178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:01.831534 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:01.833359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:01.873563 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4354/8698] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:03.571715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:03.573276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:03.691535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aabf381-8bfe-4e55-abc8-3235663d65bc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:03.701831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:03.702620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:03.707158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:03.707614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:03.712089 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:03.863860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:03.865214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a11c2-8f14-4924-a05a-d343855f9be1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:03.883838 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4345/8699] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:08.754210 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:08.842006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4125a8c7-cda2-4ad3-827c-48150d4c0d7b service cinder] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:08.847746 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:08.848805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:08.849081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:08.849359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] PATH_INFO: `/v3/users/d1d3449f31614a33af14cdb11e5c42ca` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:08.850764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1d3449f31614a33af14cdb11e5c42ca)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:08.852885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:08.960179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1d3449f31614a33af14cdb11e5c42ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:08.974042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1d3449f31614a33af14cdb11e5c42ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:08.981784 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:08.999150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1d3449f31614a33af14cdb11e5c42ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.001283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1d3449f31614a33af14cdb11e5c42ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.011478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1d3449f31614a33af14cdb11e5c42ca'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.019090 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4355/8700] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:54:08 2022] DELETE /identity/v3/users/d1d3449f31614a33af14cdb11e5c42ca => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:09.026932 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:09.027424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:09.027536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:09.080805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:09.082339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:09.163036 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4346/8701] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:09.175240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:09.176904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:09.241007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a3ff18-48f6-4900-a417-5a2a16293900 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:09.244947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1b769-e1c4-457b-8d50-47c665b5c945 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:09.244947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b769-e1c4-457b-8d50-47c665b5c945 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:09.246455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b769-e1c4-457b-8d50-47c665b5c945 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:09.246455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1b769-e1c4-457b-8d50-47c665b5c945 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:09.256909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1b769-e1c4-457b-8d50-47c665b5c945 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:09.258529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d1b769-e1c4-457b-8d50-47c665b5c945 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:09.269456 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4356/8702] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:54:09.626757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:09.629069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:09.646788 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:09.656385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf077fed-c93f-471b-affd-0bbc50849ce4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:09.696469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:09.699403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:09.699849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:09.700133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] PATH_INFO: `/v3/projects/0dbbbe0a9fc84a9fb55d54b26f0bf722` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:09.704798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dbbbe0a9fc84a9fb55d54b26f0bf722)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:09.706858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:09.764760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dbbbe0a9fc84a9fb55d54b26f0bf722', 'request_id': 'req-dae655b1-53fb-4478-983d-198f5d6ccfb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.772610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dbbbe0a9fc84a9fb55d54b26f0bf722', 'request_id': 'req-dae655b1-53fb-4478-983d-198f5d6ccfb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.779956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dbbbe0a9fc84a9fb55d54b26f0bf722', 'request_id': 'req-dae655b1-53fb-4478-983d-198f5d6ccfb9'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.798833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] The token cache is being invalidate because project 0dbbbe0a9fc84a9fb55d54b26f0bf722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:54:09.800564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.801235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dae655b1-53fb-4478-983d-198f5d6ccfb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:09.803498 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4347/8703] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:54:09 2022] DELETE /identity/v3/projects/0dbbbe0a9fc84a9fb55d54b26f0bf722 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:54:09.811664 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:09.812232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:09.812232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:09.834413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:09.835674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:09.916993 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4357/8704] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:09.932543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:09.932843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:09.933109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:09.953297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:09.954422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:09.964234 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4348/8705] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:09.968561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:09.979104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18265fd6-108f-4c51-9aa0-2e6d59586113 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:09.984211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:09.984948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:09.985200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:09.985460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:09.986204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 11:54:09.986498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:09.988578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.004381 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4358/8706] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 11:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 11:54:10.006603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.017244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d076826-1974-42e9-b1f2-909621f8cac8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.024275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.025109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.025400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.026084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.027411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.029601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.062441 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4349/8707] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:10.065192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.079465 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c674638c-b240-4164-a4e2-d39b86316e1f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.161369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.162540 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.162832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.163242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.164073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.166897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.183633 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:10.202212 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4359/8708] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/users => generated 294 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:10.206465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.218208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0efdddc-4228-481e-8f95-3b4edd95bfbb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.223674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.224369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.224667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.224940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.225722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.227374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.240382 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4350/8709] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:10.244166 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.255072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5a69ac-1b85-4410-ae6c-454949aecc7e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.260467 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207843b5-4da2-406c-ad68-6b8d8f54546e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.261174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207843b5-4da2-406c-ad68-6b8d8f54546e admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.261458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207843b5-4da2-406c-ad68-6b8d8f54546e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.261737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207843b5-4da2-406c-ad68-6b8d8f54546e admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.262508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207843b5-4da2-406c-ad68-6b8d8f54546e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.264133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207843b5-4da2-406c-ad68-6b8d8f54546e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.274886 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4360/8710] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:10.279225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.289651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61e3079-8811-4895-bf17-cc224f0de3ca admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.295276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.296173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.296521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.296891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] PATH_INFO: `/v3/projects/a2295e5311ba4a81a45e376ef3b6d645/users/fd806060ca794b879e2500fe8dfa317f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.311942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2295e5311ba4a81a45e376ef3b6d645, user_id=fd806060ca794b879e2500fe8dfa317f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.314705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.330370 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4351/8711] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:54:10 2022] PUT /identity/v3/projects/a2295e5311ba4a81a45e376ef3b6d645/users/fd806060ca794b879e2500fe8dfa317f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:10.341711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.342063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.342359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.374471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] MFA Rules not processed for user `fd806060ca794b879e2500fe8dfa317f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:10.375717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:10.456214 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4361/8712] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:10.461766 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.532450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd263aaa-350a-4232-a2b6-519ce34427e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.537928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.538590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.538875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.539158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.539849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.541818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.577567 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4352/8713] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:10.583464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.595643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2bbb71-e662-411d-95d7-30466fed0581 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.661478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.662146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.662438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.662710 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.663395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.665535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.688330 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4362/8714] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/users => generated 294 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 11:54:10.693330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.704098 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6afdc1-0661-4547-8f1b-f9a37fb844a7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.708940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.709609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.709895 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.710176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.710919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.712587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.714736 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:10.725111 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4353/8715] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:10.730014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.744086 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e32ed50-6037-4cad-ab5e-cc2d456abd32 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.756777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e54100-ac4c-4f77-8ae4-ac3e0994e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.757209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54100-ac4c-4f77-8ae4-ac3e0994e0e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.757489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54100-ac4c-4f77-8ae4-ac3e0994e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.758147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e54100-ac4c-4f77-8ae4-ac3e0994e0e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.759588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e54100-ac4c-4f77-8ae4-ac3e0994e0e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.761015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e54100-ac4c-4f77-8ae4-ac3e0994e0e0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.772641 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4363/8716] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:10.777239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:10.788144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00714a6e-eadd-46e0-a2e2-e7bc2abf419f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:10.795919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:10.797655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.797944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.798195 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] PATH_INFO: `/v3/projects/905ea7177571401091184ade903ad3c3/users/af9f01708caa4edeb26bae17c81a474f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.817577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=905ea7177571401091184ade903ad3c3, user_id=af9f01708caa4edeb26bae17c81a474f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:10.820378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:10.838632 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4354/8717] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:54:10 2022] PUT /identity/v3/projects/905ea7177571401091184ade903ad3c3/users/af9f01708caa4edeb26bae17c81a474f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:10.849827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be104504-7045-445a-893e-48f023a161bb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:10.850353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be104504-7045-445a-893e-48f023a161bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:10.850353 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be104504-7045-445a-893e-48f023a161bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:10.881483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-be104504-7045-445a-893e-48f023a161bb None None] MFA Rules not processed for user `af9f01708caa4edeb26bae17c81a474f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:10.882907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be104504-7045-445a-893e-48f023a161bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:10.945151 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:10.973997 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4364/8718] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:10.979045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.054806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a430ba1-1aa7-40d3-b1f1-7c77bb32f94c admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.062279 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.062854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.063339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.063681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.064464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.067639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.097701 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4355/8719] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 11:54:10 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:11.103920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be104504-7045-445a-893e-48f023a161bb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.118510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be104504-7045-445a-893e-48f023a161bb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.195050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.195837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.196120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.196421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.197117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.199066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.222468 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4365/8720] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 11:54:11 2022] POST /identity/v3/users => generated 301 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 11:54:11.227092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.238483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f92a-f682-4fab-a5e3-954b21b9c69a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.243485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.244139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.244492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.244771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.245504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.247169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.259981 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4356/8721] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:11.265515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.277649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef87fa6-3f27-40e3-8878-4ffc95ec2961 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.282779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.283709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.283988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.284269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] PATH_INFO: `/v3/projects/c6112435db6846e0957f6f5be9279792/users/85abea023af146d0a8c798d46ccb4d91/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.306668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6112435db6846e0957f6f5be9279792, user_id=85abea023af146d0a8c798d46ccb4d91, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.309502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.330759 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4366/8722] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:54:11 2022] PUT /identity/v3/projects/c6112435db6846e0957f6f5be9279792/users/85abea023af146d0a8c798d46ccb4d91/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:11.335850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.347568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1d43f-7c80-4eca-b6a2-af40c891e7a8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.418543 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b31c7-70f8-41b8-be40-d9782918194a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.419225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b31c7-70f8-41b8-be40-d9782918194a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.419507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b31c7-70f8-41b8-be40-d9782918194a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.419780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b31c7-70f8-41b8-be40-d9782918194a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.420549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b31c7-70f8-41b8-be40-d9782918194a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.422202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b31c7-70f8-41b8-be40-d9782918194a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.432862 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4357/8723] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 11:54:11 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 11:54:11.437424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.448486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476ffb4-a3d6-4e87-b5bf-7de6c41efbf7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.453819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.454725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.455012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.455291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] PATH_INFO: `/v3/projects/c6112435db6846e0957f6f5be9279792/users/85abea023af146d0a8c798d46ccb4d91/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.457507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6112435db6846e0957f6f5be9279792, user_id=85abea023af146d0a8c798d46ccb4d91, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.460286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.471822 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4367/8724] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 11:54:11 2022] PUT /identity/v3/projects/c6112435db6846e0957f6f5be9279792/users/85abea023af146d0a8c798d46ccb4d91/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:11.484868 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.485188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.485526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.520964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] MFA Rules not processed for user `85abea023af146d0a8c798d46ccb4d91`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:11.522233 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:11.559178 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:11.602777 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4358/8725] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:54:11.618226 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:11.620126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:11.702107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0229036-217a-41fa-bdc0-89a55b84f285 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:11.708617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368984b-0df5-4a8e-9f00-da4827b28f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:11.709275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368984b-0df5-4a8e-9f00-da4827b28f02 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:11.709557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368984b-0df5-4a8e-9f00-da4827b28f02 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:11.709833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368984b-0df5-4a8e-9f00-da4827b28f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:11.743676 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:11.777930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368984b-0df5-4a8e-9f00-da4827b28f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:11.779536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368984b-0df5-4a8e-9f00-da4827b28f02 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:11.788952 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4368/8726] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:11 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:13.676220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:13.677975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:13.762172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c81902-1226-4918-a49f-03b5683b3686 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:13.768933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:13.770393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:13.770393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:13.771516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:13.784127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:13.786464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:13.816686 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4359/8727] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:13 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:18.070419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:18.070881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:18.071017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:18.095926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] MFA Rules not processed for user `fd806060ca794b879e2500fe8dfa317f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:54:18.097273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:18.110026 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4369/8728] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:54:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:54:23.709302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:23.721791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8f5e8-f8cc-4acf-90c1-a32cd9a6d8e8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:23.725661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:23.726410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:23.726780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:23.727065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:23.728970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:23.744113 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:23.745925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:23.757693 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4360/8729] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:28.090349 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=16 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:28.376099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:28.377770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:28.395605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8171b0f1-1584-4843-a485-f445de266b56 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:28.400463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:28.401173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:28.401654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:28.401919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:28.403969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:28.423096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:28.424765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:28.440858 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4370/8730] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:33.751003 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=46 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:37.181658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:37.195161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fd5fa5-d220-4061-a9c5-a499e5efff58 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:37.201076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:37.201915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:37.202168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:37.203063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:37.205495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:37.221376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:37.223151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:37.239004 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4361/8731] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:38.432206 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:47.230210 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:55.567846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:55.570057 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:55.657499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ba864-d768-40d7-97f2-6e639c183d54 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:55.662609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972780-0766-423c-8c23-02172f33f24b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:55.663481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972780-0766-423c-8c23-02172f33f24b service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:55.663766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972780-0766-423c-8c23-02172f33f24b service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:55.664038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98972780-0766-423c-8c23-02172f33f24b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:55.666359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-98972780-0766-423c-8c23-02172f33f24b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:55.682586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972780-0766-423c-8c23-02172f33f24b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:55.684331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98972780-0766-423c-8c23-02172f33f24b service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:55.698853 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4371/8732] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:54:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:54:59.189738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:59.191749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:59.306929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ef9602-2f1e-4562-b068-cf4b7011f332 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:59.311963 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:59.312979 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:59.313310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:59.313668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] PATH_INFO: `/v3/users/4298885ada06459e8a315d954bd8c1ed` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:59.314959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4298885ada06459e8a315d954bd8c1ed)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:59.317122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:59.375039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4298885ada06459e8a315d954bd8c1ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.376170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4298885ada06459e8a315d954bd8c1ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.386957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4298885ada06459e8a315d954bd8c1ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.387590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4298885ada06459e8a315d954bd8c1ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.396054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4298885ada06459e8a315d954bd8c1ed'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.416375 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4362/8733] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:54:59 2022] DELETE /identity/v3/users/4298885ada06459e8a315d954bd8c1ed => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:59.608015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972780-0766-423c-8c23-02172f33f24b service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:59.622178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98972780-0766-423c-8c23-02172f33f24b service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:59.705029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:59.705911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:59.706192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:59.706463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] PATH_INFO: `/v3/projects/396456a8ab89489ba74518c230d0854a` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:59.707675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=396456a8ab89489ba74518c230d0854a)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:59.709650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:59.766336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '396456a8ab89489ba74518c230d0854a', 'request_id': 'req-c22feab9-22f9-4b6d-8c60-4644d615a8e2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.774971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '396456a8ab89489ba74518c230d0854a', 'request_id': 'req-c22feab9-22f9-4b6d-8c60-4644d615a8e2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.782213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '396456a8ab89489ba74518c230d0854a', 'request_id': 'req-c22feab9-22f9-4b6d-8c60-4644d615a8e2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.793114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] The token cache is being invalidate because project 396456a8ab89489ba74518c230d0854a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:54:59.793404 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.794070 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.795702 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4372/8734] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:54:59 2022] DELETE /identity/v3/projects/396456a8ab89489ba74518c230d0854a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:54:59.800177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:54:59.801747 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:54:59.817153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb1b4b8-b1a2-4edd-b513-668d9716f3dd admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:54:59.890036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:54:59.890953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:54:59.891258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:54:59.891531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] PATH_INFO: `/v3/users/17c69e9abd18451a81e8b37d05406a40` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:54:59.892863 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c69e9abd18451a81e8b37d05406a40)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:54:59.894814 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:54:59.918920 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:54:59.949904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c69e9abd18451a81e8b37d05406a40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.950706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c69e9abd18451a81e8b37d05406a40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.959012 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c69e9abd18451a81e8b37d05406a40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.959702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c69e9abd18451a81e8b37d05406a40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.968301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc64973b-59c6-48ee-9272-653e74e6796c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c69e9abd18451a81e8b37d05406a40'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:54:59.988082 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4363/8735] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:54:59 2022] DELETE /identity/v3/users/17c69e9abd18451a81e8b37d05406a40 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:00.172673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:00.174174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:00.196570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22feab9-22f9-4b6d-8c60-4644d615a8e2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:00.217883 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:00.262557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:00.263502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:00.263783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:00.264055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] PATH_INFO: `/v3/projects/771b387fab924be28a3547253bdeaf8f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:00.265669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771b387fab924be28a3547253bdeaf8f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:00.267647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:00.334378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771b387fab924be28a3547253bdeaf8f', 'request_id': 'req-889bbeaa-1d77-4256-8493-39b2d5d7bb45'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:00.345139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771b387fab924be28a3547253bdeaf8f', 'request_id': 'req-889bbeaa-1d77-4256-8493-39b2d5d7bb45'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:00.352749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771b387fab924be28a3547253bdeaf8f', 'request_id': 'req-889bbeaa-1d77-4256-8493-39b2d5d7bb45'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:00.368800 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] The token cache is being invalidate because project 771b387fab924be28a3547253bdeaf8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:55:00.369101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:00.369763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-889bbeaa-1d77-4256-8493-39b2d5d7bb45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:00.371395 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4373/8736] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:55:00 2022] DELETE /identity/v3/projects/771b387fab924be28a3547253bdeaf8f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:09.862706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:09.863334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:09.863334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:09.887623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:55:09.888915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:09.955880 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4364/8737] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:55:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:55:10.363900 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:13.805570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d623-d29c-4116-8e8d-5521bdcd247f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:13.806895 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d623-d29c-4116-8e8d-5521bdcd247f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:13.807411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87d623-d29c-4116-8e8d-5521bdcd247f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:13.840785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7b87d623-d29c-4116-8e8d-5521bdcd247f None None] MFA Rules not processed for user `fd806060ca794b879e2500fe8dfa317f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:55:13.842328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b87d623-d29c-4116-8e8d-5521bdcd247f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:13.938253 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4374/8738] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:55:13 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:55:19.947177 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=45,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:23.927961 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=25 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:33.473220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:33.476906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:33.641582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2203abad-b3f5-40f8-8084-eddf91afa20b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:33.649887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:33.651201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:33.651728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:33.652294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:33.655976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:33.697902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:33.700268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c531-bbe5-4eb5-9fa7-9c3c1ae3ba09 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:33.700832 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c531-bbe5-4eb5-9fa7-9c3c1ae3ba09 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:33.700981 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c531-bbe5-4eb5-9fa7-9c3c1ae3ba09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:33.701617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:33.739849 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4365/8739] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:55:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:55:33.782678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-16d2c531-bbe5-4eb5-9fa7-9c3c1ae3ba09 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:55:33.783887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-16d2c531-bbe5-4eb5-9fa7-9c3c1ae3ba09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:33.864850 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4375/8740] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 11:55:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:55:33.929176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:33.930960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:34.044484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed16da2-2e18-447c-8eb9-54656721bbad service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:34.057904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:34.057904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:34.057904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:34.057904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:34.069076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:34.070727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:34.081277 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4366/8741] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:55:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:55:35.423870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947737-1bff-4231-a50e-7a7d7abce33a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:35.424255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947737-1bff-4231-a50e-7a7d7abce33a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:35.424385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2947737-1bff-4231-a50e-7a7d7abce33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:35.443168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e2947737-1bff-4231-a50e-7a7d7abce33a None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:55:35.444395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e2947737-1bff-4231-a50e-7a7d7abce33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:35.451947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4376/8742] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:55:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:55:44.076723 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=77 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:45.436574 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:45.437772 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=47 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:45.439656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:45.518710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa3162-e1d9-48aa-87b6-cf9fe5616ec9 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:45.525201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:45.526478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:45.527520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:45.527520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] PATH_INFO: `/v3/users/fd806060ca794b879e2500fe8dfa317f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:45.528283 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd806060ca794b879e2500fe8dfa317f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:45.530591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:45.583475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd806060ca794b879e2500fe8dfa317f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:45.584153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd806060ca794b879e2500fe8dfa317f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:45.592536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd806060ca794b879e2500fe8dfa317f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:45.593223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd806060ca794b879e2500fe8dfa317f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:45.601357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd806060ca794b879e2500fe8dfa317f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:45.621915 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4367/8743] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:55:45 2022] DELETE /identity/v3/users/fd806060ca794b879e2500fe8dfa317f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:45.626650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:45.627156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:45.627601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:45.646615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:55:45.647845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:45.716292 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4377/8744] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:55:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 11:55:45.726984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:45.728657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:45.803878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5289de46-9341-42e8-ac6d-c44e2b2159b2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:45.807845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:45.808676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:45.808952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:45.809238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:45.819237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:45.820964 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:45.831188 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4368/8745] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:55:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:55:46.019893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:46.021671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:46.043279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741c2af-fd90-49ba-be6d-a41233765388 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:46.063121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:46.064024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:46.064298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:46.064589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] PATH_INFO: `/v3/projects/a2295e5311ba4a81a45e376ef3b6d645` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:46.065903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2295e5311ba4a81a45e376ef3b6d645)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:46.068168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:46.151449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2295e5311ba4a81a45e376ef3b6d645', 'request_id': 'req-657ac35a-2864-4f94-a656-fe33fcf1c223'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.161712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2295e5311ba4a81a45e376ef3b6d645', 'request_id': 'req-657ac35a-2864-4f94-a656-fe33fcf1c223'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.170229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2295e5311ba4a81a45e376ef3b6d645', 'request_id': 'req-657ac35a-2864-4f94-a656-fe33fcf1c223'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.184368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] The token cache is being invalidate because project a2295e5311ba4a81a45e376ef3b6d645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:55:46.184368 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.185504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.188428 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4378/8746] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:55:46 2022] DELETE /identity/v3/projects/a2295e5311ba4a81a45e376ef3b6d645 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:46.191874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:46.198809 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:46.204129 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db4583-17db-43a0-b249-c7184545d0f6 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:46.289552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:46.290369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:46.290657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:46.290939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] PATH_INFO: `/v3/users/af9f01708caa4edeb26bae17c81a474f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:46.292796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9f01708caa4edeb26bae17c81a474f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:46.295128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:46.352954 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9f01708caa4edeb26bae17c81a474f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.354053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9f01708caa4edeb26bae17c81a474f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.363601 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9f01708caa4edeb26bae17c81a474f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.364450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9f01708caa4edeb26bae17c81a474f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.373207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9f01708caa4edeb26bae17c81a474f'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.395466 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4369/8747] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:55:46 2022] DELETE /identity/v3/users/af9f01708caa4edeb26bae17c81a474f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:46.710753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:46.713283 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:46.730536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ac35a-2864-4f94-a656-fe33fcf1c223 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:46.797936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:46.798795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:46.799017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:46.799289 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] PATH_INFO: `/v3/projects/905ea7177571401091184ade903ad3c3` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:46.800530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=905ea7177571401091184ade903ad3c3)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:46.802482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:46.837208 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:46.857926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '905ea7177571401091184ade903ad3c3', 'request_id': 'req-477804fe-e6c3-49e5-a4f0-c59de4365900'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.868046 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '905ea7177571401091184ade903ad3c3', 'request_id': 'req-477804fe-e6c3-49e5-a4f0-c59de4365900'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.876041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '905ea7177571401091184ade903ad3c3', 'request_id': 'req-477804fe-e6c3-49e5-a4f0-c59de4365900'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.888424 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] The token cache is being invalidate because project 905ea7177571401091184ade903ad3c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:55:46.888715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.889499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:46.891020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4379/8748] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:55:46 2022] DELETE /identity/v3/projects/905ea7177571401091184ade903ad3c3 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:46.895360 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:46.896888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:46.910744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f90fae-0868-41db-b7dc-b346479751c9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:46.974387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:46.975298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:46.975610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:46.975855 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] PATH_INFO: `/v3/users/85abea023af146d0a8c798d46ccb4d91` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:46.977241 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85abea023af146d0a8c798d46ccb4d91)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:46.979243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:47.012534 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:47.036754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85abea023af146d0a8c798d46ccb4d91'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.037406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85abea023af146d0a8c798d46ccb4d91'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.044668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85abea023af146d0a8c798d46ccb4d91'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.045284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85abea023af146d0a8c798d46ccb4d91'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.052684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-7cf9e4b3-187d-4f71-ae5a-e5486b45f8f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85abea023af146d0a8c798d46ccb4d91'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.071066 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4370/8749] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:55:46 2022] DELETE /identity/v3/users/85abea023af146d0a8c798d46ccb4d91 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:47.260377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:55:47.261873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:55:47.284220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477804fe-e6c3-49e5-a4f0-c59de4365900 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:55:47.364785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:55:47.365677 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:55:47.365941 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:55:47.366206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] PATH_INFO: `/v3/projects/c6112435db6846e0957f6f5be9279792` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:55:47.367414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6112435db6846e0957f6f5be9279792)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:55:47.369374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:55:47.437081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6112435db6846e0957f6f5be9279792', 'request_id': 'req-234c8994-3881-46a6-9cb6-753416fad8ac'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.445868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6112435db6846e0957f6f5be9279792', 'request_id': 'req-234c8994-3881-46a6-9cb6-753416fad8ac'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.452742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6112435db6846e0957f6f5be9279792', 'request_id': 'req-234c8994-3881-46a6-9cb6-753416fad8ac'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.464408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] The token cache is being invalidate because project c6112435db6846e0957f6f5be9279792 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:55:47.464719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.465510 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:55:47.467299 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4380/8750] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:55:47 2022] DELETE /identity/v3/projects/c6112435db6846e0957f6f5be9279792 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:55:57.067242 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=6,keystone:SELECT=19,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:55:57.460901 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=13,keystone:SELECT=65,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:27.407085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e97b-439e-4e3c-af6c-45a3c4e10f22 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:27.408071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e97b-439e-4e3c-af6c-45a3c4e10f22 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:27.408071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e97b-439e-4e3c-af6c-45a3c4e10f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:27.440397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f448e97b-439e-4e3c-af6c-45a3c4e10f22 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:27.441637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f448e97b-439e-4e3c-af6c-45a3c4e10f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:27.532735 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4371/8751] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 11:56:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:27.546641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:27.548437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:27.666237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c8994-3881-46a6-9cb6-753416fad8ac admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:27.674066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93883696-2e7e-4550-a212-c5489c212ec9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:27.675176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883696-2e7e-4550-a212-c5489c212ec9 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:27.675623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883696-2e7e-4550-a212-c5489c212ec9 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:27.676078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93883696-2e7e-4550-a212-c5489c212ec9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:27.687148 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93883696-2e7e-4550-a212-c5489c212ec9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:27.688841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93883696-2e7e-4550-a212-c5489c212ec9 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:27.699029 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4381/8752] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 11:56:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 11:56:37.529784 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=38 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:37.694899 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=43 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:45.645110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:45.645710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:45.645710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:45.667676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:45.668924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:45.726977 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4372/8753] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:46.534239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:46.534737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:46.534841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:46.585676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:56:46.586917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:46.656790 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4382/8754] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:56:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:56:46.671808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:56:46.674058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:56:46.693325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf38e97-842a-4112-9b54-ef3b29325d3e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:56:46.698688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22161cb0-421a-435e-babb-90f853087764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:56:46.699346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22161cb0-421a-435e-babb-90f853087764 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:56:46.699623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22161cb0-421a-435e-babb-90f853087764 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:56:46.699906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22161cb0-421a-435e-babb-90f853087764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:56:46.715242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22161cb0-421a-435e-babb-90f853087764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:56:46.716953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22161cb0-421a-435e-babb-90f853087764 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:56:46.728017 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4373/8755] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:56:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:56:56.646490 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=39 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:56:56.723203 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=31 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:04.056506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:04.057907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:04.146281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3735eb-984c-4e00-a4cb-1464f975153a None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:04.151952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:04.152653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:04.152939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:04.153215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:04.155031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:04.170114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:04.171709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:04.185249 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4383/8756] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:09.141067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22161cb0-421a-435e-babb-90f853087764 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:09.142563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-22161cb0-421a-435e-babb-90f853087764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:09.161300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22161cb0-421a-435e-babb-90f853087764 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:09.167071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:09.167737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:09.168004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:09.168296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:09.170184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:09.187078 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:09.188750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:09.205972 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4374/8757] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:14.178084 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=38 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:19.195889 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:34.692559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:34.709055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29980216-fd86-404b-b333-9721e5ea7c53 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:34.715164 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:34.715838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:34.716104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:34.716401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:34.718686 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:34.749350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:34.751156 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:34.765270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4384/8758] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:36.448481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:36.450151 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:36.469340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eea55c-47ad-4a52-80e4-f18762f72664 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:36.475712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:36.476432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:36.476781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:36.477139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:36.479691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:36.497306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:36.499689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:36.515793 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4375/8759] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:44.757662 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=11 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:46.508287 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:48.027679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:48.044603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fba7348-7ea0-4b05-acfd-c44e3989483b service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:48.051591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:48.052259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:48.052567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:48.052841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:48.054917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:48.118173 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:48.119771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af75584d-c22c-4938-803e-2da13df38c7a service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:48.129259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4385/8760] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:50.923312 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:50.942051 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd4894-d712-4cde-bc65-19a730a14f06 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:50.949457 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:50.950157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:50.950571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:50.950910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:50.953018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:50.969924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:50.971902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:50.988563 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4376/8761] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:52.571894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:52.572440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:52.572553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:52.612147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:57:52.613436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:52.670680 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4386/8762] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Jul 19 11:57:52 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:57:52.676858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:52.686265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364f40d3-7751-476b-8dd3-8f2c9643a8e0 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:52.690082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:52.690724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:52.691013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:52.691284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:52.693260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:52.766658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:52.768207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:52.779576 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4377/8763] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:57:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:57:59.214743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:59.216365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:59.240279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97709b7a-2120-475a-9c4c-170c78fd9e05 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:59.246479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:59.247394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:59.247676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:59.247950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] PATH_INFO: `/v3/users/5f070a3e8dca4ed2921dcca7b93e21c0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:59.249546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f070a3e8dca4ed2921dcca7b93e21c0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:59.251810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:59.318091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f070a3e8dca4ed2921dcca7b93e21c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.327692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f070a3e8dca4ed2921dcca7b93e21c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.342542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f070a3e8dca4ed2921dcca7b93e21c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.343391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f070a3e8dca4ed2921dcca7b93e21c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.351920 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f070a3e8dca4ed2921dcca7b93e21c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.361315 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4387/8764] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:57:59 2022] DELETE /identity/v3/users/5f070a3e8dca4ed2921dcca7b93e21c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:57:59.570995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:59.583305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef84f5b-01a9-4776-a111-273237016dcc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:59.653470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:59.654415 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:59.654854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:59.655181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] PATH_INFO: `/v3/projects/e07bd423dec645e5880a1ad1b1a73c00` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:59.656567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07bd423dec645e5880a1ad1b1a73c00)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:59.658758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:59.718940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07bd423dec645e5880a1ad1b1a73c00', 'request_id': 'req-b6b81d96-69d7-4634-acc2-41885cc8a34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.726426 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07bd423dec645e5880a1ad1b1a73c00', 'request_id': 'req-b6b81d96-69d7-4634-acc2-41885cc8a34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.733758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07bd423dec645e5880a1ad1b1a73c00', 'request_id': 'req-b6b81d96-69d7-4634-acc2-41885cc8a34e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.752294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] The token cache is being invalidate because project e07bd423dec645e5880a1ad1b1a73c00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:57:59.752805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.754108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.756880 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4378/8765] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:57:59 2022] DELETE /identity/v3/projects/e07bd423dec645e5880a1ad1b1a73c00 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 11:57:59.762693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:57:59.764273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:57:59.785769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51c849e-549f-4fed-bb44-f233437e943b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:57:59.792291 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:57:59.860240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:57:59.861091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:57:59.861371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:57:59.861620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] PATH_INFO: `/v3/users/d816ee1399d043839a9f73cbcf5f4de4` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:57:59.863082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d816ee1399d043839a9f73cbcf5f4de4)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:57:59.865281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:57:59.917901 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd816ee1399d043839a9f73cbcf5f4de4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.926257 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd816ee1399d043839a9f73cbcf5f4de4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.940692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd816ee1399d043839a9f73cbcf5f4de4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.941432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd816ee1399d043839a9f73cbcf5f4de4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.949382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd816ee1399d043839a9f73cbcf5f4de4'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:57:59.956603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4388/8766] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 11:57:59 2022] DELETE /identity/v3/users/d816ee1399d043839a9f73cbcf5f4de4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:58:00.167602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:58:00.169513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:58:00.189681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b81d96-69d7-4634-acc2-41885cc8a34e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:58:00.203784 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:58:00.264744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:58:00.265653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:58:00.265944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:58:00.266219 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] PATH_INFO: `/v3/projects/9e4f3dc90fcc4571ba585ba2b880477d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:58:00.267478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e4f3dc90fcc4571ba585ba2b880477d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:58:00.269790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:58:00.327660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e4f3dc90fcc4571ba585ba2b880477d', 'request_id': 'req-ee0c07af-e92e-4739-a2c4-bafc541a15d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:58:00.334842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e4f3dc90fcc4571ba585ba2b880477d', 'request_id': 'req-ee0c07af-e92e-4739-a2c4-bafc541a15d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:58:00.341880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e4f3dc90fcc4571ba585ba2b880477d', 'request_id': 'req-ee0c07af-e92e-4739-a2c4-bafc541a15d2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:58:00.359099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] The token cache is being invalidate because project 9e4f3dc90fcc4571ba585ba2b880477d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 11:58:00.359375 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:58:00.360092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-ee0c07af-e92e-4739-a2c4-bafc541a15d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 11:58:00.361842 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4379/8767] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 11:58:00 2022] DELETE /identity/v3/projects/9e4f3dc90fcc4571ba585ba2b880477d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 11:58:09.952623 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:58:10.355641 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:59:06.607316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:06.608865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:06.710160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb453501-c35c-4102-b8ca-a479ffa98323 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:06.781956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:06.782616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:06.782904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:06.783188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:06.785177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:06.848483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:06.850515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:06.860616 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4389/8768] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:59:08.550511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcda68-127c-4c2e-be87-00c8d43a7dbe None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:08.551139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcda68-127c-4c2e-be87-00c8d43a7dbe None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:08.551139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fcda68-127c-4c2e-be87-00c8d43a7dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:08.588833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f3fcda68-127c-4c2e-be87-00c8d43a7dbe None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:59:08.590054 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f3fcda68-127c-4c2e-be87-00c8d43a7dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:08.645058 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4380/8769] 10.222.0.15 () {58 vars in 1062 bytes} [Tue Jul 19 11:59:08 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:59:08.653611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:08.668717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f863c-0697-4848-a7c5-6aea85ddb4bf service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:08.673712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:08.674360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:08.674646 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:08.674916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:08.676939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:08.693972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:08.695435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:08.710219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4390/8770] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:59:15.442056 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931ded8-ee55-4765-a5f7-eddda6fb21fa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:15.442883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931ded8-ee55-4765-a5f7-eddda6fb21fa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:15.442883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931ded8-ee55-4765-a5f7-eddda6fb21fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:15.464974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9931ded8-ee55-4765-a5f7-eddda6fb21fa None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:59:15.466201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9931ded8-ee55-4765-a5f7-eddda6fb21fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:15.474828 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4381/8771] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 11:59:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:59:15.806359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:15.813348 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:59:15.818406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55446-6e1f-48ef-a145-735bbb0a3171 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:15.823405 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:15.824054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:15.824375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:15.824638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:15.826600 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:15.841436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:15.842940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:15.854379 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4391/8772] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:59:17.354708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:17.355293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:17.355293 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:17.375823 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 11:59:17.377092 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:17.448745 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4382/8773] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 11:59:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 11:59:17.460549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:17.462198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:17.481280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0d9bb-8796-42c4-b75e-1e0d4ef17828 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:17.487216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:17.487852 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:17.488136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:17.488452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:17.497725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:17.499358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:17.509971 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4392/8774] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:59:27.440090 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=60 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:59:27.505278 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:59:27.889130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:27.898629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82766b-7160-4981-bd1e-71e69b2198a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:27.903198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:27.903813 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:27.904093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:27.904388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:27.906456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:27.923832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:27.925365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:27.939514 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4383/8775] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:59:36.584609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:36.586276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:36.600239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c1c592-84a1-4bf4-b64f-49dd7f8afb81 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:36.608358 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:36.609064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:36.609333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:36.609649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:36.611978 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:36.681780 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:36.683248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f2260-a22b-4317-ac1a-19218701fefa service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:36.693803 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4393/8776] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 11:59:37.931699 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:59:38.444956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 11:59:38.454196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0aef3-24e0-4078-8fa3-abab703f2ba5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 11:59:38.458268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 11:59:38.459026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 11:59:38.459262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 11:59:38.459476 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 11:59:38.461427 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 11:59:38.475338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 11:59:38.476850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 11:59:38.488790 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4384/8777] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 11:59:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 11:59:46.688793 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=30 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 11:59:48.483805 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:01:16.816409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:01:16.817020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:01:16.817020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:01:16.838951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] MFA Rules not processed for user `7365119e3cc74e4fbfefd8d261fb3216`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:01:16.840193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:01:16.848338 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4394/8778] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:01:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:01:22.650325 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:01:22.660014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706b7e4-fb23-4f60-a3a7-e6a0dd61b0eb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:01:22.664934 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:01:22.665885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:01:22.666180 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:01:22.666500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:01:22.669251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:01:22.694605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:01:22.696491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:01:22.709357 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4385/8779] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:01:26.831898 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:01:32.702238 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:02:39.476469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:39.493450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67f47b5-f2bd-469c-a862-da8e6dd348ae None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:39.499595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:39.500281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:39.500591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:39.500864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:39.502926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:39.517791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:39.519391 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:39.534915 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4395/8780] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:39.700915 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:02:39.702395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:39.720470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b7d12-4b3e-45ab-bb1f-4c6de0a9e78c service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:02:39.725594 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:02:39.726244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:02:39.726521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:02:39.726796 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:02:39.728668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:02:39.743431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:02:39.745050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:02:39.758356 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4386/8781] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:02:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:02:49.525495 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:02:49.751293 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:21.383763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:21.387569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:21.415796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2354a140-942b-4029-ba28-00532524bd84 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:21.423215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86186952-746b-494c-8f8c-df610f579640 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:21.423215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86186952-746b-494c-8f8c-df610f579640 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:21.423585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86186952-746b-494c-8f8c-df610f579640 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:21.423733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86186952-746b-494c-8f8c-df610f579640 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:21.425558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86186952-746b-494c-8f8c-df610f579640 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:21.443073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86186952-746b-494c-8f8c-df610f579640 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:21.445095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86186952-746b-494c-8f8c-df610f579640 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:21.461629 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4396/8782] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:24.440045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:24.441881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:24.461638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45d9ade-ebf1-4ed7-9b26-ce9df859c422 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:24.467745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:24.468860 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:24.476417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:24.477088 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:24.479174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:24.498227 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:24.498748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:24.520194 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4387/8783] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:31.452368 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:34.513122 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:48.197035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86186952-746b-494c-8f8c-df610f579640 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:48.206902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86186952-746b-494c-8f8c-df610f579640 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:48.210820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:48.211488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:48.211775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:48.212054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:48.213907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:48.315868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:48.317377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:48.328233 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4397/8784] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:03:51.316393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:51.334410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6328ed62-c1e5-47c7-bea8-39ea0232bfb0 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:51.339925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:51.340665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:51.340952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:51.341391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:51.343255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:51.360057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:51.361741 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:51.377029 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4388/8785] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:55.014882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:55.029798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ace8ff-6ebe-4aa0-b9cf-57fad078500e service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:55.035158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:55.035850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:55.036135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:55.036454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:55.038310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:55.053480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:55.055095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:55.069821 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4398/8786] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:03:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:03:55.082800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:55.084294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:55.100029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285b002-3cb6-4bf0-afee-d9f08db510b7 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:55.105791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:55.106689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:55.106995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:55.107276 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] PATH_INFO: `/v3/users/7365119e3cc74e4fbfefd8d261fb3216` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:55.123502 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7365119e3cc74e4fbfefd8d261fb3216)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:55.125508 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:55.179224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7365119e3cc74e4fbfefd8d261fb3216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.179917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7365119e3cc74e4fbfefd8d261fb3216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.186990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7365119e3cc74e4fbfefd8d261fb3216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.187626 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7365119e3cc74e4fbfefd8d261fb3216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.194924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7365119e3cc74e4fbfefd8d261fb3216'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.212440 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4389/8787] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:03:55 2022] DELETE /identity/v3/users/7365119e3cc74e4fbfefd8d261fb3216 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:03:55.402694 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:55.417174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44ae09b-80b6-4b10-aa5d-017be38fb18d service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:55.489928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:55.490854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:55.491139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:55.491415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] PATH_INFO: `/v3/projects/343d6a3561fa46fc9ca586b6661d78c8` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:55.504669 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] RBAC: Authorizing `identity:delete_project(project_id=343d6a3561fa46fc9ca586b6661d78c8)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:55.506656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:55.559207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '343d6a3561fa46fc9ca586b6661d78c8', 'request_id': 'req-1f02c760-b963-4a93-9587-5068385e8feb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.563109 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:55.567360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '343d6a3561fa46fc9ca586b6661d78c8', 'request_id': 'req-1f02c760-b963-4a93-9587-5068385e8feb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.576013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '343d6a3561fa46fc9ca586b6661d78c8', 'request_id': 'req-1f02c760-b963-4a93-9587-5068385e8feb'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.589022 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] The token cache is being invalidate because project 343d6a3561fa46fc9ca586b6661d78c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:03:55.589312 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.589979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.591590 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4399/8788] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:03:55 2022] DELETE /identity/v3/projects/343d6a3561fa46fc9ca586b6661d78c8 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:03:55.595909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:55.597309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:55.612620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63298a1a-b0d3-4174-bf6c-cf05fba4205a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:55.676492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:55.677721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:55.678007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:55.678282 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] PATH_INFO: `/v3/users/30953a926e3c42498f09a7a5892ee15c` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:55.693201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30953a926e3c42498f09a7a5892ee15c)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:55.695173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:55.735188 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:03:55.743511 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30953a926e3c42498f09a7a5892ee15c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.744304 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30953a926e3c42498f09a7a5892ee15c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.753027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30953a926e3c42498f09a7a5892ee15c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.753890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30953a926e3c42498f09a7a5892ee15c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.762201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-900da984-74ae-469e-8a37-f97b4777eec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30953a926e3c42498f09a7a5892ee15c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:55.782167 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4390/8789] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:03:55 2022] DELETE /identity/v3/users/30953a926e3c42498f09a7a5892ee15c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:03:55.974781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:03:55.976277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:03:55.990590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f02c760-b963-4a93-9587-5068385e8feb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:03:56.050997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:03:56.051886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:03:56.052294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:03:56.052709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] PATH_INFO: `/v3/projects/7f2f9dea02b64b7dbffe63954efcee5c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:03:56.063993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2f9dea02b64b7dbffe63954efcee5c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:03:56.065943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:03:56.120602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2f9dea02b64b7dbffe63954efcee5c', 'request_id': 'req-01226394-3cf9-4141-98c5-2859bf2adc77'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:56.130095 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2f9dea02b64b7dbffe63954efcee5c', 'request_id': 'req-01226394-3cf9-4141-98c5-2859bf2adc77'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:56.137875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2f9dea02b64b7dbffe63954efcee5c', 'request_id': 'req-01226394-3cf9-4141-98c5-2859bf2adc77'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:56.150333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] The token cache is being invalidate because project 7f2f9dea02b64b7dbffe63954efcee5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:03:56.150592 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:56.151395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-01226394-3cf9-4141-98c5-2859bf2adc77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:03:56.153058 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4400/8790] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:03:55 2022] DELETE /identity/v3/projects/7f2f9dea02b64b7dbffe63954efcee5c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:05.777027 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:05.852553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:05.852846 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:05.853064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:05.901692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:05.902914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:05.964326 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4391/8791] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:05.973796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:05.974406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:05.974406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:05.994479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:05.995709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:06.004670 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4401/8792] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:06.011352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.021633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4cf26-84b3-43a2-9c11-efd037b77f9a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.026638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.027364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.027621 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.027903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.028704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:04:06.029016 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.030697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.044287 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4392/8793] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:04:06.058417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.068369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf25c4-8a8c-44b3-850f-d82fa5700146 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.074099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.074781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.075036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.075302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.075997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.077943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.119716 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4402/8794] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:04:06 2022] POST /identity/v3/projects => generated 393 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:04:06.120945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.131481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb907-08c6-43d9-9c9c-2859387f1189 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.193105 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.193778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.194066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.194343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.195055 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.197043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.220669 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4393/8795] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:04:06 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:04:06.225061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.236539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fecbb-f404-4d1a-b791-51b018fea7a5 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.242616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.243280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.243551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.243820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.244585 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.246193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.257162 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4403/8796] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:04:06.261577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.272564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1515dac-604d-4c50-bf23-d4f1a5ffd411 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.278391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08baa0e2-9d50-4d8b-aebf-5180a5587eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.279030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baa0e2-9d50-4d8b-aebf-5180a5587eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.279298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baa0e2-9d50-4d8b-aebf-5180a5587eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.279568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08baa0e2-9d50-4d8b-aebf-5180a5587eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.280310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08baa0e2-9d50-4d8b-aebf-5180a5587eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.281985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08baa0e2-9d50-4d8b-aebf-5180a5587eb1 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.293426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4394/8797] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:04:06.298331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.312194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6074ad36-2887-4e5e-b402-f99fafb0d494 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.321085 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.321839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.322138 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.322422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] PATH_INFO: `/v3/projects/80dc837a8f6c48c8989ef89074e43f81/users/d0c37b84d48e43608e959c2710a7d06f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.337501 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:06.342647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80dc837a8f6c48c8989ef89074e43f81, user_id=d0c37b84d48e43608e959c2710a7d06f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.347433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.364992 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4404/8798] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:04:06 2022] PUT /identity/v3/projects/80dc837a8f6c48c8989ef89074e43f81/users/d0c37b84d48e43608e959c2710a7d06f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:06.378662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.378953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.379230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.406243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] MFA Rules not processed for user `d0c37b84d48e43608e959c2710a7d06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:06.407818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:06.448681 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:06.484872 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4395/8799] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:06.489692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.557855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2148e60-99b5-4209-8af3-695f2b14fa0f admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.562769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.563440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.563724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.563997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.564816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.566739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.595941 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4405/8800] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:04:06 2022] POST /identity/v3/projects => generated 393 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:04:06.600154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.611968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c1cef7-b5fd-42af-ae70-ed6a9e3f4738 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.674046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.674702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.674996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.675280 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.675972 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.677960 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.703529 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4396/8801] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:04:06 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:04:06.708431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.720794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297278aa-a73d-4177-aa8c-64579f451e22 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.726266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.726940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.727282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.727551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.728280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.730044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.741514 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4406/8802] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:04:06.745898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.756438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d1cc0-8430-4ba2-8a1b-f872dd5f73d6 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.761943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.762834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.763115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.763391 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] PATH_INFO: `/v3/projects/917b50257cfc445dacc44a484f68ffc5/users/96bf68fb07fd46c7b93665e7dd93fd49/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.779103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=917b50257cfc445dacc44a484f68ffc5, user_id=96bf68fb07fd46c7b93665e7dd93fd49, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.781837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.796667 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4397/8803] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:04:06 2022] PUT /identity/v3/projects/917b50257cfc445dacc44a484f68ffc5/users/96bf68fb07fd46c7b93665e7dd93fd49/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:06.806595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.820333 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6f4051-be31-4db7-9123-89c30cfba8c9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.893074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886a096-24de-4e15-9ed0-4517269038a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.893993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a096-24de-4e15-9ed0-4517269038a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.894313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a096-24de-4e15-9ed0-4517269038a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.894576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886a096-24de-4e15-9ed0-4517269038a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.895594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886a096-24de-4e15-9ed0-4517269038a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.897613 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b886a096-24de-4e15-9ed0-4517269038a2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.909388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4407/8804] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:04:06.913940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:06.932806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee424b7f-a679-450c-bdc8-a66df53281e0 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:06.938393 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41a486-250b-4b16-9aa0-033507532dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:06.939306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41a486-250b-4b16-9aa0-033507532dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.939597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41a486-250b-4b16-9aa0-033507532dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.939875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41a486-250b-4b16-9aa0-033507532dba admin admin] PATH_INFO: `/v3/projects/917b50257cfc445dacc44a484f68ffc5/users/96bf68fb07fd46c7b93665e7dd93fd49/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:06.942118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41a486-250b-4b16-9aa0-033507532dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=917b50257cfc445dacc44a484f68ffc5, user_id=96bf68fb07fd46c7b93665e7dd93fd49, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:06.944872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41a486-250b-4b16-9aa0-033507532dba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:06.958232 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4398/8805] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:04:06 2022] PUT /identity/v3/projects/917b50257cfc445dacc44a484f68ffc5/users/96bf68fb07fd46c7b93665e7dd93fd49/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:06.970232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:06.970624 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:06.970967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:07.003268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] MFA Rules not processed for user `96bf68fb07fd46c7b93665e7dd93fd49`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:07.004535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:07.057582 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:07.081204 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4408/8806] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:07.093698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17c44-dd66-4faa-844e-f84b4af6e719 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:07.093988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17c44-dd66-4faa-844e-f84b4af6e719 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:07.094267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17c44-dd66-4faa-844e-f84b4af6e719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:07.113986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-09e17c44-dd66-4faa-844e-f84b4af6e719 None None] MFA Rules not processed for user `d0c37b84d48e43608e959c2710a7d06f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:07.115468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-09e17c44-dd66-4faa-844e-f84b4af6e719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:07.181854 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4399/8807] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:07.196660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:07.198342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:07.287436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503a6b85-2409-49a8-8540-854aaf205447 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:07.295917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:07.295917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:07.296508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:07.296615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:07.306117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:07.307738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:07.317400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4409/8808] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:08.318652 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:08.319226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:08.319226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:08.341132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:08.342409 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:08.372799 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:08.413057 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4400/8809] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jul 19 12:04:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:08.425869 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:08.427398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:08.446133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f7f6b5-8cf7-4d6b-8e0b-98f4de4ece36 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:08.453174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:08.454263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:08.454749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:08.455104 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:08.464720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:08.466371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:08.476809 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4410/8810] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:08.925251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:08.927266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:08.987704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3ed2d-fc82-4b37-8ea1-7e276a9eb690 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:08.991719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:08.992441 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:08.992729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:08.993074 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:08.995500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:09.013705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:09.015406 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:09.031959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4401/8811] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:16.105229 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:16.123623 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516813a-149c-41a3-a7e5-103fbe698caf service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:16.129463 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:16.130128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:16.130569 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:16.130856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:16.133140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:16.160631 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:16.162259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81366eb-606e-4648-8489-4bdd92016f46 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:16.177000 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4411/8812] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:18.685172 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:18.700514 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d989c7-6f7f-411b-8faa-91681fb0a18d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:18.706740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:18.707385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:18.707667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:18.707941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:18.717193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:18.718740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:18.728630 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4402/8813] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:18.743158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15059e49-41af-4c6f-a1ff-1ad57f79ab93 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:18.743707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15059e49-41af-4c6f-a1ff-1ad57f79ab93 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:18.743707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15059e49-41af-4c6f-a1ff-1ad57f79ab93 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:18.745166 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4412/8814] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 12:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:04:18.750111 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] Authenticating service token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 12:04:18.765906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:18.774849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7a8d02-e5b6-4f4a-ba89-83a645679598 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:18.780902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117e3109-0759-4914-a3cd-fed18b65b143 tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96bf68fb07fd46c7b93665e7dd93fd49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '917b50257cfc445dacc44a484f68ffc5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:18.781782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3109-0759-4914-a3cd-fed18b65b143 tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:18.782075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3109-0759-4914-a3cd-fed18b65b143 tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:18.782357 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117e3109-0759-4914-a3cd-fed18b65b143 tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] PATH_INFO: `/v3/projects/917b50257cfc445dacc44a484f68ffc5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:18.783727 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3109-0759-4914-a3cd-fed18b65b143 tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] RBAC: Authorizing `identity:get_project(project_id=917b50257cfc445dacc44a484f68ffc5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:18.785588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117e3109-0759-4914-a3cd-fed18b65b143 tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:18.787386 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4403/8815] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 12:04:18 2022] GET /identity/v3/projects/917b50257cfc445dacc44a484f68ffc5 => generated 393 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:04:18.939041 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15059e49-41af-4c6f-a1ff-1ad57f79ab93 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:18.950729 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15059e49-41af-4c6f-a1ff-1ad57f79ab93 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:18.954957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:18.955642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:18.956547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:18.957061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:18.959106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:18.972708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:18.974113 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:18.985588 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4413/8816] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:19.147705 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887dd5-30b9-495b-964b-95def4140c43 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:19.148032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887dd5-30b9-495b-964b-95def4140c43 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:19.148372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16887dd5-30b9-495b-964b-95def4140c43 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:19.150558 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4404/8817] 10.222.0.15 () {54 vars in 912 bytes} [Tue Jul 19 12:04:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:04:19.157304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] Authenticating service token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Jul 19 12:04:19.158771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:19.178545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:19.188715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f615e1c-2908-4986-a8c3-fd4ad6d982bf service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:19.194615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96bf68fb07fd46c7b93665e7dd93fd49', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '917b50257cfc445dacc44a484f68ffc5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:19.195481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:19.195763 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:19.196043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] PATH_INFO: `/v3/projects/917b50257cfc445dacc44a484f68ffc5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:19.197410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] RBAC: Authorizing `identity:get_project(project_id=917b50257cfc445dacc44a484f68ffc5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:19.199648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:19.202927 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4414/8818] 10.222.0.15 () {58 vars in 1443 bytes} [Tue Jul 19 12:04:19 2022] GET /identity/v3/projects/917b50257cfc445dacc44a484f68ffc5 => generated 393 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:04:19.377011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16887dd5-30b9-495b-964b-95def4140c43 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:19.392383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16887dd5-30b9-495b-964b-95def4140c43 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:19.399341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:19.400251 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:19.400640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:19.400984 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:19.403530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:19.417030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:19.418555 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138faa8-9f6d-46ca-9390-f1230160cb88 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:19.429747 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4405/8819] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:22.130943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:22.195514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38932b19-af5f-4f03-8199-48f29cd6bc4b tempest-ServersAdminNegativeTestJSON-1977951589 tempest-ServersAdminNegativeTestJSON-1977951589-project-admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:22.200311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:22.201261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:22.201541 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:22.201818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] PATH_INFO: `/v3/users/d0c37b84d48e43608e959c2710a7d06f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:22.203026 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c37b84d48e43608e959c2710a7d06f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:22.205078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:22.233642 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:22.256106 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c37b84d48e43608e959c2710a7d06f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.264967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c37b84d48e43608e959c2710a7d06f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.278029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c37b84d48e43608e959c2710a7d06f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.278718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c37b84d48e43608e959c2710a7d06f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.285861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c37b84d48e43608e959c2710a7d06f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.292046 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4415/8820] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:04:22 2022] DELETE /identity/v3/users/d0c37b84d48e43608e959c2710a7d06f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:22.297162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:22.297832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:22.297832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:22.317058 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:22.318319 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:22.391979 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4406/8821] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:22.403038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:22.404834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:22.470351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1133fba-5ada-4a5a-9de7-929d07b3bacb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:22.473987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:22.474642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:22.474914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:22.475254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:22.485332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:22.486263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:22.496672 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4416/8822] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:22.695834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:22.697377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:22.710286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b6f18-cbac-4640-bbe6-feae7a0b6987 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:22.715598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:22.716524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:22.716816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:22.717095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] PATH_INFO: `/v3/projects/80dc837a8f6c48c8989ef89074e43f81` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:22.718311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80dc837a8f6c48c8989ef89074e43f81)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:22.720269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:22.760046 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:22.774101 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80dc837a8f6c48c8989ef89074e43f81', 'request_id': 'req-bffbaab1-73cf-487d-83fc-24f69822785e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.780698 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80dc837a8f6c48c8989ef89074e43f81', 'request_id': 'req-bffbaab1-73cf-487d-83fc-24f69822785e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.786254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80dc837a8f6c48c8989ef89074e43f81', 'request_id': 'req-bffbaab1-73cf-487d-83fc-24f69822785e'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.803740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] The token cache is being invalidate because project 80dc837a8f6c48c8989ef89074e43f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:04:22.804267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.805192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.807589 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4407/8823] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:04:22 2022] DELETE /identity/v3/projects/80dc837a8f6c48c8989ef89074e43f81 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:22.812008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:22.823284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f092586-ef64-493e-94ef-e712d31c0d4d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:22.886662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:22.887690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:22.887948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:22.888220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] PATH_INFO: `/v3/users/96bf68fb07fd46c7b93665e7dd93fd49` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:22.889451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96bf68fb07fd46c7b93665e7dd93fd49)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:22.891434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:22.941508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96bf68fb07fd46c7b93665e7dd93fd49'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.943263 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:22.950050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96bf68fb07fd46c7b93665e7dd93fd49'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.963482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96bf68fb07fd46c7b93665e7dd93fd49'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.964135 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96bf68fb07fd46c7b93665e7dd93fd49'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.970992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-9c212faa-af05-4763-bd1c-917ff7c6c9d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96bf68fb07fd46c7b93665e7dd93fd49'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:22.977054 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4417/8824] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:04:22 2022] DELETE /identity/v3/users/96bf68fb07fd46c7b93665e7dd93fd49 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:04:23.265550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.267049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:23.282144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbaab1-73cf-487d-83fc-24f69822785e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.342822 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.343614 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.343897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.344177 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] PATH_INFO: `/v3/projects/917b50257cfc445dacc44a484f68ffc5` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.345413 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=917b50257cfc445dacc44a484f68ffc5)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.347352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.398307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '917b50257cfc445dacc44a484f68ffc5', 'request_id': 'req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:23.404778 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '917b50257cfc445dacc44a484f68ffc5', 'request_id': 'req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:23.411461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '917b50257cfc445dacc44a484f68ffc5', 'request_id': 'req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:23.425726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] The token cache is being invalidate because project 917b50257cfc445dacc44a484f68ffc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:04:23.426255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:23.426939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-afa2cd8b-f6ae-4efe-80b4-cec55ca02e96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:04:23.428678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4408/8825] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:04:23 2022] DELETE /identity/v3/projects/917b50257cfc445dacc44a484f68ffc5 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:04:23.434988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.435486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.435625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.456258 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:23.457514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:23.523815 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4418/8826] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:23.532435 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.532725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.533020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.554168 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:23.555384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:23.564366 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4409/8827] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:23.568883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.579667 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe33a4-f242-489d-a634-ba4c43be1f1f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.584765 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.585420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.585701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.585986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.586745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:04:23.587051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.588737 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.601442 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4419/8828] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:04:23.606258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.616755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc657186-e231-48ef-9c41-a45216523b7a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.622899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.623567 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.623830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.624117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.624876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.626800 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.656559 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4410/8829] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:04:23 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:04:23.661193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.671846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8811d9e-9d72-42ec-9038-d32615baaedf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.737224 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.737904 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.738183 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.738460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.739163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.741163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.767040 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4420/8830] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:04:23 2022] POST /identity/v3/users => generated 290 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:04:23.768856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.785384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c564de-bc47-4185-a341-d3490cd5edb5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.793204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.794091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.794371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.794656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.795390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.797057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.808393 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4411/8831] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:04:23.812847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.824147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ca232-432b-4cd7-a61e-6eb9ad607ec9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.829690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3b34-9e40-4ad1-bb39-31fc90d95536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.830381 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b34-9e40-4ad1-bb39-31fc90d95536 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.830632 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b34-9e40-4ad1-bb39-31fc90d95536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.830923 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3b34-9e40-4ad1-bb39-31fc90d95536 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.831682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3b34-9e40-4ad1-bb39-31fc90d95536 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.833338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3b34-9e40-4ad1-bb39-31fc90d95536 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.848962 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4421/8832] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:04:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:04:23.850236 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:23.862403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe4a1d8-4c66-4f82-932b-920c0a3bde77 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:23.869019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:23.870335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.870725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.871063 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] PATH_INFO: `/v3/projects/c4da87145cdd410bbeca66b527f7eeda/users/8bdec900808a47a88aac030c1a93fbf3/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.874957 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:23.889665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4da87145cdd410bbeca66b527f7eeda, user_id=8bdec900808a47a88aac030c1a93fbf3, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:23.892670 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:23.908118 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4412/8833] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:04:23 2022] PUT /identity/v3/projects/c4da87145cdd410bbeca66b527f7eeda/users/8bdec900808a47a88aac030c1a93fbf3/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:04:23.913545 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faef3ec-4ad6-4934-96ef-66ad5ea5cd13 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:23.913903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faef3ec-4ad6-4934-96ef-66ad5ea5cd13 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:23.914268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faef3ec-4ad6-4934-96ef-66ad5ea5cd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:23.931425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2faef3ec-4ad6-4934-96ef-66ad5ea5cd13 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:23.932616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2faef3ec-4ad6-4934-96ef-66ad5ea5cd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:23.962935 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:24.001652 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4422/8834] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:04:24.012007 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:24.014299 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:24.088988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1c08b-513e-4d9f-ba24-acae07db8b60 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:24.095216 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb2ade-fde1-4438-89e1-4e27c72fe5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:24.095884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2ade-fde1-4438-89e1-4e27c72fe5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:24.096171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2ade-fde1-4438-89e1-4e27c72fe5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:24.097260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb2ade-fde1-4438-89e1-4e27c72fe5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:24.109134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb2ade-fde1-4438-89e1-4e27c72fe5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:24.110988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb2ade-fde1-4438-89e1-4e27c72fe5b6 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:24.121599 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4413/8835] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:28.244363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:28.244873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:28.244873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:28.272622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] MFA Rules not processed for user `8bdec900808a47a88aac030c1a93fbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:28.273837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:28.354647 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4423/8836] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:28.367828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1afc-782d-4c0f-af4d-7080fb0ca2ab None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:28.368428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1afc-782d-4c0f-af4d-7080fb0ca2ab None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:28.368428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb1afc-782d-4c0f-af4d-7080fb0ca2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:28.389220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-3bdb1afc-782d-4c0f-af4d-7080fb0ca2ab None None] MFA Rules not processed for user `8bdec900808a47a88aac030c1a93fbf3`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:28.390920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3bdb1afc-782d-4c0f-af4d-7080fb0ca2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:28.397955 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4414/8837] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:28.410980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:28.412747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:28.512396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088adb8a-b3d1-40d9-a854-28a78ec30121 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:28.523115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:28.523796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:28.524083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:28.524388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:28.533717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:28.535340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:28.544941 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4424/8838] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:28.577490 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:28.577866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:28.578218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:28.634784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] MFA Rules not processed for user `2bbe7cd61ad745a9833acd3d3e4a066d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:28.636337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:28.705562 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4415/8839] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:28.711853 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:28.722192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e398-94ce-4eff-a028-e22ae74cc27e service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:28.726280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:28.726936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:28.727208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:28.727484 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:28.729445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:28.748602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:28.750189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:28.765482 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4425/8840] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:29.397851 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:29.399586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:29.467623 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:29.489746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3a333-ccdf-41d6-b5f6-4b63cba19495 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:29.495416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:29.496093 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:29.496598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:29.496882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:29.498818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:29.514228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:29.515790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:29.526946 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4416/8841] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:38.327673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:38.330013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:38.347848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d8305-e220-40d7-951a-d897d0d3e509 service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:38.353195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:38.353899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:38.354184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:38.354455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:38.356698 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:38.370548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:38.371996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841b308-edb9-4ba8-ad91-775a1e9ed947 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:38.384318 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4426/8842] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:39.522362 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:40.768658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:40.778267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047030b3-b7f1-4f5d-992f-1fe93ed560d1 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:40.782036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:40.782689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:40.782969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:40.783412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:40.785492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:40.799871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:40.801587 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d333-e784-4343-b3aa-ee152b824286 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:40.814349 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4417/8843] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:40.943756 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966cf44-ea34-4cc4-8183-4a0fa6d88a16 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:40.944416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966cf44-ea34-4cc4-8183-4a0fa6d88a16 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:40.944416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966cf44-ea34-4cc4-8183-4a0fa6d88a16 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:40.945750 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4427/8844] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:04:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:04:40.950753 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:40.951109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:40.951401 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:40.970484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:40.971700 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:40.981026 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4418/8845] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:04:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:41.003445 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966cf44-ea34-4cc4-8183-4a0fa6d88a16 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:41.020728 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966cf44-ea34-4cc4-8183-4a0fa6d88a16 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:41.026201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:41.026845 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.027126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.027401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.036281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:41.037944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:41.048416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4428/8846] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:41.239552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:41.249983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4823f066-6cf4-4ceb-922a-77779aac7db0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:41.254061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:41.254706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.254986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.255257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.257214 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:41.275421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:41.276898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482de1ff-ce6d-4317-8574-dfddde31d18f service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:41.291257 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4419/8847] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:41.365262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:41.378912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b986bf-9ad0-4acf-b3cd-a93a299b3d5a service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:41.385838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:41.386490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.386771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.387042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.389278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:41.398114 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:41.402403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:41.404122 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02eca0-5ccd-4553-aaa1-3d718e33a46c service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:41.414802 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4429/8848] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:04:41.748901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.749322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.749608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.773169 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:41.774444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:41.785227 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4420/8849] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 19 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:41.813991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.814280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.814579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.816388 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:41.829923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db8d60-f3c5-4a57-bd45-ee6077e82119 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:41.834108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:04:41.835311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:41.835486 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:04:41.835900 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.836223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.836499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.845021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4430/8850] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:04:41.845559 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:41.847163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:41.851003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:04:41.857966 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4421/8851] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:04:41.860862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd034a7c-5e35-4000-9942-a9e0b6136fca None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:04:41.866543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:04:41.867192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:04:41.867472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:04:41.867742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:04:41.879193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:04:41.880020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:04:41.890767 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4431/8852] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:04:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:04:51.853888 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=24 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:04:51.886148 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=12 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:27.719087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:27.729957 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1aa5b-06a7-4494-9f1c-63271dd59102 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:27.735642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:27.736667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:27.736956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:27.737235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] PATH_INFO: `/v3/users/8bdec900808a47a88aac030c1a93fbf3` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:27.738445 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdec900808a47a88aac030c1a93fbf3)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:27.740428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:27.789226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdec900808a47a88aac030c1a93fbf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:27.789909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdec900808a47a88aac030c1a93fbf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:27.801864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdec900808a47a88aac030c1a93fbf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:27.802583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdec900808a47a88aac030c1a93fbf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:27.810352 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a5449b6d-c4e7-4fde-8f39-61918916bb5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdec900808a47a88aac030c1a93fbf3'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:27.829307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4422/8853] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:05:27 2022] DELETE /identity/v3/users/8bdec900808a47a88aac030c1a93fbf3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:05:28.015801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.032757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a90ca7-c3d7-47cb-9518-88d54c71e6bf service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.098120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.099020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.099298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.099566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] PATH_INFO: `/v3/projects/c4da87145cdd410bbeca66b527f7eeda` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.100876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4da87145cdd410bbeca66b527f7eeda)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.102867 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.151665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4da87145cdd410bbeca66b527f7eeda', 'request_id': 'req-bd963238-3afe-4b03-867d-cbdd267deeaa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:28.161422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4da87145cdd410bbeca66b527f7eeda', 'request_id': 'req-bd963238-3afe-4b03-867d-cbdd267deeaa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:28.168706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4da87145cdd410bbeca66b527f7eeda', 'request_id': 'req-bd963238-3afe-4b03-867d-cbdd267deeaa'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:28.184239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] The token cache is being invalidate because project c4da87145cdd410bbeca66b527f7eeda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:05:28.184714 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:28.185722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-bd963238-3afe-4b03-867d-cbdd267deeaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:05:28.187956 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4432/8854] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:05:28 2022] DELETE /identity/v3/projects/c4da87145cdd410bbeca66b527f7eeda => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:05:28.195460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.195746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.196024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.215342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:28.216622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:28.290310 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4423/8855] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:28.299338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.299666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.299944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.324828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:28.326140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:28.336259 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4433/8856] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:28.341389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.352561 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390c35e-c049-4b26-b258-afa1032e8675 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.358607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.359369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.359793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.360154 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.361321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:05:28.361750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.364399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.383379 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4424/8857] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:05:28.388167 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.398772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e6093-b156-432f-9e4b-524b0b801d5b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.404967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.405575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.405850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.406117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.406812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.408788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.438732 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4434/8858] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:05:28 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:05:28.443939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.456758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed21a2d-0e6f-4487-b4dd-a06ae8ff5f41 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.526867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.527558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.527839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.528110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.528830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.530763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.537384 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:28.555084 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4425/8859] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:05:28 2022] POST /identity/v3/users => generated 291 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:05:28.558554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.569154 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9525a-1566-4610-a315-a8266a8fdcd6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.574321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.574991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.575276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.575554 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.576290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.577955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.589225 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4435/8860] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:05:28.593424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.605143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8cfe1b-9dd8-400c-8b8b-57897c02c85a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.611060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9b99fe-f125-4ecc-badb-6c91640eb0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.611760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b99fe-f125-4ecc-badb-6c91640eb0ca admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.612050 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b99fe-f125-4ecc-badb-6c91640eb0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.612329 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b99fe-f125-4ecc-badb-6c91640eb0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.613096 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b99fe-f125-4ecc-badb-6c91640eb0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.614748 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9b99fe-f125-4ecc-badb-6c91640eb0ca admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.626515 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4426/8861] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:05:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:05:28.630898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.641908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63406701-e41e-440b-b751-2ef64c8471c6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.647401 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.648372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.648666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.648952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] PATH_INFO: `/v3/projects/0501aec311ff4920b67077cd0ebe83b9/users/5de9cbf9c020469ea60f3e9dbb10951d/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.666326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0501aec311ff4920b67077cd0ebe83b9, user_id=5de9cbf9c020469ea60f3e9dbb10951d, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.668918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.694179 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4436/8862] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:05:28 2022] PUT /identity/v3/projects/0501aec311ff4920b67077cd0ebe83b9/users/5de9cbf9c020469ea60f3e9dbb10951d/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:05:28.699486 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a2c6-1d5f-4058-9b00-315b3a79de9a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.699786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a2c6-1d5f-4058-9b00-315b3a79de9a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.700086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6a2c6-1d5f-4058-9b00-315b3a79de9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.718920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-94e6a2c6-1d5f-4058-9b00-315b3a79de9a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:28.720114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-94e6a2c6-1d5f-4058-9b00-315b3a79de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:28.783836 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4427/8863] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:05:28.793946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:28.795926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:28.829586 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:28.861982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eacc19-c298-4875-9833-91751f172d6e admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:28.865823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9eb9c2-e9bc-45a4-aa97-8c9355177888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:28.866721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eb9c2-e9bc-45a4-aa97-8c9355177888 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:28.866971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eb9c2-e9bc-45a4-aa97-8c9355177888 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:28.867250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9eb9c2-e9bc-45a4-aa97-8c9355177888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:28.879030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eb9c2-e9bc-45a4-aa97-8c9355177888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:28.880528 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9eb9c2-e9bc-45a4-aa97-8c9355177888 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:28.890913 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4437/8864] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:05:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:05:33.109337 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:33.110194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:33.110532 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:33.142638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] MFA Rules not processed for user `5de9cbf9c020469ea60f3e9dbb10951d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:33.144973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:33.213775 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4428/8865] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:05:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:33.224873 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb28d83-7d91-4dab-9ced-e48c41aa5e9f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:33.225321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb28d83-7d91-4dab-9ced-e48c41aa5e9f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:33.225446 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb28d83-7d91-4dab-9ced-e48c41aa5e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:33.243951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5cb28d83-7d91-4dab-9ced-e48c41aa5e9f None None] MFA Rules not processed for user `5de9cbf9c020469ea60f3e9dbb10951d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:33.245328 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5cb28d83-7d91-4dab-9ced-e48c41aa5e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:33.253305 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4438/8866] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:05:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:33.266192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:33.267731 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:33.348885 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0590608-4c26-49b2-a373-d4861a11a05a None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:33.354648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a140f8ff-e952-4fde-b6ea-1858bf141e85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:33.355313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140f8ff-e952-4fde-b6ea-1858bf141e85 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:33.355763 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140f8ff-e952-4fde-b6ea-1858bf141e85 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:33.355848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a140f8ff-e952-4fde-b6ea-1858bf141e85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:33.360886 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:33.365398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140f8ff-e952-4fde-b6ea-1858bf141e85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:33.367825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a140f8ff-e952-4fde-b6ea-1858bf141e85 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:33.378740 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4429/8867] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:05:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:05:43.238727 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=17 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:43.373958 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:45.681417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988f16-a63b-48f6-95fb-f6b224eb415f None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:45.681980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988f16-a63b-48f6-95fb-f6b224eb415f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:45.681980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28988f16-a63b-48f6-95fb-f6b224eb415f None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:45.683431 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4439/8868] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:05:45.689569 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68258109-3ed2-4e84-9848-35051217de1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:45.690103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68258109-3ed2-4e84-9848-35051217de1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:45.690340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68258109-3ed2-4e84-9848-35051217de1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:45.739344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-68258109-3ed2-4e84-9848-35051217de1b None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:05:45.740926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-68258109-3ed2-4e84-9848-35051217de1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:45.825649 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4430/8869] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:05:45 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:05:45.851436 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988f16-a63b-48f6-95fb-f6b224eb415f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:05:45.853558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-28988f16-a63b-48f6-95fb-f6b224eb415f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:05:45.873826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28988f16-a63b-48f6-95fb-f6b224eb415f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:05:45.880684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4374218-96cb-4eb7-a65b-ef851299a673 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:05:45.881373 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374218-96cb-4eb7-a65b-ef851299a673 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:05:45.881658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374218-96cb-4eb7-a65b-ef851299a673 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:05:45.881939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4374218-96cb-4eb7-a65b-ef851299a673 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:05:45.892215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374218-96cb-4eb7-a65b-ef851299a673 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:05:45.893974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4374218-96cb-4eb7-a65b-ef851299a673 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:05:45.906147 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4440/8870] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:05:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:05:55.821959 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=37 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:05:55.900681 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:06:07.050586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f4c8-40af-4c78-86a7-bb2bd7a90df2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:07.051121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f4c8-40af-4c78-86a7-bb2bd7a90df2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:07.051121 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458f4c8-40af-4c78-86a7-bb2bd7a90df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:07.096577 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7458f4c8-40af-4c78-86a7-bb2bd7a90df2 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:07.097745 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7458f4c8-40af-4c78-86a7-bb2bd7a90df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:07.108623 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4431/8871] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jul 19 12:06:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:08.302206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:08.302799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:08.302799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:08.323189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:08.324336 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:08.335469 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4441/8872] 10.222.0.15 () {58 vars in 1059 bytes} [Tue Jul 19 12:06:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:17.092815 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:06:18.317944 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:06:20.207362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:20.207968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:20.207968 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:20.227442 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:20.229412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:20.238392 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4432/8873] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:06:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:20.249937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:20.251466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:20.274995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160cd8c-c841-4fab-83be-9e09435cda82 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:20.278866 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cbbb2c-45ba-401d-8976-a1724be01484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:20.279488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbbb2c-45ba-401d-8976-a1724be01484 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:20.279789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbbb2c-45ba-401d-8976-a1724be01484 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:20.280038 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cbbb2c-45ba-401d-8976-a1724be01484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:20.290972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbbb2c-45ba-401d-8976-a1724be01484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:20.292431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cbbb2c-45ba-401d-8976-a1724be01484 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:20.305048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4442/8874] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:23.274517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:23.284896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55adf8-5e9d-4838-98a6-a6947511a10f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:23.289347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:23.290049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:23.290328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:23.290612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:23.292632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:23.306403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:23.307958 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:23.320204 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4433/8875] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:24.002015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55ec3-7c83-4666-a14f-b106446eb97b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:24.002574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55ec3-7c83-4666-a14f-b106446eb97b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:24.002574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b55ec3-7c83-4666-a14f-b106446eb97b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:24.022959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-e8b55ec3-7c83-4666-a14f-b106446eb97b None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:24.024267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8b55ec3-7c83-4666-a14f-b106446eb97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:24.034271 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4443/8876] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:06:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:24.045582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:24.054584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2036b9-477d-4d76-a277-5d1c4243ee33 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:24.058518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19a5c6-f18a-4c98-91f6-f8a4220d1ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:24.059517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a5c6-f18a-4c98-91f6-f8a4220d1ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:24.059517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a5c6-f18a-4c98-91f6-f8a4220d1ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:24.059772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19a5c6-f18a-4c98-91f6-f8a4220d1ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:24.071046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a5c6-f18a-4c98-91f6-f8a4220d1ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:24.072639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19a5c6-f18a-4c98-91f6-f8a4220d1ff5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:24.083489 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4434/8877] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:28.995211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:28.995781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:28.995781 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:29.025542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] MFA Rules not processed for user `5de9cbf9c020469ea60f3e9dbb10951d`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:29.026772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:29.054292 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4444/8878] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:06:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:32.252603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3b13f-202a-4a98-a114-0190cd477ff7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:32.253138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3b13f-202a-4a98-a114-0190cd477ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:32.253221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3b13f-202a-4a98-a114-0190cd477ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:32.273305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f0b3b13f-202a-4a98-a114-0190cd477ff7 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:32.274669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f0b3b13f-202a-4a98-a114-0190cd477ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:32.303107 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4435/8879] 10.222.0.16 () {58 vars in 1015 bytes} [Tue Jul 19 12:06:32 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:32.318065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:32.328687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef88570-3fcf-41c1-9cf9-daeb1446991f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:32.332675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35793875-de04-47e3-b1bf-610797954d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:32.333557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793875-de04-47e3-b1bf-610797954d66 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:32.333874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793875-de04-47e3-b1bf-610797954d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:32.334254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35793875-de04-47e3-b1bf-610797954d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:32.342813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793875-de04-47e3-b1bf-610797954d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:32.344267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35793875-de04-47e3-b1bf-610797954d66 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:32.352470 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4445/8880] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:40.745013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c8a4-06dc-464c-9c63-3ec1b1857dc7 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:40.745610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c8a4-06dc-464c-9c63-3ec1b1857dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:40.745610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c8a4-06dc-464c-9c63-3ec1b1857dc7 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:40.747130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4436/8881] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:06:40.752451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:40.753064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:40.753064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:40.773120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:40.774338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:40.793006 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4446/8882] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:40.813542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e72a-e098-41a0-b8a5-4760e9921f1b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:40.813752 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e72a-e098-41a0-b8a5-4760e9921f1b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:40.814025 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9e72a-e098-41a0-b8a5-4760e9921f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:40.832036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0cd9e72a-e098-41a0-b8a5-4760e9921f1b None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:06:40.833250 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0cd9e72a-e098-41a0-b8a5-4760e9921f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:06:40.842138 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4437/8883] 10.222.0.15 () {58 vars in 1058 bytes} [Tue Jul 19 12:06:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:06:40.848407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:06:40.859432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e439c4-2355-4ebc-baf5-a3e269d77ec5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:06:40.865054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:06:40.865708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:06:40.865989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:06:40.866267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:06:40.875511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:06:40.877150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:06:40.887199 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4447/8884] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:06:50.827524 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=28 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:06:50.883249 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=46 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:10.372612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea102-484c-465d-87e1-fabb4e4b9679 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:10.373171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea102-484c-465d-87e1-fabb4e4b9679 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:10.373171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ea102-484c-465d-87e1-fabb4e4b9679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:10.404363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-9a9ea102-484c-465d-87e1-fabb4e4b9679 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:10.405598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9a9ea102-484c-465d-87e1-fabb4e4b9679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:10.413218 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4438/8885] 10.222.0.49 () {58 vars in 1015 bytes} [Tue Jul 19 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:10.425838 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:10.436396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da24da-0e92-49a3-a32b-af4d113c9ba9 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:10.440196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:10.440915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:10.441202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:10.441512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:10.449561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:10.451030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:10.459547 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4448/8886] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:13.015173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595a468-d53f-4221-8230-aa511b1d4c84 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:13.016021 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595a468-d53f-4221-8230-aa511b1d4c84 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:13.016642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f595a468-d53f-4221-8230-aa511b1d4c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:13.036889 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f595a468-d53f-4221-8230-aa511b1d4c84 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:13.038163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f595a468-d53f-4221-8230-aa511b1d4c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:13.067444 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4439/8887] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:07:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:13.083700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:13.096998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941d32b-ee81-4cf6-8ce7-a576f1dd365d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:13.102823 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:13.103492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:13.103775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:13.104054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:13.114983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:13.116549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:13.127631 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4449/8888] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:17.003203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:17.003203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:17.003203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:17.025148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:17.026634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:17.038077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4440/8889] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:07:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:07:17.065843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:17.078250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78dfff9-dd4f-4e24-8447-67d6a78a1ab0 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:17.089179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:17.091610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:17.091915 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:17.092236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:17.103383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:17.105064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:17.120552 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4450/8890] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:25.479356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:25.510557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79df10a7-4a0c-447b-9b62-55058c7161a0 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:25.519036 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:25.520311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:25.520622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:25.520899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] PATH_INFO: `/v3/users/5de9cbf9c020469ea60f3e9dbb10951d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:25.522175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de9cbf9c020469ea60f3e9dbb10951d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:25.524592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:25.575781 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de9cbf9c020469ea60f3e9dbb10951d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.576456 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de9cbf9c020469ea60f3e9dbb10951d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.585650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de9cbf9c020469ea60f3e9dbb10951d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.586334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de9cbf9c020469ea60f3e9dbb10951d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.594030 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-19cdf8ad-3dad-495e-9b17-890b2005a08f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de9cbf9c020469ea60f3e9dbb10951d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.611481 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4441/8891] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:07:25 2022] DELETE /identity/v3/users/5de9cbf9c020469ea60f3e9dbb10951d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:25.823935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:25.844482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2bf9b0-d9d0-4970-ad4b-46860cdfb314 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:25.919284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:25.920170 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:25.920481 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:25.920762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] PATH_INFO: `/v3/projects/0501aec311ff4920b67077cd0ebe83b9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:25.922031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0501aec311ff4920b67077cd0ebe83b9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:25.923967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:25.976416 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0501aec311ff4920b67077cd0ebe83b9', 'request_id': 'req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.985536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0501aec311ff4920b67077cd0ebe83b9', 'request_id': 'req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:25.992228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0501aec311ff4920b67077cd0ebe83b9', 'request_id': 'req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:26.003165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] The token cache is being invalidate because project 0501aec311ff4920b67077cd0ebe83b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:07:26.003454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:26.004182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-44e40d6a-3bb3-4aeb-ae54-7b2ed959961d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:07:26.005865 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4451/8892] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:07:25 2022] DELETE /identity/v3/projects/0501aec311ff4920b67077cd0ebe83b9 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:26.011262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.011557 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.011844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.032267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:26.033537 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:26.103157 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4442/8893] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:26.111426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.111711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.111988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.132115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:26.133377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:26.143515 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4452/8894] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:26.148879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.160630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef54972-1638-4bc5-a41c-6932e35b77e4 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.166560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.167226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.167513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.167780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.168544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:07:26.168850 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.170499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.183101 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4443/8895] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:07:26.187715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.198005 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae69b6-4aaa-4d1c-9755-be3a545f4571 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.203047 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.203707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.203983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.204255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.204994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.206927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.243416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4453/8896] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:07:26 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:07:26.247848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.258959 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a089c89e-200d-4676-a23f-41cba826fe62 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.268083 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:26.323019 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.323716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.323986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.324261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.324995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.326948 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.354496 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4444/8897] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:07:26 2022] POST /identity/v3/users => generated 290 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:07:26.358979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.370261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22e2768-830b-4524-87d0-2a6193d20800 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.376340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.377062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.377345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.377625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.378371 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.380009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.392156 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4454/8898] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:07:26.396912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.407896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38271c75-2dbc-4228-81e0-76472459c59e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.413716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40199e4-8081-4eec-8062-6f9d49a769a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.414395 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40199e4-8081-4eec-8062-6f9d49a769a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.414672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40199e4-8081-4eec-8062-6f9d49a769a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.414944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40199e4-8081-4eec-8062-6f9d49a769a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.415671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40199e4-8081-4eec-8062-6f9d49a769a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.417451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40199e4-8081-4eec-8062-6f9d49a769a0 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.428699 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4445/8899] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:07:26.433960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.445198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47437-7c21-405f-ba13-e455adffe32d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.450407 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.451840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.452137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.452447 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] PATH_INFO: `/v3/projects/01f1f191659048f5a1fbbb744adc21f4/users/cb8212275cf14cc9b1682f4e015d3705/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.461230 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:26.470642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01f1f191659048f5a1fbbb744adc21f4, user_id=cb8212275cf14cc9b1682f4e015d3705, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.473539 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.487627 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4455/8900] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:07:26 2022] PUT /identity/v3/projects/01f1f191659048f5a1fbbb744adc21f4/users/cb8212275cf14cc9b1682f4e015d3705/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:07:26.493690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52c8f-cb30-4f50-b84d-8fce2009a323 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.494231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52c8f-cb30-4f50-b84d-8fce2009a323 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.494231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52c8f-cb30-4f50-b84d-8fce2009a323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.514805 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0fb52c8f-cb30-4f50-b84d-8fce2009a323 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:26.516034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0fb52c8f-cb30-4f50-b84d-8fce2009a323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:26.584581 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4446/8901] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:07:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:26.595017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:26.597114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:26.661601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f1ccc-52e4-4eed-ad5f-4103792b9dd6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:26.665833 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:26.666529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:26.666779 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:26.667083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:26.677350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:26.678840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:26.689495 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4456/8902] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:30.962184 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62aabd-e760-4aaf-bf31-1a01a73ffec4 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:30.962726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62aabd-e760-4aaf-bf31-1a01a73ffec4 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:30.962726 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d62aabd-e760-4aaf-bf31-1a01a73ffec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:30.994762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5d62aabd-e760-4aaf-bf31-1a01a73ffec4 None None] MFA Rules not processed for user `cb8212275cf14cc9b1682f4e015d3705`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:30.996536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5d62aabd-e760-4aaf-bf31-1a01a73ffec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:31.088292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4447/8903] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:07:30 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:31.104377 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:31.105883 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:31.186727 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79ce95-cd52-4491-b571-082c9afc8421 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:31.193025 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8f124e-bb6f-417e-8228-8ddf840ebf0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:31.197422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f124e-bb6f-417e-8228-8ddf840ebf0e service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:31.197919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f124e-bb6f-417e-8228-8ddf840ebf0e service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:31.198413 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8f124e-bb6f-417e-8228-8ddf840ebf0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:31.217598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f124e-bb6f-417e-8228-8ddf840ebf0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:31.219634 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8f124e-bb6f-417e-8228-8ddf840ebf0e service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:31.238511 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4457/8904] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:32.769992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:32.770722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:32.771471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:32.791870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] MFA Rules not processed for user `cb8212275cf14cc9b1682f4e015d3705`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:32.793134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:32.802539 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4448/8905] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:07:32 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:07:33.193964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c369-5d21-420e-89ef-05065f85e2bd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:33.194917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c369-5d21-420e-89ef-05065f85e2bd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:33.195263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8c369-5d21-420e-89ef-05065f85e2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:33.215974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-21e8c369-5d21-420e-89ef-05065f85e2bd None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:07:33.217403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-21e8c369-5d21-420e-89ef-05065f85e2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:07:33.224685 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4458/8906] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:07:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:07:33.237709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:07:33.248871 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5748273d-31a4-41a3-8979-f26c188f4797 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:07:33.252739 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa3f15-b8f7-45a8-a126-20fd5ed24aa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:07:33.253806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3f15-b8f7-45a8-a126-20fd5ed24aa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:07:33.254220 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3f15-b8f7-45a8-a126-20fd5ed24aa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:07:33.254491 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa3f15-b8f7-45a8-a126-20fd5ed24aa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:07:33.263542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3f15-b8f7-45a8-a126-20fd5ed24aa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:07:33.265139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa3f15-b8f7-45a8-a126-20fd5ed24aa3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:07:33.275053 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4449/8907] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:07:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:07:43.210207 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:07:43.270942 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:16.759016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdd3a-1c08-4e0e-879b-de51b650edbf None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:16.759762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdd3a-1c08-4e0e-879b-de51b650edbf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:16.759762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bdd3a-1c08-4e0e-879b-de51b650edbf None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:16.761150 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4459/8908] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 19 12:08:16.766780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ade7-4ecd-4a4c-9a13-19c68f4191c5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:16.767380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ade7-4ecd-4a4c-9a13-19c68f4191c5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:16.767380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e00ade7-4ecd-4a4c-9a13-19c68f4191c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:16.845714 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5e00ade7-4ecd-4a4c-9a13-19c68f4191c5 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:08:16.846356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5e00ade7-4ecd-4a4c-9a13-19c68f4191c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:08:16.923192 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4450/8909] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:08:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:08:16.944927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdd3a-1c08-4e0e-879b-de51b650edbf None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:08:16.946805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bf6bdd3a-1c08-4e0e-879b-de51b650edbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:08:16.965094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bdd3a-1c08-4e0e-879b-de51b650edbf None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:08:16.970819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:08:16.971269 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:16.971579 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:16.971859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:16.983584 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:08:16.985271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:08:16.996579 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4460/8910] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:08:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:08:26.913884 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=40 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:26.991995 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:31.453580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf38ea9-45c8-4aa8-a7d2-37883537f34e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:31.454137 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf38ea9-45c8-4aa8-a7d2-37883537f34e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:31.454231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf38ea9-45c8-4aa8-a7d2-37883537f34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:31.482307 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cbf38ea9-45c8-4aa8-a7d2-37883537f34e None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:08:31.493027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cbf38ea9-45c8-4aa8-a7d2-37883537f34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:08:31.507144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4451/8911] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:08:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:08:31.543383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:08:31.544854 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:08:31.563804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c3a57-501a-442b-b4f2-88f86d450603 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:08:31.573639 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa84c5c-b852-4a7e-88e9-17b55597a986 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:08:31.574342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84c5c-b852-4a7e-88e9-17b55597a986 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:31.574629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84c5c-b852-4a7e-88e9-17b55597a986 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:31.574907 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa84c5c-b852-4a7e-88e9-17b55597a986 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:31.586196 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84c5c-b852-4a7e-88e9-17b55597a986 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:08:31.588098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa84c5c-b852-4a7e-88e9-17b55597a986 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:08:31.601048 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4461/8912] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:08:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:08:41.473636 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:41.596262 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:41.895237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:41.895530 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:41.896026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:41.914842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] MFA Rules not processed for user `cb8212275cf14cc9b1682f4e015d3705`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:08:41.916077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:08:41.924040 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4452/8913] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:08:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:08:42.249277 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6768-51f0-40a7-ab59-37eca21db727 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:42.249608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6768-51f0-40a7-ab59-37eca21db727 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:42.249936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eb6768-51f0-40a7-ab59-37eca21db727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:42.296023 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-80eb6768-51f0-40a7-ab59-37eca21db727 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:08:42.297295 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-80eb6768-51f0-40a7-ab59-37eca21db727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:08:42.305510 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4462/8914] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:08:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:08:42.320545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:08:42.331020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b9424-d7e5-440f-b680-a37a9fba1562 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:08:42.334946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de67650-35e2-4af4-96cc-41afe00da623 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:08:42.335575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de67650-35e2-4af4-96cc-41afe00da623 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:08:42.335888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de67650-35e2-4af4-96cc-41afe00da623 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:08:42.336165 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de67650-35e2-4af4-96cc-41afe00da623 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:08:42.344095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de67650-35e2-4af4-96cc-41afe00da623 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:08:42.345596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de67650-35e2-4af4-96cc-41afe00da623 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:08:42.354292 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4453/8915] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:08:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:08:52.293314 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=9 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:08:52.350675 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:09:38.806460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feac5c-5a04-40bc-aa00-ccaa857203f5 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:38.807076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feac5c-5a04-40bc-aa00-ccaa857203f5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:38.807076 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82feac5c-5a04-40bc-aa00-ccaa857203f5 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:38.808746 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4463/8916] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:09:38.814099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:38.814590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:38.814696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:38.833481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:09:38.834707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:38.844130 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4454/8917] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:09:38.867273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feac5c-5a04-40bc-aa00-ccaa857203f5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:09:38.869126 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-82feac5c-5a04-40bc-aa00-ccaa857203f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:38.886058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82feac5c-5a04-40bc-aa00-ccaa857203f5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:09:38.892217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:09:38.892868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:38.893145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:38.893421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:38.902268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:09:38.903825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:09:38.915530 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4464/8918] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:09:39.502808 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:09:39.513862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31146-c116-404f-aa48-2f2e8e37cb80 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:09:39.520412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:09:39.521340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:39.521718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:39.522076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:39.525020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:39.543159 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:09:39.544825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef979748-9d1e-4014-a8b8-b9644ddf91ca service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:09:39.557760 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4455/8919] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:09:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:09:43.832855 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:09:43.845458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f0e6-d361-44df-ab2e-e38938e28dc1 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:09:43.851326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:09:43.852291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:43.852606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:43.852886 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:43.854977 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:43.869529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:09:43.873367 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:09:43.890127 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4465/8920] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:09:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:09:49.551045 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=9 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:09:53.884682 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=12 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:09:55.332662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:55.332662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:55.333188 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:55.352252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] MFA Rules not processed for user `cb8212275cf14cc9b1682f4e015d3705`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:09:55.353515 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:55.361740 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4456/8921] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:09:55 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:09:56.026338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:09:56.037509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2b39-e129-49aa-b0e6-d3c996208de9 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:09:56.043326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:09:56.044078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:09:56.044366 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:09:56.044660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:09:56.046529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:09:56.060072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:09:56.061882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdbc5c5-84bb-48d9-9f71-2b855934ede7 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:09:56.072599 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4466/8922] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:09:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:05.346619 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:06.068177 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:42.426976 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:42.438383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424e0c1-8d69-4fae-ba5e-f0402d12e724 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:42.442179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:42.442838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:42.443132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:42.444127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:42.446127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:42.476001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:42.477672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44704cfe-4782-43e1-8d1f-edf6158c078e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:42.490613 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4457/8923] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:42.598687 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edf62-5396-41b1-a9ad-ae3d27871123 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:42.599759 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edf62-5396-41b1-a9ad-ae3d27871123 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:42.599875 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103edf62-5396-41b1-a9ad-ae3d27871123 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:42.601416 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4467/8924] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:10:42.609402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:42.609671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:42.609970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:42.630933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:10:42.632066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:42.642179 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4458/8925] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:10:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:10:42.666114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103edf62-5396-41b1-a9ad-ae3d27871123 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:42.683232 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103edf62-5396-41b1-a9ad-ae3d27871123 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:42.688831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:42.689525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:42.689807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:42.690108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:42.699625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:42.701290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:42.712001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4468/8926] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:42.885646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:42.895689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e7314-5938-4367-be04-50ce2f994ef8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:42.899723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:42.900411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:42.900674 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:42.900949 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:42.902844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:42.942685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:42.944011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b526d55-2646-40cf-9113-e48d856eab28 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:42.960237 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4459/8927] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:43.028217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:10:43.039616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7619587-d960-4978-a7fd-f85fb14b49aa service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:10:43.045309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:10:43.046063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:10:43.046752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:10:43.046985 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:10:43.049246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:10:43.062182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:10:43.063820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:10:43.075162 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4469/8928] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:10:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:10:52.950868 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=28 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:10:53.070219 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=12 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:11:12.566183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:12.566688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:12.566780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:12.585738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] MFA Rules not processed for user `cb8212275cf14cc9b1682f4e015d3705`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:11:12.587046 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:12.594668 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4460/8929] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:11:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:11:21.473132 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:11:21.483863 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3f98e-a6e7-40aa-9e59-a8bdbb6b5b5a service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:11:21.488159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:11:21.488849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:21.489131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:21.489422 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:21.491437 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:21.512020 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:11:21.513494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0de0ab-1042-40c8-94fa-f960efff51b8 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:11:21.524959 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4470/8930] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:11:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:11:22.580034 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:11:31.520180 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:11:48.138663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:11:48.141064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:48.157838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afd6de-db97-4c95-9c71-d1f0f2353ad8 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:11:48.162770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:11:48.163429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:11:48.163709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:11:48.163992 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:11:48.166199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:11:48.177898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:11:48.179709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:11:48.188999 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4461/8931] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:11:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:11:58.184749 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:00.249962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a383-afdd-48dd-8d04-2e5dfd47bcdf None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:00.250796 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a383-afdd-48dd-8d04-2e5dfd47bcdf None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:00.251014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5189a383-afdd-48dd-8d04-2e5dfd47bcdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:00.307573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5189a383-afdd-48dd-8d04-2e5dfd47bcdf None None] MFA Rules not processed for user `55aac242daf746b283fb3cb561b3462e`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:12:00.308862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5189a383-afdd-48dd-8d04-2e5dfd47bcdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:00.381888 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4471/8932] 10.222.0.15 () {58 vars in 1061 bytes} [Tue Jul 19 12:12:00 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:12:00.388254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:00.398364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e059ab-1d2e-497f-a454-7a681038d047 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:00.402681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:00.403324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:00.403613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:00.403884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:00.405818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:00.420772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:00.422242 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:00.433868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4462/8933] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:10.378113 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=38 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:10.428619 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:11.606034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031532c-667d-40f6-b8ab-6ed0f280fa48 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:11.606644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031532c-667d-40f6-b8ab-6ed0f280fa48 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:11.606644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031532c-667d-40f6-b8ab-6ed0f280fa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:11.628891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5031532c-667d-40f6-b8ab-6ed0f280fa48 None None] MFA Rules not processed for user `86cbfe3a2d7b4b25b4ec629118e20d5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:12:11.630180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5031532c-667d-40f6-b8ab-6ed0f280fa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:11.638001 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4472/8934] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:12:11.658468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:11.668495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35729d-901b-40f7-88ee-0ba1c688575d service cinder] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:11.672387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66bd46-5475-4376-b61f-6a0b633b982b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:11.673062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66bd46-5475-4376-b61f-6a0b633b982b service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:11.673347 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66bd46-5475-4376-b61f-6a0b633b982b service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:11.673624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66bd46-5475-4376-b61f-6a0b633b982b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:11.682542 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66bd46-5475-4376-b61f-6a0b633b982b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:11.683998 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66bd46-5475-4376-b61f-6a0b633b982b service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:11.692822 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4463/8935] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:11.800102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94b0cc-66f5-44aa-a8d4-1d7afd68b540 None None] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:11.800412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94b0cc-66f5-44aa-a8d4-1d7afd68b540 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:11.800690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94b0cc-66f5-44aa-a8d4-1d7afd68b540 None None] PATH_INFO: `/` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:11.802113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4473/8936] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:12:11.807294 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439414-51ea-410f-8758-c2d7cf5f33ad None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:11.807588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439414-51ea-410f-8758-c2d7cf5f33ad None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:11.807866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b439414-51ea-410f-8758-c2d7cf5f33ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:11.828759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6b439414-51ea-410f-8758-c2d7cf5f33ad None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:12:11.830059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6b439414-51ea-410f-8758-c2d7cf5f33ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:11.840868 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4464/8937] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:12:11.865614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94b0cc-66f5-44aa-a8d4-1d7afd68b540 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:11.882181 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94b0cc-66f5-44aa-a8d4-1d7afd68b540 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:11.888264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:11.888964 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:11.889250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:11.889530 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:11.899620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:11.901274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:11.912642 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4474/8938] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:12.098553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:12.098847 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:12.099127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:12.118609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:12:12.119806 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:12.129529 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4465/8939] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:12:12.141805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:12.152247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2ebb9-03fc-4b2e-b576-c76653b0fc3f service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:12.156372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:12.157033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:12.157315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:12.157594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:12.168821 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:12.170268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:12.182669 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4475/8940] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:22.112645 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:22.176816 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=15 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:31.842417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:31.857447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a669e4ff-27da-4be4-922d-9f8e931048a7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:31.864744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:31.865460 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:31.865798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:31.866120 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:31.875047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:31.876685 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:31.886108 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4466/8941] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:38.423995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:38.435868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b89eb8-ae7f-44b8-8f76-363d05891417 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:38.439997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:38.440692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:38.440993 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:38.441271 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:38.443200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:38.455273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:38.457497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:38.468474 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4476/8942] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:38.909485 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:38.922771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4adaac-f43b-438a-aaa3-eed789e20b42 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:38.928770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:38.929428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:38.929712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:38.929990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:38.931803 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:38.946848 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:38.948505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:38.964134 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4467/8943] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:12:48.464057 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:48.957826 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:12:54.681736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:12:54.699294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a16322-5b62-458b-929c-f0a42404455d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:12:54.706478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:12:54.707152 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:12:54.707429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:12:54.707697 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:12:54.709711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:12:54.724499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:12:54.726105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae36b7c-f5a8-42f0-b320-3f3bb50c0601 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:12:54.737243 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4477/8944] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:12:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:04.732812 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:25.114742 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:25.129196 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc68ec8-e386-443e-b585-c4b1687fc8f5 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:25.135819 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:25.136825 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:25.137258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:25.137613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:25.149146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:25.150639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:25.160959 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4468/8945] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:28.463282 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:28.463879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:28.463879 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:28.485735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:28.486970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:28.496656 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4478/8946] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:13:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:28.510465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:28.529363 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feddf52-ae50-4bff-bc8e-eebb6c17b9f1 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:28.535208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:28.536139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:28.536591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:28.537003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:28.537260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:28.552365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:28.552712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706aca1f-a9b9-44a8-9bbb-45b54d51745b None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:28.554301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:28.559363 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:28.560986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:28.561673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:28.562538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] PATH_INFO: `/v3/users/cb8212275cf14cc9b1682f4e015d3705` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:28.564629 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb8212275cf14cc9b1682f4e015d3705)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:28.568059 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:28.571912 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4469/8947] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:28.622398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb8212275cf14cc9b1682f4e015d3705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.631280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb8212275cf14cc9b1682f4e015d3705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.643640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb8212275cf14cc9b1682f4e015d3705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.644291 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb8212275cf14cc9b1682f4e015d3705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.652266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-6496fb9c-a08e-4abc-bafa-77b7edb93bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb8212275cf14cc9b1682f4e015d3705'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.660777 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4479/8948] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:13:28 2022] DELETE /identity/v3/users/cb8212275cf14cc9b1682f4e015d3705 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:13:28.848942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:28.860787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08972c5-352d-46c6-88ec-ad208b9c3046 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:28.922684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:28.923575 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:28.923865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:28.924143 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] PATH_INFO: `/v3/projects/01f1f191659048f5a1fbbb744adc21f4` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:28.925474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] RBAC: Authorizing `identity:delete_project(project_id=01f1f191659048f5a1fbbb744adc21f4)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:28.927422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:28.985833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01f1f191659048f5a1fbbb744adc21f4', 'request_id': 'req-492dd854-0a85-44be-a2de-41f9fb94672c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.992668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01f1f191659048f5a1fbbb744adc21f4', 'request_id': 'req-492dd854-0a85-44be-a2de-41f9fb94672c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:28.998821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01f1f191659048f5a1fbbb744adc21f4', 'request_id': 'req-492dd854-0a85-44be-a2de-41f9fb94672c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:29.015328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] The token cache is being invalidate because project 01f1f191659048f5a1fbbb744adc21f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:13:29.015527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:29.016365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-492dd854-0a85-44be-a2de-41f9fb94672c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:13:29.017939 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4470/8949] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:13:28 2022] DELETE /identity/v3/projects/01f1f191659048f5a1fbbb744adc21f4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:13:29.023248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.023532 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.023815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.043043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:29.044280 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:29.110113 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4480/8950] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:29.121261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.121552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.121921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.143071 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:29.144289 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:29.154612 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4471/8951] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:29.157913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.169101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7ecb7b-66be-4653-838e-15b963d39709 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.174628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.175457 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.175803 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.176114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.176997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:13:29.177369 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.179064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.192863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4481/8952] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:13:29.197447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.212547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7ed6b4-9fae-4f1e-af7b-61292ed3118e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.218697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.218969 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.219410 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.219663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.220366 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.222331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.256644 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4472/8953] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:13:29 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:13:29.259785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.271458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17fa54-afad-47c8-80d0-05fd37505db6 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.321804 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:29.333223 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.333914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.334198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.334475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.335176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.337230 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.360445 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4482/8954] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:13:29 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:13:29.364906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.375690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127d80ef-aec1-4944-a3e0-10f33e1baecc admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.380907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.381616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.381901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.382149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.382944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.384615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.395914 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4473/8955] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:13:29.400839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.413618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375a7de4-c188-4b7c-b096-08db9057afee admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.418542 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c48f754-6375-4457-990f-0da70722d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.419213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f754-6375-4457-990f-0da70722d127 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.419497 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f754-6375-4457-990f-0da70722d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.419771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c48f754-6375-4457-990f-0da70722d127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.420550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48f754-6375-4457-990f-0da70722d127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.422169 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c48f754-6375-4457-990f-0da70722d127 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.432915 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4483/8956] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:13:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:13:29.437735 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.448248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa16f67-23dc-4402-a548-961a1a8aa072 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.453147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.454106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.454387 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.454664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] PATH_INFO: `/v3/projects/4251bc65d8c545a9931fe1682944fdac/users/5f43a6f069f743ce89988079fd09605f/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.472144 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4251bc65d8c545a9931fe1682944fdac, user_id=5f43a6f069f743ce89988079fd09605f, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.475192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.486368 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:29.492487 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4474/8957] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:13:29 2022] PUT /identity/v3/projects/4251bc65d8c545a9931fe1682944fdac/users/5f43a6f069f743ce89988079fd09605f/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:13:29.498341 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82a373-d0dd-43ab-a9a1-1e48eb4d2e2d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.498861 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82a373-d0dd-43ab-a9a1-1e48eb4d2e2d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.498952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82a373-d0dd-43ab-a9a1-1e48eb4d2e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.524327 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-fe82a373-d0dd-43ab-a9a1-1e48eb4d2e2d None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:29.525513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fe82a373-d0dd-43ab-a9a1-1e48eb4d2e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:29.591221 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4484/8958] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:29.604733 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:29.606945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:29.666306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0db46b-7166-444d-bb72-c3139ed73fc9 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:29.670623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad91600-6263-410e-898d-22eceacb66e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:29.671270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad91600-6263-410e-898d-22eceacb66e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:29.671552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad91600-6263-410e-898d-22eceacb66e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:29.671821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad91600-6263-410e-898d-22eceacb66e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:29.681642 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad91600-6263-410e-898d-22eceacb66e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:29.683083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad91600-6263-410e-898d-22eceacb66e4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:29.695584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4475/8959] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:34.058778 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:34.059680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:34.061123 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:34.094755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] MFA Rules not processed for user `5f43a6f069f743ce89988079fd09605f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:34.096202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:34.171919 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4485/8960] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:13:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:34.182432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:34.182993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:34.182993 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:34.202062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] MFA Rules not processed for user `5f43a6f069f743ce89988079fd09605f`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:34.203389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:34.210870 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4476/8961] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:13:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:34.223275 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:34.224777 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:34.288328 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:34.305603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864170ba-1f8e-4555-af21-a4c20505cbf1 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:34.311201 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b17f70-e450-4eaa-ac2f-ee9a20052dfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:34.311878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b17f70-e450-4eaa-ac2f-ee9a20052dfc service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:34.312162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b17f70-e450-4eaa-ac2f-ee9a20052dfc service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:34.312839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b17f70-e450-4eaa-ac2f-ee9a20052dfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:34.321966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b17f70-e450-4eaa-ac2f-ee9a20052dfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:34.323618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b17f70-e450-4eaa-ac2f-ee9a20052dfc service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:34.333792 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4486/8962] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:34.602266 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:34.612326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c497197-089d-46f2-807f-22b4f67403cc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:34.616497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:34.617145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:34.617425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:34.617696 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:34.619757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:34.630425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:34.631901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:34.640724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4477/8963] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:13:44.329425 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:44.636828 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=35 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:44.798705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:44.799040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:44.799268 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:44.819758 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] MFA Rules not processed for user `5f43a6f069f743ce89988079fd09605f`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:13:44.821015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:44.828326 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4487/8964] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:13:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:13:48.593762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:13:48.611343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788f3e95-9c82-402d-81be-b0c305689f63 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:13:48.618160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:13:48.618830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:13:48.619374 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:13:48.619795 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:13:48.621840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:13:48.636866 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:13:48.638544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:13:48.653548 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4478/8965] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:13:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:13:54.814832 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:13:58.645463 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:08.143807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:08.156611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c855e06-3e88-4902-be0d-a2b030279949 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:08.161288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:08.162188 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:08.162478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:08.162744 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] PATH_INFO: `/v3/users/5f43a6f069f743ce89988079fd09605f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:08.164140 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f43a6f069f743ce89988079fd09605f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:08.166179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:08.219503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f43a6f069f743ce89988079fd09605f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.227337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f43a6f069f743ce89988079fd09605f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.240324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f43a6f069f743ce89988079fd09605f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.241063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f43a6f069f743ce89988079fd09605f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.248274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f05e1aaf-2353-4929-939a-6c789e3682c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f43a6f069f743ce89988079fd09605f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.254329 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4488/8966] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:14:08 2022] DELETE /identity/v3/users/5f43a6f069f743ce89988079fd09605f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:08.802974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:08.814694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aaf9c2-6d10-48bb-a106-2bb93b63f1cf service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:08.885987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:08.886859 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:08.887176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:08.887506 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] PATH_INFO: `/v3/projects/4251bc65d8c545a9931fe1682944fdac` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:08.888688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4251bc65d8c545a9931fe1682944fdac)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:08.890620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:08.942854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4251bc65d8c545a9931fe1682944fdac', 'request_id': 'req-91afcf71-eb77-4364-95a5-c684503cc2fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.949566 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4251bc65d8c545a9931fe1682944fdac', 'request_id': 'req-91afcf71-eb77-4364-95a5-c684503cc2fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.956128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4251bc65d8c545a9931fe1682944fdac', 'request_id': 'req-91afcf71-eb77-4364-95a5-c684503cc2fb'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.986039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] The token cache is being invalidate because project 4251bc65d8c545a9931fe1682944fdac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:14:08.986327 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.986995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-91afcf71-eb77-4364-95a5-c684503cc2fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:08.988676 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4479/8967] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:14:08 2022] DELETE /identity/v3/projects/4251bc65d8c545a9931fe1682944fdac => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:08.993892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:08.994176 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:08.994458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.046794 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:09.048032 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:09.115679 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4489/8968] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:09.130744 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.131037 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.131341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.151580 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:09.152842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:09.162459 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4480/8969] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:09.167533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.181896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c07e08-ceb6-4ec8-9e3e-7447e723adb7 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.187256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.187997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.188197 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.188508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.189244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:14:09.189601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.191551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.208505 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4490/8970] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:14:09.212703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.222355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785c9c9-584f-4aff-99fc-1cb2335d6398 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.228380 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.229083 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.229369 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.229646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.230343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.232314 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.272321 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4481/8971] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:14:09 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:14:09.276771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.287936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62237f9-63df-41ea-9507-0cd36ffcc5b3 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.322939 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:09.349319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.350006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.350286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.350564 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.351262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.353249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.373566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4491/8972] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:14:09 2022] POST /identity/v3/users => generated 285 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:14:09.377913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.388994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bbdd1c-c5b5-4857-8b0f-08bd839981ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.394248 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.394888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.395217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.395497 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.396235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.397902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.408835 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4482/8973] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:14:09.413177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.424380 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8222ac6e-d9df-457a-99fb-879f2c72dc5c admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.429692 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fc75cd-50fe-4aca-b8ec-d4d8218bce38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.430364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc75cd-50fe-4aca-b8ec-d4d8218bce38 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.430641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc75cd-50fe-4aca-b8ec-d4d8218bce38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.430917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fc75cd-50fe-4aca-b8ec-d4d8218bce38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.431659 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc75cd-50fe-4aca-b8ec-d4d8218bce38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.433326 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fc75cd-50fe-4aca-b8ec-d4d8218bce38 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.444769 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4492/8974] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:14:09.449815 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.463252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8d16e-6602-4d0a-9e29-cefc0f625d07 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.468953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.469942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.470223 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.470504 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] PATH_INFO: `/v3/projects/898f80f66eb54763a11c5050916397dc/users/f1e6576602ec462cb03d0787777c9847/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.487125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=898f80f66eb54763a11c5050916397dc, user_id=f1e6576602ec462cb03d0787777c9847, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.489996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.499004 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:09.505524 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4483/8975] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:14:09 2022] PUT /identity/v3/projects/898f80f66eb54763a11c5050916397dc/users/f1e6576602ec462cb03d0787777c9847/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:09.518273 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16befd62-b252-4166-81ce-0ad9d45c7c75 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.518565 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16befd62-b252-4166-81ce-0ad9d45c7c75 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.518851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16befd62-b252-4166-81ce-0ad9d45c7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.547665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-16befd62-b252-4166-81ce-0ad9d45c7c75 None None] MFA Rules not processed for user `f1e6576602ec462cb03d0787777c9847`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:09.548972 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-16befd62-b252-4166-81ce-0ad9d45c7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:09.619441 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4493/8976] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:14:09.632226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:09.635583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:09.710782 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf205da8-822b-41ab-af8c-ced7d375ff9a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:09.717059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:09.718010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:09.718416 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:09.718811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:09.730171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:09.731609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:09.740775 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4484/8977] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:18.029250 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:18.030385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:18.030919 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:18.063812 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:18.065147 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:18.185187 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4494/8978] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:14:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:18.205661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:18.207977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:18.229952 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8404d-953a-4ade-9ed8-ff3b8c2d2585 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:18.236039 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa875c0e-a130-4280-8b98-63b27e19bec3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:18.237150 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa875c0e-a130-4280-8b98-63b27e19bec3 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:18.237603 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa875c0e-a130-4280-8b98-63b27e19bec3 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:18.238034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa875c0e-a130-4280-8b98-63b27e19bec3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:18.248602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa875c0e-a130-4280-8b98-63b27e19bec3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:18.250428 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa875c0e-a130-4280-8b98-63b27e19bec3 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:18.262310 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4485/8979] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:20.161887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:20.213847 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:20.233627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e9aae-7101-473b-a4e8-3c6fde855e4f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:20.238578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:20.239469 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.239752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.240030 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] PATH_INFO: `/v3/users/f1e6576602ec462cb03d0787777c9847` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.241284 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e6576602ec462cb03d0787777c9847)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:20.243242 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:20.291986 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e6576602ec462cb03d0787777c9847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.300400 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e6576602ec462cb03d0787777c9847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.313040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e6576602ec462cb03d0787777c9847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.313701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e6576602ec462cb03d0787777c9847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.321580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e6576602ec462cb03d0787777c9847'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.327739 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4495/8980] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:14:20 2022] DELETE /identity/v3/users/f1e6576602ec462cb03d0787777c9847 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:20.332384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.332844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.332977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.351194 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:20.352397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:20.415747 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4486/8981] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:20.427301 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:20.428951 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:20.492014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d452972-34df-4d98-a9df-684ba1b24bb8 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:20.495742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f457f-d098-4dc0-aace-1b5ea1d9a171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:20.496435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f457f-d098-4dc0-aace-1b5ea1d9a171 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.496799 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f457f-d098-4dc0-aace-1b5ea1d9a171 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.496988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f457f-d098-4dc0-aace-1b5ea1d9a171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.506174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f457f-d098-4dc0-aace-1b5ea1d9a171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:20.507619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f457f-d098-4dc0-aace-1b5ea1d9a171 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:20.517727 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4496/8982] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:20.709067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:20.710647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:20.723191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a19cf-4804-4202-b1d9-20691eb72fc2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:20.728260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:20.729181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.729464 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.729728 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] PATH_INFO: `/v3/projects/898f80f66eb54763a11c5050916397dc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.730973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=898f80f66eb54763a11c5050916397dc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:20.732953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:20.795926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '898f80f66eb54763a11c5050916397dc', 'request_id': 'req-dc7a4f56-a459-4b0e-8631-551abbda0bc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.804535 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '898f80f66eb54763a11c5050916397dc', 'request_id': 'req-dc7a4f56-a459-4b0e-8631-551abbda0bc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.810480 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '898f80f66eb54763a11c5050916397dc', 'request_id': 'req-dc7a4f56-a459-4b0e-8631-551abbda0bc7'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.828977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] The token cache is being invalidate because project 898f80f66eb54763a11c5050916397dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:14:20.829269 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.829990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-dc7a4f56-a459-4b0e-8631-551abbda0bc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:20.831578 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4487/8983] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:14:20 2022] DELETE /identity/v3/projects/898f80f66eb54763a11c5050916397dc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:20.837184 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.837474 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.837753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.856452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:20.857678 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:20.920966 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4497/8984] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:20.929647 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.929947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.930226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.950891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:20.952531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:20.962952 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4488/8985] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:20.967683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:20.974345 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:20.978775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56899d8-b796-4301-b9a2-aa8c6cdd30c5 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:20.985053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:20.986171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:20.986633 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:20.986942 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:20.987966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:14:20.988477 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:20.990498 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.004411 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4498/8986] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:14:21.009454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:21.015564 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:21.020125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c72660-bdbd-4c87-b2ba-68fe1978a2e7 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:21.027608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:21.028616 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.028920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.029451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.030239 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:21.032434 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.061717 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4489/8987] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:14:21 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:14:21.066372 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:21.077890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41c55e-6c60-4785-8f6c-fd5544433abb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:21.135921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:21.136635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.136914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.137207 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.137912 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:21.139900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.162057 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4499/8988] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:14:21 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:14:21.166707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:21.179231 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de884cb-2f3d-4484-9aca-c64bb9c832f5 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:21.184297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:21.184986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.185292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.185564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.186301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:21.187936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.209805 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4490/8989] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:14:21.214830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:21.227473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc015b9-c33f-4ddd-9459-4b49130d9cb7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:21.233990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c879a6-0663-424a-af9b-81b9d7c4f110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:21.234792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c879a6-0663-424a-af9b-81b9d7c4f110 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.235157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c879a6-0663-424a-af9b-81b9d7c4f110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.235525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c879a6-0663-424a-af9b-81b9d7c4f110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.236281 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c879a6-0663-424a-af9b-81b9d7c4f110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:21.238048 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c879a6-0663-424a-af9b-81b9d7c4f110 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.252239 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4500/8990] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:14:21.256255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:21.266790 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf46216-a16d-48eb-a69c-8da1a5a3bc99 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:21.272602 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:21.273310 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.273589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.273891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] PATH_INFO: `/v3/projects/0bce6831113d41dfae2c2b38166130ce/users/7cc75e66c4f543dca861527bed422f3c/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.290045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bce6831113d41dfae2c2b38166130ce, user_id=7cc75e66c4f543dca861527bed422f3c, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:21.293018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.318541 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4491/8991] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:14:21 2022] PUT /identity/v3/projects/0bce6831113d41dfae2c2b38166130ce/users/7cc75e66c4f543dca861527bed422f3c/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:14:21.333717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.334120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.334523 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.370606 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] MFA Rules not processed for user `7cc75e66c4f543dca861527bed422f3c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:21.371844 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:21.448266 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4501/8992] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:21.458816 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:21.460917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:21.527835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67d601a-8214-437f-82e0-3ab2b066f182 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:21.532382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea449da-c7df-4974-8522-98d5f73aaa15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:21.533062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea449da-c7df-4974-8522-98d5f73aaa15 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:21.533349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea449da-c7df-4974-8522-98d5f73aaa15 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:21.533629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea449da-c7df-4974-8522-98d5f73aaa15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:21.542660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea449da-c7df-4974-8522-98d5f73aaa15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:21.544197 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea449da-c7df-4974-8522-98d5f73aaa15 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:21.553328 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4492/8993] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:26.194575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:26.271880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7c598-8c13-479e-b1eb-14a94cc3f6bd None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:26.277334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:26.278279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:26.278568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:26.278840 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] PATH_INFO: `/v3/users/7cc75e66c4f543dca861527bed422f3c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:26.280088 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cc75e66c4f543dca861527bed422f3c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:26.282080 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:26.283600 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:26.334103 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cc75e66c4f543dca861527bed422f3c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.343279 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cc75e66c4f543dca861527bed422f3c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.355801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cc75e66c4f543dca861527bed422f3c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.356475 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cc75e66c4f543dca861527bed422f3c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.363870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cc75e66c4f543dca861527bed422f3c'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.370429 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4502/8994] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:14:26 2022] DELETE /identity/v3/users/7cc75e66c4f543dca861527bed422f3c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:26.375300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:26.375784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:26.375876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:26.394709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:26.395833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:26.474229 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4493/8995] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:14:26.485963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:26.487795 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:26.553699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616b9a0-d21a-4fe5-89b3-feebf7977d55 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:26.557721 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39a9f3c-d9f2-4960-8afe-0aaedc956b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:26.558378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9f3c-d9f2-4960-8afe-0aaedc956b35 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:26.558662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9f3c-d9f2-4960-8afe-0aaedc956b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:26.558938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39a9f3c-d9f2-4960-8afe-0aaedc956b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:26.569024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9f3c-d9f2-4960-8afe-0aaedc956b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:26.570471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39a9f3c-d9f2-4960-8afe-0aaedc956b35 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:26.580210 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4503/8996] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:26.765896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:26.767563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:26.780461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdbca4-ff0f-4bf2-b7cf-38cbbc9c3f3c None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:26.785824 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:26.787066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:26.787368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:26.787651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] PATH_INFO: `/v3/projects/0bce6831113d41dfae2c2b38166130ce` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:26.789045 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bce6831113d41dfae2c2b38166130ce)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:26.791024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:26.840003 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:26.843390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bce6831113d41dfae2c2b38166130ce', 'request_id': 'req-46ce191f-fa2c-458b-b896-a125a78599f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.850376 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bce6831113d41dfae2c2b38166130ce', 'request_id': 'req-46ce191f-fa2c-458b-b896-a125a78599f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.855918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bce6831113d41dfae2c2b38166130ce', 'request_id': 'req-46ce191f-fa2c-458b-b896-a125a78599f2'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.867639 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] The token cache is being invalidate because project 0bce6831113d41dfae2c2b38166130ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:14:26.867928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.868664 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-46ce191f-fa2c-458b-b896-a125a78599f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:14:26.870313 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4494/8997] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:14:26 2022] DELETE /identity/v3/projects/0bce6831113d41dfae2c2b38166130ce => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:26.875640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:26.875926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:26.876202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:26.894767 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:26.895980 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:26.966720 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4504/8998] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:26.974902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:26.975190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:26.975470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:26.993990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:26.995190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:27.004363 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4495/8999] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:27.010125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.020500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e26247-1bd7-43d0-afd1-f6f564ab9a4f None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.026236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.026952 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.027231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.027505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.028240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:14:27.028576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.030192 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.043078 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4505/9000] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:14:27.047826 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.058147 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049f4a1-cbef-4e5e-b16f-0f915468691b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.063907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.064622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.064907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.065170 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.065864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.068298 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.095553 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4496/9001] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:14:27 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:14:27.100031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.110626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da90ba-bcee-468a-a19c-ac66a255af74 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.115577 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:27.171362 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.172043 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.172329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.172647 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.173334 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.175278 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.201039 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4506/9002] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:14:27 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:14:27.202418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.215495 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3402fa3-447a-4165-ab4c-10db0cc1e029 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.221134 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.221876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.222162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.222444 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.223193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.225340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.238394 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4497/9003] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:14:27.243950 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.261290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a91141-f2ac-4b9d-88fb-01b7cdfe70dc admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.269374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa35f1b9-c7e6-49b3-aea2-b487edacc9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.270550 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35f1b9-c7e6-49b3-aea2-b487edacc9b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.271108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35f1b9-c7e6-49b3-aea2-b487edacc9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.271665 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa35f1b9-c7e6-49b3-aea2-b487edacc9b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.273110 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35f1b9-c7e6-49b3-aea2-b487edacc9b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.276236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa35f1b9-c7e6-49b3-aea2-b487edacc9b9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.296299 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4507/9004] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:14:27.301115 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.311970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7691a1a-8b5b-47fa-b344-06e587fc4d5a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.317688 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.318634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.318921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.319199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] PATH_INFO: `/v3/projects/43f340f220934c5d9172a71188b7766d/users/5236db8210cd4c53b0341aca8060dafd/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.335436 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=43f340f220934c5d9172a71188b7766d, user_id=5236db8210cd4c53b0341aca8060dafd, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.338183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.353357 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4498/9005] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:14:27 2022] PUT /identity/v3/projects/43f340f220934c5d9172a71188b7766d/users/5236db8210cd4c53b0341aca8060dafd/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:27.359538 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bf32c-4244-4755-917a-98e7c0ec1316 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.359949 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bf32c-4244-4755-917a-98e7c0ec1316 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.360360 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27bf32c-4244-4755-917a-98e7c0ec1316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.381290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a27bf32c-4244-4755-917a-98e7c0ec1316 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:27.382533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a27bf32c-4244-4755-917a-98e7c0ec1316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:27.466116 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4508/9006] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:27.477181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:27.479589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:27.543394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a87d7a0-294e-4962-b501-75109ad191ba admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:27.547343 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:27.548004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:27.548286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:27.548599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:27.558082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:27.559544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:27.569538 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4499/9007] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:31.775485 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:31.776024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:31.776024 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:31.806817 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] MFA Rules not processed for user `5236db8210cd4c53b0341aca8060dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:31.807954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:31.884697 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4509/9008] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:31 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:31.889517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:31.899684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7d94f-c6d2-4ef3-abcd-713c64c2d979 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:31.904991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:31.905663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:31.905929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:31.906221 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:31.906905 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:31.908902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:31.940077 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4500/9009] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:14:31 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:14:31.942654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:31.957618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933d95a-d742-493a-80f2-0db815637ba8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:31.971512 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:32.026701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:32.027374 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:32.027709 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:32.028014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:32.028785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:32.030913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:32.054163 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4510/9010] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:14:31 2022] POST /identity/v3/users => generated 301 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:14:32.058417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:32.070707 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e91af6-dbdb-43e6-ae22-929fc4a08670 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:32.075925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:32.076640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:32.076927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:32.077204 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:32.077946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:32.079653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:32.092565 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4501/9011] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:14:32.095671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:32.106464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634886f6-9c53-4b78-b707-3852135b4394 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:32.111455 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:32.112383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:32.112683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:32.112962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] PATH_INFO: `/v3/projects/4ff40c3fe7f247f6be6dcbdc315b9816/users/59dbd5e2394842389930616b568adccc/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:32.130072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff40c3fe7f247f6be6dcbdc315b9816, user_id=59dbd5e2394842389930616b568adccc, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:32.132995 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:32.148487 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4511/9012] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:14:32 2022] PUT /identity/v3/projects/4ff40c3fe7f247f6be6dcbdc315b9816/users/59dbd5e2394842389930616b568adccc/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:32.152470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:32.164779 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513b16ff-c39f-4687-b38b-71eda8ff9674 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:32.230542 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:32.260108 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88503683-328c-4d4e-b12d-47eeee15c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:32.260830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503683-328c-4d4e-b12d-47eeee15c513 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:32.261136 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503683-328c-4d4e-b12d-47eeee15c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:32.261381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88503683-328c-4d4e-b12d-47eeee15c513 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:32.262131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88503683-328c-4d4e-b12d-47eeee15c513 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:32.263797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88503683-328c-4d4e-b12d-47eeee15c513 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:32.275312 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4502/9013] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:14:32.279825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:32.291133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebbc930-f8d2-415f-a35c-45d8951ed464 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:32.296136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:32.297102 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:32.297387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:32.297668 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] PATH_INFO: `/v3/projects/4ff40c3fe7f247f6be6dcbdc315b9816/users/59dbd5e2394842389930616b568adccc/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:32.299705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ff40c3fe7f247f6be6dcbdc315b9816, user_id=59dbd5e2394842389930616b568adccc, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:32.302449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:32.314154 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4512/9014] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:14:32 2022] PUT /identity/v3/projects/4ff40c3fe7f247f6be6dcbdc315b9816/users/59dbd5e2394842389930616b568adccc/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:14:36.997553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85ad3-97c1-4b5c-ac5c-7b6ac823b411 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:36.998102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85ad3-97c1-4b5c-ac5c-7b6ac823b411 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:36.998102 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f85ad3-97c1-4b5c-ac5c-7b6ac823b411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:37.026399 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-83f85ad3-97c1-4b5c-ac5c-7b6ac823b411 None None] MFA Rules not processed for user `59dbd5e2394842389930616b568adccc`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:37.027658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-83f85ad3-97c1-4b5c-ac5c-7b6ac823b411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:37.113678 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4503/9015] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:37.131065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:37.133892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:37.219856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a5e2d-8964-46ef-a64c-b6bbd7e39ee4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:37.230618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:37.231560 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:37.231902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:37.232244 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:37.300204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:37.302238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:37.324852 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4513/9016] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:37.412762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:37.413125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:37.413396 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:37.433077 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] MFA Rules not processed for user `5236db8210cd4c53b0341aca8060dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:14:37.434305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:37.449660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4504/9017] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:14:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:14:37.740680 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:37.742389 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:37.753408 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:37.805158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321fdf46-a486-4577-8305-9b986c5f3505 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:37.808772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:37.809439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:37.809725 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:37.810007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:37.811830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:37.822996 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:37.824483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:37.833524 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4514/9018] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:47.426672 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=48 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:47.829980 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=23 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:48.225881 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:48.227628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:48.303548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2387127-3ff3-4424-b471-6090b24c0a40 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:48.309671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:48.310339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:48.310625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:48.310902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:48.312838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:48.326226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:48.327876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:48.338208 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4505/9019] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:49.091732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:49.093453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:49.162157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0168a89-7d9a-4afb-88ae-3f79579be408 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:49.168099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc9438c-bd64-41c9-8905-c7ca09956068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '55aac242daf746b283fb3cb561b3462e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:49.169131 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9438c-bd64-41c9-8905-c7ca09956068 service cinder] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:49.169543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9438c-bd64-41c9-8905-c7ca09956068 service cinder] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:49.169927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc9438c-bd64-41c9-8905-c7ca09956068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:49.183034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9438c-bd64-41c9-8905-c7ca09956068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:49.184661 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc9438c-bd64-41c9-8905-c7ca09956068 service cinder] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:49.196956 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4515/9020] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:49.497244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:14:49.499620 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:49.514004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a98a54-bb2b-405b-b623-cdabc7e29770 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:14:49.519668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:14:49.520333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:14:49.520654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:14:49.520936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:14:49.522883 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:14:49.549991 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:14:49.552272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:14:49.569483 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4506/9021] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:14:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:14:59.190918 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=26 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:14:59.563052 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=38 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:15.471847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:15.472433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:15.472433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:15.491506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] MFA Rules not processed for user `5236db8210cd4c53b0341aca8060dafd`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:15:15.492786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:15.500219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4516/9022] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:15:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:15:25.486036 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:58.758390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:58.837877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbccf68-4139-4dbc-ade5-aa36e8732ee2 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:58.843423 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:58.844368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:58.844666 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:58.844942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] PATH_INFO: `/v3/users/5236db8210cd4c53b0341aca8060dafd` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:58.846287 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=5236db8210cd4c53b0341aca8060dafd)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:58.848272 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:58.902291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5236db8210cd4c53b0341aca8060dafd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:58.902935 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5236db8210cd4c53b0341aca8060dafd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:58.911260 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5236db8210cd4c53b0341aca8060dafd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:58.912090 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5236db8210cd4c53b0341aca8060dafd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:58.919721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5236db8210cd4c53b0341aca8060dafd'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:58.938234 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4507/9023] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:15:58 2022] DELETE /identity/v3/users/5236db8210cd4c53b0341aca8060dafd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:15:59.124654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:59.138067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad87e6-835b-4936-8fff-ebfe399800f8 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:59.199944 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:59.200947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:59.201204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:59.201505 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] PATH_INFO: `/v3/projects/43f340f220934c5d9172a71188b7766d` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:59.202732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43f340f220934c5d9172a71188b7766d)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:59.204940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:59.258290 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43f340f220934c5d9172a71188b7766d', 'request_id': 'req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.266499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43f340f220934c5d9172a71188b7766d', 'request_id': 'req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.274146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43f340f220934c5d9172a71188b7766d', 'request_id': 'req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.285458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] The token cache is being invalidate because project 43f340f220934c5d9172a71188b7766d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:15:59.285775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.286504 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.288206 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4517/9024] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:15:59 2022] DELETE /identity/v3/projects/43f340f220934c5d9172a71188b7766d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:15:59.292593 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:59.294162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:59.307695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4127084-40a5-4f6e-bd3a-f650fba823bf admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:59.385942 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:59.391378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:59.391378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:59.391378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] PATH_INFO: `/v3/users/59dbd5e2394842389930616b568adccc` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:59.391378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59dbd5e2394842389930616b568adccc)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:59.391378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:59.416088 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:59.443324 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59dbd5e2394842389930616b568adccc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.443971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59dbd5e2394842389930616b568adccc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.452637 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59dbd5e2394842389930616b568adccc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.453246 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59dbd5e2394842389930616b568adccc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.460661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d97ac89d-0872-4081-9db8-e1de63f01440 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59dbd5e2394842389930616b568adccc'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.478826 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4508/9025] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:15:59 2022] DELETE /identity/v3/users/59dbd5e2394842389930616b568adccc => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:15:59.666887 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:15:59.668390 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:59.682625 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69d4173-74fb-41f8-8bb4-3de3cf7e2b51 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:15:59.745967 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:15:59.746891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:59.747175 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:59.747451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] PATH_INFO: `/v3/projects/4ff40c3fe7f247f6be6dcbdc315b9816` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:59.748719 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ff40c3fe7f247f6be6dcbdc315b9816)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:15:59.750645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:15:59.788859 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:15:59.803031 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ff40c3fe7f247f6be6dcbdc315b9816', 'request_id': 'req-f7ef11d9-478e-4543-afac-ab04bf1eb42f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.810655 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ff40c3fe7f247f6be6dcbdc315b9816', 'request_id': 'req-f7ef11d9-478e-4543-afac-ab04bf1eb42f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.817953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ff40c3fe7f247f6be6dcbdc315b9816', 'request_id': 'req-f7ef11d9-478e-4543-afac-ab04bf1eb42f'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.831527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] The token cache is being invalidate because project 4ff40c3fe7f247f6be6dcbdc315b9816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:15:59.831789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.832588 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-f7ef11d9-478e-4543-afac-ab04bf1eb42f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:15:59.834188 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4518/9026] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:15:59 2022] DELETE /identity/v3/projects/4ff40c3fe7f247f6be6dcbdc315b9816 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:15:59.839472 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d536-e69e-4624-be44-2a204231971b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:59.839983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d536-e69e-4624-be44-2a204231971b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:59.840109 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b0d536-e69e-4624-be44-2a204231971b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:59.862986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-79b0d536-e69e-4624-be44-2a204231971b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:15:59.864898 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-79b0d536-e69e-4624-be44-2a204231971b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:59.954909 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4509/9027] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:15:59.963342 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:15:59.963622 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:15:59.963909 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:15:59.984962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:15:59.986208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:15:59.995385 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4519/9028] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:15:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:15:59.999945 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d536-e69e-4624-be44-2a204231971b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.010708 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b0d536-e69e-4624-be44-2a204231971b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.015662 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.016372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.016667 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.016940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.017681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:16:00.017989 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.019657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.032992 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4510/9029] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:15:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:16:00.037630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.048813 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1a47c0-e05b-4098-9917-99b85cf5cdea None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.055045 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.055735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.056013 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.056274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.057260 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.059079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.087407 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4520/9030] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:16:00 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:16:00.092042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.103339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544d290-816e-45b9-9448-e3f6a69a240f admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.163988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.164786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.165087 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.165370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.166080 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.168029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.190985 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4511/9031] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:16:00 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:16:00.195288 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.206819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9885f-fc8b-4a77-8e6f-5d6874205d10 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.212774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.213561 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.213814 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.214067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.214801 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.216459 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.227532 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4521/9032] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:16:00.232789 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.248235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568ecf7f-8113-46b7-9442-ea983ffc1566 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.255646 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9044c2a-2aad-4f81-abd0-32b7530a6d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.256660 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044c2a-2aad-4f81-abd0-32b7530a6d39 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.257017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044c2a-2aad-4f81-abd0-32b7530a6d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.257471 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044c2a-2aad-4f81-abd0-32b7530a6d39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.258553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9044c2a-2aad-4f81-abd0-32b7530a6d39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.260955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9044c2a-2aad-4f81-abd0-32b7530a6d39 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.271769 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4512/9033] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:16:00 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:16:00.276234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.287426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11251549-ebd7-4740-add1-ebf860637718 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.294235 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.295396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.295679 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.295958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] PATH_INFO: `/v3/projects/47b2fcf17ad54faa8b645b50aedea5ec/users/c9fff78bf0024c888b683eabd9e249a9/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.313254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47b2fcf17ad54faa8b645b50aedea5ec, user_id=c9fff78bf0024c888b683eabd9e249a9, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.316305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.332195 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4522/9034] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:16:00 2022] PUT /identity/v3/projects/47b2fcf17ad54faa8b645b50aedea5ec/users/c9fff78bf0024c888b683eabd9e249a9/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:16:00.337827 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965503b5-934b-43ed-aad8-a008a40359f0 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.338124 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965503b5-934b-43ed-aad8-a008a40359f0 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.338407 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965503b5-934b-43ed-aad8-a008a40359f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.345649 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:00.358676 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-965503b5-934b-43ed-aad8-a008a40359f0 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:00.360533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-965503b5-934b-43ed-aad8-a008a40359f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:00.426560 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4513/9035] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:00.438533 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:00.441091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:00.504741 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9be381-df0f-44a3-b8f2-88c1fe480186 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:00.508605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:00.509262 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:00.509546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:00.509882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:00.519707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:00.521208 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:00.531207 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4523/9036] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:16:04.721732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:04.722339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:04.722339 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:04.761243 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] MFA Rules not processed for user `c9fff78bf0024c888b683eabd9e249a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:04.762440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:04.852753 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4514/9037] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:16:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:04.857806 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:04.868572 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e544b7-529b-4d7e-8d96-8bc48ee51c3b service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:04.874028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:04.874672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:04.875119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:04.875395 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:04.876081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:04.878044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:04.913533 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4524/9038] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:16:04 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:16:04.917809 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:04.928956 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec103767-f5ef-426e-9b6a-e0cab22e4bfa None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:04.989841 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:04.990586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:04.990879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:04.991158 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:04.996908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:04.996908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:05.028065 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4515/9039] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:16:04 2022] POST /identity/v3/users => generated 299 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:16:05.032239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:05.043350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a2bc8-4b2e-4683-936a-22957eaddca9 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:05.050829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:05.050829 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:05.051194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:05.051292 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:05.052384 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:05.056272 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:05.069787 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4525/9040] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:16:05.074500 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:05.085943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dab120-c911-4591-87ba-e6e91cafb95d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:05.092228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:05.093479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:05.093765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:05.094047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] PATH_INFO: `/v3/projects/f6374e83a8ea4530aeae2caf865e9b1f/users/2d5ae4edf90748cebe52fa8cea223eb2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:05.111411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6374e83a8ea4530aeae2caf865e9b1f, user_id=2d5ae4edf90748cebe52fa8cea223eb2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:05.114228 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:05.125649 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:05.140289 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4516/9041] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:16:05 2022] PUT /identity/v3/projects/f6374e83a8ea4530aeae2caf865e9b1f/users/2d5ae4edf90748cebe52fa8cea223eb2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:16:05.144409 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:05.155862 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc95c82-85a6-4c1a-9b2f-b20e1442d1da admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:05.188004 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:05.227921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443eb2da-d40b-480e-b30e-c1b8d018b537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:05.228748 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb2da-d40b-480e-b30e-c1b8d018b537 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:05.229101 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb2da-d40b-480e-b30e-c1b8d018b537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:05.229656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443eb2da-d40b-480e-b30e-c1b8d018b537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:05.230419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb2da-d40b-480e-b30e-c1b8d018b537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:05.232067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443eb2da-d40b-480e-b30e-c1b8d018b537 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:05.246191 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4526/9042] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:16:05.247370 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:05.258902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e29e9bc-78a9-4883-98ba-cdde42bcde77 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:05.265208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:05.266130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:05.266412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:05.266907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] PATH_INFO: `/v3/projects/f6374e83a8ea4530aeae2caf865e9b1f/users/2d5ae4edf90748cebe52fa8cea223eb2/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:05.268899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6374e83a8ea4530aeae2caf865e9b1f, user_id=2d5ae4edf90748cebe52fa8cea223eb2, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:05.271612 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:05.283896 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4517/9043] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:16:05 2022] PUT /identity/v3/projects/f6374e83a8ea4530aeae2caf865e9b1f/users/2d5ae4edf90748cebe52fa8cea223eb2/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:16:09.981608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39526c0a-a2f5-4bf7-a1ad-110f6b92af56 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:09.982199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39526c0a-a2f5-4bf7-a1ad-110f6b92af56 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:09.982199 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39526c0a-a2f5-4bf7-a1ad-110f6b92af56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:10.012605 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-39526c0a-a2f5-4bf7-a1ad-110f6b92af56 None None] MFA Rules not processed for user `2d5ae4edf90748cebe52fa8cea223eb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:10.013870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-39526c0a-a2f5-4bf7-a1ad-110f6b92af56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:10.088020 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4527/9044] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:16:09 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:10.126522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:10.128544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:10.220247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a61ed-79cc-4bd8-b221-e26174e18603 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:10.226017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aeb289-03a7-4b84-8527-ae28540c28a5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:10.226804 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeb289-03a7-4b84-8527-ae28540c28a5 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:10.227086 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeb289-03a7-4b84-8527-ae28540c28a5 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:10.227359 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aeb289-03a7-4b84-8527-ae28540c28a5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:10.289044 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeb289-03a7-4b84-8527-ae28540c28a5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:10.290533 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aeb289-03a7-4b84-8527-ae28540c28a5 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:10.300206 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4518/9045] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:16:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:16:10.449215 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:10.449502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:10.449775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:10.517261 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:10.518507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:10.606288 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4528/9046] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:10.666769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf560-0cc5-46af-9ab4-a8513495e774 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:10.667062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf560-0cc5-46af-9ab4-a8513495e774 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:10.667344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaf560-0cc5-46af-9ab4-a8513495e774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:10.726371 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4fdaf560-0cc5-46af-9ab4-a8513495e774 None None] MFA Rules not processed for user `198dcf35a0894d4e824229e10573a251`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:10.727600 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4fdaf560-0cc5-46af-9ab4-a8513495e774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:10.788601 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:10.818902 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4519/9047] 10.222.0.15 () {58 vars in 1040 bytes} [Tue Jul 19 12:16:10 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:10.825660 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:10.838644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd6a73e-35bd-4fd5-a24c-7d38e7017223 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:10.843785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:10.844487 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:10.844771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:10.845042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:10.854882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:10.856502 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:10.860648 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=100 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:10.867928 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4529/9048] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:16:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:16:19.684454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:19.685066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:19.685340 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:19.704332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] MFA Rules not processed for user `c9fff78bf0024c888b683eabd9e249a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:19.705563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:19.713203 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4520/9049] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:16:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:20.324385 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:20.326211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:20.411092 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17688623-122a-44ea-be98-bf7ad323c54c service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:20.417589 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:20.418338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:20.418620 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:20.418892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:20.420701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:20.434690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:20.436506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a983a7-d3c0-4b38-9bc8-dba44408ca31 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:20.447046 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4530/9050] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:16:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:16:21.434499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:21.509550 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b28f44-e2bb-480b-9d76-70c2d1212a67 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:21.513332 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:21.514011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:21.514907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:21.514907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:21.516498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:21.598840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:21.600368 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:21.612940 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4521/9051] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:16:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:16:21.791810 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:21.792451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:21.792451 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:21.813119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:16:21.814515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:21.824332 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4531/9052] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:16:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:16:21.837645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:21.849432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7fea41-52d5-4f57-af27-8d5d72b61b0d service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:21.854552 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:21.855268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:21.855553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:21.855832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:21.866524 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:21.868145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:21.877191 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4522/9053] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:16:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:16:31.807310 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=40 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:31.873780 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=74 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:16:53.979786 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:16:53.981500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:16:54.026508 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777756e5-8c47-4244-9fa0-2f611d0d9da9 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:16:54.030608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:16:54.031274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:16:54.031559 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:16:54.031843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:16:54.066165 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:16:54.068002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:16:54.079979 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4532/9054] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:16:53 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:17:04.074489 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=28 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:02.255157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:02.279709 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b7613e-a107-4a7d-9ed3-46ec23e73964 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:02.284584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:02.285275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:02.285563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:02.285844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:02.287887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:02.299284 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:02.300853 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:02.310786 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4523/9055] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:18:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:18:12.306662 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:18:35.821568 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:18:35.831017 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c5fdd9-5d53-4a63-b56c-1631c8cdebb2 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:18:35.835614 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:18:35.836263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:18:35.836580 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:18:35.836868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:18:35.838940 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:18:35.853893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:18:35.855351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:18:35.882240 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4533/9056] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:18:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:18:45.878309 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:19:50.769613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:50.771160 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:50.813610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb01b26f-8934-4092-9d10-91be8a2cb9b8 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:50.825599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:50.826411 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:50.826743 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:50.827573 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:50.829623 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:50.846349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:50.848061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:50.861700 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4524/9057] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:19:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:19:52.261516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:52.265640 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:52.280785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8ec69-b528-4195-9f7a-4d20fe346954 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:52.288619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:52.289439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:52.289820 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:52.290202 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:52.292788 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:52.306195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:52.308460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:52.320270 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4534/9058] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:19:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:19:53.787549 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:53.800331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949aacd-a64f-450b-b5a9-04a75095c8e4 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:53.807211 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:53.807941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:53.808226 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:53.808544 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:53.810596 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:53.839867 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:53.841570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e98588e-c0ff-45c0-8175-efbe42e0aea9 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:53.853149 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4525/9059] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:19:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:19:56.519136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:19:56.520630 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:56.536254 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b994700a-b471-4593-b837-18a2d76f0b97 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:19:56.542636 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:19:56.543297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:19:56.543581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:19:56.543830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:19:56.545755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:19:56.558441 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:19:56.560053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:19:56.570733 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4535/9060] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:20:03.848233 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=17 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:04.914492 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9e18-bbcb-4f01-a6a4-9df7d2d1057f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:04.915153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9e18-bbcb-4f01-a6a4-9df7d2d1057f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:04.915153 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c9e18-bbcb-4f01-a6a4-9df7d2d1057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:04.937630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-114c9e18-bbcb-4f01-a6a4-9df7d2d1057f None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:04.938835 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-114c9e18-bbcb-4f01-a6a4-9df7d2d1057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:04.947931 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4526/9061] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 12:20:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:20:04.991084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:05.003402 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9c1ea-19df-4903-abf9-b7f72af96b05 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:05.009775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:05.010458 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.010720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.010999 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.020094 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:05.021747 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:05.030630 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4536/9062] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:20:05.530953 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f750-014d-4c6d-bb14-85f19b38c220 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.531249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f750-014d-4c6d-bb14-85f19b38c220 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.531529 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056f750-014d-4c6d-bb14-85f19b38c220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.550450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-d056f750-014d-4c6d-bb14-85f19b38c220 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:05.551681 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d056f750-014d-4c6d-bb14-85f19b38c220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:05.560665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4527/9063] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:20:05.576061 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:05.587947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d95bb-9fe7-429b-a290-bd518ef314e2 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:05.594752 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:05.595450 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:05.595676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:05.595943 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:05.605171 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:05.606773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:05.615261 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4537/9064] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:20:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:20:13.832179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:13.832738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:13.832854 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:13.852164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] MFA Rules not processed for user `c9fff78bf0024c888b683eabd9e249a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:13.853403 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:13.861293 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4528/9065] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:20:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:20:14.131151 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:14.141313 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e02125-cb78-41c8-bf79-8161750fbd39 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:14.145531 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:14.146179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:14.146432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:14.146804 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:14.148764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:14.158998 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:14.160511 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288fc26-ba1e-439f-8746-ab9d6592c47b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:14.169400 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4538/9066] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:20:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:20:14.500951 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:14.513715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578ae01-c880-4fcc-8392-5beca27e74bd None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:14.518985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:14.519653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:14.519939 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:14.520218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:14.522112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:14.539597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:14.541840 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:14.554934 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4529/9067] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:20:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:20:15.990220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:15.990772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:15.990772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:15.997301 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=31 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:16.010203 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:20:16.012575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:16.019302 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4539/9068] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:20:16.032026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:16.043651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0c8a7b-356a-4d26-8e9e-7126336ee365 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:16.049891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:16.050554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:16.050838 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:16.051112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:16.065644 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:16.067356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:16.076011 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4530/9069] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:20:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:20:24.298194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:24.310248 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483c5b0-440d-4bd7-9d1c-19e52cf85e7c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:24.314603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:24.315265 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:24.315549 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:24.315830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:24.317827 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:24.328868 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:24.330352 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:24.340059 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4540/9070] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:20:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:20:26.072815 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=21 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:32.361632 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:20:32.374640 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e925d3-28d5-4dd3-8b28-247dcedb445c service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:20:32.380890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:20:32.381556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:20:32.381837 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:20:32.382118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:20:32.384389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:20:32.396754 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:20:32.398657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:20:32.411039 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4531/9071] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:20:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:20:34.335763 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:20:42.406083 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:10.758885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:10.780382 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d20ec-8eec-4fbe-b450-dbc1409c5a13 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:10.786825 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4eb1f-13a0-48cb-bd69-c98048995043 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:10.787507 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4eb1f-13a0-48cb-bd69-c98048995043 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:10.787791 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4eb1f-13a0-48cb-bd69-c98048995043 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:10.788078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4eb1f-13a0-48cb-bd69-c98048995043 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:10.797736 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4eb1f-13a0-48cb-bd69-c98048995043 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:10.799359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4eb1f-13a0-48cb-bd69-c98048995043 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:10.809766 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4541/9072] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:21:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:21:20.804805 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=9 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:21:53.063377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:21:53.074321 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323c171-ecfb-44cb-8b00-6f6797726ced service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:21:53.078193 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:21:53.078879 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:21:53.079163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:21:53.079484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:21:53.091125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:21:53.092592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:21:53.103387 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4532/9073] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:21:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:03.098726 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:07.453826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:07.454308 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:07.454408 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:07.474420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:07.475648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:07.485691 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4542/9074] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 12:22:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:07.527349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:07.539268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb25dfe-2465-4fe0-817f-d6646b017d47 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:07.544628 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:07.545281 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:07.545563 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:07.545852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:07.554011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:07.555605 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:07.564644 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4533/9075] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:22:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:22:07.961456 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:07.971848 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008c746b-6e6f-478c-8744-da3ad0150c49 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:07.975882 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:07.976552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:07.976824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:07.977091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:08.042216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:08.043715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:08.065110 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4543/9076] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:11.400171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:11.412484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c3d552-043d-4570-8315-d810cf3f1324 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:11.417545 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:11.418192 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:11.418468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:11.418765 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:11.420608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:11.434346 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:11.435937 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:11.450718 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4534/9077] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:14.914206 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:14.926414 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9617033-d21c-48c6-bff9-b1e8b4eb0f69 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:14.932426 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:14.933332 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:14.933615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:14.933893 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] PATH_INFO: `/v3/users/c9fff78bf0024c888b683eabd9e249a9` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:14.935318 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9fff78bf0024c888b683eabd9e249a9)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:14.939989 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:14.993689 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9fff78bf0024c888b683eabd9e249a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.001243 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9fff78bf0024c888b683eabd9e249a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.013881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9fff78bf0024c888b683eabd9e249a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.014682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9fff78bf0024c888b683eabd9e249a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.022264 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9fff78bf0024c888b683eabd9e249a9'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.029296 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4544/9078] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:22:14 2022] DELETE /identity/v3/users/c9fff78bf0024c888b683eabd9e249a9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:22:15.211175 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:15.224985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f193d-fd41-462d-8dea-5671de9a6f0c service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:15.290527 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:15.291540 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:15.291919 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:15.292301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] PATH_INFO: `/v3/projects/47b2fcf17ad54faa8b645b50aedea5ec` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:15.294586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] RBAC: Authorizing `identity:delete_project(project_id=47b2fcf17ad54faa8b645b50aedea5ec)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:15.296582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:15.345723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47b2fcf17ad54faa8b645b50aedea5ec', 'request_id': 'req-e4d1ac63-87a9-4180-8567-ec906b1b123a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.352484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47b2fcf17ad54faa8b645b50aedea5ec', 'request_id': 'req-e4d1ac63-87a9-4180-8567-ec906b1b123a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.358724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47b2fcf17ad54faa8b645b50aedea5ec', 'request_id': 'req-e4d1ac63-87a9-4180-8567-ec906b1b123a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.373309 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] The token cache is being invalidate because project 47b2fcf17ad54faa8b645b50aedea5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:22:15.373588 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.374202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.375798 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4535/9079] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:22:15 2022] DELETE /identity/v3/projects/47b2fcf17ad54faa8b645b50aedea5ec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:22:15.380117 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:15.381641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:15.398557 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8492f88-70c3-41d9-a006-777d9db4a832 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:15.453270 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:15.464500 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:15.465431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:15.466137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:15.466525 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] PATH_INFO: `/v3/users/2d5ae4edf90748cebe52fa8cea223eb2` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:15.468037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5ae4edf90748cebe52fa8cea223eb2)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:15.470715 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:15.529890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5ae4edf90748cebe52fa8cea223eb2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.539119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5ae4edf90748cebe52fa8cea223eb2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.552128 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5ae4edf90748cebe52fa8cea223eb2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.552876 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5ae4edf90748cebe52fa8cea223eb2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.560107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-735d1139-3bec-415d-9893-cb6194dffe89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5ae4edf90748cebe52fa8cea223eb2'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.566551 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4545/9080] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:22:15 2022] DELETE /identity/v3/users/2d5ae4edf90748cebe52fa8cea223eb2 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:22:15.757198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:15.758661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:15.771844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1ac63-87a9-4180-8567-ec906b1b123a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:15.837285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:15.838531 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:15.838817 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:15.839127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] PATH_INFO: `/v3/projects/f6374e83a8ea4530aeae2caf865e9b1f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:15.840334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6374e83a8ea4530aeae2caf865e9b1f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:15.842478 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:15.849010 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:15.895899 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6374e83a8ea4530aeae2caf865e9b1f', 'request_id': 'req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.902389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6374e83a8ea4530aeae2caf865e9b1f', 'request_id': 'req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.909247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6374e83a8ea4530aeae2caf865e9b1f', 'request_id': 'req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.923732 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] The token cache is being invalidate because project f6374e83a8ea4530aeae2caf865e9b1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:22:15.924013 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.924675 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-eeaf8907-f64b-4e6f-bf26-2a730fdfba63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:22:15.926281 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4536/9081] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:22:15 2022] DELETE /identity/v3/projects/f6374e83a8ea4530aeae2caf865e9b1f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:22:15.931617 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:15.932083 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:15.932174 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:15.963361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:15.964611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:16.026566 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4546/9082] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:16.038661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.039140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.039608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.061173 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:16.062394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:16.071041 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4537/9083] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:16.075768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.085864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617f2d3-51af-424a-984d-14dfd2b74911 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.091238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.091903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.092185 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.092501 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.093236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:22:16.093548 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.095178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.107426 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4547/9084] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:22:16.112917 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.124420 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb5199-b712-4d5e-82a6-96cfb187d14f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.133061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.133977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.134342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.134694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.135689 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.138356 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.172314 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4538/9085] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/projects => generated 393 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:22:16.176611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.187936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a6584-ea0d-45a0-8df2-0cf22b5170c4 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.236907 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:16.252712 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.253425 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.253708 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.254016 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.254773 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.257035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.276644 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4548/9086] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:22:16.280886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.291902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f69d2-f4e4-44a3-8eb9-f19cdf33a7e2 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.298038 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.298711 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.298996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.299252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.299982 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.301654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.312927 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4539/9087] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:22:16.317105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.328034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d1264-f3fa-4a12-8de7-34be0dd725dd admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.334034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b97449-ae5a-4c1b-8462-1511ee22763b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.334735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97449-ae5a-4c1b-8462-1511ee22763b admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.335018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97449-ae5a-4c1b-8462-1511ee22763b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.335297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b97449-ae5a-4c1b-8462-1511ee22763b admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.336050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b97449-ae5a-4c1b-8462-1511ee22763b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.337734 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b97449-ae5a-4c1b-8462-1511ee22763b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.350789 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4549/9088] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:22:16.355202 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.365941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b48b8a9-46e0-4157-873b-59677e9753bb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.370870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.371769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.372149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.372454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] PATH_INFO: `/v3/projects/0721433e25b84a5998b6019d879e1a78/users/ee77e34918e04e33b001752c7b920be6/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.388082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0721433e25b84a5998b6019d879e1a78, user_id=ee77e34918e04e33b001752c7b920be6, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.390877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.406927 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4540/9089] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:22:16 2022] PUT /identity/v3/projects/0721433e25b84a5998b6019d879e1a78/users/ee77e34918e04e33b001752c7b920be6/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:22:16.419354 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.420072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.420072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.450774 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] MFA Rules not processed for user `ee77e34918e04e33b001752c7b920be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:16.452027 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:16.518710 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4550/9090] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:16.523663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.594880 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73813bf1-4caf-4caa-8b73-489114ba3541 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.601075 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.602024 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.602341 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.602619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.603308 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.605277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.634907 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4541/9091] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/projects => generated 391 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:22:16.640706 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.653172 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dfb455-2d3d-4883-8f63-8c4caa0226da None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.716802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.717482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.717766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.718065 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.718749 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.720702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.744394 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4551/9092] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:22:16.745876 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.757461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62c5eb5-9f9b-49d2-9bf5-57e071b90959 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.763618 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.764295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.764619 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.764874 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.765636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.767261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.779463 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4542/9093] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:22:16.783857 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.795576 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd6ff0c-254b-418f-98b6-178ae2b7859a admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.801286 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.802191 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.802472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.802751 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] PATH_INFO: `/v3/projects/5ca1e597e09f4df389fe16b7453ef977/users/02d9f2c443884a6995e8e0ad576dcde5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.819096 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1e597e09f4df389fe16b7453ef977, user_id=02d9f2c443884a6995e8e0ad576dcde5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.821815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.838684 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4552/9094] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:22:16 2022] PUT /identity/v3/projects/5ca1e597e09f4df389fe16b7453ef977/users/02d9f2c443884a6995e8e0ad576dcde5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:22:16.843033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.850043 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:16.854522 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e13e3-9c0e-454c-baaf-10c8d5489bc8 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.913710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c4596-d535-4fa5-a99e-b5557c4be816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.914364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4596-d535-4fa5-a99e-b5557c4be816 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.914648 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4596-d535-4fa5-a99e-b5557c4be816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.914920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c4596-d535-4fa5-a99e-b5557c4be816 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.915634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c4596-d535-4fa5-a99e-b5557c4be816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.917278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c4596-d535-4fa5-a99e-b5557c4be816 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.927399 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4543/9095] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:22:16.931872 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:16.942616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edb279-cd7e-4076-bf7b-c1c113883b46 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:16.947897 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:16.948850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.949133 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.949411 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] PATH_INFO: `/v3/projects/5ca1e597e09f4df389fe16b7453ef977/users/02d9f2c443884a6995e8e0ad576dcde5/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:16.951515 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ca1e597e09f4df389fe16b7453ef977, user_id=02d9f2c443884a6995e8e0ad576dcde5, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:16.954239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:16.966388 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4553/9096] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:22:16 2022] PUT /identity/v3/projects/5ca1e597e09f4df389fe16b7453ef977/users/02d9f2c443884a6995e8e0ad576dcde5/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:22:16.977703 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:16.977995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:16.978261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:17.004455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] MFA Rules not processed for user `02d9f2c443884a6995e8e0ad576dcde5`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:17.005649 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:17.086468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4544/9097] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:22:16 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:17.100970 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:17.103029 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:17.121763 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:17.210519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b6e14-54cf-49b7-b7b9-1bced7fa33b2 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:17.217506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a0c2a7-3cbd-43f9-b903-bd4a92f01ce8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:17.218158 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c2a7-3cbd-43f9-b903-bd4a92f01ce8 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:17.218438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c2a7-3cbd-43f9-b903-bd4a92f01ce8 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:17.218690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a0c2a7-3cbd-43f9-b903-bd4a92f01ce8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:17.279162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0c2a7-3cbd-43f9-b903-bd4a92f01ce8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:17.280789 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a0c2a7-3cbd-43f9-b903-bd4a92f01ce8 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:17.293819 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4554/9098] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:21.196857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:21.198421 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:21.283759 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2122066-8a63-4fd3-abdb-8638330d9cfb None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:21.287583 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:21.288252 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:21.288585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:21.288996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:21.300004 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:21.301723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:21.311982 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4545/9099] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:21 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:24.380227 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673172-334d-4ab0-95db-069eea054b94 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:24.380956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673172-334d-4ab0-95db-069eea054b94 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:24.380956 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86673172-334d-4ab0-95db-069eea054b94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:24.401870 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-86673172-334d-4ab0-95db-069eea054b94 None None] MFA Rules not processed for user `ee77e34918e04e33b001752c7b920be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:22:24.403259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86673172-334d-4ab0-95db-069eea054b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:24.412329 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4555/9100] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:22:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:22:24.785106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:24.786828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:24.799818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b3b2bd-0cf2-4263-a1ac-50710d9f3368 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:24.805230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:24.806926 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:24.807513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:24.808475 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:24.810636 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:24.825663 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:24.828907 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:24.852583 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4546/9101] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:25.247586 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673172-334d-4ab0-95db-069eea054b94 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:22:25.249098 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-86673172-334d-4ab0-95db-069eea054b94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:25.372006 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86673172-334d-4ab0-95db-069eea054b94 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:22:25.380246 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:22:25.380960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:22:25.381891 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:22:25.382180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:22:25.384075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:22:25.399000 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:22:25.401453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529021a4-6f5d-4860-949d-d3d3023c2584 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:22:25.417522 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4556/9102] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:22:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:22:34.836003 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=98 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:22:35.408517 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:09.221372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:09.230821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42e71a7-12e2-4306-9f6a-5d001f00ab60 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:09.235767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:09.236424 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:09.236755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:09.237032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:09.239218 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:09.249810 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:09.251224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:09.259488 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4547/9103] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:19.255730 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:30.528035 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:30.528551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:30.528650 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:30.548256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] MFA Rules not processed for user `ee77e34918e04e33b001752c7b920be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:23:30.549594 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:30.557802 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4557/9104] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:23:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:23:37.498780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:23:37.511526 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ade3a1-864b-479f-aad9-0f1e622d1416 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:23:37.513882 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:23:37.514656 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:23:37.515076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:23:37.515365 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:23:37.517821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:23:37.532911 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:23:37.534397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:23:37.547209 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4548/9105] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:23:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:23:40.542791 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:23:47.541043 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:24:58.775936 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:24:58.777637 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:58.794420 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a1694a-eca0-4341-ab79-723a7cb58133 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:24:58.801240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:24:58.801906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:24:58.802217 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:24:58.802490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:24:58.804656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:24:58.818008 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:24:58.819651 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:24:58.834043 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4558/9106] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:24:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:02.528691 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:02.540682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6b953d-8f69-4323-b761-83ebe67551fb service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:02.546107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:02.546776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:02.547067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:02.547349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:02.549400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:02.562509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:02.564139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:02.574723 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4549/9107] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:03.242903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:03.244543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:03.261914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6b12a4-8033-410a-9afc-706dc03d8cd6 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:03.267885 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:03.268670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:03.268954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:03.269236 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:03.271055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:03.284742 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:03.286348 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd55c3c-1b2a-4a38-88b1-93ec29e7b384 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:03.297660 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4559/9108] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:05.750924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:05.768179 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34228d6a-d6c4-4e4e-9929-15c9ae0d5266 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:05.775597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:05.777334 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:05.777625 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:05.777925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:05.781034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:05.800655 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:05.803438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:05.818920 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4550/9109] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:25:13.293092 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=12 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:15.810976 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:16.542460 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:16.542917 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:16.543087 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:16.573516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] MFA Rules not processed for user `ee77e34918e04e33b001752c7b920be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:25:16.575007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:16.582810 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4560/9110] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:25:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:25:16.977328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:25:16.989062 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3361a8d-3849-4a5f-a422-0ed98d639d2b service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:25:16.994933 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:25:16.995746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:25:16.996135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:25:16.996568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:25:16.998548 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:25:17.010738 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:25:17.012333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2128a84-bc92-4f7f-bc3e-ca9f79048841 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:25:17.021835 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4551/9111] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:25:16 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:25:26.565973 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:25:27.018464 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:26:03.020900 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:26:03.032417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da1f3b-edfa-423a-9fa7-041c08890477 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:26:03.036074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:26:03.036782 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:03.037081 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:03.037323 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:03.041983 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:26:03.049948 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:26:03.051410 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44a97fe-2145-429c-a7c2-90c7258ca4fd service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:26:03.063219 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4561/9112] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:03.185112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478808fe-aba6-4e4c-ac5b-0b6a18e7d091 None None] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:03.185692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478808fe-aba6-4e4c-ac5b-0b6a18e7d091 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:03.185798 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478808fe-aba6-4e4c-ac5b-0b6a18e7d091 None None] PATH_INFO: `/` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:03.187426 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4552/9113] 10.222.0.15 () {54 vars in 921 bytes} [Tue Jul 19 12:26:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 19 12:26:03.192938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:03.193302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:03.193645 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:03.235120 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] MFA Rules not processed for user `a53c17ba16b146b78da33383a6be1f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:26:03.236720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:26:03.245372 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4562/9114] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:26:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:26:03.266902 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478808fe-aba6-4e4c-ac5b-0b6a18e7d091 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:26:03.285017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478808fe-aba6-4e4c-ac5b-0b6a18e7d091 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:26:03.290624 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:26:03.291797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:03.292095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:03.292412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:03.301582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:26:03.303178 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:26:03.313277 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4553/9115] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:03.501111 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:26:03.511309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c3884-808e-434a-8722-244d261f9932 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:26:03.515556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:26:03.516209 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:03.516527 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:03.516798 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:03.519082 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:26:03.533959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:26:03.535418 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:26:03.547848 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4563/9116] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:03.611447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:26:03.622463 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93066ea9-7f91-4b5a-9b00-7f0c57f3ad83 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:26:03.627940 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:26:03.628723 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:03.629014 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:03.629305 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:03.631255 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:26:03.644262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:26:03.646047 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:26:03.656851 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4554/9117] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:26:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:13.542362 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=21 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:26:13.652313 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=12 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:26:22.738259 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:26:22.761245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7543df-5c65-47d0-8580-8762b2715a94 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:26:22.765656 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:26:22.766319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:22.766635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:22.766914 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:22.769134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:26:22.779843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:26:22.781429 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:26:22.789986 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4564/9118] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:26:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:29.795682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:26:29.808936 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d544e87e-6319-45ad-9f8d-273b5bcff1fd service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:26:29.815422 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:26:29.816082 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:26:29.816385 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:26:29.816658 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:26:29.818715 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:26:29.831865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:26:29.833590 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:26:29.845941 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4555/9119] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:26:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:26:32.786365 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=10 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:26:39.840443 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:00.319570 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:00.328960 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e314d9-48eb-413c-92bb-740522f2504b service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:00.333221 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:00.333955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:00.334238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:00.334513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:00.342162 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:00.396316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:00.397802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6d0912-3194-4565-8ce3-0f9c7620d917 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:00.410329 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4565/9120] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:27:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:27:06.705060 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:06.761232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679641cb-51dc-4971-8756-cb9bac539069 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:06.766929 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:06.771029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:06.771425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:06.771712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:06.774572 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:06.790447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:06.792373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:06.804189 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4556/9121] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:27:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:27:10.404577 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=23 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:13.111293 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:13.111916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:13.111916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:13.134735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] MFA Rules not processed for user `ee77e34918e04e33b001752c7b920be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:27:13.135991 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:27:13.144021 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4566/9122] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:27:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:27:16.799547 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=22 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:17.293210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:17.308875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5738edc-795a-47b3-9518-61635ac4aca7 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:17.318335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:17.319103 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:17.319394 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:17.319654 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:17.329163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:17.330784 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:17.340671 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4557/9123] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:27:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:27:23.125688 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:24.839249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:27:24.850216 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd832115-1c46-4132-9695-34a7191ef57d None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:27:24.854608 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:27:24.855267 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:27:24.855573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:27:24.855834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:27:24.866526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:27:24.867992 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:27:24.878279 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4567/9124] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:27:24 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:27:27.335983 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:27:34.873912 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:28:11.026262 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:28:11.055085 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68227f92-59f1-4208-8374-e3b271c3fdf3 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:28:11.059313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d124879-3fe6-422a-b98a-28830f384c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:28:11.059988 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d124879-3fe6-422a-b98a-28830f384c41 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:28:11.060296 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d124879-3fe6-422a-b98a-28830f384c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:28:11.060609 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d124879-3fe6-422a-b98a-28830f384c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:28:11.068586 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d124879-3fe6-422a-b98a-28830f384c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:28:11.070035 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d124879-3fe6-422a-b98a-28830f384c41 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:28:11.078075 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4558/9125] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:28:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:28:21.074746 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:28:50.302423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:28:50.322628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc227f6e-d758-495b-9327-4197d63d7d4c service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:28:50.327276 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:28:50.327939 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:28:50.328220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:28:50.328509 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:28:50.340182 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:28:50.341700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:28:50.364603 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4568/9126] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:28:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:00.361789 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=15 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:02.222235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:02.222821 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:02.223061 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:02.243995 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] MFA Rules not processed for user `ee77e34918e04e33b001752c7b920be6`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:29:02.245722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:29:02.263003 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4559/9127] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:29:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:29:02.601602 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:29:02.611129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fed78a-7762-43ca-b7bb-e2ecad9d4bfe service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:29:02.615099 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:29:02.615924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:29:02.616274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:29:02.616658 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:29:02.625913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:29:02.629305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:29:02.639106 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4569/9128] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:29:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:29:12.238694 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:29:12.634994 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:01.339286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:01.357067 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c585067-bf21-4355-83e6-b24a5c03e514 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:01.366690 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:01.367315 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:01.367599 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:01.367875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:01.378313 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:01.379943 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:01.390696 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4560/9129] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:05.301514 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:05.314743 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7737a-f6ca-4d76-b852-f5060b07b0bc service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:05.320859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:05.321903 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:05.322200 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:05.322462 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:05.324471 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:05.359040 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:05.360775 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:05.372667 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4570/9130] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:30:05.523858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:05.536100 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02b704-8881-48b8-b21f-c23e2392a5c2 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:05.542695 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ae8aa-d51e-4a1b-8ca4-c1a193f86bd7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:05.543692 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae8aa-d51e-4a1b-8ca4-c1a193f86bd7 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:05.544217 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae8aa-d51e-4a1b-8ca4-c1a193f86bd7 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:05.545027 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ae8aa-d51e-4a1b-8ca4-c1a193f86bd7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:05.560777 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ae8aa-d51e-4a1b-8ca4-c1a193f86bd7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:05.562417 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ae8aa-d51e-4a1b-8ca4-c1a193f86bd7 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:05.580665 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4561/9131] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:30:05.632466 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:05.716220 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0811309b-a7ee-44c1-958a-df8ffb183cbc service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:05.722042 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:05.723701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:05.724007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:05.724255 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] PATH_INFO: `/v3/users/ee77e34918e04e33b001752c7b920be6` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:05.725730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee77e34918e04e33b001752c7b920be6)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:05.727762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:05.790924 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee77e34918e04e33b001752c7b920be6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:05.797811 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee77e34918e04e33b001752c7b920be6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:05.810553 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee77e34918e04e33b001752c7b920be6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:05.811298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee77e34918e04e33b001752c7b920be6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:05.818304 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee77e34918e04e33b001752c7b920be6'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:05.824874 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4571/9132] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:30:05 2022] DELETE /identity/v3/users/ee77e34918e04e33b001752c7b920be6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:30:05.829897 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:05.830183 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:05.830465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:05.872390 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:05.873638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:05.936997 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4562/9133] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:30:05.947159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:05.948757 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:06.005808 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:06.012816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87731a-7014-45fb-ad98-1c634e7e7987 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:06.017785 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:06.018618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:06.019125 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:06.019543 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:06.030234 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:06.031684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:06.041863 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4572/9134] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:06.253462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:06.255125 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:06.273034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937026f-4cf5-4885-8e12-72cab2c3fd0b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:06.278862 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:06.279891 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:06.280010 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:06.280297 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] PATH_INFO: `/v3/projects/0721433e25b84a5998b6019d879e1a78` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:06.281657 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0721433e25b84a5998b6019d879e1a78)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:06.283755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:06.334517 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0721433e25b84a5998b6019d879e1a78', 'request_id': 'req-d2774d00-b0c0-4282-9843-499b7ab91240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.341022 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0721433e25b84a5998b6019d879e1a78', 'request_id': 'req-d2774d00-b0c0-4282-9843-499b7ab91240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.347139 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0721433e25b84a5998b6019d879e1a78', 'request_id': 'req-d2774d00-b0c0-4282-9843-499b7ab91240'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.361212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] The token cache is being invalidate because project 0721433e25b84a5998b6019d879e1a78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:30:06.361481 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.362095 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.363692 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4563/9135] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:30:06 2022] DELETE /identity/v3/projects/0721433e25b84a5998b6019d879e1a78 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:30:06.369213 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:06.380091 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff75fa1-c2be-4e8a-b79d-73ea69fa58f5 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:06.448546 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:06.449453 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:06.449738 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:06.450012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] PATH_INFO: `/v3/users/02d9f2c443884a6995e8e0ad576dcde5` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:06.451315 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02d9f2c443884a6995e8e0ad576dcde5)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:06.453298 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:06.511739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02d9f2c443884a6995e8e0ad576dcde5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.521137 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02d9f2c443884a6995e8e0ad576dcde5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.536461 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02d9f2c443884a6995e8e0ad576dcde5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.537406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02d9f2c443884a6995e8e0ad576dcde5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.547865 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-fa31dc14-0310-4900-a7ca-3311a08390b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02d9f2c443884a6995e8e0ad576dcde5'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.556892 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4573/9136] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:30:06 2022] DELETE /identity/v3/users/02d9f2c443884a6995e8e0ad576dcde5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:30:06.847611 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:06.848665 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:06.862857 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2774d00-b0c0-4282-9843-499b7ab91240 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:06.906683 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:06.927849 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:06.928786 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:06.929064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:06.929362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] PATH_INFO: `/v3/projects/5ca1e597e09f4df389fe16b7453ef977` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:06.930634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ca1e597e09f4df389fe16b7453ef977)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:06.932608 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:06.991669 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ca1e597e09f4df389fe16b7453ef977', 'request_id': 'req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:06.998432 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ca1e597e09f4df389fe16b7453ef977', 'request_id': 'req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:07.005059 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ca1e597e09f4df389fe16b7453ef977', 'request_id': 'req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:07.019591 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] The token cache is being invalidate because project 5ca1e597e09f4df389fe16b7453ef977 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80581) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:30:07.019811 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:07.020509 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-024a6216-4ed5-49a4-a317-58b3b9c3cd4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:30:07.022122 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4564/9137] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:30:06 2022] DELETE /identity/v3/projects/5ca1e597e09f4df389fe16b7453ef977 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:30:07.027754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.028051 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.028331 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.073168 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:07.074417 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:07.129249 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:07.144296 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4574/9138] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:30:07.153155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.153443 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.153721 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.183751 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:07.185311 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:07.199658 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4565/9139] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:30:07.206344 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.219067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b7c0b-335b-43e1-a11e-314ff0d27b55 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.224724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.225398 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.225673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.225963 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] PATH_INFO: `/v3/domains` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.226726 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80580) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:30:07.227034 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.228670 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.242771 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4575/9140] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:30:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:30:07.247237 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.257277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53dc3e-31c7-4169-9835-f94b0c878b4b None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.262048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.262718 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.263003 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.263285 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.264006 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.265985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.306724 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4566/9141] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:30:07 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:30:07.310994 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.321480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e01b54-4627-4a07-9628-ed64447df853 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.383860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.384591 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.384947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.385350 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.386434 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.389346 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.417606 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4576/9142] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:30:07 2022] POST /identity/v3/users => generated 287 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:30:07.421884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.433971 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b85a2-c08b-4483-b229-429532b16993 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.439291 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.439978 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.440257 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.440571 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.441301 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.442955 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.453307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4567/9143] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:30:07.457494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.471251 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b78300-1b21-49ca-9304-6b83d6ad03eb admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.478611 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe6884-a97f-47f8-98cd-10c3af0c78f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.479314 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6884-a97f-47f8-98cd-10c3af0c78f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.479598 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6884-a97f-47f8-98cd-10c3af0c78f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.479871 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe6884-a97f-47f8-98cd-10c3af0c78f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.480672 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe6884-a97f-47f8-98cd-10c3af0c78f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.482302 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe6884-a97f-47f8-98cd-10c3af0c78f6 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.495967 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4577/9144] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:30:07.503161 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.519909 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317fe9-5749-454b-9525-a79336b36e94 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.524999 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.527483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.527483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.527719 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] PATH_INFO: `/v3/projects/501ba5bee952424db54324e3ddee2f89/users/070720a026fc4cf7aa2202f4284ef80b/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.545275 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=501ba5bee952424db54324e3ddee2f89, user_id=070720a026fc4cf7aa2202f4284ef80b, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.547975 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.563063 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4568/9145] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:30:07 2022] PUT /identity/v3/projects/501ba5bee952424db54324e3ddee2f89/users/070720a026fc4cf7aa2202f4284ef80b/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:30:07.568513 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770cb2-24ab-4b74-820c-5599b123bd52 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.568802 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770cb2-24ab-4b74-820c-5599b123bd52 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.569063 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56770cb2-24ab-4b74-820c-5599b123bd52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.588699 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-56770cb2-24ab-4b74-820c-5599b123bd52 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:07.589954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-56770cb2-24ab-4b74-820c-5599b123bd52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:07.660418 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4578/9146] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:30:07.670694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:07.672734 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:07.734668 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5749a65-9616-449e-bdb9-fa997687c002 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:07.738638 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:07.739306 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:07.739592 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:07.739872 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:07.749996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:07.751498 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:07.758080 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:07.764205 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4569/9147] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:12.148214 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.148735 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.148828 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.178818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] MFA Rules not processed for user `070720a026fc4cf7aa2202f4284ef80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:12.180068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:12.237333 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:12.264025 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4579/9148] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:30:12.268694 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:12.278717 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35fd04-48d5-4bfc-85a7-a864ad224392 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:12.283322 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:12.283977 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.284264 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.284581 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] PATH_INFO: `/v3/projects` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.285295 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:12.287244 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:12.315894 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4570/9149] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:30:12 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:30:12.320071 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:12.331595 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f7e9-2373-4510-a115-329105865c06 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:12.396766 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:12.397454 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.397730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.398001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] PATH_INFO: `/v3/users` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.398701 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:12.400754 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:12.429085 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4580/9150] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:30:12 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:30:12.433534 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:12.444528 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e3280-739c-4cc5-a74a-d6164255722e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:12.450541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:12.451140 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.451418 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.451710 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.452483 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:12.454107 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:12.466372 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4571/9151] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:30:12.472440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:12.484247 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c4797-1bc4-4058-9912-18ce6fd23315 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:12.491552 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:12.493193 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.493480 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.493761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] PATH_INFO: `/v3/projects/dbd174634a9a4699836b4a4058e62f1c/users/80fd7c66b81c4d2c85d82114a8e87a0d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.511146 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd174634a9a4699836b4a4058e62f1c, user_id=80fd7c66b81c4d2c85d82114a8e87a0d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:12.513878 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:12.529110 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4581/9152] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:30:12 2022] PUT /identity/v3/projects/dbd174634a9a4699836b4a4058e62f1c/users/80fd7c66b81c4d2c85d82114a8e87a0d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:30:12.533672 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:12.548261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2715041e-72fc-47f5-9191-c1d4767f9087 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:12.621117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c3a80-f103-4d5c-ae87-b5ea30f4d02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:12.621845 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3a80-f103-4d5c-ae87-b5ea30f4d02b admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.622212 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3a80-f103-4d5c-ae87-b5ea30f4d02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.622496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c3a80-f103-4d5c-ae87-b5ea30f4d02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.623232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c3a80-f103-4d5c-ae87-b5ea30f4d02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:12.624914 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c3a80-f103-4d5c-ae87-b5ea30f4d02b admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:12.635933 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4572/9153] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:30:12 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:30:12.640610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:12.652654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec98446-7db6-4233-b41b-385908c268ac admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:12.657761 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:12.658662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:12.658916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:12.659195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] PATH_INFO: `/v3/projects/dbd174634a9a4699836b4a4058e62f1c/users/80fd7c66b81c4d2c85d82114a8e87a0d/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:12.661705 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbd174634a9a4699836b4a4058e62f1c, user_id=80fd7c66b81c4d2c85d82114a8e87a0d, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:12.664916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:12.677626 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4582/9154] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:30:12 2022] PUT /identity/v3/projects/dbd174634a9a4699836b4a4058e62f1c/users/80fd7c66b81c4d2c85d82114a8e87a0d/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:30:17.603355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1de1-3c9f-4c2a-bd36-e8b07798af75 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:17.603807 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1de1-3c9f-4c2a-bd36-e8b07798af75 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:17.604069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae1de1-3c9f-4c2a-bd36-e8b07798af75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:17.635597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-7dae1de1-3c9f-4c2a-bd36-e8b07798af75 None None] MFA Rules not processed for user `80fd7c66b81c4d2c85d82114a8e87a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:17.637042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-7dae1de1-3c9f-4c2a-bd36-e8b07798af75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:17.719510 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4573/9155] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:17 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:30:17.737975 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:17.740157 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:17.845490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed2c74-e647-44e6-a4ae-545cb66ff83d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:17.852068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:17.852068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:17.852068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:17.853648 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:17.899577 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:17.920178 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:17.921934 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:17.934598 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4583/9156] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:18.983429 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:18.984256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:18.984595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:19.003886 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] MFA Rules not processed for user `070720a026fc4cf7aa2202f4284ef80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:30:19.005191 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:19.012869 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4574/9157] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:30:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:30:19.356189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:19.357947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:19.424412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfb7fa-1bdb-4ab7-9174-6aa291f3c4b6 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:19.429843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:19.430946 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:19.431294 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:19.431574 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:19.433839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:19.445237 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:19.446724 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:19.456469 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4584/9158] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:19.803505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:19.809330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:19.886384 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:19.919419 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1985f-b69a-489d-892b-d258883e83d2 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:19.925265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:19.925950 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:19.926238 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:19.926525 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:19.928439 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:19.945065 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:19.945316 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:19.970226 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4575/9159] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:22.671787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:22.674430 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:22.705163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d816379-2ea9-42de-9741-fdacb2ad5c00 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:22.719831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:22.720547 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:22.720831 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:22.721114 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:22.726691 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:30:22.741824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:22.743849 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:22.756808 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4585/9160] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:29.955644 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=13 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:32.380034 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:30:32.392181 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e7583-67de-464b-b6c1-29da89c35729 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:30:32.396802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bfa59-8070-4971-b351-f732108839a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:30:32.397469 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfa59-8070-4971-b351-f732108839a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:30:32.397756 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfa59-8070-4971-b351-f732108839a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:30:32.398032 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bfa59-8070-4971-b351-f732108839a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:30:32.408273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfa59-8070-4971-b351-f732108839a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:30:32.409780 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bfa59-8070-4971-b351-f732108839a4 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:30:32.420270 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4576/9161] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:30:32 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:30:32.756714 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=42 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:30:42.415702 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:28.569449 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:28.579753 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e170d767-f70f-4d9f-9987-3bcbe52d84e6 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:28.583745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:28.584522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:28.584776 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:28.585078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:28.587072 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:28.624673 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:28.626351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:28.638509 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4586/9162] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:38.633481 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=14 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:41.241229 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.242201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.242201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.301333 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:41.302576 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:41.376082 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4577/9163] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:32:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:41.431675 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:41.433387 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:41.545902 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d8b01-20b3-450b-9d71-e05986fefd72 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:41.551406 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59219978-7375-4a0a-801b-bbdab6a7f61b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:41.552060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59219978-7375-4a0a-801b-bbdab6a7f61b service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:41.552359 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59219978-7375-4a0a-801b-bbdab6a7f61b service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:41.552642 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59219978-7375-4a0a-801b-bbdab6a7f61b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:41.561078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59219978-7375-4a0a-801b-bbdab6a7f61b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:41.562693 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59219978-7375-4a0a-801b-bbdab6a7f61b service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:41.570952 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4587/9164] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:32:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:32:44.485414 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:44.504518 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8896373-7742-4693-82d0-dfd8aae3f3e5 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:44.510564 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:44.511348 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:44.511746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:44.512112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:44.514595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:44.533079 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:44.534496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:44.547397 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4578/9165] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:51.567627 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=41 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:53.956439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:53.957067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:53.957067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.014470 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] MFA Rules not processed for user `2af38e680ecd4346b44dad744de8e50c`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:54.015718 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.027869 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4588/9166] 10.222.0.15 () {58 vars in 1018 bytes} [Tue Jul 19 12:32:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:54.039990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.041521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.123553 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74966591-250a-47ea-9909-9bf454d589fd service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.127470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.128133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.128455 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.128772 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.139148 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.140645 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.151468 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4579/9167] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:32:54.233518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.243830 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d17a22-69d9-4977-b40c-f62134664434 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.248969 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.249619 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.249892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.250160 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.252720 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.278204 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.279713 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.288034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4589/9168] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:54.367536 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.377224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e121c0-e8b3-4643-978d-127f34e5ae56 service glance] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.380912 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.381560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.381843 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.382128 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.384043 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.399342 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.400830 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.412643 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4580/9169] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:54.474529 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:54.476984 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.493337 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a3f6b-02e2-41f1-b16a-c237b0b3eee3 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:54.499077 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:54.499739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:54.500021 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:54.500473 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:54.502682 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:54.516415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:54.517851 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:54.529114 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4590/9170] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:55.451171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:55.460974 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b458ba16-1c89-43b9-b7a1-7e117de529d5 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:55.465501 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:55.466149 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:55.466431 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:55.466713 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:55.468746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:55.479176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:55.480680 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf4f2b-e3dd-4280-a415-57c58f3ce601 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:55.489054 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4581/9171] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:56.360581 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:56.404627 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e4d3d-5025-4341-a443-5736c659d6db service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:56.411150 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:56.411982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:56.412399 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:56.412787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:56.415068 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:56.432922 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:56.434768 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:56.448161 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4591/9172] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:32:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:32:57.141740 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f64d4-ae64-461a-9b5e-f4ea1aa9c2f1 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:57.142224 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f64d4-ae64-461a-9b5e-f4ea1aa9c2f1 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:57.142440 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008f64d4-ae64-461a-9b5e-f4ea1aa9c2f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:57.155109 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:32:57.161634 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-008f64d4-ae64-461a-9b5e-f4ea1aa9c2f1 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:32:57.162941 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-008f64d4-ae64-461a-9b5e-f4ea1aa9c2f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:32:57.171068 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4582/9173] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:32:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:32:57.183009 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:32:57.194908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c750-271d-424a-a89b-df192c507ff4 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:32:57.200274 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:32:57.200954 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:32:57.201238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:32:57.201512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:32:57.210084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:32:57.211745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:32:57.220573 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4592/9174] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:32:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:33:07.216874 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=42 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:13.219397 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.219903 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.220011 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.238379 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:33:13.239565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:33:13.247706 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4583/9175] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 12:33:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:33:13.259953 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:33:13.271684 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b545e2-e806-44f9-bb5e-7b8030fe3870 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:33:13.277894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d3d32-4565-4173-9217-f3ce96f7f19c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:33:13.278163 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d3d32-4565-4173-9217-f3ce96f7f19c service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:33:13.278478 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d3d32-4565-4173-9217-f3ce96f7f19c service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:33:13.278702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d3d32-4565-4173-9217-f3ce96f7f19c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:33:13.287338 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d3d32-4565-4173-9217-f3ce96f7f19c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:33:13.288962 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367d3d32-4565-4173-9217-f3ce96f7f19c service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:33:13.297494 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4593/9176] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:33:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:33:23.233653 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=3 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:33:23.294158 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:31.192878 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:31.203127 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6c662-8dda-461f-9962-4087f0047798 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:31.208910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:31.212622 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:31.213145 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:31.213505 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:31.216171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:31.231049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:31.233131 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:31.243929 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4584/9177] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:34:35.906894 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:35.907419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:35.907419 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:35.925815 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] MFA Rules not processed for user `070720a026fc4cf7aa2202f4284ef80b`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:34:35.927004 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:35.934645 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4594/9178] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:34:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:34:41.238999 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:45.920589 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:34:54.808162 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:34:54.818425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495a8f-d94b-40f6-97aa-42801dcfbe2e service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:34:54.821927 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:34:54.822828 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:34:54.823117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:34:54.823398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:34:54.825344 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:34:54.841300 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:34:54.843135 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:34:54.853489 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4585/9179] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:34:54 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:35:04.849121 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:08.819520 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:08.833256 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe45a1-90d3-40f5-99fa-02879f4f9f3c None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:08.841671 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:08.842321 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:08.842603 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:08.842874 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:08.845145 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:35:08.858638 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:08.860231 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:08.870637 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4595/9180] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:35:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:35:10.499888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:35:10.513962 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece42bd-ebd4-439c-9aa7-2cc71724fbcc service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:35:10.520470 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:35:10.521099 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:35:10.521378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:35:10.521651 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:35:10.523757 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:35:10.536290 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:35:10.537987 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:35:10.548144 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4586/9181] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:35:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:35:18.866156 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:35:20.543830 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:12.847033 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:12.886908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36fa8f-06e9-43c7-a0ba-38689db6ccad service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:12.894159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:12.894807 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:12.895075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:12.895351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:12.903860 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:12.905578 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:12.914931 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4596/9182] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:22.911003 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=15 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:28.899451 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:28.929254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430dfe1a-5310-4073-9848-6ff79aef20a1 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:28.933174 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:28.933836 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:28.934122 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:28.934398 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:28.944913 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:28.946358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:28.957276 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4587/9183] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:34.597107 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:34.612877 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6d8204-68ef-44a6-9163-3c650fae224c service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:34.629159 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:34.630011 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:34.630396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:34.631396 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:34.644824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:34.646503 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:34.661072 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4597/9184] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:38.952837 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=13 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:44.655176 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:37:44.678921 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:37:44.691358 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f529a-52c3-497b-a294-35807f5bb768 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:37:44.697507 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:37:44.698477 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:37:44.699001 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:37:44.699496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:37:44.709793 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:37:44.711653 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:37:44.727986 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4588/9185] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:37:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:37:54.718225 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=6 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:38:12.448519 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:38:12.458139 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835667f9-1783-4495-963b-a7e4893a582d service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:38:12.462127 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:38:12.462771 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:38:12.463067 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:38:12.463356 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:38:12.471320 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:38:12.473003 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:38:12.483539 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4598/9186] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:38:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:38:22.479129 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:06.453302 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:06.489521 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30177a23-f37e-424c-8dd8-1c8b58f13a48 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:06.495338 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:06.496091 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:06.496270 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:06.496706 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:06.507864 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:06.509697 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:06.521584 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4589/9187] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:15.770601 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:15.790906 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc15ff1-caa4-4023-822d-181b97008020 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:15.794666 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:15.795329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:15.795609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:15.795913 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:15.862517 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:15.863959 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:15.884290 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4599/9188] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:16.517246 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=15 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:19.216182 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:19.240331 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f39b61-f189-4b2b-85b3-385e85873c40 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:19.246560 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:19.247349 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:19.247762 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:19.248230 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:19.250362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:19.276986 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:19.278568 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:19.290432 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4590/9189] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:22.543496 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:22.563819 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85eab62-f8fb-4cd9-a66e-79ce8b074f04 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:22.574499 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:22.574717 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:22.575136 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:22.575431 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:22.578015 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:22.593439 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:22.596129 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:22.622899 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4600/9190] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:22.645773 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:22.657064 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59433d5e-87d1-49b1-919d-f8adb091c84e service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:22.663362 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:22.664247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:22.664565 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:22.664842 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] PATH_INFO: `/v3/users/070720a026fc4cf7aa2202f4284ef80b` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:22.666048 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] RBAC: Authorizing `identity:delete_user(user_id=070720a026fc4cf7aa2202f4284ef80b)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:22.668020 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:22.719132 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070720a026fc4cf7aa2202f4284ef80b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:22.719890 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070720a026fc4cf7aa2202f4284ef80b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:22.733026 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070720a026fc4cf7aa2202f4284ef80b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:22.733650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070720a026fc4cf7aa2202f4284ef80b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:22.741650 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070720a026fc4cf7aa2202f4284ef80b'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:22.762303 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4591/9191] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:22 2022] DELETE /identity/v3/users/070720a026fc4cf7aa2202f4284ef80b => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:22.956899 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:22.968616 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8425a9e7-c740-493b-8fe1-73ee9530b9dc service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:23.027740 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:23.028653 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.028937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.029211 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] PATH_INFO: `/v3/projects/501ba5bee952424db54324e3ddee2f89` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.030512 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=501ba5bee952424db54324e3ddee2f89)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:23.032556 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:23.086792 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '501ba5bee952424db54324e3ddee2f89', 'request_id': 'req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.094421 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '501ba5bee952424db54324e3ddee2f89', 'request_id': 'req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.100683 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '501ba5bee952424db54324e3ddee2f89', 'request_id': 'req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.103069 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:23.113590 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] The token cache is being invalidate because project 501ba5bee952424db54324e3ddee2f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:23.113908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.114558 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.116142 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4601/9192] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:22 2022] DELETE /identity/v3/projects/501ba5bee952424db54324e3ddee2f89 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:23.120378 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:23.122068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:23.136155 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578601c-940a-4c94-a250-f0117137f94d admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:23.196232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:23.197190 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.197474 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.197746 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] PATH_INFO: `/v3/users/80fd7c66b81c4d2c85d82114a8e87a0d` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.198994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80fd7c66b81c4d2c85d82114a8e87a0d)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:23.200983 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:23.249146 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:23.252069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80fd7c66b81c4d2c85d82114a8e87a0d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.252797 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80fd7c66b81c4d2c85d82114a8e87a0d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.260985 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80fd7c66b81c4d2c85d82114a8e87a0d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.261661 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80fd7c66b81c4d2c85d82114a8e87a0d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.269072 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-06a9ffb4-caca-4c7a-a31b-2afb90c7f5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80fd7c66b81c4d2c85d82114a8e87a0d'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.288218 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4592/9193] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:39:23 2022] DELETE /identity/v3/users/80fd7c66b81c4d2c85d82114a8e87a0d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:23.465846 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:23.467452 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:23.486037 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f06f0-182a-4b80-983b-c1f39fd5a6d7 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:23.565837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:23.566769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.567053 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.567488 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] PATH_INFO: `/v3/projects/dbd174634a9a4699836b4a4058e62f1c` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.568770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbd174634a9a4699836b4a4058e62f1c)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:23.570690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:23.622816 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbd174634a9a4699836b4a4058e62f1c', 'request_id': 'req-c381cb79-5778-48c5-93d7-744c57cc26c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.632536 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbd174634a9a4699836b4a4058e62f1c', 'request_id': 'req-c381cb79-5778-48c5-93d7-744c57cc26c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.639365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbd174634a9a4699836b4a4058e62f1c', 'request_id': 'req-c381cb79-5778-48c5-93d7-744c57cc26c0'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.650526 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] The token cache is being invalidate because project dbd174634a9a4699836b4a4058e62f1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:39:23.650770 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.651495 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-c381cb79-5778-48c5-93d7-744c57cc26c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:39:23.653147 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4602/9194] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:39:23 2022] DELETE /identity/v3/projects/dbd174634a9a4699836b4a4058e62f1c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:23.658627 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.659130 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.659232 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.677682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:23.678918 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:23.741437 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4593/9195] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:23.750115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.750403 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.750674 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.770423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:23.771644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:23.781635 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4603/9196] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:23.786002 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:23.796208 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97de582b-78ac-410c-a1b5-f6279da0a21e None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:23.801425 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:23.802084 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.802402 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.802683 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.803412 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80581) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 19 12:39:23.803722 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:23.805377 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:23.817366 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4594/9197] 10.222.0.15 () {58 vars in 1152 bytes} [Tue Jul 19 12:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 19 12:39:23.822316 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:23.832662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3ca80-7dca-4c85-a295-c23e5ea01b69 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:23.838892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:23.839567 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.839847 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.840134 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.840880 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:23.842834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:23.877280 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4604/9198] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:23 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:23.883018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:23.893994 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f78af16-bcd5-4c79-877c-22df06d0c4c7 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:23.960791 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:23.961465 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:23.961749 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:23.962017 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:23.962704 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:23.964865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:23.985145 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4595/9199] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:23 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:23.989433 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:23.999938 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b901c7b-9ffb-4722-a9ea-33deb1bb9cba admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:24.004911 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:24.005575 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:24.005850 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:24.006121 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:24.006859 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:24.008490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:24.018947 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4605/9200] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 19 12:39:24.023205 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:24.033589 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c92612-d6e0-49d0-a195-60b7d1f0f63e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:24.038729 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b8f52-fcfd-415a-b544-7bd360ac8625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:24.039438 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b8f52-fcfd-415a-b544-7bd360ac8625 admin admin] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:24.039760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b8f52-fcfd-415a-b544-7bd360ac8625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:24.040066 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b8f52-fcfd-415a-b544-7bd360ac8625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:24.040858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b8f52-fcfd-415a-b544-7bd360ac8625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:24.042513 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b8f52-fcfd-415a-b544-7bd360ac8625 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:24.053204 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4596/9201] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:24.057482 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:24.068618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c0a9e-8e0b-49c1-8e36-e34207240875 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:24.073723 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:24.074628 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] REQUEST_METHOD: `PUT` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:24.074905 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:24.075179 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] PATH_INFO: `/v3/projects/ecfcd9336706472d9615fb3d9b406524/users/5092a129f46a4664b0dda1b4477dab3a/roles/1b8336fe2a2642b387272398a640a960` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:24.091079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecfcd9336706472d9615fb3d9b406524, user_id=5092a129f46a4664b0dda1b4477dab3a, role_id=1b8336fe2a2642b387272398a640a960)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:24.093839 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:24.107754 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4606/9202] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:24 2022] PUT /identity/v3/projects/ecfcd9336706472d9615fb3d9b406524/users/5092a129f46a4664b0dda1b4477dab3a/roles/1b8336fe2a2642b387272398a640a960 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 19 12:39:24.113041 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afe66-418d-4d09-b9a2-388021bd287a None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:24.113335 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afe66-418d-4d09-b9a2-388021bd287a None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:24.113617 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104afe66-418d-4d09-b9a2-388021bd287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:24.136770 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-104afe66-418d-4d09-b9a2-388021bd287a None None] MFA Rules not processed for user `44cb4b6cf7e6461fb9360e3f317f41d2`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:24.138584 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-104afe66-418d-4d09-b9a2-388021bd287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:24.163316 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:24.204614 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4597/9203] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:39:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:24.215448 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:24.217442 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:24.242370 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:24.284245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aa44c6-c579-4952-bcbb-8074d627321b admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:24.289012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:24.289654 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:24.289957 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:24.290324 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:24.300432 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:24.301890 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:24.311763 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4607/9204] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:28.493607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.494482 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.494767 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.526163 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] MFA Rules not processed for user `5092a129f46a4664b0dda1b4477dab3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:28.527771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:28.601855 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4598/9205] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:39:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:39:28.607001 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:28.617108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795c34e-4949-4152-9a0e-7a114a1bb03d service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:28.622028 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:28.622703 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.622988 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.623263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] PATH_INFO: `/v3/projects` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.624007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:28.625974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:28.656625 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4608/9206] 10.222.0.15 () {60 vars in 1152 bytes} [Tue Jul 19 12:39:28 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 19 12:39:28.657858 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:28.668750 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259ab37-0a33-4100-8dc5-94d196d930a9 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:28.725468 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:28.726146 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.726430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.726702 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] PATH_INFO: `/v3/users` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.727923 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:28.729771 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:28.752924 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4599/9207] 10.222.0.15 () {60 vars in 1143 bytes} [Tue Jul 19 12:39:28 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 19 12:39:28.757388 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:28.768834 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8c9aa2-4f8c-4bd0-b7e1-505c795d892d admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:28.773982 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:28.774649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.774928 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.775195 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.775926 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:28.777610 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:28.788713 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4609/9208] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:28.793247 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:28.803833 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24415bb3-193f-40e8-b872-af5ec36e145a admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:28.809383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:28.810330 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.810613 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.810888 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] PATH_INFO: `/v3/projects/54e4839c7cfa40c5815b5b17659e20f0/users/657643cd8e7b4e40b4864ceffa06c733/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.827213 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e4839c7cfa40c5815b5b17659e20f0, user_id=657643cd8e7b4e40b4864ceffa06c733, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:28.829947 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:28.845656 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4600/9209] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:28 2022] PUT /identity/v3/projects/54e4839c7cfa40c5815b5b17659e20f0/users/657643cd8e7b4e40b4864ceffa06c733/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:28.850383 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:28.861987 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e02ba0-e39d-4c29-a6d8-2dca24e58820 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:28.921974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1f5ad-9839-40d3-8929-a35a5bd19334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:28.922896 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f5ad-9839-40d3-8929-a35a5bd19334 admin admin] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.923055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f5ad-9839-40d3-8929-a35a5bd19334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.923365 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1f5ad-9839-40d3-8929-a35a5bd19334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.924055 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f5ad-9839-40d3-8929-a35a5bd19334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:28.925722 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1f5ad-9839-40d3-8929-a35a5bd19334 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:28.936880 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4610/9210] 10.222.0.15 () {58 vars in 1121 bytes} [Tue Jul 19 12:39:28 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 19 12:39:28.941273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:28.952946 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b271f15-be1a-4b78-a04c-7b4f6a79d1eb admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:28.958018 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:28.958930 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:28.959203 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:28.959479 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] PATH_INFO: `/v3/projects/54e4839c7cfa40c5815b5b17659e20f0/users/657643cd8e7b4e40b4864ceffa06c733/roles/c71870b3a21e455080504ab36dac896f` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:28.961610 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=54e4839c7cfa40c5815b5b17659e20f0, user_id=657643cd8e7b4e40b4864ceffa06c733, role_id=c71870b3a21e455080504ab36dac896f)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:28.964292 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:28.979865 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4601/9211] 10.222.0.15 () {60 vars in 1482 bytes} [Tue Jul 19 12:39:28 2022] PUT /identity/v3/projects/54e4839c7cfa40c5815b5b17659e20f0/users/657643cd8e7b4e40b4864ceffa06c733/roles/c71870b3a21e455080504ab36dac896f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:39:33.630494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa84ec-d768-4048-bd40-75d842939cdc None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:33.630990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa84ec-d768-4048-bd40-75d842939cdc None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:33.631075 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa84ec-d768-4048-bd40-75d842939cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:33.670842 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-29aa84ec-d768-4048-bd40-75d842939cdc None None] MFA Rules not processed for user `657643cd8e7b4e40b4864ceffa06c733`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:33.672240 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-29aa84ec-d768-4048-bd40-75d842939cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:33.752719 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4611/9212] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:39:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:33.769210 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:33.775278 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:33.789490 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:33.861682 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb759673-c0a7-424f-8ea7-b16f908aca8e admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:33.867382 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:33.868049 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:33.868326 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:33.868630 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:33.922207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:33.923870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:33.933463 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4602/9213] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:35.982189 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:35.982690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:35.982824 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:36.001310 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] MFA Rules not processed for user `5092a129f46a4664b0dda1b4477dab3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:39:36.002566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:36.011070 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4612/9214] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:39:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:39:36.338896 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:36.402068 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f10f625-6696-4dca-a7f2-8dc7afdb68b3 service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:36.406925 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:36.407906 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:36.408186 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:36.408494 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:36.410996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:36.424207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:36.425724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:36.435276 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4603/9215] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:36.801249 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:36.808267 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:36.815483 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54116910-7c06-4620-bd8a-b4edb50a22bb None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:36.819676 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:36.820378 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:36.820662 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:36.820947 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:36.822716 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:36.836566 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:36.838007 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:36.850112 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4613/9216] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:37.801607 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:37.803235 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:37.859725 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=100 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:37.880585 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d6db20-91f7-417c-872f-b32493681f27 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:37.885894 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:37.886556 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:37.886844 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:37.887138 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:37.889118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:37.900615 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:37.902265 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:37.912096 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4604/9217] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:39:46.844809 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=5 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:47.908238 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=10 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:39:50.979551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:39:50.981084 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:39:50.992979 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac638cc5-165a-46e8-81d2-64acede01e75 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:39:50.996805 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:39:50.997464 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:39:50.997787 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:39:50.998054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:39:51.008958 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:39:51.010412 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:39:51.021355 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4614/9218] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:39:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:01.015804 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:14.803724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:14.817870 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ac595-cfc0-438a-95ae-e425c609b726 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:14.824461 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:14.825112 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:14.825400 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:14.825671 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:14.827875 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:14.861450 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:14.863073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:14.873471 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4605/9219] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:14 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:15.569119 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:15.570769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:15.586641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b01ba2-f161-4b75-bbc6-628c10db85ba service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:15.592732 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:15.593375 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:15.593657 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:15.593927 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:15.595841 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:15.607892 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:15.609641 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ee4fe3-023c-42ef-98f1-f0d64e3c5934 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:15.619956 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4615/9220] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:23.222259 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:40:23.233920 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0985974f-dcb0-4278-8cec-6b8fc2a78073 service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:40:23.239042 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:40:23.239712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:40:23.239990 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:40:23.240256 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:40:23.242430 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:40:23.253199 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:40:23.254737 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:40:23.265395 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4606/9221] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:40:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:40:25.615935 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:40:33.261569 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=17 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:41:52.217345 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2a87-c9ee-40c3-b513-9a1b501f67ea None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:41:52.217930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2a87-c9ee-40c3-b513-9a1b501f67ea None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:41:52.217930 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a2a87-c9ee-40c3-b513-9a1b501f67ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:41:52.237688 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-b22a2a87-c9ee-40c3-b513-9a1b501f67ea None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:41:52.238908 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b22a2a87-c9ee-40c3-b513-9a1b501f67ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:41:52.299344 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4616/9222] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:41:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 19 12:41:52.356595 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:41:52.358684 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:41:52.447852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8559fb81-8916-4e49-930b-913dcd753a85 service neutron] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:41:52.455164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:41:52.455834 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:41:52.456118 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:41:52.456446 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:41:52.465110 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:41:52.466924 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:41:52.475078 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4607/9223] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:41:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:42:00.837012 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:00.837571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:00.837571 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:00.856644 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] MFA Rules not processed for user `5092a129f46a4664b0dda1b4477dab3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:42:00.857921 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:00.866042 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4617/9224] 10.222.0.15 () {58 vars in 957 bytes} [Tue Jul 19 12:42:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:42:01.209209 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:01.219724 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13b6ca9-6009-407c-8024-3b1a73d55c28 service swift] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:01.224381 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:01.225070 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:01.225355 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:01.225633 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:01.227686 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:01.238673 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:01.240117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e71da5-f8d4-4de3-939c-6a57688229c3 service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:01.248537 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4608/9225] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:01.617054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:01.629835 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af3379-5d4b-4f33-b408-c82e6877c354 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:01.635058 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:01.635745 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:01.636018 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:01.636305 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:01.638205 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:01.650266 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:01.651864 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:01.663523 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4618/9226] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:42:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:42:03.108254 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:03.108755 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:03.108856 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:03.128201 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:42:03.129516 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:42:03.137475 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4609/9227] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:42:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:42:03.149826 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:42:03.161198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed90171-add4-43d8-96db-cc6b1972c992 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:42:03.166115 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:42:03.166764 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:42:03.167050 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:42:03.167329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:42:03.175990 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:42:03.177626 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:42:03.186398 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4619/9228] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:42:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:42:13.122812 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=41 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:42:13.183395 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=40 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:43:17.439328 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:43:17.449769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd4551-1154-4686-b041-e33478a87ccc None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:43:17.454373 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:43:17.455033 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:43:17.455318 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:43:17.455597 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:43:17.457831 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:43:17.481268 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:43:17.482712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08c0270-2ce6-4567-b34c-f90744e940cc service neutron] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:43:17.491164 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4610/9229] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:43:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:43:27.487615 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=11 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:01.461329 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:01.462965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:01.561297 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f177ae51-be6e-4228-bab2-07dbc61378e8 service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:01.565700 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bbe7cd61ad745a9833acd3d3e4a066d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:01.566361 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:01.566643 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:01.566916 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:01.568856 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:01.602490 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:01.603937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:01.615902 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4620/9230] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:05.226336 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:05.226877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:05.226877 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:05.295286 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:05.296520 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:05.325196 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4611/9231] 10.222.0.15 () {58 vars in 1009 bytes} [Tue Jul 19 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:05.366340 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:05.388491 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204ac6c-74d9-4bde-b769-37b2d627c58b service glance] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:05.394105 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f40bc94-ed74-4b26-8ea3-bb87a21aff8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:05.394755 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40bc94-ed74-4b26-8ea3-bb87a21aff8d service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:05.395036 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40bc94-ed74-4b26-8ea3-bb87a21aff8d service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:05.395311 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40bc94-ed74-4b26-8ea3-bb87a21aff8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:05.404073 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40bc94-ed74-4b26-8ea3-bb87a21aff8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:05.405690 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f40bc94-ed74-4b26-8ea3-bb87a21aff8d service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:05.414442 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4621/9232] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:44:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:44:06.502069 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:06.519928 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd866116-a265-449c-8145-bf89670c1b9f None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:06.527510 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:06.528176 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:06.528499 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:06.528783 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:06.530910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:06.553447 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:06.555462 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:06.575250 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4612/9233] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 19 12:44:14.296494 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] REQUEST_METHOD: `POST` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:14.297064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:14.297064 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:14.317351 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.auth.core [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80580) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:14.318518 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:14.327120 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4622/9234] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 12:44:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:14.340629 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:14.352372 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea17882c-5906-45ee-a218-51e7c2087eeb service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:14.358547 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a20f08-c9a6-4d35-9a62-c85aba11a171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:14.359198 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20f08-c9a6-4d35-9a62-c85aba11a171 service swift] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:14.359484 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20f08-c9a6-4d35-9a62-c85aba11a171 service swift] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:14.359760 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a20f08-c9a6-4d35-9a62-c85aba11a171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:14.369133 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20f08-c9a6-4d35-9a62-c85aba11a171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:14.370769 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a20f08-c9a6-4d35-9a62-c85aba11a171 service swift] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:14.379660 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4613/9235] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:44:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 19 12:44:15.614587 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:15.641739 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157443a8-b4ae-4f21-8574-845e10eab994 None None] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:15.646649 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:15.647522 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:15.647808 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:15.648078 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:15.649965 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:15.664573 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:15.665966 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:15.678583 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4623/9236] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:19.343908 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958963d9-266d-472d-a188-1c9042643d69 None None] REQUEST_METHOD: `POST` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:19.344389 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958963d9-266d-472d-a188-1c9042643d69 None None] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:19.344496 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958963d9-266d-472d-a188-1c9042643d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:19.362865 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.auth.core [None req-958963d9-266d-472d-a188-1c9042643d69 None None] MFA Rules not processed for user `4578e533395642979715feec9c4de758`. Rule list: `[]` (Enabled: `True`). {{(pid=80581) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 19 12:44:19.364073 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-958963d9-266d-472d-a188-1c9042643d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:19.372218 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4614/9237] 10.222.0.15 () {58 vars in 967 bytes} [Tue Jul 19 12:44:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 19 12:44:19.384394 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:19.395918 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c134e83-eccb-4d60-836b-bbcc9480f499 service nova] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:19.401492 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '198dcf35a0894d4e824229e10573a251', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:19.402141 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:19.402435 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:19.402702 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:19.411506 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:19.413239 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:19.422254 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4624/9238] 10.222.0.15 () {60 vars in 1384 bytes} [Tue Jul 19 12:44:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 19 12:44:20.725887 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958963d9-266d-472d-a188-1c9042643d69 None None] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:20.742207 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958963d9-266d-472d-a188-1c9042643d69 None None] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:20.750467 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af38e680ecd4346b44dad744de8e50c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:20.751261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:20.751558 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:20.751832 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:20.753910 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:20.766818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:20.768776 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:20.792433 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4615/9239] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:25.692438 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:25.697225 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=69 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:25.703609 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef910fc9-5697-400e-b699-e9af0f85afcd service swift] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:25.707818 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '86cbfe3a2d7b4b25b4ec629118e20d5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:25.708516 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:25.708783 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:25.709060 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:25.784238 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:25.785733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:25.795399 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4625/9240] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:28.680554 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:28.687624 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=44 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:28.696788 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f1fa8-d7ed-4fc7-8e23-78ecd5d94e8e service nova] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:28.702261 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:28.703029 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:28.703383 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:28.703736 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:28.706215 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:28.721579 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:28.729852 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:28.743085 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4616/9241] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:32.027760 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:32.039961 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442fb6a9-6307-4e4d-a68f-c68c819e3720 service neutron] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:32.045285 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:32.046177 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:32.046618 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:32.047054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:32.049066 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:32.061635 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:32.063263 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:32.075185 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4626/9242] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:44:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:44:32.096005 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:32.108384 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecb5d2-7b48-4334-bf52-b2a32e53346c service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:32.117273 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:32.118157 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:32.118437 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:32.118712 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] PATH_INFO: `/v3/users/5092a129f46a4664b0dda1b4477dab3a` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:32.119944 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5092a129f46a4664b0dda1b4477dab3a)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:32.122057 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:32.180716 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5092a129f46a4664b0dda1b4477dab3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.181582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5092a129f46a4664b0dda1b4477dab3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.199249 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5092a129f46a4664b0dda1b4477dab3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.200076 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5092a129f46a4664b0dda1b4477dab3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.207582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5092a129f46a4664b0dda1b4477dab3a'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.226704 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4617/9243] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:44:32 2022] DELETE /identity/v3/users/5092a129f46a4664b0dda1b4477dab3a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:44:32.407062 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:32.420309 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbff7ec-80a6-4184-8afc-a908f8085c17 service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:32.478898 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:32.479772 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:32.480044 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:32.480319 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] PATH_INFO: `/v3/projects/ecfcd9336706472d9615fb3d9b406524` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:32.482074 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecfcd9336706472d9615fb3d9b406524)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:32.484002 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:32.532364 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecfcd9336706472d9615fb3d9b406524', 'request_id': 'req-3d4c8142-bf7d-4283-ad10-c845da8780cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.541974 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecfcd9336706472d9615fb3d9b406524', 'request_id': 'req-3d4c8142-bf7d-4283-ad10-c845da8780cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.548228 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecfcd9336706472d9615fb3d9b406524', 'request_id': 'req-3d4c8142-bf7d-4283-ad10-c845da8780cf'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.559446 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:32.571971 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] The token cache is being invalidate because project ecfcd9336706472d9615fb3d9b406524 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:44:32.572472 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.573415 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.575076 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4627/9244] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:44:32 2022] DELETE /identity/v3/projects/ecfcd9336706472d9615fb3d9b406524 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:44:32.579350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:32.580970 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:32.593904 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04009308-f82d-41bc-a2b1-08f12f3f3f71 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:32.651117 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:32.651996 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:32.652277 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:32.652582 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] PATH_INFO: `/v3/users/657643cd8e7b4e40b4864ceffa06c733` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:32.653802 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=657643cd8e7b4e40b4864ceffa06c733)` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:32.655725 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:32.702267 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '657643cd8e7b4e40b4864ceffa06c733'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.702901 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '657643cd8e7b4e40b4864ceffa06c733'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.711454 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '657643cd8e7b4e40b4864ceffa06c733'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.712106 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '657643cd8e7b4e40b4864ceffa06c733'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.719364 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.notifications [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '657643cd8e7b4e40b4864ceffa06c733'} {{(pid=80581) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:32.720544 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:32.739531 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4618/9245] 10.222.0.15 () {58 vars in 1223 bytes} [Tue Jul 19 12:44:32 2022] DELETE /identity/v3/users/657643cd8e7b4e40b4864ceffa06c733 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:44:32.934079 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:44:32.935582 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:44:32.950535 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c8142-bf7d-4283-ad10-c845da8780cf admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:44:33.012014 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44cb4b6cf7e6461fb9360e3f317f41d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d370718d88b47738f450251a884cc98', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:44:33.012935 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:44:33.013218 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:44:33.013479 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] PATH_INFO: `/v3/projects/54e4839c7cfa40c5815b5b17659e20f0` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:44:33.014730 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54e4839c7cfa40c5815b5b17659e20f0)` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:44:33.016711 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:44:33.064180 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54e4839c7cfa40c5815b5b17659e20f0', 'request_id': 'req-a41dee68-431f-4039-9899-892143346e09'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:33.073039 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54e4839c7cfa40c5815b5b17659e20f0', 'request_id': 'req-a41dee68-431f-4039-9899-892143346e09'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:33.079881 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54e4839c7cfa40c5815b5b17659e20f0', 'request_id': 'req-a41dee68-431f-4039-9899-892143346e09'} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:33.092054 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] The token cache is being invalidate because project 54e4839c7cfa40c5815b5b17659e20f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80580) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 19 12:44:33.092489 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:33.093245 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.notifications [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80580) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 19 12:44:33.095034 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4628/9246] 10.222.0.15 () {58 vars in 1232 bytes} [Tue Jul 19 12:44:32 2022] DELETE /identity/v3/projects/54e4839c7cfa40c5815b5b17659e20f0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 19 12:44:42.736259 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:44:43.087712 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:45:17.490164 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:45:17.492981 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:45:17.573787 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86cdfc-92c9-4269-bf59-20bed3a08c93 admin admin] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:45:17.636598 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:45:17.637258 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:45:17.637541 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:45:17.637818 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:45:17.639758 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:45:17.651839 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:45:17.653570 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:45:17.664064 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4619/9247] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:45:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:45:20.767769 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:45:20.769423 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:45:20.785707 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41dee68-431f-4039-9899-892143346e09 admin admin] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:45:20.791762 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:45:20.792440 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:45:20.792733 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:45:20.792997 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:45:20.794955 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.fernet_utils [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80580) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:45:20.806615 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:45:20.808198 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:45:20.818639 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4629/9248] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:45:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:45:27.659799 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=58 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:45:30.814198 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=6 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:22.492433 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] Authenticating user token {{(pid=80581) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:22.493973 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.fernet_utils [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80581) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 19 12:50:22.579114 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809d515-11e5-40c3-8a53-6feb146174ae service placement] Validating token access rules against request {{(pid=80581) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:22.585225 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b2842-be5e-4469-8843-fda132d13a37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80581) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:22.585884 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2842-be5e-4469-8843-fda132d13a37 service placement] REQUEST_METHOD: `GET` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:22.586171 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2842-be5e-4469-8843-fda132d13a37 service placement] SCRIPT_NAME: `/identity` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:22.586449 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2842-be5e-4469-8843-fda132d13a37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80581) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:22.595350 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b2842-be5e-4469-8843-fda132d13a37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:22.597053 n-d-master-1 devstack@keystone.service[80581]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b2842-be5e-4469-8843-fda132d13a37 service placement] RBAC: Authorization granted {{(pid=80581) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:22.607307 n-d-master-1 devstack@keystone.service[80581]: [pid: 80581|app: 0|req: 4620/9249] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:25.767937 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] Authenticating user token {{(pid=80580) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 19 12:50:25.838317 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3baaf-d658-4558-ae4a-5ef0c212016e service placement] Validating token access rules against request {{(pid=80580) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 19 12:50:25.844843 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adcf93-5d31-4b4f-a3dd-83d2732fb80d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a53c17ba16b146b78da33383a6be1f61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5209fa56576f4c589b359c96bcb1c94c', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80580) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 19 12:50:25.845555 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adcf93-5d31-4b4f-a3dd-83d2732fb80d service placement] REQUEST_METHOD: `GET` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 19 12:50:25.845837 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adcf93-5d31-4b4f-a3dd-83d2732fb80d service placement] SCRIPT_NAME: `/identity` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 19 12:50:25.846108 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adcf93-5d31-4b4f-a3dd-83d2732fb80d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80580) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 19 12:50:25.855551 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adcf93-5d31-4b4f-a3dd-83d2732fb80d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 19 12:50:25.857194 n-d-master-1 devstack@keystone.service[80580]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adcf93-5d31-4b4f-a3dd-83d2732fb80d service placement] RBAC: Authorization granted {{(pid=80580) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 19 12:50:25.867921 n-d-master-1 devstack@keystone.service[80580]: [pid: 80580|app: 0|req: 4630/9250] 10.222.0.15 () {60 vars in 1365 bytes} [Tue Jul 19 12:50:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 19 12:50:32.602849 n-d-master-1 devstack@keystone.service[80581]: DEBUG dbcounter [-] [80581] Writing DB stats keystone:SELECT=37 {{(pid=80581) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 12:50:35.863877 n-d-master-1 devstack@keystone.service[80580]: DEBUG dbcounter [-] [80580] Writing DB stats keystone:SELECT=27 {{(pid=80580) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}